-- Logs begin at Mon 2022-10-24 08:03:12 UTC, end at Mon 2022-10-24 10:34:21 UTC. -- Oct 24 08:40:18.735764 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 08:40:18.746050 n-d-master-1 devstack@n-api.service[111042]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 08:40:18 2022] *** Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: nodename: n-d-master-1 Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: machine: x86_64 Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: clock source: unix Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: pcre jit disabled Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: detected number of CPU cores: 4 Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: current working directory: / Oct 24 08:40:18.747535 n-d-master-1 devstack@n-api.service[111042]: detected binary path: /usr/bin/uwsgi-core Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: your processes number limit is 47680 Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: your memory page size is 4096 bytes Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: detected max file descriptor number: 2048 Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: lock engine: pthread robust mutexes Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: thunder lock: enabled Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 08:40:18.748138 n-d-master-1 devstack@n-api.service[111042]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 08:40:18.787592 n-d-master-1 devstack@n-api.service[111042]: Python main interpreter initialized at 0x5647fae699c0 Oct 24 08:40:18.787592 n-d-master-1 devstack@n-api.service[111042]: python threads support enabled Oct 24 08:40:18.787592 n-d-master-1 devstack@n-api.service[111042]: your server socket listen backlog is limited to 100 connections Oct 24 08:40:18.787592 n-d-master-1 devstack@n-api.service[111042]: your mercy for graceful operations on workers is 90 seconds Oct 24 08:40:18.788029 n-d-master-1 devstack@n-api.service[111042]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 08:40:18.788029 n-d-master-1 devstack@n-api.service[111042]: *** Operational MODE: preforking *** Oct 24 08:40:18.788304 n-d-master-1 devstack@n-api.service[111042]: *** uWSGI is running in multiple interpreter mode *** Oct 24 08:40:18.788304 n-d-master-1 devstack@n-api.service[111042]: spawned uWSGI master process (pid: 111042) Oct 24 08:40:18.788501 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 24 08:40:18.789071 n-d-master-1 devstack@n-api.service[111042]: spawned uWSGI worker 1 (pid: 111043, cores: 1) Oct 24 08:40:18.789862 n-d-master-1 devstack@n-api.service[111042]: spawned uWSGI worker 2 (pid: 111044, cores: 1) Oct 24 08:40:18.789862 n-d-master-1 devstack@n-api.service[111042]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 08:40:19.466308 n-d-master-1 devstack@n-api.service[111044]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:40:19.471738 n-d-master-1 devstack@n-api.service[111043]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:40:20.556129 n-d-master-1 devstack@n-api.service[111043]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:40:20.556129 n-d-master-1 devstack@n-api.service[111043]: from cryptography.utils import int_from_bytes Oct 24 08:40:20.556946 n-d-master-1 devstack@n-api.service[111043]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:40:20.556946 n-d-master-1 devstack@n-api.service[111043]: from cryptography.utils import int_from_bytes Oct 24 08:40:20.557127 n-d-master-1 devstack@n-api.service[111044]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:40:20.557127 n-d-master-1 devstack@n-api.service[111044]: from cryptography.utils import int_from_bytes Oct 24 08:40:20.557127 n-d-master-1 devstack@n-api.service[111044]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:40:20.557127 n-d-master-1 devstack@n-api.service[111044]: from cryptography.utils import int_from_bytes Oct 24 08:40:23.093081 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:40:23.093677 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:40:23.093870 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:40:23.094230 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:40:23.094485 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:40:23.094868 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.095086 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:40:23.095446 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.095539 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:40:23.095618 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.095793 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.095886 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:40:23.096127 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.096260 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:40:23.096429 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.096519 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:40:23.096744 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.096839 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.097058 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.097144 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.097408 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.097510 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.097668 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.097771 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.098513 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.098637 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.098832 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.098949 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.099148 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.099273 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.099451 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.099593 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.099756 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.099918 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100069 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100179 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100368 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100493 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100684 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100814 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.100983 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.101131 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.101464 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.101562 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.101946 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102082 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102195 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102298 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102399 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102502 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102704 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.102910 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.103041 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.103124 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.103417 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.103510 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.103732 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.103827 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104035 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104118 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104342 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104424 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104640 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104724 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.104971 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.105054 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.105277 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.105391 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.105614 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.105699 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.105920 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.106004 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.106244 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.106361 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.106550 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.106655 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.106905 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107031 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107218 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107319 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107536 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107628 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107837 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.107974 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.108158 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.108250 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.108476 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.108562 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.108790 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.108874 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.109105 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.109197 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.109426 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.109525 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.109729 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.109813 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110032 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110126 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110342 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110426 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110639 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110726 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.110937 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111030 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111184 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111269 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111489 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111583 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111803 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.111889 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112119 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112210 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112420 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112510 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112667 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112752 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112914 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.112999 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.113225 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.113351 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.113636 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.114233 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.114419 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.114506 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.114721 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.114815 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.114980 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115071 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115234 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115320 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115551 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115646 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115868 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.115954 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.116164 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.116366 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.116469 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.116549 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117010 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117105 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117331 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117433 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117639 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117809 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.117938 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118022 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118239 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118324 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118543 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118631 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118860 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.118944 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.119157 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.119251 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.119478 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.119564 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.119875 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120022 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120106 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120190 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120375 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120467 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120689 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120780 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.120991 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.121095 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.121286 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.121509 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.121599 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.121676 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.121905 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122003 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122233 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122347 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122533 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122637 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122779 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.122871 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123073 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123157 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123369 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123467 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123678 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123778 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.123976 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124060 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124273 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124363 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124559 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124650 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124850 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.124939 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.125147 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.125237 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.125467 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.125561 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.125766 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.125853 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126064 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126148 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126362 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126447 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126657 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126750 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.126953 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127094 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127251 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127337 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127548 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127640 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127841 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.127934 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.128139 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.128222 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.128442 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.128529 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.128738 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.128898 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129035 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129153 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129380 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129470 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129682 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129785 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.129992 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130075 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130290 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130374 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130586 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130679 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130884 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.130975 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.131183 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.131267 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.131480 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.131573 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.131789 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.131874 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132090 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132189 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132382 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132474 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132689 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132774 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.132982 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133070 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133280 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133425 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133613 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133704 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133912 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.133995 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.134206 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.134291 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.134504 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.134587 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.134800 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.134883 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135093 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135179 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135390 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135474 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135682 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135773 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.135978 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136103 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136270 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136355 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136569 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136696 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136869 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.136955 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.137165 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.137249 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.137487 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.137589 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.137785 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.137874 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.138078 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.138161 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.138394 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.138487 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.138711 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.138796 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.139016 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.139107 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.139319 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.139412 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.139621 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.139706 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.139934 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:40:23.140026 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.140251 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.140342 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.140556 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.140645 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.140862 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.140947 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.141179 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.141263 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.141513 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.141634 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.141821 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.141927 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.142127 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.142228 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.142438 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.142531 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.142747 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.142839 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143068 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143166 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143377 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143508 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143685 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143777 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.143995 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.144087 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.144370 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.144464 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.144615 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.144705 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.144959 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.145055 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.145271 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.145392 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.145611 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.145703 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.145929 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146021 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146279 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146359 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146548 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146675 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146866 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.146958 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.147180 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.147274 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.147483 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.147570 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.147788 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.147881 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.148093 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.148191 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.148438 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.148570 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.148745 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.148830 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149053 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149138 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149381 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149487 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149691 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149775 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.149995 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.150092 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.150299 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.150391 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.150604 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.150691 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.150910 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151005 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151214 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151300 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151519 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151611 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151837 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.151933 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.152143 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.152227 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.152447 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.152539 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.152755 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.152848 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.153063 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.153155 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.153405 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.153500 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.153711 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.153814 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154019 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154112 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154325 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154410 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154623 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154708 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.154920 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155012 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155219 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155304 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155521 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155607 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155818 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.155903 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.156124 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.156209 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.156428 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.156514 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.156728 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.156811 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157027 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157119 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157355 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157445 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157661 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157748 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.157965 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.158057 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.158273 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.158408 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.158578 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.158724 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.158885 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159037 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159191 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159344 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159492 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159654 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159809 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.159965 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.160116 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.160277 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.160963 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.161105 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.161451 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.161553 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.161767 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.161853 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162073 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162158 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162383 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162469 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162692 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162785 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.162997 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.163083 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.163303 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.163395 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.163612 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.163698 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.163916 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164000 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164225 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164310 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164532 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164617 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164838 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.164921 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.165149 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.165236 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.165484 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.165584 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.165803 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.165900 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.166115 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.166207 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.166422 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.166507 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.166722 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.166820 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167027 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167119 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167326 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167418 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167626 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167724 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.167926 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168011 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168231 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168316 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168534 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168628 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168833 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.168918 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.169130 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.169214 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.169453 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.169586 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.169751 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.169839 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170055 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170146 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170357 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170442 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170656 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170741 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.170952 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171035 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171250 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171336 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171552 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171637 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171867 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.171951 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.172170 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.172262 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.172474 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.172559 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.172777 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.172870 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.173078 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.173163 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.173442 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.173530 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.173745 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.173841 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174051 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174135 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174359 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174456 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174667 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174760 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.174974 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.175061 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.175289 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.175374 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.175596 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.175690 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.175902 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.176054 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.176747 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.176873 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.177059 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.177145 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.177388 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.177474 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.177707 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.177802 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178008 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178094 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178319 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178404 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178624 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178708 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.178946 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179033 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179258 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179343 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179571 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179655 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179871 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.179957 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.180178 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.180268 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.180482 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.180573 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.180786 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.180872 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.181090 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.181175 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.181424 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.181525 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.181756 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.181845 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182044 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182135 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182349 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182451 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182649 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182740 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.182954 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183038 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183256 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183352 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183568 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183653 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183865 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.183956 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.184172 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.184269 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.184475 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.184561 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.184796 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.184880 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.185094 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.185179 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.185423 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.185511 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.185726 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.185809 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186030 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186116 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186334 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186419 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186638 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186723 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.186949 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187044 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187237 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187329 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187540 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187632 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187846 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.187938 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.188147 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.188238 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.188452 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.188546 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.188750 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.188833 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189051 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189134 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189374 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189478 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189675 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189760 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.189973 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190059 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190277 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190376 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190578 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190662 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190883 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.190969 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.191188 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.191281 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.191490 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.191613 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.191813 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.191900 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.192111 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.192205 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.192428 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.192512 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.192727 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.192811 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193027 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193113 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193347 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193434 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193648 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193733 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.193967 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194053 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194275 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194365 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194573 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194659 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194874 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.194960 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.195179 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.195270 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.195479 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.195570 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.195787 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.195873 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.196091 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.196177 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.196395 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.196487 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.196705 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.196790 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197013 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197143 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197338 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197468 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197649 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197786 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.197950 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198035 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198251 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198345 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198562 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198647 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198870 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.198959 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.199172 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.199296 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.199477 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.199604 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.199780 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.199866 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200078 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200165 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200382 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200466 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200691 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200781 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.200995 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.201263 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.201419 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.201617 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.201705 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.201916 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.202009 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.202227 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.202375 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.202565 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.202699 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.202879 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.203204 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.203297 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.203526 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.203612 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.203833 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.203920 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.204132 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.204225 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.204436 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.204528 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.204735 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.204828 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205034 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205161 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205361 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205522 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205664 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205837 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.205964 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.206144 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.206262 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.206455 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.206567 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.206759 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.206867 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.207063 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.207228 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.207407 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.207551 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.207717 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.207812 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208024 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208110 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208329 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208413 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208638 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208723 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.208943 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209035 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209245 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209371 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209574 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209670 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209872 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.209958 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.210175 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.210259 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.210475 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.210572 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.210786 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.210871 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.211091 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.211178 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.211410 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.211508 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.211718 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.211804 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212025 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212109 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212329 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212422 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212626 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212715 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.212944 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213028 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213244 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213353 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213570 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213655 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213871 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.213956 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.214177 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.214262 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.214481 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.214573 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.214780 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.214865 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.215085 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.215171 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.215388 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.215474 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.215695 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.215786 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216000 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216092 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216299 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216384 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216606 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216699 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216902 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.216987 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.217210 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.217361 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.217538 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.217669 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.217840 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.217962 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.218139 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.218232 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.218439 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.218532 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.218739 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.218830 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219037 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219123 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219340 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219433 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219638 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219765 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.219938 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220029 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220234 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220320 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220532 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220617 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220830 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.220922 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.221130 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.221219 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.221453 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.221550 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.221753 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.221837 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.222063 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.222148 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.222367 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.222459 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.222661 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.222744 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.223486 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.223578 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.223792 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.223877 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.224090 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.224175 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.224389 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.224474 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.224693 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.224777 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225001 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225102 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225331 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225441 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225624 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225710 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.225929 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226027 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226225 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226309 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226525 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226609 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226821 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.226913 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.227123 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.227208 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.227420 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.227505 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.227716 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.227802 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228010 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228096 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228306 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228391 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228602 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228688 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228901 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.228986 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.229207 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.229314 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.229535 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.229623 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.229834 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.229917 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.230131 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.230218 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.230433 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.230519 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.230735 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.230819 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231052 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231186 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231360 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231446 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231666 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231751 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.231970 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232063 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232272 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232362 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232574 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232665 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232883 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.232980 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.233183 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.233268 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.233519 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.233605 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.233825 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.233922 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.234136 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.234227 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.234435 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.234520 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.234733 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.234827 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235048 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235131 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235352 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235436 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235655 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235740 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.235963 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236046 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236275 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236358 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236576 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236667 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236878 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.236962 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.237182 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.237266 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.237513 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.237600 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.237814 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.237898 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.238122 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.238206 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.238431 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.238594 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.239292 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.239379 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.239599 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.239693 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.239905 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.239989 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.240210 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.240305 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.240512 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.240604 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.240813 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.240898 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.241119 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.241204 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.241447 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.241549 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242003 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242089 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242320 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242405 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242621 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242713 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.242920 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243004 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243224 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243306 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243520 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243605 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243826 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.243917 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.244124 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.244215 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.244445 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.244555 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.244751 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.244863 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.245055 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.245171 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.245383 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.245500 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.245689 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.245808 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.246000 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.246115 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.246459 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.246608 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.246731 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.246817 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247032 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247126 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247341 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247425 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247647 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247732 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.247982 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.248093 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.248655 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.248917 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249052 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249289 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249445 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249530 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249611 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249677 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249677 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.249968 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250038 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250114 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250221 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250295 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250382 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250496 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250671 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250845 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.250940 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.251111 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.251250 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.251417 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.251658 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.251816 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252014 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252150 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252272 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252354 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252600 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252730 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.252918 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253015 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253218 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253334 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253565 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253653 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253891 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.253980 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.254237 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.254340 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.254542 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.254642 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.254852 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255002 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255158 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255315 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255476 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255625 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255793 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.255945 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.256099 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.256266 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.256409 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.256572 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.256710 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.256878 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.257027 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.257191 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.257370 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.257600 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.257700 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.257926 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.258041 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.258249 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.258378 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.258557 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.258697 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.258872 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.259003 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.259285 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.259379 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.259615 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.259701 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.259921 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260007 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260221 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260316 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260527 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260612 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260827 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.260939 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.261130 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.261262 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.261472 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.261599 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.261776 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.261922 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262083 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262247 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262392 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262551 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262696 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262854 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.262997 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.263163 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.263294 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.263468 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.263609 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.263773 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.263907 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.264100 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.264209 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.264402 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.264518 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.264712 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.264832 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265024 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265137 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265357 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265458 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265665 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265759 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.265968 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266055 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266289 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266375 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266591 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266678 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266911 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.266996 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.267224 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.267310 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.267529 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.267615 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.267841 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.267977 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.268144 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.268258 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.268463 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.268553 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.268765 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.268851 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.269068 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.269153 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.269403 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.269492 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.269734 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.269830 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270050 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270144 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270363 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270450 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270678 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270762 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.270976 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271068 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271274 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271366 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271578 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271664 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271878 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.271971 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.272177 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.272263 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.272475 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.272562 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.272776 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.272874 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.273073 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.273159 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.273395 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.273485 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.273694 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.273782 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274010 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274095 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274307 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274399 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274622 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274710 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.274925 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275017 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275221 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275320 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275522 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275618 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275819 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.275905 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.276117 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.276211 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.276419 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.276505 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.276738 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.276823 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277040 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277139 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277381 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277469 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277690 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277775 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.277997 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.278094 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.278301 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.278388 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.278603 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.278688 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.278912 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279005 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279228 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279320 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279538 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279623 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279843 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.279939 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.280154 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.280248 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.280464 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.280556 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.280775 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.280861 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.281087 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.281360 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.281450 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.281686 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.281784 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.281998 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.282084 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.282306 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.282400 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.282614 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.282708 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.282926 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.283019 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.283236 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.283322 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.283544 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.283638 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.283851 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.284108 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.284193 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.284440 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.284539 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.284758 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.284844 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.285069 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.285154 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.285923 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286103 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286244 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286330 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286559 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286643 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286871 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.286972 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.287180 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.287267 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.287488 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.287572 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.287799 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.287886 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.288129 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.288214 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.288431 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.288556 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.288744 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.288831 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.289057 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.289152 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.289392 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.289494 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.289707 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.289793 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290016 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290102 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290326 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290428 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290635 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290722 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.290944 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291037 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291250 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291337 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291558 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291650 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291867 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.291990 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.292179 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.292265 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.292493 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.292580 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.292805 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.292890 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.293116 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.293202 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.293448 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.293535 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.293763 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.293848 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.294068 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.294278 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.294387 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.294591 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.294701 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.294920 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295027 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295239 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295360 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295559 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295681 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295869 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.295996 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.296179 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.296310 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.296501 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.296624 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.296803 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.297104 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.297195 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.297441 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.297531 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.297750 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.297838 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298049 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298135 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298365 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298450 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298669 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298756 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.298970 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.299056 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.299286 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.299372 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.299590 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.299677 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.299890 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.300121 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.300207 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.300467 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.300610 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.300777 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.300872 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.301149 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.301741 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.301965 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302090 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302273 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302372 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302573 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302658 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302888 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.302975 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.303188 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.303422 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.303509 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.303773 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.303867 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304083 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304168 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304384 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304469 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304683 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304777 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.304990 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.305076 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.305323 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.305424 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.305621 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.305709 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.305928 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306014 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306230 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306316 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306543 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306629 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306843 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.306926 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.307142 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.307227 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.307440 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.307536 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.307745 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.307838 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308045 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308131 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308345 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308431 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308641 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308761 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.308941 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309041 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309246 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309365 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309570 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309656 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309871 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.309965 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.310176 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.310262 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.310487 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.310572 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.310792 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.310890 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.311097 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.311183 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.311402 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.311488 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.311705 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.311799 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312007 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312092 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312305 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312389 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312611 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312698 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312913 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.312997 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.313224 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.313345 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.313556 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.313650 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.313863 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.313956 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.314186 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.314271 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.314504 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.314590 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.314807 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.315036 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.315130 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.315386 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.315556 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.315681 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.315767 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316008 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316094 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316316 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316404 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316647 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316753 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.316951 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.317037 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.317252 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.317358 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.317598 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.317833 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.317926 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.318220 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.318336 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.318488 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.318578 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.318790 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.318918 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.319094 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.319189 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.319402 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.319501 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.319708 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.319793 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320011 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320105 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320315 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320407 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320619 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320751 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.320922 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321009 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321226 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321342 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321558 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321655 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321860 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.321948 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.322608 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.322707 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.322707 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.322845 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.322925 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.322992 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323076 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323156 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323366 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323473 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323653 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323826 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.323962 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324050 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324273 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324383 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324551 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324645 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324857 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.324980 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.325247 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.325363 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.325517 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.325604 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.325828 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.325933 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.326125 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.326212 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.326458 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.326746 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.326839 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327055 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327150 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327362 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327489 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327669 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327755 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.327982 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.328082 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.329604 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.329679 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.330791 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.330867 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.330945 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.331026 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.331026 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.331026 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.331329 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332108 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332459 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332554 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332693 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332784 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332863 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.332952 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333032 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333111 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333241 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333339 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333541 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333643 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333764 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.333956 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334053 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334138 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334216 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334405 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334494 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334573 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334640 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334706 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334780 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334860 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.334938 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335016 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335093 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335178 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335265 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335352 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335432 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335510 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335587 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335666 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335752 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335839 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335839 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.335981 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336059 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336136 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336221 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336300 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336377 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336455 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336567 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336698 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336874 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.336971 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.337174 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.337259 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.337500 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.337600 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.337803 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.337889 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338100 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338192 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338397 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338496 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338695 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338781 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.338997 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339125 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339300 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339396 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339601 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339687 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339908 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.339993 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.340212 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.340299 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.340515 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.340600 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.340816 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.340902 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.341118 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.341211 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.341442 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.341531 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.341748 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.341843 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.342082 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.342180 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.342385 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.342471 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.342697 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.342796 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343002 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343146 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343305 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343399 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343609 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343779 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.343911 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344003 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344233 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344327 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344551 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344654 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344853 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.344947 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.345171 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.345260 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.345500 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.345602 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.345815 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.345918 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.346120 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.346206 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.346428 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.346523 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.346737 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.346834 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.347038 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.347126 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.347344 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.347434 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.347648 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.347735 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.348475 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.348571 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.348784 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.348917 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.349097 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.349193 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.349426 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.349537 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.349737 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.349882 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350022 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350161 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350399 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350554 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350694 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350826 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.350973 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351127 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351261 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351421 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351530 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351614 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351825 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.351915 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.352139 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.352239 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.352452 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.352540 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.352762 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.352858 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.353077 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.353187 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.353421 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.353546 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.353734 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.353847 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.354036 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.354126 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.354279 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:40:23.354375 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.354664 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.354998 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.355345 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.355659 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.356001 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.356329 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.356641 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.356954 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.357258 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:40:23.357526 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:40:23.509465 n-d-master-1 devstack@n-api.service[111043]: INFO dbcounter [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Registered counter for database nova_api Oct 24 08:40:23.512712 n-d-master-1 devstack@n-api.service[111044]: INFO dbcounter [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Registered counter for database nova_api Oct 24 08:40:23.531187 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_db.sqlalchemy.engines [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.532915 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_db.sqlalchemy.engines [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.537932 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writer thread running {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.539610 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writer thread running {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.595323 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.context [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=111043) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:40:23.596869 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.context [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=111044) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:40:23.599766 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:40:23.600241 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:40:23.601413 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_concurrency.lockutils [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:40:23.601869 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:40:23.601980 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_concurrency.lockutils [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:40:23.602583 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:40:23.603028 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:40:23.603522 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_concurrency.lockutils [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:40:23.604265 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_concurrency.lockutils [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:40:23.604709 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_concurrency.lockutils [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:40:23.605022 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:40:23.606748 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_concurrency.lockutils [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:40:23.607037 n-d-master-1 devstack@n-api.service[111043]: INFO dbcounter [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Registered counter for database nova_cell0 Oct 24 08:40:23.608759 n-d-master-1 devstack@n-api.service[111044]: INFO dbcounter [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Registered counter for database nova_cell0 Oct 24 08:40:23.611151 n-d-master-1 devstack@n-api.service[111043]: INFO dbcounter [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Registered counter for database nova_cell1 Oct 24 08:40:23.613020 n-d-master-1 devstack@n-api.service[111044]: INFO dbcounter [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Registered counter for database nova_cell1 Oct 24 08:40:23.619703 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_db.sqlalchemy.engines [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.621521 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_db.sqlalchemy.engines [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.622753 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_db.sqlalchemy.engines [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.625256 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_db.sqlalchemy.engines [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.628961 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writer thread running {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.629796 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writer thread running {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.630451 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writer thread running {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.635787 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writer thread running {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.779857 n-d-master-1 devstack@n-api.service[111043]: INFO dbcounter [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Registered counter for database nova_cell0 Oct 24 08:40:23.789052 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_db.sqlalchemy.engines [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.789261 n-d-master-1 devstack@n-api.service[111044]: INFO dbcounter [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Registered counter for database nova_cell0 Oct 24 08:40:23.793975 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writer thread running {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:23.799944 n-d-master-1 devstack@n-api.service[111044]: DEBUG oslo_db.sqlalchemy.engines [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:40:23.805760 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writer thread running {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:40:24.140290 n-d-master-1 devstack@n-api.service[111043]: WARNING keystonemiddleware.auth_token [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:40:24.141398 n-d-master-1 devstack@n-api.service[111044]: WARNING keystonemiddleware.auth_token [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:40:24.148381 n-d-master-1 devstack@n-api.service[111043]: WARNING keystonemiddleware.auth_token [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:40:24.149425 n-d-master-1 devstack@n-api.service[111044]: WARNING keystonemiddleware.auth_token [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:40:24.495799 n-d-master-1 devstack@n-api.service[111044]: WARNING keystonemiddleware.auth_token [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:40:24.496064 n-d-master-1 devstack@n-api.service[111043]: WARNING keystonemiddleware.auth_token [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:40:24.501851 n-d-master-1 devstack@n-api.service[111044]: WARNING keystonemiddleware.auth_token [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:40:24.502075 n-d-master-1 devstack@n-api.service[111043]: WARNING keystonemiddleware.auth_token [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:40:24.507797 n-d-master-1 devstack@n-api.service[111043]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647fae699c0 pid: 111043 (default app) Oct 24 08:40:24.507967 n-d-master-1 devstack@n-api.service[111044]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647fae699c0 pid: 111044 (default app) Oct 24 08:40:24.509960 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:24.511175 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-9be83930-d1bb-4cea-baab-214bb54ac266 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001812 Oct 24 08:40:24.511597 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Mon Oct 24 08:40:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:51.096447 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:51.098287 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002640 Oct 24 08:41:51.098702 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:51.109972 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_api:SELECT=3 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:51.111865 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_cell0:SELECT=3 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:51.113900 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_cell1:SELECT=3 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:51.114762 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:52.001069 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-30f59599-2500-4cc0-83ea-aeeb60ea7da1 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:52.035770 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-30f59599-2500-4cc0-83ea-aeeb60ea7da1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930971 Oct 24 08:41:52.036556 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 08:41:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:41:54.715267 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:54.716268 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-34e83265-6988-4922-af21-b38143d6e9d1 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 24 08:41:54.716902 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:55.202381 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-87ffc8e7-be9d-4482-a445-3954947b83eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:55.253217 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-87ffc8e7-be9d-4482-a445-3954947b83eb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.529469 Oct 24 08:41:55.254005 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:41:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:41:55.477891 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-97a6f83c-7423-4d9c-b3fc-82f066909280 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:55.484395 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_api:SELECT=3 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:55.486185 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_cell1:SELECT=3 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:55.486926 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_cell0:SELECT=3 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:55.487629 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:55.555383 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-97a6f83c-7423-4d9c-b3fc-82f066909280 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292506 Oct 24 08:41:55.555986 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Oct 24 08:41:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:41:58.286043 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-87ffc8e7-be9d-4482-a445-3954947b83eb admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:58.287118 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-87ffc8e7-be9d-4482-a445-3954947b83eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 Oct 24 08:41:58.289411 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:41:59.198820 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-4ae58b3c-c270-46c8-ba8f-6145fb66b198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "disk": 5, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:59.257288 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-4ae58b3c-c270-46c8-ba8f-6145fb66b198 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.962758 Oct 24 08:41:59.258909 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:41:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:41:59.272817 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-0c9f4c0b-d8c8-4c9c-91a3-e8b109ef7a7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:59.326053 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-0c9f4c0b-d8c8-4c9c-91a3-e8b109ef7a7b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058429 Oct 24 08:41:59.329470 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Oct 24 08:41:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:02.193656 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-4ae58b3c-c270-46c8-ba8f-6145fb66b198 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:02.196949 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-4ae58b3c-c270-46c8-ba8f-6145fb66b198 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003993 Oct 24 08:42:02.198756 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:02.815768 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-910953d1-cd36-4d72-a74a-15a86dba2df0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:02.837801 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-910953d1-cd36-4d72-a74a-15a86dba2df0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.627221 Oct 24 08:42:02.838853 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:02.854375 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-8decdca9-7094-4407-91b7-ffe91c7a80a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:02.888072 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-8decdca9-7094-4407-91b7-ffe91c7a80a7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037242 Oct 24 08:42:02.888643 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Oct 24 08:42:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:05.567407 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-910953d1-cd36-4d72-a74a-15a86dba2df0 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:05.568423 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-910953d1-cd36-4d72-a74a-15a86dba2df0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 24 08:42:05.572247 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:06.067021 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-1fcb60ba-3e30-402e-b1fc-7fa8d674dc2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "ram": 2048, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:06.088744 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-1fcb60ba-3e30-402e-b1fc-7fa8d674dc2a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513490 Oct 24 08:42:06.089932 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:06.102859 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-b6def404-835a-4590-bccb-bc02f71731ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:06.148109 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-b6def404-835a-4590-bccb-bc02f71731ee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043377 Oct 24 08:42:06.148770 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Oct 24 08:42:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:42:08.944946 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-1fcb60ba-3e30-402e-b1fc-7fa8d674dc2a admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:08.946586 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-1fcb60ba-3e30-402e-b1fc-7fa8d674dc2a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Oct 24 08:42:08.957650 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:09.481887 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-e55ac23a-8249-480d-b38d-37b6b2f82d83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:09.504125 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-e55ac23a-8249-480d-b38d-37b6b2f82d83 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.549986 Oct 24 08:42:09.510311 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:09.517041 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-f1261b8f-8ac3-43a9-a5c5-2b15bb1eef13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:09.554966 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-f1261b8f-8ac3-43a9-a5c5-2b15bb1eef13 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041056 Oct 24 08:42:09.574732 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Oct 24 08:42:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:42:12.362518 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-e55ac23a-8249-480d-b38d-37b6b2f82d83 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:12.364544 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-e55ac23a-8249-480d-b38d-37b6b2f82d83 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002905 Oct 24 08:42:12.365386 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:12.897411 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-48a71889-17de-431f-95a9-f6198068e164 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:12.924967 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-48a71889-17de-431f-95a9-f6198068e164 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.552676 Oct 24 08:42:12.929345 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 08:42:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:42:16.258552 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-e55ac23a-8249-480d-b38d-37b6b2f82d83 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:16.259875 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-e55ac23a-8249-480d-b38d-37b6b2f82d83 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Oct 24 08:42:16.260304 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:16.748584 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-6ede464e-69bf-426e-b23c-0d210881642c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:16.774112 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-6ede464e-69bf-426e-b23c-0d210881642c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506645 Oct 24 08:42:16.774984 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:16.791585 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-21fad4fc-fc2c-4312-b66d-16bfbf28bd48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:16.829706 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-21fad4fc-fc2c-4312-b66d-16bfbf28bd48 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045107 Oct 24 08:42:16.830440 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Oct 24 08:42:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:19.494842 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-6ede464e-69bf-426e-b23c-0d210881642c admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:19.495872 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-6ede464e-69bf-426e-b23c-0d210881642c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 24 08:42:19.496277 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:42:19.916818 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-e8496554-b2b0-44da-a0b1-16c1100d6293 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "ram": 2048}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:19.936852 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-e8496554-b2b0-44da-a0b1-16c1100d6293 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433601 Oct 24 08:42:19.938141 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:19.950425 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-eccdb97b-a4dc-4e10-8799-e48dde14bb01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:19.974471 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-eccdb97b-a4dc-4e10-8799-e48dde14bb01 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027819 Oct 24 08:42:19.975069 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Oct 24 08:42:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:22.646893 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-e8496554-b2b0-44da-a0b1-16c1100d6293 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:22.647897 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-e8496554-b2b0-44da-a0b1-16c1100d6293 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 24 08:42:22.648302 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:23.126239 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-5da14ad7-f6ef-4b3d-bb56-386ea570a5ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "swap": 0}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:23.160348 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-5da14ad7-f6ef-4b3d-bb56-386ea570a5ab admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.505290 Oct 24 08:42:23.161074 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:23.173732 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-7ae8b494-9aad-4095-878e-35b07e05f936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:23.178784 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:23.205558 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-7ae8b494-9aad-4095-878e-35b07e05f936 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035992 Oct 24 08:42:23.206594 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Oct 24 08:42:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:25.876538 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-5da14ad7-f6ef-4b3d-bb56-386ea570a5ab admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:25.878216 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-5da14ad7-f6ef-4b3d-bb56-386ea570a5ab admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Oct 24 08:42:25.878614 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:42:26.374997 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-a8c23293-3633-4e27-b5d5-91810b6fa211 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "swap": 0, "name": "m1.large"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:26.399111 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-a8c23293-3633-4e27-b5d5-91810b6fa211 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513714 Oct 24 08:42:26.399742 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:42:26.413907 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-ac88b14b-41bb-48bb-8099-f2df344a9e2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:26.420337 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:26.441655 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-ac88b14b-41bb-48bb-8099-f2df344a9e2c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031921 Oct 24 08:42:26.442609 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Oct 24 08:42:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:29.139889 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-a8c23293-3633-4e27-b5d5-91810b6fa211 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:29.141693 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-a8c23293-3633-4e27-b5d5-91810b6fa211 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Oct 24 08:42:29.145568 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:29.589851 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-5f8c8f05-efe5-4b93-95a2-7795c3826ca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:29.612611 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-5f8c8f05-efe5-4b93-95a2-7795c3826ca5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464060 Oct 24 08:42:29.617330 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Oct 24 08:42:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:29.626165 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-85dcd422-fb3e-48e5-8212-5c62dc9c61b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:29.652494 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-85dcd422-fb3e-48e5-8212-5c62dc9c61b3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030563 Oct 24 08:42:29.661745 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Oct 24 08:42:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:49.347997 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-5f8c8f05-efe5-4b93-95a2-7795c3826ca5 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:49.348925 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-5f8c8f05-efe5-4b93-95a2-7795c3826ca5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 24 08:42:49.349445 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:49.360703 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:49.753777 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-29c8c760-e325-427a-b22e-ce8f703324bd admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:49.771931 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-29c8c760-e325-427a-b22e-ce8f703324bd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.416313 Oct 24 08:42:49.772482 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 08:42:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:51.088540 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-5f8c8f05-efe5-4b93-95a2-7795c3826ca5 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:51.089577 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-5f8c8f05-efe5-4b93-95a2-7795c3826ca5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 24 08:42:51.089982 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:51.618717 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c4f4a704-b0cc-4f70-97ec-3b5e0f564912 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:51.624108 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.wsgi [None req-c4f4a704-b0cc-4f70-97ec-3b5e0f564912 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c4f4a704-b0cc-4f70-97ec-3b5e0f564912 admin admin] Request method failure captured: Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Accept: application/json Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Accept-Encoding: gzip, deflate Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Connection: keep-alive Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Content-Length: 0 Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Host: 10.222.0.25 Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Openstack-Api-Version: compute 2.92 Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: Openstack-System-Scope: None Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: User-Agent: python-novaclient Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Auth-Token: gAAAAABjVlAKhe37s2CQAWoURYVeIGttA28NxU29obVaX7Mze480tajsuzymjCAaTxdIXmOmUpSm-9Zh8BD6P-3MMRODScztRH4TJWuzaHYfBRaQOIJrL2bHLY0Vy206h0DtGN9CrAdGbHrFQtb-wRQEj4UG5IPH2RprxfhF1HG3E0d-JVY6btk Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Domain-Id: None Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Domain-Name: None Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Identity-Status: Confirmed Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Is-Admin-Project: True Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Project-Domain-Id: default Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Project-Domain-Name: Default Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Project-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Project-Name: admin Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Role: admin,member,reader Oct 24 08:42:51.627394 n-d-master-1 devstack@n-api.service[111044]: X-Roles: admin,member,reader Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5d57fb385334787a7547e0f12982788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5d57fb385334787a7547e0f12982788"}]}] Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-Tenant: admin Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-Tenant-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-Tenant-Name: admin Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-User: admin Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-User-Domain-Id: default Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-User-Domain-Name: Default Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-User-Id: 382bba280be9494c8775eed19488896e Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: X-User-Name: admin Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: method: > Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: exception: Flavor 42 could not be found. Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: action_args: {'id': '42'} Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:42:51.629841 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:51.631133 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.632564 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c4f4a704-b0cc-4f70-97ec-3b5e0f564912 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:42:51.634123 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c4f4a704-b0cc-4f70-97ec-3b5e0f564912 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396656 Oct 24 08:42:51.634123 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Oct 24 08:42:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:51.638537 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-b827d14c-3f12-4b4c-9ce9-e003a3bd8262 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:51.642773 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:51.662738 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-b827d14c-3f12-4b4c-9ce9-e003a3bd8262 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027692 Oct 24 08:42:51.663308 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Oct 24 08:42:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:51.674899 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-93518fa1-b010-4c6f-a261-c2689d669dbe admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:51.696764 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-93518fa1-b010-4c6f-a261-c2689d669dbe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026851 Oct 24 08:42:51.697231 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Oct 24 08:42:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:42:51.706869 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-72d18fb2-fd47-421c-ba0a-49d358342875 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:51.713321 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.wsgi [None req-72d18fb2-fd47-421c-ba0a-49d358342875 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-72d18fb2-fd47-421c-ba0a-49d358342875 admin admin] Request method failure captured: Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Accept: application/json Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Accept-Encoding: gzip, deflate Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Connection: keep-alive Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Content-Length: 0 Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Host: 10.222.0.25 Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Openstack-Api-Version: compute 2.92 Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: Openstack-System-Scope: None Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: User-Agent: python-novaclient Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Auth-Token: gAAAAABjVlAKhe37s2CQAWoURYVeIGttA28NxU29obVaX7Mze480tajsuzymjCAaTxdIXmOmUpSm-9Zh8BD6P-3MMRODScztRH4TJWuzaHYfBRaQOIJrL2bHLY0Vy206h0DtGN9CrAdGbHrFQtb-wRQEj4UG5IPH2RprxfhF1HG3E0d-JVY6btk Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Domain-Id: None Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Domain-Name: None Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Identity-Status: Confirmed Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Is-Admin-Project: True Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Project-Domain-Id: default Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Project-Domain-Name: Default Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Project-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Project-Name: admin Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Role: admin,member,reader Oct 24 08:42:51.716633 n-d-master-1 devstack@n-api.service[111043]: X-Roles: admin,member,reader Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5d57fb385334787a7547e0f12982788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5d57fb385334787a7547e0f12982788"}]}] Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-Tenant: admin Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-Tenant-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-Tenant-Name: admin Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-User: admin Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-User-Domain-Id: default Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-User-Domain-Name: Default Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-User-Id: 382bba280be9494c8775eed19488896e Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: X-User-Name: admin Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: method: > Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: exception: Flavor 42 could not be found. Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: action_args: {'id': '42'} Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:42:51.718659 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:51.719598 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:51.720828 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-72d18fb2-fd47-421c-ba0a-49d358342875 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:42:51.722037 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-72d18fb2-fd47-421c-ba0a-49d358342875 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014932 Oct 24 08:42:51.722037 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Oct 24 08:42:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:52.944529 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-93518fa1-b010-4c6f-a261-c2689d669dbe admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:52.945632 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-93518fa1-b010-4c6f-a261-c2689d669dbe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Oct 24 08:42:52.946037 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:42:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:53.496176 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-a3bff513-1554-4d2c-b611-77198156020a admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:53.502175 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.wsgi [None req-a3bff513-1554-4d2c-b611-77198156020a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-a3bff513-1554-4d2c-b611-77198156020a admin admin] Request method failure captured: Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Accept: application/json Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Accept-Encoding: gzip, deflate Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Connection: keep-alive Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Content-Length: 0 Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Host: 10.222.0.25 Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Openstack-Api-Version: compute 2.92 Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: Openstack-System-Scope: None Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: User-Agent: python-novaclient Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Auth-Token: gAAAAABjVlAM1OG0XpWRiN-S2wVwnP1a0S20Uv7evzA53BHnvVN9fLgvgIPORWSyw3ElYV4HqS5GZbWaCi1UPomcDbycdYD46bw61NrD-AdnO77pO8ckocSn1XTm8UUtwScnZ9NF6TPk9afKhNLSgHL9DJTqe_-7KCD2weegiD5l0AJw1pU_ZEo Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Domain-Id: None Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Domain-Name: None Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Identity-Status: Confirmed Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Is-Admin-Project: True Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Project-Domain-Id: default Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Project-Domain-Name: Default Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Project-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Project-Name: admin Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Role: admin,member,reader Oct 24 08:42:53.503427 n-d-master-1 devstack@n-api.service[111043]: X-Roles: admin,member,reader Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5d57fb385334787a7547e0f12982788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5d57fb385334787a7547e0f12982788"}]}] Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-Tenant: admin Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-Tenant-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-Tenant-Name: admin Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-User: admin Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-User-Domain-Id: default Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-User-Domain-Name: Default Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-User-Id: 382bba280be9494c8775eed19488896e Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: X-User-Name: admin Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: method: > Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: exception: Flavor 84 could not be found. Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: action_args: {'id': '84'} Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:42:53.504955 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:53.505951 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.507251 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-a3bff513-1554-4d2c-b611-77198156020a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:42:53.508470 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-a3bff513-1554-4d2c-b611-77198156020a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.421882 Oct 24 08:42:53.508470 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Oct 24 08:42:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:53.514547 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-6531fcb3-9d4c-4d82-82af-8edc67599f5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:53.529360 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-6531fcb3-9d4c-4d82-82af-8edc67599f5a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018381 Oct 24 08:42:53.529910 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Oct 24 08:42:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:53.539610 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-47cbc030-b3e2-46b6-9d05-5b4a3556aeca admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:53.555423 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-47cbc030-b3e2-46b6-9d05-5b4a3556aeca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019471 Oct 24 08:42:53.555975 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Oct 24 08:42:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:53.566138 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-48fc134e-f24b-4bd8-9282-0552fea785c6 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:53.571341 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.wsgi [None req-48fc134e-f24b-4bd8-9282-0552fea785c6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-48fc134e-f24b-4bd8-9282-0552fea785c6 admin admin] Request method failure captured: Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Accept: application/json Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Accept-Encoding: gzip, deflate Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Connection: keep-alive Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Content-Length: 0 Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Host: 10.222.0.25 Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Openstack-Api-Version: compute 2.92 Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: Openstack-System-Scope: None Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: User-Agent: python-novaclient Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Auth-Token: gAAAAABjVlAM1OG0XpWRiN-S2wVwnP1a0S20Uv7evzA53BHnvVN9fLgvgIPORWSyw3ElYV4HqS5GZbWaCi1UPomcDbycdYD46bw61NrD-AdnO77pO8ckocSn1XTm8UUtwScnZ9NF6TPk9afKhNLSgHL9DJTqe_-7KCD2weegiD5l0AJw1pU_ZEo Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Domain-Id: None Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Domain-Name: None Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Identity-Status: Confirmed Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Is-Admin-Project: True Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Project-Domain-Id: default Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Project-Domain-Name: Default Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Project-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Project-Name: admin Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Role: admin,member,reader Oct 24 08:42:53.572849 n-d-master-1 devstack@n-api.service[111044]: X-Roles: admin,member,reader Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5d57fb385334787a7547e0f12982788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5d57fb385334787a7547e0f12982788"}]}] Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-Tenant: admin Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-Tenant-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-Tenant-Name: admin Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-User: admin Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-User-Domain-Id: default Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-User-Domain-Name: Default Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-User-Id: 382bba280be9494c8775eed19488896e Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: X-User-Name: admin Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: method: > Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: exception: Flavor 84 could not be found. Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: action_args: {'id': '84'} Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:42:53.574411 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:53.575365 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:53.576929 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-48fc134e-f24b-4bd8-9282-0552fea785c6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:42:53.578749 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-48fc134e-f24b-4bd8-9282-0552fea785c6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012256 Oct 24 08:42:53.578749 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Oct 24 08:42:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:54.782610 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-47cbc030-b3e2-46b6-9d05-5b4a3556aeca admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:54.783609 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-47cbc030-b3e2-46b6-9d05-5b4a3556aeca admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 24 08:42:54.783997 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:55.317210 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c1f006ab-a1a8-416e-aa83-6c7957f60bd3 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:55.323196 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.wsgi [None req-c1f006ab-a1a8-416e-aa83-6c7957f60bd3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c1f006ab-a1a8-416e-aa83-6c7957f60bd3 admin admin] Request method failure captured: Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Accept: application/json Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Accept-Encoding: gzip, deflate Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Connection: keep-alive Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Content-Length: 0 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Host: 10.222.0.25 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Openstack-Api-Version: compute 2.92 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: Openstack-System-Scope: None Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: User-Agent: python-novaclient Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Auth-Token: gAAAAABjVlAOS0riTD9XqRp-USl0-bIOuTiP4KabquganPOujATxbo9tHwTuvL_zDL-eDUhq31Pt8y3SAp-un_f2rJsZm5Avz5fSlaDncDyR27XUOkAcsyaEfbTRgdMkcNE0UPZgJHYzgaIq5HQMisLBaD_pHO1z6bsimYjl0KQCCbiwQZn9P40 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Domain-Id: None Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Domain-Name: None Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Identity-Status: Confirmed Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Is-Admin-Project: True Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Project-Domain-Id: default Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Project-Domain-Name: Default Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Project-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Project-Name: admin Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Role: admin,member,reader Oct 24 08:42:55.324703 n-d-master-1 devstack@n-api.service[111044]: X-Roles: admin,member,reader Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5d57fb385334787a7547e0f12982788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5d57fb385334787a7547e0f12982788"}]}] Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-Tenant: admin Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-Tenant-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-Tenant-Name: admin Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-User: admin Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-User-Domain-Id: default Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-User-Domain-Name: Default Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-User-Id: 382bba280be9494c8775eed19488896e Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: X-User-Name: admin Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: method: > Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: exception: Flavor 451 could not be found. Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: action_args: {'id': '451'} Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:42:55.326240 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:55.328972 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.330125 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c1f006ab-a1a8-416e-aa83-6c7957f60bd3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:42:55.331107 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c1f006ab-a1a8-416e-aa83-6c7957f60bd3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.403997 Oct 24 08:42:55.331107 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 08:42:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:55.336529 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-c13be2f2-12bd-4fd7-a2e9-f2321cd48c26 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:55.351721 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-c13be2f2-12bd-4fd7-a2e9-f2321cd48c26 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018726 Oct 24 08:42:55.352287 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Oct 24 08:42:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:55.362207 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:55.378098 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019480 Oct 24 08:42:55.378669 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Oct 24 08:42:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:42:55.388395 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-ab2405f6-450e-4027-91a0-851e24bcc1b7 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:55.394116 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.wsgi [None req-ab2405f6-450e-4027-91a0-851e24bcc1b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-ab2405f6-450e-4027-91a0-851e24bcc1b7 admin admin] Request method failure captured: Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Accept: application/json Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Accept-Encoding: gzip, deflate Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Connection: keep-alive Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Content-Length: 0 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Host: 10.222.0.25 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Openstack-Api-Version: compute 2.92 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: Openstack-System-Scope: None Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: User-Agent: python-novaclient Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Auth-Token: gAAAAABjVlAOS0riTD9XqRp-USl0-bIOuTiP4KabquganPOujATxbo9tHwTuvL_zDL-eDUhq31Pt8y3SAp-un_f2rJsZm5Avz5fSlaDncDyR27XUOkAcsyaEfbTRgdMkcNE0UPZgJHYzgaIq5HQMisLBaD_pHO1z6bsimYjl0KQCCbiwQZn9P40 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Domain-Id: None Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Domain-Name: None Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Identity-Status: Confirmed Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Is-Admin-Project: True Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Project-Domain-Id: default Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Project-Domain-Name: Default Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Project-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Project-Name: admin Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Role: admin,member,reader Oct 24 08:42:55.395648 n-d-master-1 devstack@n-api.service[111043]: X-Roles: admin,member,reader Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5d57fb385334787a7547e0f12982788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5d57fb385334787a7547e0f12982788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5d57fb385334787a7547e0f12982788"}]}] Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-Tenant: admin Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-Tenant-Id: d5d57fb385334787a7547e0f12982788 Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-Tenant-Name: admin Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-User: admin Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-User-Domain-Id: default Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-User-Domain-Name: Default Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-User-Id: 382bba280be9494c8775eed19488896e Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: X-User-Name: admin Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: method: > Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: exception: Flavor 451 could not be found. Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: action_args: {'id': '451'} Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:42:55.397099 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:55.398067 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: ERROR nova.api.openstack.wsgi Oct 24 08:42:55.399279 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-ab2405f6-450e-4027-91a0-851e24bcc1b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:42:55.400532 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-ab2405f6-450e-4027-91a0-851e24bcc1b7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012424 Oct 24 08:42:55.400532 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 08:42:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:56.623328 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:56.624375 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 24 08:42:56.624777 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:57.154980 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-65d57adf-2c2e-4e6e-91bd-4b44ac60cbb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:57.175588 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-65d57adf-2c2e-4e6e-91bd-4b44ac60cbb6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.414579 Oct 24 08:42:57.176070 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Oct 24 08:42:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:42:58.410055 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:58.411049 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 24 08:42:58.411452 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:58.954895 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-2a1daa27-8cd5-4534-8b47-6a0ce74b8138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:42:58.973978 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-2a1daa27-8cd5-4534-8b47-6a0ce74b8138 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.426655 Oct 24 08:42:58.974459 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Oct 24 08:42:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:43:00.216340 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:43:00.217454 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 24 08:43:00.218460 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:43:00.749208 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-c53fff23-eb14-4b02-a47f-4b6bc12ad77b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:43:00.768849 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-c53fff23-eb14-4b02-a47f-4b6bc12ad77b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.412072 Oct 24 08:43:00.769445 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Oct 24 08:43:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:43:01.998640 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:43:01.999651 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 24 08:43:02.000034 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:43:02.560170 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-a8a9e3c4-0791-44ca-95cd-165a5c6e7b48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:43:02.580468 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-a8a9e3c4-0791-44ca-95cd-165a5c6e7b48 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.443743 Oct 24 08:43:02.581031 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Oct 24 08:43:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:43:03.863424 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:43:03.864608 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Oct 24 08:43:03.865269 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:43:04.469016 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-841db80d-8ef6-4610-8563-861125760463 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:43:04.491002 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-841db80d-8ef6-4610-8563-861125760463 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.461221 Oct 24 08:43:04.491842 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Mon Oct 24 08:43:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:44:02.517799 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:44:02.518804 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-c999445d-35df-465a-a9d9-e530caf32d5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 24 08:44:02.519231 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Mon Oct 24 08:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:44:02.529556 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:02.924522 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-75b44522-6129-4667-aa4f-c3fe34ab08ff admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:44:02.945461 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-75b44522-6129-4667-aa4f-c3fe34ab08ff admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420170 Oct 24 08:44:02.945919 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 08:44:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:44:02.966728 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_api:SELECT=14 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:02.971301 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-5141f0ab-b7ac-4e4d-9248-2a75b32da671 admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:44:02.978720 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-5141f0ab-b7ac-4e4d-9248-2a75b32da671 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013405 Oct 24 08:44:02.979243 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Mon Oct 24 08:44:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:44:02.991684 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-f6144bed-c039-4929-ae33-2709d969f097 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:44:02.999351 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-f6144bed-c039-4929-ae33-2709d969f097 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011360 Oct 24 08:44:02.999953 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Mon Oct 24 08:44:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:44:03.011913 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-68b460fc-bb38-426f-a3db-8b0ea0dd571e admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:44:03.019657 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-68b460fc-bb38-426f-a3db-8b0ea0dd571e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011400 Oct 24 08:44:03.020214 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Mon Oct 24 08:44:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:44:03.032615 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-efe3ebe6-a92e-466c-a438-478f4ea83d84 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:44:03.039888 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-efe3ebe6-a92e-466c-a438-478f4ea83d84 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011469 Oct 24 08:44:03.040408 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Mon Oct 24 08:44:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:11.382022 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-68b460fc-bb38-426f-a3db-8b0ea0dd571e admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:11.383033 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-68b460fc-bb38-426f-a3db-8b0ea0dd571e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 24 08:49:11.383425 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:11.526544 n-d-master-1 devstack@n-api.service[111043]: DEBUG dbcounter [-] [111043] Writing DB stats nova_api:SELECT=6 {{(pid=111043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:11.681116 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:11.686175 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:11.686664 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:11.687097 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:11.687814 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:11.688263 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:11.688682 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:11.729789 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-60b53ee2-6bce-43d4-97e8-a41ea6bf0110 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.204326 Oct 24 08:49:11.730409 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 08:49:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:49:12.822046 n-d-master-1 devstack@n-api.service[111044]: DEBUG nova.api.openstack.wsgi [None req-68b460fc-bb38-426f-a3db-8b0ea0dd571e admin admin] Calling method '>' {{(pid=111044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:12.823052 n-d-master-1 devstack@n-api.service[111044]: INFO nova.api.openstack.requestlog [None req-68b460fc-bb38-426f-a3db-8b0ea0dd571e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 24 08:49:12.823460 n-d-master-1 devstack@n-api.service[111044]: [pid: 111044|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Oct 24 08:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:13.018516 n-d-master-1 devstack@n-api.service[111043]: DEBUG nova.api.openstack.wsgi [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Calling method '>' {{(pid=111043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.022473 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.022957 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.023441 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.024223 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.024665 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.025480 n-d-master-1 devstack@n-api.service[111043]: DEBUG oslo_concurrency.lockutils [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.049966 n-d-master-1 devstack@n-api.service[111043]: INFO nova.api.openstack.requestlog [None req-bab2c2a4-af82-4519-b427-1fbde890b546 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.085299 Oct 24 08:49:13.050851 n-d-master-1 devstack@n-api.service[111043]: [pid: 111043|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 08:49:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:01.607835 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 24 08:50:01.608505 n-d-master-1 devstack@n-api.service[111042]: Mon Oct 24 08:50:01 2022 - graceful shutdown triggered... Oct 24 08:50:01.608978 n-d-master-1 devstack@n-api.service[111043]: Gracefully killing worker 1 (pid: 111043)... Oct 24 08:50:01.609786 n-d-master-1 devstack@n-api.service[111044]: Gracefully killing worker 2 (pid: 111044)... Oct 24 08:50:01.737260 n-d-master-1 devstack@n-api.service[111044]: DEBUG dbcounter [-] [111044] Writing DB stats nova_api:SELECT=4 {{(pid=111044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:02.609279 n-d-master-1 devstack@n-api.service[111042]: worker 1 buried after 1 seconds Oct 24 08:50:02.609735 n-d-master-1 devstack@n-api.service[111042]: worker 2 buried after 1 seconds Oct 24 08:50:02.609735 n-d-master-1 devstack@n-api.service[111042]: goodbye to uWSGI. Oct 24 08:50:02.610885 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 24 08:50:02.611447 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 24 08:50:02.614265 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 08:50:02.630046 n-d-master-1 devstack@n-api.service[126910]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 08:50:02 2022] *** Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: nodename: n-d-master-1 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: machine: x86_64 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: clock source: unix Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: pcre jit disabled Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: detected number of CPU cores: 4 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: current working directory: / Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: detected binary path: /usr/bin/uwsgi-core Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: your processes number limit is 47680 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: your memory page size is 4096 bytes Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: detected max file descriptor number: 2048 Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: lock engine: pthread robust mutexes Oct 24 08:50:02.632442 n-d-master-1 devstack@n-api.service[126910]: thunder lock: enabled Oct 24 08:50:02.633834 n-d-master-1 devstack@n-api.service[126910]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 08:50:02.633834 n-d-master-1 devstack@n-api.service[126910]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 08:50:02.673777 n-d-master-1 devstack@n-api.service[126910]: Python main interpreter initialized at 0x562e309df9c0 Oct 24 08:50:02.673777 n-d-master-1 devstack@n-api.service[126910]: python threads support enabled Oct 24 08:50:02.673777 n-d-master-1 devstack@n-api.service[126910]: your server socket listen backlog is limited to 100 connections Oct 24 08:50:02.673777 n-d-master-1 devstack@n-api.service[126910]: your mercy for graceful operations on workers is 90 seconds Oct 24 08:50:02.674207 n-d-master-1 devstack@n-api.service[126910]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 08:50:02.674207 n-d-master-1 devstack@n-api.service[126910]: *** Operational MODE: preforking *** Oct 24 08:50:02.674505 n-d-master-1 devstack@n-api.service[126910]: *** uWSGI is running in multiple interpreter mode *** Oct 24 08:50:02.674505 n-d-master-1 devstack@n-api.service[126910]: spawned uWSGI master process (pid: 126910) Oct 24 08:50:02.678241 n-d-master-1 devstack@n-api.service[126910]: spawned uWSGI worker 1 (pid: 126919, cores: 1) Oct 24 08:50:02.678241 n-d-master-1 devstack@n-api.service[126910]: spawned uWSGI worker 2 (pid: 126920, cores: 1) Oct 24 08:50:02.678241 n-d-master-1 devstack@n-api.service[126910]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 08:50:02.674705 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 24 08:50:03.344731 n-d-master-1 devstack@n-api.service[126919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:50:03.354953 n-d-master-1 devstack@n-api.service[126920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:50:04.590934 n-d-master-1 devstack@n-api.service[126919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:50:04.590934 n-d-master-1 devstack@n-api.service[126919]: from cryptography.utils import int_from_bytes Oct 24 08:50:04.591580 n-d-master-1 devstack@n-api.service[126919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:50:04.591580 n-d-master-1 devstack@n-api.service[126919]: from cryptography.utils import int_from_bytes Oct 24 08:50:04.594015 n-d-master-1 devstack@n-api.service[126920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:50:04.594015 n-d-master-1 devstack@n-api.service[126920]: from cryptography.utils import int_from_bytes Oct 24 08:50:04.594485 n-d-master-1 devstack@n-api.service[126920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:50:04.594485 n-d-master-1 devstack@n-api.service[126920]: from cryptography.utils import int_from_bytes Oct 24 08:50:07.127991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:50:07.128874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:50:07.128874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:50:07.129160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:50:07.129522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:50:07.129840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.130212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.130491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.130812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.131146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.131457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.131782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.132106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.132441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.132700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.133015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.133375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.133734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.134049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.134360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.134727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.134984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.135306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.135612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.136122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.136581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.139568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.140537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.140537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.140537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.140839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.140987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.141382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.141702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.142191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.142379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.142636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.142941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.143362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.143609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.143982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.144309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.144614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.144932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.145245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.145597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.145888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.146192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.146445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.146754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.147329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.147460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.147726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.147982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.148230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.148552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.148876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.149405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.149568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.149837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.150196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.150477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.150841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.151150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.151457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.151786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.152101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.152426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.152735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.153053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.153495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.153750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.154062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.154411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.154734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.155045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.155366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.155690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.155997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.156306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.156613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.156934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.157258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.157596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.157850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.158156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.158461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.158783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.159087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.159398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.159702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.160010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.160312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.160623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.160926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.161231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.161571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.161880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.162183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.162491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.162798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.163100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.163430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.163759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.164064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.164366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.164667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.165716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.165818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.166125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.166430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.166754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.167062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.167372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.167693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.168004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.168315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.168627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.168935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.169241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.169598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.169901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.170212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.170510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.170814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.171117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.171421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.171724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.172025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.172323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.172648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.173044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.173381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.173693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.174001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.174365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.174713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.175044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.175390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.175712 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.176047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.176379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.176699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.177011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.177363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.177693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.178005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.178328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.178628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.178949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.179270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.179599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.179914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.180392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.181121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.181436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.181757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.182084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.182411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.182722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.183187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.183417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.183778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.184108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.184437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.184748 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.185145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.185495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.185851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.186172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.186482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.186803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.187121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.187448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.187767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.188074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.188388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.188702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.189013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.189377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.189700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.190027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.190345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.190667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.190985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.191419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.191689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.191924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.192202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.192507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.192809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.193124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.193521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.193843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.194176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.194485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.194899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.195128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.195440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.195747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.196087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.196395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.196709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.197026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.197353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.197681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.197994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.198304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.198628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.198932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.199238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.199583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.199894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.200195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.200504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.200885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.201134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.201477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.201786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.202125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.202459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.202761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.203085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.203408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.203723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.204026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.204383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.204689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.204998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.205335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.205632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.205936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.206241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.206544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.206846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.207153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.207476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.207785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.208087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.208390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.208692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.209035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.209365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.209711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.210048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.210366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.210689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.211010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.211367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.211711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.212024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.212335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.212646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.212965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.213276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.213617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.213929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.214251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.214562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.214881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.215188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.215503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.215843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.216177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.216493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.216815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.217131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.217467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.217777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.218086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.218396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.218704 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.219020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.219328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.219642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.219950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.220270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.220576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.220892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.221197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.221536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.221867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.222198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.222507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.222817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.223138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.223448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.223757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.224066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.224369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.224678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.224980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.225313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.225622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.225931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.226233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.226546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.226859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.227697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.227982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.228293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.228614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.228923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.229286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.229599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.229976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.230212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.231310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.231310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.231310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.231577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.231717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.232067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.232380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.232686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.233003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.233345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.233660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.233982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.234293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.234603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.234925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.235240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.235551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.235861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.236173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.236485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.236799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.237117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.237456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.237768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.238081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.238386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.238698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.239018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.239602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.239937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.240252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.240572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.240915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.241343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.241593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.241924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.242235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.242540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.242883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.243738 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.244047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.244359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.244667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.244975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.245277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.245611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.245912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.246230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.246521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.247076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.247399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.247703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.248015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.248319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.248643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.248951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.249256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.249584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.249887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.250236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.250541 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.250882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.251212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.251553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.251861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.252168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.252494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.252803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.253137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.253463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.253681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:50:07.254195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.254355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:50:07.254453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.254453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.254632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:50:07.254724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.254854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:50:07.254955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.255115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:50:07.255254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.255508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.255607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.255840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.255933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.256149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.256256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.256455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.256555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.256769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.256862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.257078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.257199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.257423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.257567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.257773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.257892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.258086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.258197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.258381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.258529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.258734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.258845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.259048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.259148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.259354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.259462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.259671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.259781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.259978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.260088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.260302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.260403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.260589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.260699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.260901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.261002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.261211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.261333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.261541 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.261758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.261878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.262092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.262199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.262396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.262578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.262730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.262912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.263053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.263193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.263349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.263491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.263632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.263773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.263920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.264066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.264213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.264353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.264522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.264676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.264812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.264954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.265103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.265285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.265437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.265630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.265745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.265950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.266044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.266270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.266361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.266632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.266722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.266934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.267035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.267240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.267339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.267546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.267648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.267848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.267949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.268170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.268264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.268592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.268720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.268808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.268893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.269067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.269168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.269397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.269511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.269753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.269877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.270127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.270237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.270406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.270507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.270709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.270807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.271025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.271124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.271332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.271423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.271586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.271676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.271897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.271988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.272769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.272898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.272898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.273086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.273171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.273253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.273253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.273463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.273555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.273641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.273730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.273827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.274008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.274211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.274360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.274514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.274654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.274808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.274946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.275029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.275257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.275348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.275566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.275713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.275878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.276015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.276163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.276318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.276467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.276607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.276756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.276896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.277069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.277219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.277399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.277498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.277712 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.277814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.278006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.278107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.278319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.278440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.278634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.278728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.278942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.279044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.279251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.279352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.279557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.279658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.279928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.280042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.280241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.280343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.280547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.280650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.280866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.281052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.281169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.281269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.281498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.281605 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.281809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.281924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.282110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.282204 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.282418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.282512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.282677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.282793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.283059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.283284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.283411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.283611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.283714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.283924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.284016 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.284234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.284327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.284546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.284651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.284853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.284946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.285164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.285277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.285498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.285610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.285811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.285903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.286123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.286227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.286433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.286535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.286743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.286832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.287051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.287149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.287362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.287446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.287673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.287765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.287983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.288083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.288308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.288409 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.288617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.288724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.288923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.289028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.289226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.289383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.289561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.289663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.290404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.290516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.290734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.290827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.291047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.291184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.291356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.291496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.291684 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.291784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.291999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.292205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.292300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.292517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.292608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.292827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.292929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.293153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.293255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.293502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.293606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.293826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.293929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.294132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.294233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.294447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.294555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.294758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.294865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.295066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.295157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.295375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.295468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.295685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.295777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.295995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.296085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.296297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.296388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.296602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.296694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.296911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.297011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.297216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.297366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.297565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.297660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.297892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.297994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.298210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.298318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.298557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.298665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.298837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.298950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.299165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:50:07.299272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.299498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.299595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.299807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.299912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.300112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.300219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.300487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.300592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.300813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.301872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.302147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.302440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.302582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.302728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.302910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.303917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.304028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.304107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.304336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.304458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.304703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.304795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.305018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.305110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.305419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.306962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.307178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.307280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.307486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.307586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.307840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.307934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.308150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.308253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.308474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.308579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.308806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.308915 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.309138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.309252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.309465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.309574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.309787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.309878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.310103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.310205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.310419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.310529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.310732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.310832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311051 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.311980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.312991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.313200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.313320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.313535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.313745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.313860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.313953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.314130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.314298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.314443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.314600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.314743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.314885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315176 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.315907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.316046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.316451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.316597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.316736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.316878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317527 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.317879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.318169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.318311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.318424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.318529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.318737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.318830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.319991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.320085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.320304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.320397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.320612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.320715 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.320945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.321052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.321265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.321392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.321607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.321731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.321960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.322519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.322632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.322719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.322817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.322914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.323811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.324937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.325031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.325245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.325374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.325596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.325689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.325915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.326993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.327208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.327312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.327521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.327622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.327840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.327941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.328148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.328240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.328467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.328572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.328777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.328872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.329342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.329445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.329445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.329615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.329724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.329821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.330945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.331967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.332169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.332271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.332605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.332718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.332828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.333953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.334127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.334234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.334616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.334760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.334956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.335974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.336201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.336304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.336520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.337152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.337403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.337513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.337714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.337854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.338950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.339988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.340203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.340305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.340509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.340608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.340910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.341054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.341236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.341429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.341606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.341747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.341897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.342072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.342219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.342396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.342534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.342713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.342850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.343953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.344126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.344273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.344490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.344612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.344883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.345827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.346983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.347996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.348208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.348309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.348512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.348613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.348817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.348914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.349118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.349219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.349445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.349559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.349760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.349855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.350977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.351084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.351294 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.351405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.351611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.351705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.351917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.352024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.352268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.352876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.353081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.353175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.353415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.353562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.353737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.353839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.354995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.355094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.355327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.355420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.355644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.355753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.355956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.356206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.356313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.356547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.356661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.356875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.356997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.357210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.357339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.357548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.357653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.357865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.357957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.358178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.358282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.358485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.358578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.358807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.358915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.359117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.359252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.359430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.359534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.359741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.359837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.360977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.361102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.361288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.361398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.361618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.361713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.361928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.362947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.363167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.363289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.363479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.363593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.363803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.363907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.364130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.364399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.364564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.364737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.364902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.365981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.366094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.366288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.366382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.366604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.366702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.366937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.367055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.367250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.367339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.367557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.367649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.367951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.368060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.368269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.368371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.368589 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.368682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.368907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.369974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.370188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.370282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.370498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.370597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.370807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.370908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.371117 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.371211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.371439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.371546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.371995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.372089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.372321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.372423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.372634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.372737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.372936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.373991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.374199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.374297 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.374503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.374611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.374808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.374916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.375117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.375210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.375422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.375524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.375731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.375852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.376947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.377133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.377242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.377472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.377579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.377784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.377885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.378104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.378211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.378421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.378514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.378729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.378829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.379930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.380967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.381193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.381286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.381534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.381629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.381844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.381944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.382154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.382243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.382460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.382561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.382777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.382871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.383089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.383189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.383407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.383624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.383729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.383818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.384983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.385085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.385308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.385422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.385622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.385727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.385932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.386035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.386263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.386357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.386576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.386676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.386946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.387919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.388127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.388222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.388437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.388537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.388766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.388877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.389085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.389216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.389413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.389504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.389711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.389896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.390931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.391963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.392169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.392270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.392480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.392565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.392797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.392896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.393112 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.393212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.393468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.393607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.393775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.393876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.394085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.394186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.394439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.394535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.394758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.394889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395204 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.395982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:50:07.396074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.396354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.396671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.397403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.397403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.397642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.397942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.398261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.398571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.398881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.399759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.400061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.400381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.400713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.401045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.401410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.401726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.402048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.402367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.402687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.403007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.403324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.403644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.403965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.404283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.404609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.404928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.405242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.405587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.405910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.406228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.406569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.406884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.407197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.407508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.407826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.408430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.408430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.409206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.409555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.409879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.410190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.410508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.410831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.411165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.411538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.411854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.412286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.412607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.412928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.413248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.413586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.413900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.414221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.414561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.414980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.415302 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.415617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.415948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.416259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.416584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.417022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.417473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.417767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.418197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.418519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.418839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.419174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.419506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.419890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.420207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.420532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.420851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.421186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.421541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.421862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.422184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.422498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.422831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.423823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.423823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.423823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.424211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.424550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.424870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.425202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.425563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.425878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.426189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.426509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.426820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.427187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.427650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.427965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.428284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.428608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.428926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.429238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.429574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.429909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.430226 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.431090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.431416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.431748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.432066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.432381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.432712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.433029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.433360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.433676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.433989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.434348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.434668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.435000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.435341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.435683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.435998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.436345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.436682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.437005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.437341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.437672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.438022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.438318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.438629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.438946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.439261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.439576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.439888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.440205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.440517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.440828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.441138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.441493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.441802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.442133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.442450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.442768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.443082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.443429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.443786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.444113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.444432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.444757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.447545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.448063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.448218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.448547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.448874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.449225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.449850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.450191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.450513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.450838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.451220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.451472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.451790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.452685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.452685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.452871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.453025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.453421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.453724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.454059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.454407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.454745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.455073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.455400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.455721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.456093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.456413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.456728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.457052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.457855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.458009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.458305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.458631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.458949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.459270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.459592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.459909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.460231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.460552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.460898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.461240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.461762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.462090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.462414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.462739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.463323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.463647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.463989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.464364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.464696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.465022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.465609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.465959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.466278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.466600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.466941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.467257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.467571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.467904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.468222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.468536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.468866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.469181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.469787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.470149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.470474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.470811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.471142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.471466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.471780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.472113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.472427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.472738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.473060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.473401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.473714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.474025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.474344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.474665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.474976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.475292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.475604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.475940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.476250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.476558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.476869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.477188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.477551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.477862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.478406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.478406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.478406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.479222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.479385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.479695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.480012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.480372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.480714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.481008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.481364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.481679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.481988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.482318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.482637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.482968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.483291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.483608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.483969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.484294 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.484902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.485272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.485702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.486056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.486411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.486719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.487036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.487351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.487687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.488009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.488334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.488658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.488968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.489313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.489628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.489946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.490264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.490580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.490898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.491213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.491532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.491847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.492162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.492486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.493387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.493765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.494055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.494168 n-d-master-1 devstack@n-api.service[126920]: INFO dbcounter [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Registered counter for database nova_api Oct 24 08:50:07.494376 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.494698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.495019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.495349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.495672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.495993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.496319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.496656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.497259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.497584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.498025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.498347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.498678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.499011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.499361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.499678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.500004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.500322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.500648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.500969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.501329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.501690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.502028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.502355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.502674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.502987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.503300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.503618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.503946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.504265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.504575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.504886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.505212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.505555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.505870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.506185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.506495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.506813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.507122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.507431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.507741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.508052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.508362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.509252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.509597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.509922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.510222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.510542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.510849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.511160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.511513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.511886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.512208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.512541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.512862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.513183 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.513528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.513859 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.514191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.514515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.514831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.515187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.515497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.515817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.516543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.516543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.516780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.517076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.517574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.517731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.518180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.518391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.518790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.519043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.519373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.519691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.520032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.520350 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.522690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.522690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.523047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.523174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.523541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.523989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.524203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.524544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.524878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.525247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.525598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.525954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.526298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.526618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.526940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.527280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:50:07.527522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:50:07.529975 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.588569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.context [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=126920) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:50:07.590974 n-d-master-1 devstack@n-api.service[126919]: INFO dbcounter [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Registered counter for database nova_api Oct 24 08:50:07.592693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.593171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.594963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.595724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.596167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.598245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.600301 n-d-master-1 devstack@n-api.service[126920]: INFO dbcounter [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Registered counter for database nova_cell0 Oct 24 08:50:07.604695 n-d-master-1 devstack@n-api.service[126920]: INFO dbcounter [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Registered counter for database nova_cell1 Oct 24 08:50:07.612026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.612905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.616690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.619344 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.619467 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.678130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.context [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=126919) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:50:07.682853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.683349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.685005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.685831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.686285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.688437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.690642 n-d-master-1 devstack@n-api.service[126919]: INFO dbcounter [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Registered counter for database nova_cell0 Oct 24 08:50:07.695570 n-d-master-1 devstack@n-api.service[126919]: INFO dbcounter [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Registered counter for database nova_cell1 Oct 24 08:50:07.706374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.708887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.715800 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.716206 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.767552 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.777573 n-d-master-1 devstack@n-api.service[126920]: INFO dbcounter [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Registered counter for database nova_cell0 Oct 24 08:50:07.784983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.790686 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:07.872637 n-d-master-1 devstack@n-api.service[126919]: INFO dbcounter [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Registered counter for database nova_cell0 Oct 24 08:50:07.880995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:50:07.886376 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:50:08.119980 n-d-master-1 devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:50:08.127764 n-d-master-1 devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:50:08.222786 n-d-master-1 devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:50:08.231334 n-d-master-1 devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:50:08.473051 n-d-master-1 devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:50:08.479299 n-d-master-1 devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-e97216d7-e64d-4a79-838d-6db474a9b917 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:50:08.484739 n-d-master-1 devstack@n-api.service[126920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562e309df9c0 pid: 126920 (default app) Oct 24 08:50:08.586183 n-d-master-1 devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:50:08.593034 n-d-master-1 devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-1378264c-57de-4f73-b663-662779a15cf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:50:08.598574 n-d-master-1 devstack@n-api.service[126919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562e309df9c0 pid: 126919 (default app) Oct 24 08:50:49.321215 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.322244 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.323250 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.324574 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.353577 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.354372 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.355294 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.356033 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.465124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-00739b08-8f09-40ac-ad50-5552caef1904 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-452756638", "id": 212141983, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:50.526529 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-00739b08-8f09-40ac-ad50-5552caef1904 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.183970 Oct 24 08:50:50.527838 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:49 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:50.548284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac97371c-33f6-4647-a31a-12dfae4d9cd7 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.550659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '.version_select at 0x7f8dac9bdf70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.558183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=126920) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 24 08:50:50.559101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.559554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.560308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.591394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.591885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.592490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.609519 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac97371c-33f6-4647-a31a-12dfae4d9cd7 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/212141983" status: 202 len: 0 microversion: 2.1 time: 0.071511 Oct 24 08:50:50.610316 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:50:50 2022] DELETE /compute/v2.1/flavors/212141983 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:50.615146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.615786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.617860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.620208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-21864749-e243-4f2b-bd74-3adacc1ee03f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.628425 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d7227ec-7661-4cee-a278-b99cfe6108a7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.319649 Oct 24 08:50:50.629533 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 08:50:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:50.649976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3399f4b-518f-4183-ac7d-556863e52542 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-218391463", "name": "tempest-test_aggregate-963171442"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:50.690978 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-21864749-e243-4f2b-bd74-3adacc1ee03f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070612 Oct 24 08:50:50.693936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:50.695774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-f3399f4b-518f-4183-ac7d-556863e52542 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid 7eaaa526-f76d-4fee-8cb0-df86287c9fd7 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:50:50.716002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0f507dc-b0f9-49de-8275-16f43cba46ef tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1564362907", "id": 526264394, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:50.751868 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0f507dc-b0f9-49de-8275-16f43cba46ef tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.039667 Oct 24 08:50:50.761458 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 4/5] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:50 2022] POST /compute/v2.1/flavors => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:50.770991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6398902-a0e1-4d5c-9aed-ceafa4d2cf5e tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.802593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6398902-a0e1-4d5c-9aed-ceafa4d2cf5e tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.039213 Oct 24 08:50:50.803763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 5/6] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:50.831043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2bf510e-243a-45d3-9709-d39fed285e98 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.831360 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3399f4b-518f-4183-ac7d-556863e52542 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.184693 Oct 24 08:50:50.832652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2/7] 10.222.0.25 () {60 vars in 1165 bytes} [Mon Oct 24 08:50:50 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:50.850788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99c9a6cd-e644-4631-8b4b-f268489ab9a6 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.861705 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2bf510e-243a-45d3-9709-d39fed285e98 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/526264394" status: 202 len: 0 microversion: 2.1 time: 0.043438 Oct 24 08:50:50.862213 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 6/8] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:50:50 2022] DELETE /compute/v2.1/flavors/526264394 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:50.870432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47070f53-170b-4013-9254-d501f4709ea8 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.875903 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99c9a6cd-e644-4631-8b4b-f268489ab9a6 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.032394 Oct 24 08:50:50.877418 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3/9] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:50.890684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41af8c1a-b8db-4430-bdf9-ce1276b98641 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:50.912474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41af8c1a-b8db-4430-bdf9-ce1276b98641 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.912917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41af8c1a-b8db-4430-bdf9-ce1276b98641 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.913985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41af8c1a-b8db-4430-bdf9-ce1276b98641 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.934299 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47070f53-170b-4013-9254-d501f4709ea8 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067729 Oct 24 08:50:50.935680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 7/10] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:51.365509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Calling method '.version_select at 0x7f8dac835310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:51.369427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.369866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.370296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.371012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.371456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.372131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.415221 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ee38752-5a7e-42e0-8317-88c6b86ceb25 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.477332 Oct 24 08:50:51.415796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 8/11] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:51.420288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aced35d6-e809-45a0-9693-2f14a24ae4de tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1451560761", "id": 330525, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:51.439798 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aced35d6-e809-45a0-9693-2f14a24ae4de tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.022756 Oct 24 08:50:51.440406 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 9/12] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:51 2022] POST /compute/v2.1/flavors => generated 417 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:51.634154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:51.637664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.638147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.638582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.639504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.639981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.640410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.669207 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7253a542-11cb-4d24-a721-65f81aa25907 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.227517 Oct 24 08:50:51.669820 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 10/13] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:51.762510 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41af8c1a-b8db-4430-bdf9-ce1276b98641 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.876867 Oct 24 08:50:51.763158 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4/14] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:50:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:51.806504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8dac80e4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:51.810711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.811192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.811624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.812513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.812973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.813424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.856756 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb36fe2d-f74e-41d3-9528-ab323d05d5e1 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.169044 Oct 24 08:50:51.856756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 11/15] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:51.946654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Calling method '.version_select at 0x7f8dabf85430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:51.950611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.951280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.951725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.970870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.971389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.971816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.983144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.983663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.984159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.991275 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8d2d3b6e-6bb3-4deb-8ddd-2e18d91cc08c tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.226642 Oct 24 08:50:51.992615 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 5/16] 10.222.0.25 () {60 vars in 1208 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:52.110717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8a16c10-53dc-4f8a-afc1-69b3bc8cc4d1 tempest-AZAdminNegativeTestJSON-1224667613 tempest-AZAdminNegativeTestJSON-1224667613-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.112217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c8a16c10-53dc-4f8a-afc1-69b3bc8cc4d1 tempest-AZAdminNegativeTestJSON-1224667613 tempest-AZAdminNegativeTestJSON-1224667613-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1efcace670dc4275a267b4eea407fe2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475f9813da214a4f8ae7513258868d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8a16c10-53dc-4f8a-afc1-69b3bc8cc4d1 tempest-AZAdminNegativeTestJSON-1224667613 tempest-AZAdminNegativeTestJSON-1224667613-project] Request method failure captured: Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHo3biLbVgQNAONgEhvcduIQ0dy4jneyVedk34xylBtATNtrTJEIvmiplpsJTVnv1dn6tJ30j-JHlmveHkDbdwCn1uxci1yRphqlOIe0er208J6JGVrOHwCSKEHhDlK4a5MtZSmq2tbLoXkgq3LlMF5Dq3pP4HPxgQxQxeJrKqED6c Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 475f9813da214a4f8ae7513258868d93 Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1224667613 Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:50:52.115705 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/475f9813da214a4f8ae7513258868d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_475f9813da214a4f8ae7513258868d93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/475f9813da214a4f8ae7513258868d93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/475f9813da214a4f8ae7513258868d93"}]}] Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AZAdminNegativeTestJSON-1224667613 Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 475f9813da214a4f8ae7513258868d93 Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1224667613 Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AZAdminNegativeTestJSON-1224667613-project Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1efcace670dc4275a267b4eea407fe2f Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AZAdminNegativeTestJSON-1224667613-project Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 24 08:50:52.117587 n-d-master-1 devstack@n-api.service[126919]: action_args: {} Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.118332 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.120210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8a16c10-53dc-4f8a-afc1-69b3bc8cc4d1 tempest-AZAdminNegativeTestJSON-1224667613 tempest-AZAdminNegativeTestJSON-1224667613-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.122570 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8a16c10-53dc-4f8a-afc1-69b3bc8cc4d1 tempest-AZAdminNegativeTestJSON-1224667613 tempest-AZAdminNegativeTestJSON-1224667613-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.275894 Oct 24 08:50:52.122570 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 12/17] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.124069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e4cd7712-38e8-4e0a-9d94-3ac1b668a9f8 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.143089 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e4cd7712-38e8-4e0a-9d94-3ac1b668a9f8 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/330525" status: 202 len: 0 microversion: 2.1 time: 0.023782 Oct 24 08:50:52.143819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 13/18] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:50:52 2022] DELETE /compute/v2.1/flavors/330525 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:52.149899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8dac7e8af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.154882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.155327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.155761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.156473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.156919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.157361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.181722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-177aca04-ec1b-4a0d-bfc9-7583b9fef602 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.036608 Oct 24 08:50:52.182325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 14/19] 10.222.0.25 () {58 vars in 1139 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:52.198212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-680a1808-a523-472a-adf7-5c82ed2a3da3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Calling method '.version_select at 0x7f8dabf854c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.201824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-680a1808-a523-472a-adf7-5c82ed2a3da3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'd948c144feed4b4baebaa31e67002d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573f5fcb0b84c6897e41f478d05286d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-680a1808-a523-472a-adf7-5c82ed2a3da3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Request method failure captured: Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo6meCBptV284K9F83-ixzTJvVlEwkJTVB-Qo8NhLCQvxVeK897rm4Xqqv1VawKOcQAg10NG-CnGKXtPnd8Itz3LgrxX8GyGmmo2EM4Qz-Yj8eKEqwhmWGoPGMXwKB1szqkFlYx3bQxgo2n9DOl-sueBKHAaC7P6cbwxTaJpTMoF0 Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:52.205605 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f573f5fcb0b84c6897e41f478d05286d"}]}] Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d948c144feed4b4baebaa31e67002d8a Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:50:52.206854 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.207555 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 24 08:50:52.213103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.214217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-680a1808-a523-472a-adf7-5c82ed2a3da3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.214217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-680a1808-a523-472a-adf7-5c82ed2a3da3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.213468 Oct 24 08:50:52.214217 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 6/20] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.215396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc97b662-a6e8-449f-b841-9ddabc8f9bc8 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.255636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc97b662-a6e8-449f-b841-9ddabc8f9bc8 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046137 Oct 24 08:50:52.256476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 7/21] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:52.261496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8dabf8f700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.264874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.265386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.265824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.266544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.266994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.267411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.300159 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70b7b224-68d7-4615-8ca1-525763130f95 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.042583 Oct 24 08:50:52.307096 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 8/22] 10.222.0.25 () {58 vars in 1145 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:50:52.311428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29ab8e42-b69f-4858-8820-5f3b2b0b8dfc tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Calling method '.version_select at 0x7f8dabef2c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.313635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29ab8e42-b69f-4858-8820-5f3b2b0b8dfc tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'd948c144feed4b4baebaa31e67002d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573f5fcb0b84c6897e41f478d05286d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29ab8e42-b69f-4858-8820-5f3b2b0b8dfc tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Request method failure captured: Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo6meCBptV284K9F83-ixzTJvVlEwkJTVB-Qo8NhLCQvxVeK897rm4Xqqv1VawKOcQAg10NG-CnGKXtPnd8Itz3LgrxX8GyGmmo2EM4Qz-Yj8eKEqwhmWGoPGMXwKB1szqkFlYx3bQxgo2n9DOl-sueBKHAaC7P6cbwxTaJpTMoF0 Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:52.315841 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f573f5fcb0b84c6897e41f478d05286d"}]}] Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d948c144feed4b4baebaa31e67002d8a Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1'} Oct 24 08:50:52.317273 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.318039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 24 08:50:52.318882 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.320145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29ab8e42-b69f-4858-8820-5f3b2b0b8dfc tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.320145 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29ab8e42-b69f-4858-8820-5f3b2b0b8dfc tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014772 Oct 24 08:50:52.320145 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 9/23] 10.222.0.25 () {58 vars in 1188 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.325533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1eb4d967-bb87-4e1a-b059-919742f1642a tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-113574332", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.356148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1eb4d967-bb87-4e1a-b059-919742f1642a tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.036915 Oct 24 08:50:52.357179 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 10/24] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:52 2022] POST /compute/v2.1/flavors => generated 506 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:52.361902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89b181b6-fb74-4e6c-bba6-52df4efea595 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Calling method '.version_select at 0x7f8dabef2a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.376868 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-89b181b6-fb74-4e6c-bba6-52df4efea595 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.378488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1202641873", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "availability_zone": "tempest-test_az-218391463"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89b181b6-fb74-4e6c-bba6-52df4efea595 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:52.382044 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'nonexistent_hostname'} Oct 24 08:50:52.383336 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:50:52.384060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 24 08:50:52.385123 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.386207 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.387550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89b181b6-fb74-4e6c-bba6-52df4efea595 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.388599 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89b181b6-fb74-4e6c-bba6-52df4efea595 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.030354 Oct 24 08:50:52.389285 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 11/25] 10.222.0.25 () {58 vars in 1212 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:50:52.393830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9113e4bb-61a4-45fb-aab8-81fbb9c37daa tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.407367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.407863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.408591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.409508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.410090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.410640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.425252 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9113e4bb-61a4-45fb-aab8-81fbb9c37daa tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/7814a424-affb-43d5-8aeb-ca5547b1cc7a" status: 202 len: 0 microversion: 2.1 time: 0.033680 Oct 24 08:50:52.426020 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 12/26] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:50:52 2022] DELETE /compute/v2.1/flavors/7814a424-affb-43d5-8aeb-ca5547b1cc7a => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:52.436924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3c21efe-9c1d-4285-a15d-c0ccb342dfc3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Calling method '.version_select at 0x7f8dabdad670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.439340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f3c21efe-9c1d-4285-a15d-c0ccb342dfc3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'd948c144feed4b4baebaa31e67002d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573f5fcb0b84c6897e41f478d05286d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3c21efe-9c1d-4285-a15d-c0ccb342dfc3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Request method failure captured: Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo6meCBptV284K9F83-ixzTJvVlEwkJTVB-Qo8NhLCQvxVeK897rm4Xqqv1VawKOcQAg10NG-CnGKXtPnd8Itz3LgrxX8GyGmmo2EM4Qz-Yj8eKEqwhmWGoPGMXwKB1szqkFlYx3bQxgo2n9DOl-sueBKHAaC7P6cbwxTaJpTMoF0 Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:52.441234 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f573f5fcb0b84c6897e41f478d05286d"}]}] Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d948c144feed4b4baebaa31e67002d8a Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1'} Oct 24 08:50:52.442864 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.443608 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 24 08:50:52.444834 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.450059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3c21efe-9c1d-4285-a15d-c0ccb342dfc3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.450059 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3c21efe-9c1d-4285-a15d-c0ccb342dfc3 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.017997 Oct 24 08:50:52.450059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.451525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89bb5d70-dbb4-40cb-ae24-69a4a341642d tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.479135 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89bb5d70-dbb4-40cb-ae24-69a4a341642d tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032201 Oct 24 08:50:52.480028 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:52.484305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9119944-7837-497e-abdc-abb73b8259a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Calling method '.version_select at 0x7f8dabdc35e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.490808 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e9119944-7837-497e-abdc-abb73b8259a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9119944-7837-497e-abdc-abb73b8259a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:52.492980 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'nonexistent_hostname'} Oct 24 08:50:52.494056 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.494693 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.495579 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.496453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9119944-7837-497e-abdc-abb73b8259a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.496453 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9119944-7837-497e-abdc-abb73b8259a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.013491 Oct 24 08:50:52.496453 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1191 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:50:52.502878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c396da22-88a0-4ffc-a836-15c8b67f57f4 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1799201749", "id": "c57f3204-34de-4d90-8f69-d08fe2149f23", "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.524529 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c396da22-88a0-4ffc-a836-15c8b67f57f4 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028604 Oct 24 08:50:52.526263 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 16/30] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:52 2022] POST /compute/v2.1/flavors => generated 507 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:52.531689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-66dda786-9a7f-4beb-bbc1-f625f6ba2578 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Calling method '.version_select at 0x7f8dabdad3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.534393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-66dda786-9a7f-4beb-bbc1-f625f6ba2578 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'd948c144feed4b4baebaa31e67002d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573f5fcb0b84c6897e41f478d05286d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-66dda786-9a7f-4beb-bbc1-f625f6ba2578 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Request method failure captured: Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo6meCBptV284K9F83-ixzTJvVlEwkJTVB-Qo8NhLCQvxVeK897rm4Xqqv1VawKOcQAg10NG-CnGKXtPnd8Itz3LgrxX8GyGmmo2EM4Qz-Yj8eKEqwhmWGoPGMXwKB1szqkFlYx3bQxgo2n9DOl-sueBKHAaC7P6cbwxTaJpTMoF0 Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:52.536251 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f573f5fcb0b84c6897e41f478d05286d"}]}] Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d948c144feed4b4baebaa31e67002d8a Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1'} Oct 24 08:50:52.537463 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.538200 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 24 08:50:52.539282 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.540187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-66dda786-9a7f-4beb-bbc1-f625f6ba2578 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.540187 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-66dda786-9a7f-4beb-bbc1-f625f6ba2578 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011691 Oct 24 08:50:52.540187 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 17/31] 10.222.0.25 () {58 vars in 1194 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.545574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d0b14db-ef02-40cc-a4e1-1cad8c42c808 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.566905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d0b14db-ef02-40cc-a4e1-1cad8c42c808 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/c57f3204-34de-4d90-8f69-d08fe2149f23" status: 202 len: 0 microversion: 2.1 time: 0.024556 Oct 24 08:50:52.567813 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 18/32] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:50:52 2022] DELETE /compute/v2.1/flavors/c57f3204-34de-4d90-8f69-d08fe2149f23 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:52.575050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-838044c4-8166-4bb6-98ae-fb210c291d75 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Calling method '.version_select at 0x7f8dabdc3160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.584173 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-838044c4-8166-4bb6-98ae-fb210c291d75 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-838044c4-8166-4bb6-98ae-fb210c291d75 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:52.586721 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'nonexistent_hostname'} Oct 24 08:50:52.587906 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:50:52.592679 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 24 08:50:52.593867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-838044c4-8166-4bb6-98ae-fb210c291d75 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-838044c4-8166-4bb6-98ae-fb210c291d75 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017733 Oct 24 08:50:52.594936 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 19/33] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:50:52.595838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-285c4656-707c-4a56-b4e7-ac66c6b7bb47 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.616156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-285c4656-707c-4a56-b4e7-ac66c6b7bb47 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026176 Oct 24 08:50:52.617620 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 20/34] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:52.622392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2654e8eb-09cb-483a-bab0-c5bca00ba38d tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Calling method '.version_select at 0x7f8dabdadaf0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.624186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2654e8eb-09cb-483a-bab0-c5bca00ba38d tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'd948c144feed4b4baebaa31e67002d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573f5fcb0b84c6897e41f478d05286d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2654e8eb-09cb-483a-bab0-c5bca00ba38d tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Request method failure captured: Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo6meCBptV284K9F83-ixzTJvVlEwkJTVB-Qo8NhLCQvxVeK897rm4Xqqv1VawKOcQAg10NG-CnGKXtPnd8Itz3LgrxX8GyGmmo2EM4Qz-Yj8eKEqwhmWGoPGMXwKB1szqkFlYx3bQxgo2n9DOl-sueBKHAaC7P6cbwxTaJpTMoF0 Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:52.625660 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f573f5fcb0b84c6897e41f478d05286d"}]}] Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d948c144feed4b4baebaa31e67002d8a Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1'} Oct 24 08:50:52.626930 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.629502 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 24 08:50:52.630604 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.631542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2654e8eb-09cb-483a-bab0-c5bca00ba38d tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.631542 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2654e8eb-09cb-483a-bab0-c5bca00ba38d tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008582 Oct 24 08:50:52.631542 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 21/35] 10.222.0.25 () {58 vars in 1191 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.641235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dab6161-7189-42f1-a009-7560202880c7 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Calling method '.version_select at 0x7f8dabdc3b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.651676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-4dab6161-7189-42f1-a009-7560202880c7 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dab6161-7189-42f1-a009-7560202880c7 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:52.653364 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'nonexistent_hostname'} Oct 24 08:50:52.654406 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:50:52.655019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 24 08:50:52.655899 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dab6161-7189-42f1-a009-7560202880c7 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4dab6161-7189-42f1-a009-7560202880c7 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017576 Oct 24 08:50:52.656774 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 22/36] 10.222.0.25 () {58 vars in 1215 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:50:52.663099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8449293-b1e6-4008-9672-c44a66beb9d9 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-834126878", "id": 810169940, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.685611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8449293-b1e6-4008-9672-c44a66beb9d9 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.029372 Oct 24 08:50:52.686556 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 23/37] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:52 2022] POST /compute/v2.1/flavors => generated 410 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:52.691231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc9253b9-3100-4629-8b1e-7ea7024e7217 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabdadaf0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc9253b9-3100-4629-8b1e-7ea7024e7217 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 51 Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:52.695789 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: {"status": "enable", "maintenance_mode": "invalid"} Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.697096 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'disable', Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'Enable', Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'Disable', Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance: Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.697865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.699389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc9253b9-3100-4629-8b1e-7ea7024e7217 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc9253b9-3100-4629-8b1e-7ea7024e7217 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.009363 Oct 24 08:50:52.700265 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 24/38] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:50:52 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:50:52.703433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-863b0573-ad0a-4f34-ae30-2bf89ff566a0 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.717558 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-863b0573-ad0a-4f34-ae30-2bf89ff566a0 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/810169940" status: 200 len: 410 microversion: 2.1 time: 0.018798 Oct 24 08:50:52.718122 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 25/39] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/flavors/810169940 => generated 410 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:52.722815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7c09cc8-d8cd-4cfe-bfc4-0c088171d4cc tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabdcd790>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7c09cc8-d8cd-4cfe-bfc4-0c088171d4cc tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 51 Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:52.727234 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: {"status": "invalid", "maintenance_mode": "enable"} Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.728537 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'disable', Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'Enable', Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'Disable', Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance: Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.729238 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.730731 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7c09cc8-d8cd-4cfe-bfc4-0c088171d4cc tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7c09cc8-d8cd-4cfe-bfc4-0c088171d4cc tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.009384 Oct 24 08:50:52.731587 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 26/40] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:50:52 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:50:52.893450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3869246-d941-4227-affa-d567de6ac2a8 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.941163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:50:52.948190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3869246-d941-4227-affa-d567de6ac2a8 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.218027 Oct 24 08:50:52.949171 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 27/41] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:52.954015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41310a87-f61e-4179-9181-699a8fa9f8d2 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Action: 'update', calling method: .version_select at 0x7f8dabdad820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:52.957832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41310a87-f61e-4179-9181-699a8fa9f8d2 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'd948c144feed4b4baebaa31e67002d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573f5fcb0b84c6897e41f478d05286d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41310a87-f61e-4179-9181-699a8fa9f8d2 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Request method failure captured: Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 50 Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo6meCBptV284K9F83-ixzTJvVlEwkJTVB-Qo8NhLCQvxVeK897rm4Xqqv1VawKOcQAg10NG-CnGKXtPnd8Itz3LgrxX8GyGmmo2EM4Qz-Yj8eKEqwhmWGoPGMXwKB1szqkFlYx3bQxgo2n9DOl-sueBKHAaC7P6cbwxTaJpTMoF0 Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:52.959672 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f573f5fcb0b84c6897e41f478d05286d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f573f5fcb0b84c6897e41f478d05286d"}]}] Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f573f5fcb0b84c6897e41f478d05286d Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031135330 Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d948c144feed4b4baebaa31e67002d8a Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031135330-project Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: {"status": "enable", "maintenance_mode": "enable"} Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 24 08:50:52.961056 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:52.962006 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 24 08:50:52.963161 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:52.964369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41310a87-f61e-4179-9181-699a8fa9f8d2 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:52.964369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41310a87-f61e-4179-9181-699a8fa9f8d2 tempest-HostsAdminNegativeTestJSON-2031135330 tempest-HostsAdminNegativeTestJSON-2031135330-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.012323 Oct 24 08:50:52.965123 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 28/42] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:50:52 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:52.971211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8aa7d17a-de5a-4768-8e7f-28d97da18fe7 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.991628 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8aa7d17a-de5a-4768-8e7f-28d97da18fe7 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/810169940" status: 202 len: 0 microversion: 2.1 time: 0.025209 Oct 24 08:50:52.993185 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 29/43] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:50:52 2022] DELETE /compute/v2.1/flavors/810169940 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:52.998462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ba6ffaa-c8ba-4036-b955-e7666c06c50d tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabde90d0>, body: {"status": null, "maintenance_mode": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ba6ffaa-c8ba-4036-b955-e7666c06c50d tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 42 Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:53.002908 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: {"status": null, "maintenance_mode": null} Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 24 08:50:53.004185 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'disable', Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'Enable', Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'Disable', Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance: Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi None Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:53.005039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:53.006401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:53.007448 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:50:53.007448 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:50:53.007448 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 24 08:50:53.007448 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.008379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ba6ffaa-c8ba-4036-b955-e7666c06c50d tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:53.009887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ba6ffaa-c8ba-4036-b955-e7666c06c50d tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.015583 Oct 24 08:50:53.010581 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 30/44] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:50:52 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:50:53.017383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5a6f63ae-a775-4083-832c-b3a41c2e2c2d tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.041220 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5a6f63ae-a775-4083-832c-b3a41c2e2c2d tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029432 Oct 24 08:50:53.042148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 31/45] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:53.047070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28c0a8e3-d446-4c33-abb0-059dfaf0b8a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabdcd280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.050627 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.hosts [None req-28c0a8e3-d446-4c33-abb0-059dfaf0b8a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Enabling host nonexistent_hostname. Oct 24 08:50:53.061920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-28c0a8e3-d446-4c33-abb0-059dfaf0b8a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28c0a8e3-d446-4c33-abb0-059dfaf0b8a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Request method failure captured: Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 50 Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqyLf4Uuepk3fMVOKOQQtxv7ocIE-dcCdK_Uvp-BrWaN4JDt20hVUsL_Rdm2_b7Ktyw99jqy2KXHiE6JE2zglt4CabnvHN0KKOPttmuQMVuvU91DQJOpsP34_mEUF2EhLg3FR4ykA7Gx51CYnuAxjpjlWLvvKxz0s0GCnLphrQ6sM Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:50:53.063682 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70e959422a934c69aefb8c6edfacd871"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70e959422a934c69aefb8c6edfacd871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70e959422a934c69aefb8c6edfacd871"}]}] Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 70e959422a934c69aefb8c6edfacd871 Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1856990933 Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f22d1fba646142e7b7f376a939e57b69 Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1856990933-project-admin Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: {"status": "enable", "maintenance_mode": "enable"} Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:53.064764 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:50:53.065503 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:53.072087 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.073718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28c0a8e3-d446-4c33-abb0-059dfaf0b8a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:53.074698 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28c0a8e3-d446-4c33-abb0-059dfaf0b8a5 tempest-HostsAdminNegativeTestJSON-1856990933 tempest-HostsAdminNegativeTestJSON-1856990933-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021972 Oct 24 08:50:53.074698 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 32/46] 10.222.0.25 () {60 vars in 1211 bytes} [Mon Oct 24 08:50:53 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:50:53.074698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72544c27-6faf-4b99-802e-5357031139af tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1460805886", "id": 1686978748, "os-flavor-access:is_public": "False"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.113717 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72544c27-6faf-4b99-802e-5357031139af tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.045407 Oct 24 08:50:53.114532 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 33/47] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:53.139884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19f2ba71-9193-49c3-9c66-5fd536f48ea4 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "1686978748"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.182209 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-19f2ba71-9193-49c3-9c66-5fd536f48ea4 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] HTTP exception thrown: Flavor 1686978748 could not be found. Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19f2ba71-9193-49c3-9c66-5fd536f48ea4 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] Request method failure captured: Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 107 Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHnevv9hcdj67-xIForZQHzf2AnPlA-AWKU5kcZZW_f93_2V4ffYk3LrBoJtlGF905xq5ilnYuTbNvCaaOEC3HpCOFx-hFjzIR0SgKqLhtPZc57C9CnE8THecBb3lhauNXI0EskFg3zoD55uli4T9-8cvmpsttk3YsHRFWGP5FTkNc Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7784f0dfd226407cbb3bc67566ccedf5 Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsAdminTestJSON-439253091 Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:50:53.186571 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7784f0dfd226407cbb3bc67566ccedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7784f0dfd226407cbb3bc67566ccedf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7784f0dfd226407cbb3bc67566ccedf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7784f0dfd226407cbb3bc67566ccedf5"}]}] Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsAdminTestJSON-439253091 Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7784f0dfd226407cbb3bc67566ccedf5 Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-439253091 Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsAdminTestJSON-439253091-project Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 78b4383266414cb69102b500917782d5 Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsAdminTestJSON-439253091-project Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "test", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "1686978748"}} Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:50:53.187715 n-d-master-1 devstack@n-api.service[126920]: exception: Flavor 1686978748 could not be found. Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '1686978748'}}} Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1686978748 could not be found. Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.188351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1686978748 could not be found. Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:53.189359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:53.190368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:53.190368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:53.190368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:53.190368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1686978748 could not be found. Oct 24 08:50:53.190368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:50:53.191991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19f2ba71-9193-49c3-9c66-5fd536f48ea4 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] Returning 400 to user: Flavor 1686978748 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:53.193244 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19f2ba71-9193-49c3-9c66-5fd536f48ea4 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.069494 Oct 24 08:50:53.194461 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 34/48] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:53 2022] POST /compute/v2.1/servers => generated 81 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 24 08:50:53.204852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-153b0d44-da4e-464d-9be6-5b835f3d2410 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.215797 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=11 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:53.231814 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-153b0d44-da4e-464d-9be6-5b835f3d2410 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1686978748" status: 202 len: 0 microversion: 2.1 time: 0.030723 Oct 24 08:50:53.236799 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 35/49] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:50:53 2022] DELETE /compute/v2.1/flavors/1686978748 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:50:53.247136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f184762f-1310-4386-87e8-60f4eeaa9118 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.270435 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f184762f-1310-4386-87e8-60f4eeaa9118 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032129 Oct 24 08:50:53.272132 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 36/50] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:53.295594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b344cde-60a5-41b8-88de-11048c2e6b5f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-801359746", "id": 1352122860, "os-flavor-access:is_public": "False"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.318745 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b344cde-60a5-41b8-88de-11048c2e6b5f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028274 Oct 24 08:50:53.319901 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 37/51] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:53 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:53.333620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c96b98ac-5350-48cb-aec6-88554f9298d4 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-477554959", "id": 267941518, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.358844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c96b98ac-5350-48cb-aec6-88554f9298d4 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.029455 Oct 24 08:50:53.367689 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 38/52] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:53 2022] POST /compute/v2.1/flavors => generated 410 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:53.374489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6da6099d-a28b-4d5e-be39-e5c1cdaeea6f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.421502 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6da6099d-a28b-4d5e-be39-e5c1cdaeea6f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.050103 Oct 24 08:50:53.425737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 39/53] 10.222.0.25 () {58 vars in 1169 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:53.446889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23f50707-5c81-4779-87c0-55912ed344cf tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.458312 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23f50707-5c81-4779-87c0-55912ed344cf tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.015462 Oct 24 08:50:53.459228 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 40/54] 10.222.0.25 () {58 vars in 1177 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:53.465167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:50:53.465755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:50:53.466402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:50:53.467291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:50:53.467856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:50:53.475099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1cd9840e-19ce-4315-a8fa-23ce3425ec03 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.485986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:53.486811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:53.487501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:53.488390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:53.488850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:53.489125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1cd9840e-19ce-4315-a8fa-23ce3425ec03 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.018412 Oct 24 08:50:53.489282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:53.489919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 41/55] 10.222.0.25 () {58 vars in 1171 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:53.506421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b03a18d9-5ba3-499d-bc36-d61ea9f1686b tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.516829 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b03a18d9-5ba3-499d-bc36-d61ea9f1686b tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.014086 Oct 24 08:50:53.522723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 42/56] 10.222.0.25 () {58 vars in 1169 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:53.527151 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Getting quotas for project b6c53bdfc24c4cb0a6c9b02779cc7d62. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:50:53.536892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f8fe9a5-6ed8-45d5-a0c0-5cb1c34e75cf tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.537807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Getting quotas for user f8347b4e37424f499f5756ca8b88fab4 and project b6c53bdfc24c4cb0a6c9b02779cc7d62. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:50:53.555238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:50:53.558576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:50:53.560497 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f8fe9a5-6ed8-45d5-a0c0-5cb1c34e75cf tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.027462 Oct 24 08:50:53.573886 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 43/57] 10.222.0.25 () {58 vars in 1169 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:53.583338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b40ecb75-8030-43ee-b3ec-dabfb4f7c410 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.607967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b40ecb75-8030-43ee-b3ec-dabfb4f7c410 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.028837 Oct 24 08:50:53.613446 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 44/58] 10.222.0.25 () {58 vars in 1175 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:53.627997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2648f3b-6138-4956-991b-54325a818fe4 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.646959 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60ced848-8d53-4fa1-b5b1-ff2e7fdc0436 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463103 Oct 24 08:50:53.653686 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2648f3b-6138-4956-991b-54325a818fe4 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.026687 Oct 24 08:50:53.653686 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 45/59] 10.222.0.25 () {58 vars in 1173 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:53.654867 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 15/60] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:50:53.672084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63be279d-7ca6-4f9b-b4ba-b77174fca2c1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.673230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63be279d-7ca6-4f9b-b4ba-b77174fca2c1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:53.674922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b79c0ef3-f213-4376-ad78-89de017a5b59 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.740213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b79c0ef3-f213-4376-ad78-89de017a5b59 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.071197 Oct 24 08:50:53.754073 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 16/61] 10.222.0.25 () {58 vars in 1169 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:53.763723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac0eee24-daac-451c-8286-ae65f3b17961 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.785112 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac0eee24-daac-451c-8286-ae65f3b17961 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/267941518" status: 202 len: 0 microversion: 2.1 time: 0.024293 Oct 24 08:50:53.789433 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 17/62] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:50:53 2022] DELETE /compute/v2.1/flavors/267941518 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:50:53.799260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-703a4ec5-1f42-4225-b0f4-2961ff704977 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.833781 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-703a4ec5-1f42-4225-b0f4-2961ff704977 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042958 Oct 24 08:50:53.835862 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 18/63] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:53.859811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f042a990-fc02-450a-abf6-e78547637552 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.884946 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f042a990-fc02-450a-abf6-e78547637552 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1352122860" status: 202 len: 0 microversion: 2.1 time: 0.031801 Oct 24 08:50:53.886273 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 19/64] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:50:53 2022] DELETE /compute/v2.1/flavors/1352122860 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:53.896011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-70dbe410-930e-45b5-9aa7-0204b40b82cf tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:53.947105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-70dbe410-930e-45b5-9aa7-0204b40b82cf tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056169 Oct 24 08:50:53.949526 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 20/65] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:53.983725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4006995b-beb6-4c50-8284-a38c464f4069 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-159226641", "id": 2109414266, "os-flavor-access:is_public": "False"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:54.018201 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4006995b-beb6-4c50-8284-a38c464f4069 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.049863 Oct 24 08:50:54.019476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 21/66] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:53 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:54.035714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-665dda06-ecec-4952-9a6e-8c144b7ad891 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.063865 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:DELETE=15 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:54.073081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-665dda06-ecec-4952-9a6e-8c144b7ad891 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045530 Oct 24 08:50:54.074504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 22/67] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:54.100567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1fc79440-18ce-4b80-8eaa-0a19feeefddb tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.167841 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1fc79440-18ce-4b80-8eaa-0a19feeefddb tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071585 Oct 24 08:50:54.168463 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 23/68] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:54.191746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c508d1e-aac1-44f9-be35-1426bece753a tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.234199 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c508d1e-aac1-44f9-be35-1426bece753a tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2109414266" status: 202 len: 0 microversion: 2.1 time: 0.051196 Oct 24 08:50:54.235109 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 24/69] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:50:54 2022] DELETE /compute/v2.1/flavors/2109414266 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:50:54.243372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5645dd2e-08b5-4b20-9f52-a8b30b6d9c36 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.274540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5645dd2e-08b5-4b20-9f52-a8b30b6d9c36 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034873 Oct 24 08:50:54.278417 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 25/70] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:54.295740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8954d08a-a573-4e23-9339-ea22b27e3940 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1221716278", "id": 621227639, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:54.322029 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8954d08a-a573-4e23-9339-ea22b27e3940 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028775 Oct 24 08:50:54.330523 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 26/71] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:54 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:54.343607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0485375-2238-4bdc-b7de-26923b924811 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.380248 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0485375-2238-4bdc-b7de-26923b924811 tempest-FlavorsAdminTestJSON-439253091 tempest-FlavorsAdminTestJSON-439253091-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.045189 Oct 24 08:50:54.402274 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 27/72] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:54.411535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4d3a253-e4b9-4824-bdeb-ba70bede6e86 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.435047 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4d3a253-e4b9-4824-bdeb-ba70bede6e86 tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/621227639" status: 202 len: 0 microversion: 2.1 time: 0.031556 Oct 24 08:50:54.437022 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 28/73] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:50:54 2022] DELETE /compute/v2.1/flavors/621227639 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:54.446256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e218f3a7-e295-4213-88fc-0f8b4efa2c2f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.478850 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e218f3a7-e295-4213-88fc-0f8b4efa2c2f tempest-FlavorsAdminTestJSON-1873600308 tempest-FlavorsAdminTestJSON-1873600308-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037741 Oct 24 08:50:54.479898 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 29/74] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:54.509902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63be279d-7ca6-4f9b-b4ba-b77174fca2c1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:54.535057 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63be279d-7ca6-4f9b-b4ba-b77174fca2c1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1242 microversion: 2.1 time: 0.866748 Oct 24 08:50:54.550129 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 46/75] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:53 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1242 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:55.032365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-370364217", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:55.120060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:50:55.470792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:50:55.471878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:50:55.473150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:50:55.474453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:50:55.475239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:50:55.488765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.489442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.489952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.491005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.492855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.493555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.543384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Getting quotas for project 3d7b9d4b5ef5454fbed4733abbd15bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:50:55.548197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Getting quotas for user 327f1d46d859423982fab017258b9ada and project 3d7b9d4b5ef5454fbed4733abbd15bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:50:55.563427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:55.564565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:55.567404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:50:55.570279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:50:55.577532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.578033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.578606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.579945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.581204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.581754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.649217 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b3d9cf5-212b-4987-abf2-28f22d589902 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969817 Oct 24 08:50:55.650245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 30/76] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:50:55.663723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c49f5176-070c-47c8-9edc-dc5a6a178873 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:55.664455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c49f5176-070c-47c8-9edc-dc5a6a178873 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:55.855963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:55.882747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c49f5176-070c-47c8-9edc-dc5a6a178873 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:55.898085 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d197976-492d-4d23-bc83-10e54621e184 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1290 microversion: 2.1 time: 0.339185 Oct 24 08:50:55.913979 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 47/77] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:55 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1290 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:55.926426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c49f5176-070c-47c8-9edc-dc5a6a178873 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1219 microversion: 2.1 time: 0.268126 Oct 24 08:50:55.926944 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 31/78] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:55 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1219 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:56.925585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:56.927002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:56.934506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.935253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.935763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.936461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.937220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.937732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.953615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:56.954233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:56.976314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.980848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.981801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.982717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.983321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.983891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:57.103220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:57.123504 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c48d183-f81e-48da-94f1-1c36d8529ee1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1296 microversion: 2.1 time: 0.201496 Oct 24 08:50:57.132227 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 48/79] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:56 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1296 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:57.203682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:57.229115 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-306b8d94-2b3b-416c-9257-8736ba218c2e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1215 microversion: 2.1 time: 0.279200 Oct 24 08:50:57.229971 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 32/80] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:56 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:57.457911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfca626b-1afa-4963-9615-4e5b51176854 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2137992323", "id": 1594640093, "os-flavor-access:is_public": "False"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:57.497257 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfca626b-1afa-4963-9615-4e5b51176854 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.363310 Oct 24 08:50:57.509129 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 49/81] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:57 2022] POST /compute/v2.1/flavors => generated 431 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:57.538776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c6b9d0a-4b00-4b68-add3-d6de05bd4113 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6138e94ecf2a46ea84c5348af3c7e628"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:58.150015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:58.150848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:58.159403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:58.160082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:58.160692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:58.161638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:58.162271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:58.162921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:58.503381 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c6b9d0a-4b00-4b68-add3-d6de05bd4113 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1594640093/action" status: 200 len: 97 microversion: 2.1 time: 0.971225 Oct 24 08:50:58.510383 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 33/82] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:50:57 2022] POST /compute/v2.1/flavors/1594640093/action => generated 97 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:50:58.539316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:58.540332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:58.541002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:58.549880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:58.550805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:58.551988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:58.553271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:58.558676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35860ee3-ddec-4f99-a99e-ec63836406b5 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.412214 Oct 24 08:50:58.560235 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 50/83] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:58 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:58.565089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:58.565972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:58.754136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:58.775074 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b5231cbf-7d05-4292-a736-cba91d19d471 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1277 microversion: 2.1 time: 0.251337 Oct 24 08:50:58.776365 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 34/84] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:58 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:59.212316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-345eceac-c074-41b9-b63f-aaea5dc264ec tempest-FlavorsAccessTestJSON-217702422 tempest-FlavorsAccessTestJSON-217702422-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:59.273804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-345eceac-c074-41b9-b63f-aaea5dc264ec tempest-FlavorsAccessTestJSON-217702422 tempest-FlavorsAccessTestJSON-217702422-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.710378 Oct 24 08:50:59.276099 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 51/85] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:50:58 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:59.302416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34d4ca34-a248-4da7-bc89-71858bc302ef tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6138e94ecf2a46ea84c5348af3c7e628"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:59.586394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:59.587502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:59.604991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:59.606566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:59.611955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:59.614516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:59.615842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:59.617325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:59.911643 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34d4ca34-a248-4da7-bc89-71858bc302ef tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1594640093/action" status: 200 len: 21 microversion: 2.1 time: 0.613607 Oct 24 08:50:59.918233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 35/86] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:50:59 2022] POST /compute/v2.1/flavors/1594640093/action => generated 21 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:50:59.941773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:59.943279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:59.962391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:59.964396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:59.966417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:59.969986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:59.970924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:59.972486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:00.135369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:00.154406 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ead466b-dd18-4b8e-ab02-5f3638f5bbb4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1277 microversion: 2.1 time: 0.229928 Oct 24 08:51:00.170311 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 36/87] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:59 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:00.176047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47760324-9b2b-4697-bd69-17f17e4c4a9f tempest-FlavorsAccessTestJSON-217702422 tempest-FlavorsAccessTestJSON-217702422-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.210807 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47760324-9b2b-4697-bd69-17f17e4c4a9f tempest-FlavorsAccessTestJSON-217702422 tempest-FlavorsAccessTestJSON-217702422-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039242 Oct 24 08:51:00.211419 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 37/88] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:00.234051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20e15f9e-2234-40e5-a5ae-9f43a9d122f6 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.261047 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20e15f9e-2234-40e5-a5ae-9f43a9d122f6 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1594640093" status: 202 len: 0 microversion: 2.1 time: 0.032022 Oct 24 08:51:00.265482 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 38/89] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:51:00 2022] DELETE /compute/v2.1/flavors/1594640093 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:00.306614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-efe85b7a-1893-451a-ba94-9000716742db tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.365480 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-efe85b7a-1893-451a-ba94-9000716742db tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072468 Oct 24 08:51:00.378596 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 39/90] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:00.390122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3b9b6ba-f296-42b4-9901-e630695a6f50 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1834934820", "id": 1298776988, "os-flavor-access:is_public": "False"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:00.419789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3b9b6ba-f296-42b4-9901-e630695a6f50 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.032517 Oct 24 08:51:00.422484 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 40/91] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:00 2022] POST /compute/v2.1/flavors => generated 431 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:00.443524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83a88fca-8acb-4ad2-9d1c-750ed8be87ba tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.495303 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83a88fca-8acb-4ad2-9d1c-750ed8be87ba tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1298776988/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.060846 Oct 24 08:51:00.502143 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 41/92] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 08:51:00 2022] GET /compute/v2.1/flavors/1298776988/os-flavor-access => generated 21 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:00.509117 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a257e6f-a35b-4550-8006-285056ccf1c3 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.561673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a257e6f-a35b-4550-8006-285056ccf1c3 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1298776988" status: 202 len: 0 microversion: 2.1 time: 0.058170 Oct 24 08:51:00.562397 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 42/93] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:51:00 2022] DELETE /compute/v2.1/flavors/1298776988 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:00.579765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b22860a9-6bc5-4c78-b689-89bfdd085b26 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.606878 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b22860a9-6bc5-4c78-b689-89bfdd085b26 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038795 Oct 24 08:51:00.623342 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 43/94] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:00.733554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:00.750396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4b58341-42ae-448f-92c5-387b44dfdeba tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 1.168024 Oct 24 08:51:00.755088 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 52/95] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:59 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:01.089857 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Calling method '.version_select at 0x7f8dabe0e430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:01.101575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=126919) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 24 08:51:01.103667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.104375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.108966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.182676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:01.183295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:01.192552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.194829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.196523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.198844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.202768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.206915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.211647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.215031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.218152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.248644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.249907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.250611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.266582 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86115d1a-ef33-48b5-b5a0-afe6a1d71930 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.641357 Oct 24 08:51:01.280473 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 44/96] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:01.862941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:01.888958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f4f9587-4389-4b07-a9fc-3fdca8e00fd1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.707914 Oct 24 08:51:01.891339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 53/97] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:01 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:01.900290 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:01.902643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:01.930840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.933166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.936343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.938741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.939416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.942504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.083740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f06aba02-fab4-441c-9234-4dea2acd91cf tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Calling method '.version_select at 0x7f8dabdd85e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:02.088417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f06aba02-fab4-441c-9234-4dea2acd91cf tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b945314dc73b4bd2a5b29cbfccd55ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5dfa9d66ac747138d412e0f39f59ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f06aba02-fab4-441c-9234-4dea2acd91cf tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Request method failure captured: Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/n-h2-master-1/search HTTP/1.1 Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHykBIxaxbMYjQ-NveKjSPXcquzDfUFLZW95ZAHB4O8G0bd1NizphsQz9pGUu4gXmr7pt8rw2T9af3Ug6aJRKVHOHh9wRL6-yE-gkdURouTqrp00nH9WN4kclz8o73fXxOcmwlABHzUM_UTRgPyfsjM41-MMWyR6bl3fCwSPpgWjNU Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b5dfa9d66ac747138d412e0f39f59ab6 Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1060855516 Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:02.095706 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5dfa9d66ac747138d412e0f39f59ab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5dfa9d66ac747138d412e0f39f59ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5dfa9d66ac747138d412e0f39f59ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5dfa9d66ac747138d412e0f39f59ab6"}]}] Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1060855516 Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b5dfa9d66ac747138d412e0f39f59ab6 Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1060855516 Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b945314dc73b4bd2a5b29cbfccd55ef7 Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 24 08:51:02.097670 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'n-h2-master-1'} Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:02.098463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 24 08:51:02.099627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.108590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f06aba02-fab4-441c-9234-4dea2acd91cf tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:02.109931 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f06aba02-fab4-441c-9234-4dea2acd91cf tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.822558 Oct 24 08:51:02.115704 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 45/98] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 08:51:01 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 117 bytes in 829 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:02.131365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Calling method '.version_select at 0x7f8dabd8d5e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:02.140484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.140947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.154005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.210490 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Request method failure captured: Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlH0Xcd0od_HvBmWQdyHK9U_i79CxxlBA2DCMGrKxufD-t3nGSauN67JObwq0a7P7puoaG_CiN03mEQN3_LC3UVVZzOf-WHlwlXSl-EZ1omH7MwFNci_xg-cTjFiWq4g1sRG8a9Wy8MtOg4SYz3-gagPX9voBdZQpDOGX2lr7DmzjNs Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 9869c04401ed46e186ea0c8b6a20dc2a Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-651653597 Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:02.212238 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9869c04401ed46e186ea0c8b6a20dc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9869c04401ed46e186ea0c8b6a20dc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9869c04401ed46e186ea0c8b6a20dc2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9869c04401ed46e186ea0c8b6a20dc2a"}]}] Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-651653597 Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 9869c04401ed46e186ea0c8b6a20dc2a Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-651653597 Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4b7e283469f54398957ef3c261ebf9fa Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 08:51:02.213417 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.214077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e98c8f52-6093-456b-9ab0-426c48a2e33c tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.096426 Oct 24 08:51:02.216344 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 46/99] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 08:51:02 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:02.233127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Calling method '.version_select at 0x7f8dabd8d8b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:02.235016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.235769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.236385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.252380 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:02.259266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.260590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.261528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.275551 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:02.313778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.314687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.315556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.348509 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01bb6f73-4b1d-4468-8621-e483bfcc7b03 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.113957 Oct 24 08:51:02.351430 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 47/100] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:02.375047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f9b9501-234b-4717-8f66-054a410ba5b4 tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Calling method '.version_select at 0x7f8dabd3f430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:02.383138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f9b9501-234b-4717-8f66-054a410ba5b4 tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b945314dc73b4bd2a5b29cbfccd55ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5dfa9d66ac747138d412e0f39f59ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f9b9501-234b-4717-8f66-054a410ba5b4 tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Request method failure captured: Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHykBIxaxbMYjQ-NveKjSPXcquzDfUFLZW95ZAHB4O8G0bd1NizphsQz9pGUu4gXmr7pt8rw2T9af3Ug6aJRKVHOHh9wRL6-yE-gkdURouTqrp00nH9WN4kclz8o73fXxOcmwlABHzUM_UTRgPyfsjM41-MMWyR6bl3fCwSPpgWjNU Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b5dfa9d66ac747138d412e0f39f59ab6 Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1060855516 Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:02.394644 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5dfa9d66ac747138d412e0f39f59ab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5dfa9d66ac747138d412e0f39f59ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5dfa9d66ac747138d412e0f39f59ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5dfa9d66ac747138d412e0f39f59ab6"}]}] Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1060855516 Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b5dfa9d66ac747138d412e0f39f59ab6 Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1060855516 Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b945314dc73b4bd2a5b29cbfccd55ef7 Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 24 08:51:02.396027 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1'} Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:02.396813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 24 08:51:02.398493 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.405787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f9b9501-234b-4717-8f66-054a410ba5b4 tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:02.411507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f9b9501-234b-4717-8f66-054a410ba5b4 tempest-HypervisorAdminNegativeUnderV252Test-1060855516 tempest-HypervisorAdminNegativeUnderV252Test-1060855516-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.046577 Oct 24 08:51:02.422647 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 48/101] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 08:51:02 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:02.439152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Calling method '.version_select at 0x7f8dabd3fd30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:02.446635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.447788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.452695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.487179 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] HTTP exception thrown: No hypervisor matching '64982f62-f177-4f1b-8222-2977255f6d7f' could be found. Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Request method failure captured: Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/64982f62-f177-4f1b-8222-2977255f6d7f/servers HTTP/1.1 Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlH0Xcd0od_HvBmWQdyHK9U_i79CxxlBA2DCMGrKxufD-t3nGSauN67JObwq0a7P7puoaG_CiN03mEQN3_LC3UVVZzOf-WHlwlXSl-EZ1omH7MwFNci_xg-cTjFiWq4g1sRG8a9Wy8MtOg4SYz3-gagPX9voBdZQpDOGX2lr7DmzjNs Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 9869c04401ed46e186ea0c8b6a20dc2a Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-651653597 Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:02.489583 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9869c04401ed46e186ea0c8b6a20dc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9869c04401ed46e186ea0c8b6a20dc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9869c04401ed46e186ea0c8b6a20dc2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9869c04401ed46e186ea0c8b6a20dc2a"}]}] Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-651653597 Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 9869c04401ed46e186ea0c8b6a20dc2a Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-651653597 Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4b7e283469f54398957ef3c261ebf9fa Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: exception: No hypervisor matching '64982f62-f177-4f1b-8222-2977255f6d7f' could be found. Oct 24 08:51:02.490688 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '64982f62-f177-4f1b-8222-2977255f6d7f'} Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '64982f62-f177-4f1b-8222-2977255f6d7f' could be found. Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.491864 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '64982f62-f177-4f1b-8222-2977255f6d7f' could be found. Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:02.492806 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] Returning 404 to user: No hypervisor matching '64982f62-f177-4f1b-8222-2977255f6d7f' could be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:02.493479 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-377bf2f5-b839-49dc-a2b6-1c595eff8323 tempest-HypervisorAdminNegativeUnderV252Test-651653597 tempest-HypervisorAdminNegativeUnderV252Test-651653597-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/64982f62-f177-4f1b-8222-2977255f6d7f/servers" status: 404 len: 123 microversion: 2.1 time: 0.065722 Oct 24 08:51:02.500351 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 49/102] 10.222.0.25 () {58 vars in 1281 bytes} [Mon Oct 24 08:51:02 2022] GET /compute/v2.1/os-hypervisors/64982f62-f177-4f1b-8222-2977255f6d7f/servers => generated 123 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:02.647389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:02.666212 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-45ea992a-e0b8-4046-a994-e324fa6791ac tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.771100 Oct 24 08:51:02.668729 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 54/103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:01 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:03.155707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fbbe4c-b7bf-4396-ae31-0280d971fa9e", "tag": "f3f8dfa4-f636-4afd-9782-492761b92fd1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:03.186291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.187967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.189621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.261333 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Creating event network-changed:f3f8dfa4-f636-4afd-9782-492761b92fd1 for instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e on n-h2-master-1 Oct 24 08:51:03.263293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:51:03.263900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bc00124-eb4f-4547-adcb-6f85b08ed343 req-928b4266-0164-478f-9a67-4d2860f23d6a service nova] Acquired lock "compute-rpcapi-router" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:51:03.265928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.266821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.267823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.268938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.270255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.271887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.291248 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.rpcapi [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 08:51:03.292332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] Releasing lock "compute-rpcapi-router" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:51:03.317893 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-558d4f18-5fe9-4637-b54d-70e44ac721ae None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.672023 Oct 24 08:51:03.328642 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 50/104] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:03.371604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:03.377270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:03.397656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.402594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.403365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.404522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.405192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.406466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.417910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Calling method '.version_select at 0x7f8dabc298b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:03.428745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.429953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.432196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.472693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.473791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.474466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.565126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.565719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.566159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.598140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.599342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.599796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.649201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.649736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.650173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.672047 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a5b6530-ed49-41bf-9ed7-c1cb7ffa92f4 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.879675 Oct 24 08:51:03.675276 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 55/105] 10.222.0.25 () {60 vars in 1243 bytes} [Mon Oct 24 08:51:02 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:51:03.694045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Calling method '.version_select at 0x7f8dabbfef70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:03.700125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.701951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.704509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.745093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.749743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.750911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.810581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.811138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.811697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.849956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.850934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.851605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.904315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.905515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.906767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.924604 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dfa5410-7eb9-469c-8490-09443a82d575 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.235231 Oct 24 08:51:03.928125 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 56/106] 10.222.0.25 () {60 vars in 1222 bytes} [Mon Oct 24 08:51:03 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:51:03.940129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:03.941083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:03.956305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.956848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.962239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.964063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.966966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.967464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:04.532946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:04.540883 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:04.550342 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2f57632-8747-482a-a841-08c5417033c9 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.620861 Oct 24 08:51:04.567079 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 57/107] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:03 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:04.583740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Calling method '.version_select at 0x7f8dabc5b8b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:04.602265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:04.604765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:04.605654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:04.606396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:04.613249 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-627b0a7c-8fa1-4db8-91b1-54ac4477588a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 1.281849 Oct 24 08:51:04.619372 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 51/108] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:03 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:04.697245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:04.698580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:04.699038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:04.731201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f5aa5df-d489-403e-98b8-8786f6976d85 tempest-HypervisorAdminV253TestBase-1660775164 tempest-HypervisorAdminV253TestBase-1660775164-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/ec3185e5-e902-4652-8a32-f268851fd602" status: 200 len: 792 microversion: 2.53 time: 0.162206 Oct 24 08:51:04.754238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 58/109] 10.222.0.25 () {60 vars in 1298 bytes} [Mon Oct 24 08:51:04 2022] GET /compute/v2.1/os-hypervisors/ec3185e5-e902-4652-8a32-f268851fd602 => generated 792 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:04.887810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-019a46b3-a34a-4444-ad27-27baf3b7609c req-19dd290f-f984-4bd9-be8c-49d7bbd38c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f6ddb8-3b73-4594-9437-7a83c138b456", "tag": "223384ec-988d-4f25-af50-490a8d75b2b1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:04.905428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-019a46b3-a34a-4444-ad27-27baf3b7609c req-19dd290f-f984-4bd9-be8c-49d7bbd38c2c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:04.905910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-019a46b3-a34a-4444-ad27-27baf3b7609c req-19dd290f-f984-4bd9-be8c-49d7bbd38c2c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:04.906600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-019a46b3-a34a-4444-ad27-27baf3b7609c req-19dd290f-f984-4bd9-be8c-49d7bbd38c2c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:04.934290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-019a46b3-a34a-4444-ad27-27baf3b7609c req-19dd290f-f984-4bd9-be8c-49d7bbd38c2c service nova] Creating event network-changed:223384ec-988d-4f25-af50-490a8d75b2b1 for instance 44f6ddb8-3b73-4594-9437-7a83c138b456 on n-h1-master-1 Oct 24 08:51:04.952397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-019a46b3-a34a-4444-ad27-27baf3b7609c req-19dd290f-f984-4bd9-be8c-49d7bbd38c2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326228 Oct 24 08:51:04.953421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 52/110] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:05.580237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:05.580859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:05.595713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:05.596275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:05.596691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:05.597477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:05.597991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:05.598629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:05.646529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:05.647500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:05.669361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:05.670518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:05.671064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:05.673240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:05.674902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:05.675346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:05.904584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:05.918615 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f654d60-ed65-4373-ac00-62ae07af70fb tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.342725 Oct 24 08:51:05.919172 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 59/111] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:05 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:05.921116 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=14 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:06.198805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:06.213602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fcdf904-6450-469c-a880-6aab1ed24476 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.572992 Oct 24 08:51:06.221401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 53/112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:05 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:06.945467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:06.946168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:06.964246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:06.964783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:06.970395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:06.971279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:06.971765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:06.972258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:07.003047 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:07.239465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:07.240873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:07.256561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:07.257982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:07.260402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:07.262258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:07.271455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:07.275283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:07.589471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:07.611687 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa77c3eb-af00-49f7-8d89-57f881038e6b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.671215 Oct 24 08:51:07.613616 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 60/113] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:06 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:07.961843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:07.985196 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35bb33f6-8556-455d-9919-c1b09e11353e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.749664 Oct 24 08:51:07.986444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 54/114] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:07 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:08.645448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:08.647060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:08.657846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:08.660007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:08.661461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:08.662412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:08.663224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:08.666631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:09.011806 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:09.012481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:09.031600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:09.032566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:09.036014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:09.041397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:09.045629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:09.050430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:09.273025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:09.290405 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-862810c5-a64c-4e61-8957-431629dd64c0 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.644188 Oct 24 08:51:09.291397 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 61/115] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:08 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:09.478949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:09.489073 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-577ebaa9-f6b2-43ab-8beb-935187fe7244 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.483353 Oct 24 08:51:09.493731 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 55/116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:09 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:10.316570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:10.317192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:10.329251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:10.331934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:10.332429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:10.333162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:10.333746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:10.336353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:10.524561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:10.525271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:10.536607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:10.537509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:10.540609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:10.541719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:10.543334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:10.545165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:10.788472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:10.805552 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65402ebb-ed4d-4f32-988a-4f9447d3aa2c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.492789 Oct 24 08:51:10.808867 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 62/117] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:10 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:10.857856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:10.869342 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb689b23-66b8-49d6-92bc-0b33c006522e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.348800 Oct 24 08:51:10.880418 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 56/118] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:10 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:11.404302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3fd161e7-f12d-4efe-aef5-0224e6c44268 tempest-NetworksTest-1332446715 tempest-NetworksTest-1332446715-project-admin] Calling method '.version_select at 0x7f8dabb3c1f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.423935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7399d502-94ad-4504-84b7-d5807187ac61 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1602884654", "ram": 512, "vcpus": 1, "disk": 10, "id": 1616506962, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:11.450282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7399d502-94ad-4504-84b7-d5807187ac61 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.185219 Oct 24 08:51:11.450879 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 57/119] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:11 2022] POST /compute/v2.1/flavors => generated 416 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:11.466483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20cf1146-7c03-447f-8de8-5271b00f9a30 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:11.508327 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20cf1146-7c03-447f-8de8-5271b00f9a30 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048436 Oct 24 08:51:11.509283 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 58/120] 10.222.0.25 () {60 vars in 1224 bytes} [Mon Oct 24 08:51:11 2022] POST /compute/v2.1/flavors/1616506962/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:51:11.545800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3fd161e7-f12d-4efe-aef5-0224e6c44268 tempest-NetworksTest-1332446715 tempest-NetworksTest-1332446715-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.287413 Oct 24 08:51:11.547267 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 63/121] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:11.555255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1901769d-2372-4156-bb41-c079979052f6 tempest-NetworksTest-1332446715 tempest-NetworksTest-1332446715-project-admin] Calling method '.version_select at 0x7f8dabb3c820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.642843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39fe413b-c973-4fa9-b532-764f354008a1 tempest-FlavorsExtraSpecsTestJSON-878786800 tempest-FlavorsExtraSpecsTestJSON-878786800-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.653427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39fe413b-c973-4fa9-b532-764f354008a1 tempest-FlavorsExtraSpecsTestJSON-878786800 tempest-FlavorsExtraSpecsTestJSON-878786800-project] 10.222.0.25 "GET /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.138029 Oct 24 08:51:11.654008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/flavors/1616506962/os-extra_specs => generated 66 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:11.664884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ceac9866-c62f-4d77-92fb-f1ceece02a6f tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:11.665130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1901769d-2372-4156-bb41-c079979052f6 tempest-NetworksTest-1332446715 tempest-NetworksTest-1332446715-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/6336a572-8747-4a12-b442-56936ece2af2" status: 200 len: 652 microversion: 2.1 time: 0.113906 Oct 24 08:51:11.666113 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/os-networks/6336a572-8747-4a12-b442-56936ece2af2 => generated 652 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:11.674744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8fb06f2f-05bf-4d74-9ab7-0771f4e8e2a5 tempest-NetworksTest-1332446715 tempest-NetworksTest-1332446715-project-admin] Calling method '.version_select at 0x7f8dabb3c9d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.694412 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ceac9866-c62f-4d77-92fb-f1ceece02a6f tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033491 Oct 24 08:51:11.695282 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 60/124] 10.222.0.25 () {60 vars in 1224 bytes} [Mon Oct 24 08:51:11 2022] POST /compute/v2.1/flavors/1616506962/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:51:11.705189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23a1c6fa-0711-49cd-9570-eb17312aceb5 tempest-FlavorsExtraSpecsTestJSON-878786800 tempest-FlavorsExtraSpecsTestJSON-878786800-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.715985 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23a1c6fa-0711-49cd-9570-eb17312aceb5 tempest-FlavorsExtraSpecsTestJSON-878786800 tempest-FlavorsExtraSpecsTestJSON-878786800-project] 10.222.0.25 "GET /compute/v2.1/flavors/1616506962/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014583 Oct 24 08:51:11.716588 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 61/125] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/flavors/1616506962/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:11.728388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-526a84d3-4d2a-493f-9bac-986ed50d1b86 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:11.752776 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-526a84d3-4d2a-493f-9bac-986ed50d1b86 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028906 Oct 24 08:51:11.757352 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 62/126] 10.222.0.25 () {60 vars in 1224 bytes} [Mon Oct 24 08:51:11 2022] POST /compute/v2.1/flavors/1616506962/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:11.763037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6ec54e3-af64-4fa3-b471-aa90daf87a6d tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.770933 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6ec54e3-af64-4fa3-b471-aa90daf87a6d tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011508 Oct 24 08:51:11.771817 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 63/127] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/flavors/1616506962/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:51:11.781851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55acc46a-f709-4f28-9bfd-469185154add tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:11.797569 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8fb06f2f-05bf-4d74-9ab7-0771f4e8e2a5 tempest-NetworksTest-1332446715 tempest-NetworksTest-1332446715-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.126110 Oct 24 08:51:11.798905 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 65/128] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:11.820441 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55acc46a-f709-4f28-9bfd-469185154add tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1616506962/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.042625 Oct 24 08:51:11.826512 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 64/129] 10.222.0.25 () {60 vars in 1265 bytes} [Mon Oct 24 08:51:11 2022] PUT /compute/v2.1/flavors/1616506962/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:51:11.831995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b208cff-e5d6-48f3-a038-ff30aaa47351 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.836455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.837035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:11.843224 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b208cff-e5d6-48f3-a038-ff30aaa47351 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014712 Oct 24 08:51:11.844324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 66/130] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/flavors/1616506962/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:11.845435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:11.845973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:11.846439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:11.847285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:11.847851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:11.848497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:11.855992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0164ec10-dce3-4baf-a300-7644320ac3b8 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.901637 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0164ec10-dce3-4baf-a300-7644320ac3b8 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1616506962/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.051162 Oct 24 08:51:11.902633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 67/131] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 08:51:11 2022] DELETE /compute/v2.1/flavors/1616506962/os-extra_specs/hw:numa_nodes => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:11.911985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.912778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:11.919732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:11.920291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:11.920825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:11.921631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:11.922115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:11.922569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:12.045203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:12.053121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58cd4134-f445-450a-9781-0ecbea9f5312 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.222167 Oct 24 08:51:12.056895 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 65/132] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:12.065460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35cda959-e035-4446-ab2d-734c8d1ddb7f tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:12.103986 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35cda959-e035-4446-ab2d-734c8d1ddb7f tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1616506962/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.045944 Oct 24 08:51:12.104571 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 66/133] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 08:51:12 2022] DELETE /compute/v2.1/flavors/1616506962/os-extra_specs/hw:cpu_policy => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:12.111009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:12.112941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-329d91d9-2f99-46dd-9206-08b029fd2eb0 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:12.123734 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-329d91d9-2f99-46dd-9206-08b029fd2eb0 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1616506962/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014324 Oct 24 08:51:12.124885 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e738b1c3-6d61-4136-bccc-a338794016fd tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.217220 Oct 24 08:51:12.125425 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 67/134] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 08:51:12 2022] GET /compute/v2.1/flavors/1616506962/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:12.134468 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 68/135] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:12.138033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc16488c-457c-49cb-9978-b333ee6a7521 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:12.159630 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc16488c-457c-49cb-9978-b333ee6a7521 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1616506962" status: 202 len: 0 microversion: 2.1 time: 0.028301 Oct 24 08:51:12.160459 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 68/136] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:51:12 2022] DELETE /compute/v2.1/flavors/1616506962 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:12.169125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7232ea29-9449-444c-bb1b-ae68fbb0a0e7 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:12.193137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7232ea29-9449-444c-bb1b-ae68fbb0a0e7 tempest-FlavorsExtraSpecsTestJSON-1056995113 tempest-FlavorsExtraSpecsTestJSON-1056995113-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028185 Oct 24 08:51:12.194773 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 69/137] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:13.085402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:13.087310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:13.096256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:13.097320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:13.097964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:13.098929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:13.100268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:13.101960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:13.154463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:13.155839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:13.172510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:13.174726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:13.175393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:13.177681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:13.178868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:13.183954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:13.290256 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=16 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:13.330271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:13.341900 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd0a1e26-e094-49c6-bd68-e8a40283921d tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.263335 Oct 24 08:51:13.342784 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:13 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:13.657021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:13.676290 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47751129-6c0f-4e0d-ab3d-c4606d46d743 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.527205 Oct 24 08:51:13.677656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:13 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:14.366865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:14.368072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:14.376117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:14.376608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:14.377038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:14.377772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:14.378509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:14.378932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:14.400943 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:14.561381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:14.574465 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-713da3b4-0c3c-4735-a9c2-68bc8e266b0c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.211753 Oct 24 08:51:14.586334 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 70/140] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:14 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:14.703207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:14.704238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:14.712317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:14.713493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:14.713954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:14.714670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:14.715128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:14.715557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:15.012215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:15.040612 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df5aca76-f276-4e70-8094-0570018b6b51 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.343136 Oct 24 08:51:15.041320 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 71/141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:14 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:15.600367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:15.601679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:15.612920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:15.615086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:15.615559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:15.618723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:15.619215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:15.619656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:16.068167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:16.070576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:16.082088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:16.086011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:16.089056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:16.090395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:16.091919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:16.092720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:16.315002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:16.324740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8e79477-12a2-41bd-8938-aee17564a222 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.729212 Oct 24 08:51:16.328181 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 71/142] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:15 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:16.489919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:16.501998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d67c72b5-6dd8-4f8d-a854-0fe4dee92749 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.437551 Oct 24 08:51:16.521361 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:16 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:16.876542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eebe3695-0b21-4155-bdf8-a5ed9188d8d2 tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] Calling method '.version_select at 0x7f8dabd31550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:16.898159 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eebe3695-0b21-4155-bdf8-a5ed9188d8d2 tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.568667 Oct 24 08:51:16.898835 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 72/144] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 08:51:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:16.913537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7408e3a-3356-4a75-9ac6-33fb568555cf tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabd3fa60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:16.923878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f19582bd-8d45-45d1-a5f9-13bae3f6a033 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Action: 'create', calling method: .version_select at 0x7f8dabb3c9d0>, body: {"keypair": {"name": "tempest-keypair-965023606", "type": "ssh", "user_id": "7e5abe25d50b454a956f56a0ec3fe1af", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItEXjUCGsh9gbHuUwRAH+zxcARoSyp3UNBGeyI1vvmSdpyOwqH5ulGfZUofWrPGlQhJ8LP86T3HbUbfqnqfsBl44KHgQImEehgl9tTI5MJOk0RcGDyRTdkUGbW2PM9P0A=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:16.932468 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:16.964590 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:16.999745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f19582bd-8d45-45d1-a5f9-13bae3f6a033 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Getting quotas for project fc65c2c08bfc4fbeb4adc79b5d97fa52. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:17.020580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f19582bd-8d45-45d1-a5f9-13bae3f6a033 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Getting quotas for user 0cf98c641dba4caa99263a1483849619 and project fc65c2c08bfc4fbeb4adc79b5d97fa52. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:17.089157 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f19582bd-8d45-45d1-a5f9-13bae3f6a033 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.249633 Oct 24 08:51:17.091461 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 73/145] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 08:51:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 253 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 08:51:17.106477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d08cedc5-addb-4c1f-b5d4-acd1d45d5005 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Action: 'create', calling method: .version_select at 0x7f8dabb3cee0>, body: {"keypair": {"name": "tempest-keypair-454011946", "type": "ssh", "user_id": "7e5abe25d50b454a956f56a0ec3fe1af", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmISxbksAKb4ff5T6PkYvZkfuG1XoyPhSJvb0Xyzqv8buEoOzfuUdURlNs+tiYPO4+bNKxCsmin65JX85Ym3xn5n//4zku2Cv7fn5AsxDZ/QK23hnIOU5s+555cIhkt8w=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:17.124520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d08cedc5-addb-4c1f-b5d4-acd1d45d5005 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Getting quotas for project fc65c2c08bfc4fbeb4adc79b5d97fa52. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:17.130085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d08cedc5-addb-4c1f-b5d4-acd1d45d5005 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Getting quotas for user 0cf98c641dba4caa99263a1483849619 and project fc65c2c08bfc4fbeb4adc79b5d97fa52. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:17.159720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d08cedc5-addb-4c1f-b5d4-acd1d45d5005 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.057689 Oct 24 08:51:17.160501 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 74/146] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 08:51:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 24 08:51:17.172729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32d0f34e-72e2-4965-a678-2782c47a4a87 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Calling method '.version_select at 0x7f8dabd61b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.195967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32d0f34e-72e2-4965-a678-2782c47a4a87 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-965023606?user_id=7e5abe25d50b454a956f56a0ec3fe1af" status: 200 len: 511 microversion: 2.10 time: 0.027604 Oct 24 08:51:17.198280 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 75/147] 10.222.0.25 () {60 vars in 1337 bytes} [Mon Oct 24 08:51:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-965023606?user_id=7e5abe25d50b454a956f56a0ec3fe1af => generated 511 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:17.213232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7fd07b34-6ac4-4f37-98ff-97a9ba9fa244 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Action: 'create', calling method: .version_select at 0x7f8dabc5b3a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1565484350", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeabGSVnQRrj/IabhGyeo0ipRWQ95N1BMoylBQoK6fgIz4iRF76+4LSAGwraW0OjoHZ2k57YBbonPYmkJMo3VnnFPP0PUUUS3dK3PAOCEyEohweScVjTUbDmBC0REXuAQ=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:17.253593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-7fd07b34-6ac4-4f37-98ff-97a9ba9fa244 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Getting quotas for project fc65c2c08bfc4fbeb4adc79b5d97fa52. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:17.268300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-7fd07b34-6ac4-4f37-98ff-97a9ba9fa244 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Getting quotas for user 0cf98c641dba4caa99263a1483849619 and project fc65c2c08bfc4fbeb4adc79b5d97fa52. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:17.307014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7fd07b34-6ac4-4f37-98ff-97a9ba9fa244 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.098150 Oct 24 08:51:17.307959 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 76/148] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 08:51:17 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 08:51:17.322243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71567b22-c490-4a6b-b8d5-bc5b038d7698 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Calling method '.version_select at 0x7f8dabb01820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.327582 n-d-master-1 devstack@n-api.service[126920]: WARNING oslo_db.sqlalchemy.utils [None req-71567b22-c490-4a6b-b8d5-bc5b038d7698 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 08:51:17.343468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71567b22-c490-4a6b-b8d5-bc5b038d7698 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=7e5abe25d50b454a956f56a0ec3fe1af" status: 200 len: 724 microversion: 2.10 time: 0.028203 Oct 24 08:51:17.344722 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 77/149] 10.222.0.25 () {60 vars in 1259 bytes} [Mon Oct 24 08:51:17 2022] GET /compute/v2.1/os-keypairs?user_id=7e5abe25d50b454a956f56a0ec3fe1af => generated 724 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:17.363961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5879c24-a32c-4ee5-85e5-2441b2726d21 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Calling method '.version_select at 0x7f8dabaf7dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.418217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5879c24-a32c-4ee5-85e5-2441b2726d21 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1565484350" status: 204 len: 0 microversion: 2.10 time: 0.064610 Oct 24 08:51:17.419578 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 78/150] 10.222.0.25 () {60 vars in 1325 bytes} [Mon Oct 24 08:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1565484350 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:51:17.432428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.438271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:17.458105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:17.461244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:17.464014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:17.464846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:17.465069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7408e3a-3356-4a75-9ac6-33fb568555cf tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.553781 Oct 24 08:51:17.466717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:17.467127 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 73/151] 10.222.0.25 () {60 vars in 1206 bytes} [Mon Oct 24 08:51:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:17.469349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:17.482719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73f495d8-6d10-4bb2-ae0b-d40301c615e3 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Calling method '.version_select at 0x7f8dabd31af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.560177 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73f495d8-6d10-4bb2-ae0b-d40301c615e3 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454011946?user_id=7e5abe25d50b454a956f56a0ec3fe1af" status: 204 len: 0 microversion: 2.10 time: 0.091311 Oct 24 08:51:17.564341 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 74/152] 10.222.0.25 () {60 vars in 1340 bytes} [Mon Oct 24 08:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454011946?user_id=7e5abe25d50b454a956f56a0ec3fe1af => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:51:17.567169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbe2e65a-a871-4488-b7f1-923f695d7428 tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] Calling method '.version_select at 0x7f8dabd31f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.581812 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbe2e65a-a871-4488-b7f1-923f695d7428 tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.019641 Oct 24 08:51:17.582407 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 75/153] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 08:51:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:17.594529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.595468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:17.603485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:17.603978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:17.605240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:17.605383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:17.605965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:17.606691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:17.706583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:17.719324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12550aba-1f32-471f-a29b-4fe158635270 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.297023 Oct 24 08:51:17.729390 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 79/154] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:17 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:17.731401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c862279-dce4-43c7-a48a-47d94b23f1c2 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] Calling method '.version_select at 0x7f8dabdcd280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.761110 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c862279-dce4-43c7-a48a-47d94b23f1c2 tempest-KeyPairsV210TestJSON-831365020 tempest-KeyPairsV210TestJSON-831365020-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965023606?user_id=7e5abe25d50b454a956f56a0ec3fe1af" status: 204 len: 0 microversion: 2.10 time: 0.039984 Oct 24 08:51:17.766728 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 80/155] 10.222.0.25 () {60 vars in 1340 bytes} [Mon Oct 24 08:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965023606?user_id=7e5abe25d50b454a956f56a0ec3fe1af => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:51:17.772797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fee5d6d9-a745-488c-b2ef-494347e6ae7c tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabb8b310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:17.929183 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:17.938670 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fee5d6d9-a745-488c-b2ef-494347e6ae7c tempest-QuotaClassesAdminTestJSON-1731078220 tempest-QuotaClassesAdminTestJSON-1731078220-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.169798 Oct 24 08:51:17.948306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 81/156] 10.222.0.25 () {60 vars in 1206 bytes} [Mon Oct 24 08:51:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:17.948584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-091fe923-787b-49d7-bad3-45e3fa3355d1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.353857 Oct 24 08:51:17.953714 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 76/157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:17 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:18.747954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:18.748632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:18.757169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.758755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.759673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.761058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.762256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.763932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.882375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f6ddb8-3b73-4594-9437-7a83c138b456", "name": "network-vif-plugged", "status": "completed", "tag": "223384ec-988d-4f25-af50-490a8d75b2b1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:18.917136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.918401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.919006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.945940 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Creating event network-vif-plugged:223384ec-988d-4f25-af50-490a8d75b2b1 for instance 44f6ddb8-3b73-4594-9437-7a83c138b456 on n-h1-master-1 Oct 24 08:51:18.946633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:51:18.947159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b5af44e-5ad8-40dd-86a2-eb27a4fc6877 req-f8cfe977-332f-4855-9995-7e62f313fbbe service nova] Acquired lock "compute-rpcapi-router" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:51:18.948651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.949451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.949747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.950809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.951258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.951668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.963179 n-d-master-1 devstack@n-api.service[126920]: INFO nova.compute.rpcapi [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 08:51:18.964067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] Releasing lock "compute-rpcapi-router" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:51:18.982634 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d81af832-fe03-45d5-91cf-4d82f883e6f9 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266588 Oct 24 08:51:18.983750 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 82/158] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:18.990967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:18.992040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:19.001062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:19.001817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:19.002417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:19.003259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:19.003848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:19.004741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:19.127263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:19.138297 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-673c9d4c-8d4d-459f-abde-579b89bdb32e tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.395378 Oct 24 08:51:19.158748 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 77/159] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:18 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:19.279361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:19.289842 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e6b6d8d-2d04-456a-8507-335a3f29061d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.303293 Oct 24 08:51:19.290832 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 83/160] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:18 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:20.171592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:20.173022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:20.182359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:20.183270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:20.183932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:20.184872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:20.186991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:20.188476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:20.318652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:20.319769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:20.329075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:20.329604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:20.330034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:20.330738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:20.331192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:20.331611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:20.470974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:20.480450 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3929be8e-444e-4df8-9597-515d2a3b0124 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.313988 Oct 24 08:51:20.486530 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 78/161] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:20 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:20.621158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:20.633585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-81c8df3f-fb30-4618-a851-7ef67362e2ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1319 microversion: 2.1 time: 0.319596 Oct 24 08:51:20.649792 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 84/162] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:20 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:21.056258 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c66234e6-ef23-433c-8f31-986068fc52d4 req-2661f362-931b-43c4-a2fa-2913a70672b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fbbe4c-b7bf-4396-ae31-0280d971fa9e", "name": "network-vif-plugged", "status": "completed", "tag": "f3f8dfa4-f636-4afd-9782-492761b92fd1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:21.079234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c66234e6-ef23-433c-8f31-986068fc52d4 req-2661f362-931b-43c4-a2fa-2913a70672b0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.080492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c66234e6-ef23-433c-8f31-986068fc52d4 req-2661f362-931b-43c4-a2fa-2913a70672b0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.082180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c66234e6-ef23-433c-8f31-986068fc52d4 req-2661f362-931b-43c4-a2fa-2913a70672b0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:21.097924 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c66234e6-ef23-433c-8f31-986068fc52d4 req-2661f362-931b-43c4-a2fa-2913a70672b0 service nova] Creating event network-vif-plugged:f3f8dfa4-f636-4afd-9782-492761b92fd1 for instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e on n-h2-master-1 Oct 24 08:51:21.108982 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c66234e6-ef23-433c-8f31-986068fc52d4 req-2661f362-931b-43c4-a2fa-2913a70672b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061533 Oct 24 08:51:21.110198 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 79/163] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:21.516483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:21.518481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:21.530313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.531350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.534445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:21.536705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.537921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.538910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:21.759508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93b74639-3050-4c5a-b248-38f0b4d2f5ee tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:21.769632 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93b74639-3050-4c5a-b248-38f0b4d2f5ee tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.270830 Oct 24 08:51:21.783677 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 85/164] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:21.790512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:21.791344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:21.798522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.799219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.799821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:21.800693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.801329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.801902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:22.021625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:22.035508 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d76236ac-f39f-4b7d-ba69-3a073e56ed43 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.526635 Oct 24 08:51:22.037594 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 80/165] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:21 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:22.375112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:22.387680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa446543-5e89-445b-927c-889baaa1fd4e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1468 microversion: 2.1 time: 0.601934 Oct 24 08:51:22.388830 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 86/166] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:21 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1468 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:22.872305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:22.873514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:22.885110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:22.887478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:22.888348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:22.890824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:22.892027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:22.893996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.021771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:51:23.060346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:23.061167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:23.077486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.082227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.085516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.088701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.089195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.089662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.395649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:23.408513 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4ffeca4f-cb72-4777-8bbe-d3b595128d3c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1338 microversion: 2.1 time: 0.351825 Oct 24 08:51:23.418308 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 87/167] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:23 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:23.430970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b07cae67-0f1e-48c4-98fe-0a0a2a642044 tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-993004825", "imageRef": "3b9e8f0c-cda3-4f41-9eb5-980464b3f551", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:23.498873 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b56d5a4e-8989-4c9a-b445-6b4f470052fc tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 204 len: 0 microversion: 2.1 time: 1.087927 Oct 24 08:51:23.499766 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 81/168] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:51:22 2022] DELETE /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:51:23.519046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:23.519967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:23.554974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.555881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.556534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.558004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.558635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.559342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.585746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-b07cae67-0f1e-48c4-98fe-0a0a2a642044 tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:51:23.987703 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b07cae67-0f1e-48c4-98fe-0a0a2a642044 tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 24 08:51:23.989237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b07cae67-0f1e-48c4-98fe-0a0a2a642044 tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] Request method failure captured: Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 142 Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIJAVL2esEK53FY-lMH469Vkl84Hn1egoNpfvmYC7UXtl5HgQA-RTYxrgi4zGJuOD-L6KGa6Kmz1ZXP0Hru5ziof4FxZSqZsrUAFYUbITtICOckzNWmvtGWSi5F9o5jjC7Ctx6Cg1tehDsngwwnpC8SjL2UW7poqbJ7n3lb5dYWRyw Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 0d09d5c75d2a49aaa59afa04cbf9900f Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsV2NegativeTest-1641703533 Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:23.993631 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d09d5c75d2a49aaa59afa04cbf9900f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d09d5c75d2a49aaa59afa04cbf9900f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d09d5c75d2a49aaa59afa04cbf9900f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d09d5c75d2a49aaa59afa04cbf9900f"}]}] Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsV2NegativeTest-1641703533 Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 0d09d5c75d2a49aaa59afa04cbf9900f Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1641703533 Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsV2NegativeTest-1641703533-project Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b930cfd32eab435f96cb4ab8ae622bb6 Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsV2NegativeTest-1641703533-project Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-993004825", "imageRef": "3b9e8f0c-cda3-4f41-9eb5-980464b3f551", "flavorRef": "452"}} Oct 24 08:51:23.995097 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: exception: Flavor's memory is too small for requested image. Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-993004825', 'imageRef': '3b9e8f0c-cda3-4f41-9eb5-980464b3f551', 'flavorRef': '452'}}} Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:23.995869 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:23.997515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:23.998807 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:23.998807 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:23.998807 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:23.998807 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:23.998807 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 24 08:51:23.998807 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:23.999834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-951e3c65-7174-4afc-baf8-fc9df2fbfc96 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1474 microversion: 2.1 time: 0.495305 Oct 24 08:51:24.000287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b07cae67-0f1e-48c4-98fe-0a0a2a642044 tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:24.000594 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 82/169] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:23 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1474 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:24.009878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b07cae67-0f1e-48c4-98fe-0a0a2a642044 tempest-FlavorsV2NegativeTest-1641703533 tempest-FlavorsV2NegativeTest-1641703533-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.590373 Oct 24 08:51:24.010828 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 88/170] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:23 2022] POST /compute/v2.1/servers => generated 93 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:24.285073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83bbc0f8-27ba-42eb-ac6e-2a2336cd7528 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '.version_select at 0x7f8dabd0fca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:24.362743 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83bbc0f8-27ba-42eb-ac6e-2a2336cd7528 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4" status: 200 len: 371 microversion: 2.1 time: 0.231622 Oct 24 08:51:24.363507 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 83/171] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 08:51:24 2022] GET /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4 => generated 371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:24.375775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabac9b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:24.442411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:24.443366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:24.445843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.446336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.446764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.449698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.451464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.451617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.452097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.452395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.452968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.453923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.454517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.455665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.526454 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:24.545344 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2cc29d9d-fac5-4a3a-833c-7238df4ea9a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4" status: 200 len: 328 microversion: 2.1 time: 0.173349 Oct 24 08:51:24.545980 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 89/172] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 08:51:24 2022] PUT /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4 => generated 328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:24.558795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f3205ca-6f4e-454b-bcde-d7012fba0602 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:24.571912 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f3205ca-6f4e-454b-bcde-d7012fba0602 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4" status: 202 len: 0 microversion: 2.1 time: 0.016914 Oct 24 08:51:24.572706 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 90/173] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 08:51:24 2022] DELETE /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4 => generated 0 bytes in 19 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:24.580645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b857f3b-f91e-4eac-bb60-3bfd8ef41455 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '.version_select at 0x7f8dabc5b700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:24.671585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b857f3b-f91e-4eac-bb60-3bfd8ef41455 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4" status: 200 len: 371 microversion: 2.1 time: 0.094467 Oct 24 08:51:24.679557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 91/174] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 08:51:24 2022] GET /compute/v2.1/os-quota-sets/144b2061817342f9924a79b5a5629df4 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:24.781667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:24.792134 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73b583ba-131d-42bb-8d85-bf4e31c1be33 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1488 microversion: 2.1 time: 0.355623 Oct 24 08:51:24.793755 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 84/175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:24 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1488 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:24.831394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:24.832271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:24.840087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.840688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.841518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.842558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.843138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.843666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.027902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:25.028928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:25.047637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:25.048143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:25.048584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.054462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:25.055155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:25.063520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.427007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:25.437095 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15d1a0f3-f034-436b-92c2-18d69ea3428e tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1474 microversion: 2.1 time: 0.414195 Oct 24 08:51:25.449320 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 85/176] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:25 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:25.449320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8b89351-e7a7-4ef9-a702-1c0c33e3e955 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '.version_select at 0x7f8dabd31430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:25.853424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8b89351-e7a7-4ef9-a702-1c0c33e3e955 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.412038 Oct 24 08:51:25.853955 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 86/177] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 08:51:25 2022] GET /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9/defaults => generated 371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:25.858284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c484df4-826b-4518-8483-3bd35a6c8c66 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1639 microversion: 2.1 time: 1.043242 Oct 24 08:51:25.870024 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 92/178] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:24 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1639 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:25.891690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:25.892886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:25.902191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:25.903385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:25.904316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.905242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:25.906378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:25.906860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.943957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:51:26.227406 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=13,nova_api:INSERT=11,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:26.234736 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9c8d7bc-b2fe-4751-ac41-b3e22fd31552 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 204 len: 0 microversion: 2.1 time: 0.350265 Oct 24 08:51:26.236783 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 87/179] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:51:25 2022] DELETE /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:51:26.246530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:26.247813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:26.259564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.263126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.263733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.265379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.265994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.266591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.278546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-63d6c97a-a3d4-4a95-b79b-8502f2a81bb0 req-348e98cd-e0cd-45dc-b6df-60a173d163ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f6ddb8-3b73-4594-9437-7a83c138b456", "name": "network-vif-deleted", "tag": "223384ec-988d-4f25-af50-490a8d75b2b1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:26.336850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-63d6c97a-a3d4-4a95-b79b-8502f2a81bb0 req-348e98cd-e0cd-45dc-b6df-60a173d163ae service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.341649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-63d6c97a-a3d4-4a95-b79b-8502f2a81bb0 req-348e98cd-e0cd-45dc-b6df-60a173d163ae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.341649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-63d6c97a-a3d4-4a95-b79b-8502f2a81bb0 req-348e98cd-e0cd-45dc-b6df-60a173d163ae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.383071 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-63d6c97a-a3d4-4a95-b79b-8502f2a81bb0 req-348e98cd-e0cd-45dc-b6df-60a173d163ae service nova] Creating event network-vif-deleted:223384ec-988d-4f25-af50-490a8d75b2b1 for instance 44f6ddb8-3b73-4594-9437-7a83c138b456 on n-h1-master-1 Oct 24 08:51:26.391329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-63d6c97a-a3d4-4a95-b79b-8502f2a81bb0 req-348e98cd-e0cd-45dc-b6df-60a173d163ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119649 Oct 24 08:51:26.392166 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 88/180] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:26.404472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabce04c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:26.621127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:26.630598 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9f06f12-c6fe-4c8d-864f-b6f20c4eeeb6 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1494 microversion: 2.1 time: 0.388821 Oct 24 08:51:26.634328 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 93/181] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:26 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1494 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:26.642645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:26.647192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:26.656956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.659785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.661600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.664300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.664945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.669781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.739170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.739966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.741049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.743078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lazy-loading 'fault' on Instance uuid 44f6ddb8-3b73-4594-9437-7a83c138b456 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:26.748558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.749046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.749508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.750234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.750686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.751108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.823877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:26.836379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e6a233b-98db-4c7c-b3e2-11f7d88c8df9 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 200 len: 1309 microversion: 2.1 time: 0.200900 Oct 24 08:51:26.836981 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 94/182] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:26 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:26.886595 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0f934ef-429d-4876-bb5e-27b5e9c588d8 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076" status: 200 len: 328 microversion: 2.1 time: 0.487548 Oct 24 08:51:26.894497 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 89/183] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 08:51:26 2022] PUT /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076 => generated 328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:26.900270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '.version_select at 0x7f8daba93d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:27.150698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.152460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.154091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.156165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.157588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.158593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.205105 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb7c9acc-ff67-4aa0-96fd-95db32c1688b tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076/detail" status: 200 len: 916 microversion: 2.1 time: 0.309130 Oct 24 08:51:27.225904 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 95/184] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:51:26 2022] GET /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076/detail => generated 916 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:27.482425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabd0f790>, body: {"quota_set": {"ram": "2048"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:27.657599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:27.663564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:27.676644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.681837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.685004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.686135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.688910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.689522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.701541 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:27.850448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.857652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.858482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.859617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.861471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.866003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.911302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.913042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.914338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.915418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.916128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.917019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.014237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:28.019196 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-759b2f26-5240-4a88-8fac-14dba7537674 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076?user_id=a989d9f8e85d454c87b02a746f170b90" status: 200 len: 328 microversion: 2.1 time: 0.537655 Oct 24 08:51:28.019917 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 90/185] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:51:27 2022] PUT /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076?user_id=a989d9f8e85d454c87b02a746f170b90 => generated 328 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:28.028557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2dddfdfa-9c7f-4155-907d-f5010a637490 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1494 microversion: 2.1 time: 0.377338 Oct 24 08:51:28.033726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:28.036367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:28.041906 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 96/186] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:27 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1494 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:28.050379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:28.050881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:28.053452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.057740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:28.058260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42d5a984-3e1c-4418-8aea-076a20e9d75a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '.version_select at 0x7f8daba7f8b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:28.058596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:28.059292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.091909 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] HTTP exception thrown: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Request method failure captured: Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 HTTP/1.1 Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHshbzmBQGnL4UuUNPnfyXZfzUmWXxd2ddGm-pLmtKHk66r6tTBoELsmCs9381oAYnw9_BxbDd-EA0-e5IYpuXlvCmvi6008XfmLovYS8MyURsvV8zPwR3Wr7F7qybf9trlTWKVqSP6qug6SlgTYh7V_6SHWwMoKpO2QkserkQalLk Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:28.104992 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}] Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 327f1d46d859423982fab017258b9ada Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:28.106581 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '44f6ddb8-3b73-4594-9437-7a83c138b456'} Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:28.107655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:28.109603 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:28.112516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Returning 404 to user: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:28.114508 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3de3df24-fbcb-4da3-b100-283f2cb14e44 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 404 len: 111 microversion: 2.1 time: 0.093547 Oct 24 08:51:28.116056 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 91/187] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:28 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:28.230890 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42d5a984-3e1c-4418-8aea-076a20e9d75a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076?user_id=a989d9f8e85d454c87b02a746f170b90" status: 200 len: 370 microversion: 2.1 time: 0.185469 Oct 24 08:51:28.232348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 97/188] 10.222.0.25 () {58 vars in 1323 bytes} [Mon Oct 24 08:51:28 2022] GET /compute/v2.1/os-quota-sets/7062978dec4f48f196a1ce48632d7076?user_id=a989d9f8e85d454c87b02a746f170b90 => generated 370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:28.290929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-130834792", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:28.418815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:51:28.789805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:51:28.790354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:51:28.790687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:51:28.791138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:51:28.791551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:51:28.800568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:28.801524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:28.802113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.804130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:28.804763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:28.805358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.827409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Getting quotas for project 3d7b9d4b5ef5454fbed4733abbd15bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:28.835261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Getting quotas for user 327f1d46d859423982fab017258b9ada and project 3d7b9d4b5ef5454fbed4733abbd15bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:28.857727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:51:28.860390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:51:28.861232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3bc7fab-bb51-4d4f-aef9-5cd5abb0f494 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Calling method '.version_select at 0x7f8dab9ec3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:28.917463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84e6dde7-0e10-4945-bbc1-807648bf41af tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633309 Oct 24 08:51:28.918458 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 92/189] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:51:28.932569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-505eb34f-e0d4-4c9d-98cc-cd2fd94ee217 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:28.933352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-505eb34f-e0d4-4c9d-98cc-cd2fd94ee217 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:29.018716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-505eb34f-e0d4-4c9d-98cc-cd2fd94ee217 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:29.026339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-505eb34f-e0d4-4c9d-98cc-cd2fd94ee217 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1219 microversion: 2.1 time: 0.100159 Oct 24 08:51:29.029907 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 93/190] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:28 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:29.124325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-948994313", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "a1e84f6c-6a1f-4a59-a284-a0213f1972ff"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:29.227103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] validate_networks() for [('a1e84f6c-6a1f-4a59-a284-a0213f1972ff', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:51:29.277192 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3bc7fab-bb51-4d4f-aef9-5cd5abb0f494 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.420090 Oct 24 08:51:29.277744 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 98/191] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 08:51:28 2022] GET /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9/defaults => generated 371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:29.288798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:29.289432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:29.310988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:29.311481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:29.311909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:29.312602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:29.313049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:29.313495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:29.534539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:29.544103 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c53e2643-e34c-43e0-8b72-5a3f7e6c7219 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1452 microversion: 2.1 time: 0.265209 Oct 24 08:51:29.549023 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 99/192] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:29 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1452 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:29.557948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabc29a60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:29.672640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:29.674733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:29.675508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:29.680678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:29.681206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:29.682097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.040498 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec60c0ef-7cf1-4b94-8a8d-c36860b9ad25 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9" status: 200 len: 329 microversion: 2.1 time: 0.487007 Oct 24 08:51:30.042065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 100/193] 10.222.0.25 () {60 vars in 1263 bytes} [Mon Oct 24 08:51:29 2022] PUT /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9 => generated 329 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:30.055029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-70bc9693-5e5c-414d-85f8-8630c2b383c0 req-f0c759a1-0103-4fcb-b407-d831b35991ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fbbe4c-b7bf-4396-ae31-0280d971fa9e", "name": "network-vif-deleted", "tag": "f3f8dfa4-f636-4afd-9782-492761b92fd1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:30.065741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70bc9693-5e5c-414d-85f8-8630c2b383c0 req-f0c759a1-0103-4fcb-b407-d831b35991ac service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.066064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70bc9693-5e5c-414d-85f8-8630c2b383c0 req-f0c759a1-0103-4fcb-b407-d831b35991ac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.066493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70bc9693-5e5c-414d-85f8-8630c2b383c0 req-f0c759a1-0103-4fcb-b407-d831b35991ac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.082318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-70bc9693-5e5c-414d-85f8-8630c2b383c0 req-f0c759a1-0103-4fcb-b407-d831b35991ac service nova] Creating event network-vif-deleted:f3f8dfa4-f636-4afd-9782-492761b92fd1 for instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e on n-h2-master-1 Oct 24 08:51:30.093657 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-70bc9693-5e5c-414d-85f8-8630c2b383c0 req-f0c759a1-0103-4fcb-b407-d831b35991ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050146 Oct 24 08:51:30.094487 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 101/194] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:30.100694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:30.101672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:30.115271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.115817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.116517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.116985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.117370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.120059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.248272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:30.260487 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-191da3ca-6733-4947-8c1d-c1079a951ca0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1215 microversion: 2.1 time: 0.164736 Oct 24 08:51:30.279980 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 102/195] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:30 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:30.284718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab9ec700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:30.349868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:51:30.350969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:51:30.351656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:51:30.352210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:51:30.352851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:51:30.365968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.366795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.367410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.368163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.368608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.369036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.395532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:30.402475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for user b43a269fe8b746b88c38db6b9e9bfa12 and project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:30.413009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.418033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.418742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.420916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:51:30.422075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.422663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.423968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.424547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:51:30.492736 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f819418-ca71-4e23-9573-bfbbaaa98352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461288 Oct 24 08:51:30.493712 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 94/196] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:51:30.527572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7f3cdd3-8f19-471f-b11b-bc0a8dca8d26 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:30.529459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7f3cdd3-8f19-471f-b11b-bc0a8dca8d26 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:30.580453 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:INSERT=17,nova_api:UPDATE=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:30.618635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f7f3cdd3-8f19-471f-b11b-bc0a8dca8d26 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:30.634348 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7f3cdd3-8f19-471f-b11b-bc0a8dca8d26 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1210 microversion: 2.1 time: 0.132751 Oct 24 08:51:30.636367 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 95/197] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:30 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:30.646642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:30.648885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:30.667387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.670755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.671272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.673197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.674267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.675435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.687245 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:30.736717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:30.737599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:30.738480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.739868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lazy-loading 'fault' on Instance uuid f6fbbe4c-b7bf-4396-ae31-0280d971fa9e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:30.883101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8347b4e37424f499f5756ca8b88fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:30.905085 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-185bbeae-e7e5-4382-af02-6de092d7305b tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 200 len: 1328 microversion: 2.1 time: 0.264377 Oct 24 08:51:30.907402 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 96/198] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:30 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 1328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:31.084185 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5bc85624-7604-4caa-83d7-0fc945a398a1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9" status: 200 len: 329 microversion: 2.1 time: 0.802853 Oct 24 08:51:31.092567 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 103/199] 10.222.0.25 () {60 vars in 1263 bytes} [Mon Oct 24 08:51:30 2022] PUT /compute/v2.1/os-quota-sets/ebe64af26110447790eb20d2352046f9 => generated 329 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:31.289585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:31.290540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:31.303227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.305310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.305964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.306704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.307171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.307601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.451006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:31.460465 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30dcf2c6-08eb-4c0b-b77b-3983dd6b88f0 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1277 microversion: 2.1 time: 0.176356 Oct 24 08:51:31.463764 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 97/200] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:31 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:31.673744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:31.674487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:31.684487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.685416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.686086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.687405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.688018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.688621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.823843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:31.836371 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02bc67a1-43ec-4b51-836c-7168765d0af4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1227 microversion: 2.1 time: 0.171954 Oct 24 08:51:31.854989 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 104/201] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:31 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1227 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:31.933641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:31.934255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:31.944334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.946630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.946630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.950496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.952030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.953414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.987469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] HTTP exception thrown: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Request method failure captured: Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e HTTP/1.1 Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHm6wXAXFRafGH0CzH44CXHh7Rr1HqHD5lii5axfGblFVRYtu-O6ZrVuhUyRVRSVeBzxWS7rQW__CLj7M50emGFMdCnqlDhiJA7N6psoJzPVhn5JQ_cXKfpxiAEPZV5IfM0OKLySh1u2BCVwAy7Q9uvqjD5XU9p6wg-JF5qQKPF4-w Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b6c53bdfc24c4cb0a6c9b02779cc7d62 Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:31.991284 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}] Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b6c53bdfc24c4cb0a6c9b02779cc7d62 Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminTestJSON-1705809586-project Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: f8347b4e37424f499f5756ca8b88fab4 Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminTestJSON-1705809586-project Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:31.992631 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f6fbbe4c-b7bf-4396-ae31-0280d971fa9e'} Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:31.993483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:31.994619 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:31.997917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Returning 404 to user: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:32.009194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cfeb4918-bda4-4042-86eb-a0668d70e44c tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 404 len: 111 microversion: 2.1 time: 0.079628 Oct 24 08:51:32.011575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 98/202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:31 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:32.021198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddba44dd-fa72-4efe-a140-e0bf7d2cc30c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:32.049813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddba44dd-fa72-4efe-a140-e0bf7d2cc30c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.050305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddba44dd-fa72-4efe-a140-e0bf7d2cc30c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.050741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddba44dd-fa72-4efe-a140-e0bf7d2cc30c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.298339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddba44dd-fa72-4efe-a140-e0bf7d2cc30c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.281743 Oct 24 08:51:32.299694 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 105/203] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:32.311935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05d5c60c-6b94-4578-a70c-511059aca67b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:32.406166 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05d5c60c-6b94-4578-a70c-511059aca67b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.094061 Oct 24 08:51:32.407058 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 99/204] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:32 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:32.426404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44287f51-b5cf-4a93-a48e-8e75d210b028 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-504063450"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:32.437527 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-44287f51-b5cf-4a93-a48e-8e75d210b028 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid 5a964a4f-ba40-4a85-8283-e300208494c1 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:32.510838 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44287f51-b5cf-4a93-a48e-8e75d210b028 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.088633 Oct 24 08:51:32.512197 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 106/205] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:32.524499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db71d28a-bbad-43d0-a4af-942a4870e09d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:32.526253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:32.526902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:32.543571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db71d28a-bbad-43d0-a4af-942a4870e09d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.547194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db71d28a-bbad-43d0-a4af-942a4870e09d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.548234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db71d28a-bbad-43d0-a4af-942a4870e09d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.557581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.558172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.558620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.559377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.559827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.560904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.796557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db71d28a-bbad-43d0-a4af-942a4870e09d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.275778 Oct 24 08:51:32.805115 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 107/206] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:32.809914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8947499a-daeb-4cf7-9c6d-265141a0078a tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:32.858364 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8947499a-daeb-4cf7-9c6d-265141a0078a tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.050317 Oct 24 08:51:32.869196 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 108/207] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:51:32 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:32.880689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:32.882582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:32.900071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.900594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.901081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.901852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.902301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.902718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:33.037131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:33.045189 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5606e6b-0508-4f88-ae3d-8ca26f4f787d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1268 microversion: 2.1 time: 0.174832 Oct 24 08:51:33.057380 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 109/208] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:32 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:33.061578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5778dfaf-dd03-49de-9e8a-c9156b946b9c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:33.088868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5778dfaf-dd03-49de-9e8a-c9156b946b9c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:33.089401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5778dfaf-dd03-49de-9e8a-c9156b946b9c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:33.089842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5778dfaf-dd03-49de-9e8a-c9156b946b9c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:33.326656 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5778dfaf-dd03-49de-9e8a-c9156b946b9c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.275516 Oct 24 08:51:33.334817 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 110/209] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:33 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:33.345735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1595ecf-3f9f-487b-800e-aee9afd82214 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:33.395376 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1595ecf-3f9f-487b-800e-aee9afd82214 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.059157 Oct 24 08:51:33.397694 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 111/210] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:33 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:33.423017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f59489c0-b5c8-4d54-a623-9e3d078f8e0b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1488530079"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:33.433753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-f59489c0-b5c8-4d54-a623-9e3d078f8e0b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid dd7063b9-d6e0-4c13-b064-50069ad6059f for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:33.477897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f59489c0-b5c8-4d54-a623-9e3d078f8e0b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064702 Oct 24 08:51:33.486629 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 112/211] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:33.496580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-78f88baa-77b6-4923-aba7-4157d5e824b4 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:33.516496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78f88baa-77b6-4923-aba7-4157d5e824b4 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:33.520194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78f88baa-77b6-4923-aba7-4157d5e824b4 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:33.520786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78f88baa-77b6-4923-aba7-4157d5e824b4 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:33.565697 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=11,nova_api:DELETE=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:33.737540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:33.750014 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-182a1399-dfa6-4b0d-a3a1-67233ce915e6 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 1.241815 Oct 24 08:51:33.755615 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 100/212] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:32 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:33.778284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-78f88baa-77b6-4923-aba7-4157d5e824b4 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.289371 Oct 24 08:51:33.779479 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 113/213] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:33 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:33.791224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0fb0acf-0979-4543-92b5-9bf85d47b4e2 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:33.817916 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0fb0acf-0979-4543-92b5-9bf85d47b4e2 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.030652 Oct 24 08:51:33.819659 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 101/214] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:51:33 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:33.831794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ecb9481e-d398-46e0-bc40-439bb5d3652b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:33.854846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb9481e-d398-46e0-bc40-439bb5d3652b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:33.866192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb9481e-d398-46e0-bc40-439bb5d3652b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:33.866857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb9481e-d398-46e0-bc40-439bb5d3652b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:34.082968 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ecb9481e-d398-46e0-bc40-439bb5d3652b tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.255578 Oct 24 08:51:34.087018 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 114/215] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:33 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:34.087773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:34.088569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:34.108133 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:34.115417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:34.118538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:34.120246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:34.121339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-14b5b13b-19a1-45a0-9c42-d3022ac1cac7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:34.126617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:34.128148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:34.129730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:34.214639 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-14b5b13b-19a1-45a0-9c42-d3022ac1cac7 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.116330 Oct 24 08:51:34.222900 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 115/216] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:34 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:34.236562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db57c197-8895-46c4-bb33-5d44c8b24040 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1969017909"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:34.246456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-db57c197-8895-46c4-bb33-5d44c8b24040 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid 78f028dd-5b9c-4425-8870-467bb77a0774 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:34.316399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db57c197-8895-46c4-bb33-5d44c8b24040 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082652 Oct 24 08:51:34.327815 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 116/217] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:34.337796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb09afa7-6705-42c9-b48c-225286bc7bbf tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:34.368918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb09afa7-6705-42c9-b48c-225286bc7bbf tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:34.369614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb09afa7-6705-42c9-b48c-225286bc7bbf tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:34.370158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb09afa7-6705-42c9-b48c-225286bc7bbf tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:34.670967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb09afa7-6705-42c9-b48c-225286bc7bbf tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.339824 Oct 24 08:51:34.672332 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 117/218] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:34 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:34.706562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ca8ede9-a464-4cae-86aa-4a1bb3d07072 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:34.756174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ca8ede9-a464-4cae-86aa-4a1bb3d07072 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:34.756920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ca8ede9-a464-4cae-86aa-4a1bb3d07072 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:34.757931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ca8ede9-a464-4cae-86aa-4a1bb3d07072 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:35.044530 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ca8ede9-a464-4cae-86aa-4a1bb3d07072 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.363296 Oct 24 08:51:35.046836 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 118/219] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:34 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:35.058406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.059406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:35.081810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:35.086798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:35.092710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:35.095169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:35.096088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:35.097411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:35.180383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:35.201868 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64ef3e8f-4bbf-427d-81fe-07690eddb651 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 1.128176 Oct 24 08:51:35.202465 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 102/220] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:34 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:35.218586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e166ebb3-a710-49ee-b8fe-be8593a045cc tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.262584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e166ebb3-a710-49ee-b8fe-be8593a045cc tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.059033 Oct 24 08:51:35.263777 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 103/221] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:35 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:35.281468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f928b6a-64a9-4dc3-9660-2f26bfc62d56 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2008989052"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:35.292156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-2f928b6a-64a9-4dc3-9660-2f26bfc62d56 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid ddcd8547-a237-4482-9a86-476beb24f5d5 for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:35.369129 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f928b6a-64a9-4dc3-9660-2f26bfc62d56 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097351 Oct 24 08:51:35.371676 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 104/222] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:35.382285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97bd47f0-978f-4440-b4f8-bcb944e5cb67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1172840587"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:35.392781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-97bd47f0-978f-4440-b4f8-bcb944e5cb67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid 0e517cb7-f949-4336-b5e7-abc1b47d77f5 for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:35.437745 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97bd47f0-978f-4440-b4f8-bcb944e5cb67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064406 Oct 24 08:51:35.440454 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 105/223] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:35.450014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4af1cfe6-cf08-4da2-9ac1-e39a495d9278 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.482644 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4af1cfe6-cf08-4da2-9ac1-e39a495d9278 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.040771 Oct 24 08:51:35.483819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 106/224] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:35 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:35.490285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-906657eb-25df-458a-9b14-bf865c2a2ea6 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:35.518217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906657eb-25df-458a-9b14-bf865c2a2ea6 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:35.519048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906657eb-25df-458a-9b14-bf865c2a2ea6 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:35.519824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906657eb-25df-458a-9b14-bf865c2a2ea6 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:35.710369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:35.719505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-137d6979-5a95-4a86-930b-878b6ef57323 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.671101 Oct 24 08:51:35.720091 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 119/225] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:35 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:35.736239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b27515b2-5787-4c30-9171-89a74f7b26b1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.749148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b27515b2-5787-4c30-9171-89a74f7b26b1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b27515b2-5787-4c30-9171-89a74f7b26b1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Request method failure captured: Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHpYhLm2ZxZjq8ni1nr4bC-Mj51cN2rHD14cZ6t534YkpzD2DWvEVdoOya3h9-zPZ6J-GJV-LN8vD_wCly6dlMtsQY1nyaROvuXi93cQFQjmwWifxJrv5DXZZm6lQPcuFbE6zIv1JqRgrDi0lSGYLJCdR31Njm26_uWozmza2TywXQ Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:35.751990 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6016c15bfdde44bab9699c21dabfe9c1"}]}] Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0850088244324db999931ef997700a69 Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: exception: Aggregate 5 could not be found. Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5'} Oct 24 08:51:35.753257 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:35.753996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 24 08:51:35.755039 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.762480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b27515b2-5787-4c30-9171-89a74f7b26b1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:35.763650 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b27515b2-5787-4c30-9171-89a74f7b26b1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.037161 Oct 24 08:51:35.765075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 120/226] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:51:35 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:35.778454 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-936884e6-026e-4d8d-b854-769d7dba61de tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.800572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-936884e6-026e-4d8d-b854-769d7dba61de tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-936884e6-026e-4d8d-b854-769d7dba61de tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Request method failure captured: Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHpYhLm2ZxZjq8ni1nr4bC-Mj51cN2rHD14cZ6t534YkpzD2DWvEVdoOya3h9-zPZ6J-GJV-LN8vD_wCly6dlMtsQY1nyaROvuXi93cQFQjmwWifxJrv5DXZZm6lQPcuFbE6zIv1JqRgrDi0lSGYLJCdR31Njm26_uWozmza2TywXQ Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:35.807572 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6016c15bfdde44bab9699c21dabfe9c1"}]}] Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0850088244324db999931ef997700a69 Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: exception: Aggregate 5 could not be found. Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5'} Oct 24 08:51:35.808834 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:35.809586 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:35.810596 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:35.811786 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:35.811786 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:35.811786 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:35.811786 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 24 08:51:35.811786 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:35.813859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-936884e6-026e-4d8d-b854-769d7dba61de tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:35.814912 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-936884e6-026e-4d8d-b854-769d7dba61de tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.044843 Oct 24 08:51:35.820794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 121/227] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:35 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:35.831820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a64a42f3-6e1e-4e49-961e-fc739aa5bf83 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1388504483", "name": "tempest-test_aggregate-119688801"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:35.836631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-a64a42f3-6e1e-4e49-961e-fc739aa5bf83 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid cf5a76c4-73f6-4e2f-b1cd-6705b1054eb6 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:35.906865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a64a42f3-6e1e-4e49-961e-fc739aa5bf83 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.078236 Oct 24 08:51:35.908554 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 122/228] 10.222.0.25 () {60 vars in 1165 bytes} [Mon Oct 24 08:51:35 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:35.924753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e16cde5e-2284-4f12-a64d-acf11c121ed0 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.976253 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e16cde5e-2284-4f12-a64d-acf11c121ed0 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.059437 Oct 24 08:51:35.977860 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 123/229] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:35.985424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97b5c077-76ad-4060-bf7f-ce60c6b4b619 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.997491 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-97b5c077-76ad-4060-bf7f-ce60c6b4b619 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97b5c077-76ad-4060-bf7f-ce60c6b4b619 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Request method failure captured: Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHpYhLm2ZxZjq8ni1nr4bC-Mj51cN2rHD14cZ6t534YkpzD2DWvEVdoOya3h9-zPZ6J-GJV-LN8vD_wCly6dlMtsQY1nyaROvuXi93cQFQjmwWifxJrv5DXZZm6lQPcuFbE6zIv1JqRgrDi0lSGYLJCdR31Njm26_uWozmza2TywXQ Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:35.998984 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6016c15bfdde44bab9699c21dabfe9c1"}]}] Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0850088244324db999931ef997700a69 Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: exception: Aggregate 7 could not be found. Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7'} Oct 24 08:51:36.000144 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.000828 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 24 08:51:36.001923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.004835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97b5c077-76ad-4060-bf7f-ce60c6b4b619 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:36.017766 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97b5c077-76ad-4060-bf7f-ce60c6b4b619 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.032885 Oct 24 08:51:36.018591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 124/230] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:51:35 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:36.026769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e288fea-db25-49af-aa83-2e11f0971f1c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.063678 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3e288fea-db25-49af-aa83-2e11f0971f1c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e288fea-db25-49af-aa83-2e11f0971f1c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Request method failure captured: Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHpYhLm2ZxZjq8ni1nr4bC-Mj51cN2rHD14cZ6t534YkpzD2DWvEVdoOya3h9-zPZ6J-GJV-LN8vD_wCly6dlMtsQY1nyaROvuXi93cQFQjmwWifxJrv5DXZZm6lQPcuFbE6zIv1JqRgrDi0lSGYLJCdR31Njm26_uWozmza2TywXQ Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:36.066337 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6016c15bfdde44bab9699c21dabfe9c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6016c15bfdde44bab9699c21dabfe9c1"}]}] Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6016c15bfdde44bab9699c21dabfe9c1 Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681439917 Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0850088244324db999931ef997700a69 Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminTestJSON-1681439917-project-admin Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: exception: Aggregate 7 could not be found. Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7'} Oct 24 08:51:36.067553 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:36.068765 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.069823 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:36.070959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:36.070959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:36.070959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:36.070959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 24 08:51:36.070959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.073987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e288fea-db25-49af-aa83-2e11f0971f1c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:36.076641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e288fea-db25-49af-aa83-2e11f0971f1c tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.052246 Oct 24 08:51:36.077961 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 125/231] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:36 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:36.089466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8d0d50e-be45-4bb1-bba4-e118ab0b4494 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1655722085"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.094647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-a8d0d50e-be45-4bb1-bba4-e118ab0b4494 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid 74338989-5039-40f3-b74c-3e050a30dbcc for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:36.132055 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8d0d50e-be45-4bb1-bba4-e118ab0b4494 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044396 Oct 24 08:51:36.132899 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 126/232] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:36.146855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3cb671b7-ef62-4bfa-8e52-eb303255ba74 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.162964 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-906657eb-25df-458a-9b14-bf865c2a2ea6 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.675974 Oct 24 08:51:36.163870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 107/233] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:35 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.173059 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3cb671b7-ef62-4bfa-8e52-eb303255ba74 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.031817 Oct 24 08:51:36.173657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 127/234] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:51:36 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:36.175710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8d5ade50-5ee9-470d-92d8-259f91905009 req-5ab29d84-213b-490f-852e-56024e409609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06a0c8a-abf1-42ee-ac72-f5c8af112443", "tag": "444f49df-70cc-4f5d-80b6-9145c6637381"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.180154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.187872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8d5ade50-5ee9-470d-92d8-259f91905009 req-5ab29d84-213b-490f-852e-56024e409609 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.189104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8d5ade50-5ee9-470d-92d8-259f91905009 req-5ab29d84-213b-490f-852e-56024e409609 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.189743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8d5ade50-5ee9-470d-92d8-259f91905009 req-5ab29d84-213b-490f-852e-56024e409609 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.201711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.203552 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8d5ade50-5ee9-470d-92d8-259f91905009 req-5ab29d84-213b-490f-852e-56024e409609 service nova] Creating event network-changed:444f49df-70cc-4f5d-80b6-9145c6637381 for instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 on n-h1-master-1 Oct 24 08:51:36.205003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.205516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.212418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8d5ade50-5ee9-470d-92d8-259f91905009 req-5ab29d84-213b-490f-852e-56024e409609 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041349 Oct 24 08:51:36.214023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 108/235] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.221105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f935ed95-3a49-45b0-a569-ae2317b11919 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.259472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-master-1. Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 39 Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:36.285621 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: {"add_host": {"host": "n-h2-master-1"}} Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:36.286937 n-d-master-1 devstack@n-api.service[126920]: exception: Aggregate 6 already has host n-h2-master-1. Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result.read() Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:51:36.287887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi session.flush() Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:51:36.288886 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:51:36.289986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:51:36.292702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result.read() Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 24, 8, 51, 36, 248908), 'updated_at': None, 'host': 'n-h2-master-1', 'aggregate_id': 6}] Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.295208 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-master-1. Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.299996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-master-1. Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:36.303432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:36.306428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-master-1. Oct 24 08:51:36.306428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:36.306761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f935ed95-3a49-45b0-a569-ae2317b11919 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.074280 Oct 24 08:51:36.306761 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 109/236] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.307105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-master-1. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:36.307105 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-533a0caa-4a77-4c06-aede-34c3b8160351 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.123176 Oct 24 08:51:36.307105 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 128/237] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 24 08:51:36.307522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.307522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:36.313501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d28e9b34-18aa-44c1-a92d-35a6ffb39c54 req-60851aa8-2ec4-4d5a-ab37-379d58a6a691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ae30e9-993b-4756-97fd-4e52861acaa3", "tag": "5e0ef215-44b7-4229-a74d-7a8b0e943828"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.316517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.317375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.317821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.318956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.319423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.319853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.327985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d28e9b34-18aa-44c1-a92d-35a6ffb39c54 req-60851aa8-2ec4-4d5a-ab37-379d58a6a691 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.328526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d28e9b34-18aa-44c1-a92d-35a6ffb39c54 req-60851aa8-2ec4-4d5a-ab37-379d58a6a691 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.332079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d28e9b34-18aa-44c1-a92d-35a6ffb39c54 req-60851aa8-2ec4-4d5a-ab37-379d58a6a691 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.349601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d28e9b34-18aa-44c1-a92d-35a6ffb39c54 req-60851aa8-2ec4-4d5a-ab37-379d58a6a691 service nova] Creating event network-changed:5e0ef215-44b7-4229-a74d-7a8b0e943828 for instance 61ae30e9-993b-4756-97fd-4e52861acaa3 on n-h2-master-1 Oct 24 08:51:36.355512 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d28e9b34-18aa-44c1-a92d-35a6ffb39c54 req-60851aa8-2ec4-4d5a-ab37-379d58a6a691 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046551 Oct 24 08:51:36.356818 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 129/238] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.364007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9176c9c3-921d-412b-b9a1-216e3cde537a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.385347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9176c9c3-921d-412b-b9a1-216e3cde537a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.385902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9176c9c3-921d-412b-b9a1-216e3cde537a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.386341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9176c9c3-921d-412b-b9a1-216e3cde537a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.535049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9176c9c3-921d-412b-b9a1-216e3cde537a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.176792 Oct 24 08:51:36.535745 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 130/239] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.541076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efab6404-8d7e-4399-b2c1-e2bf5843c4a5 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.551602 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efab6404-8d7e-4399-b2c1-e2bf5843c4a5 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.014810 Oct 24 08:51:36.552416 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 131/240] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:51:36 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.558020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e857e6ef-0cb2-4f55-ad42-8b7a91cd85c0 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.580807 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e857e6ef-0cb2-4f55-ad42-8b7a91cd85c0 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.026281 Oct 24 08:51:36.582274 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 132/241] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:36 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:36.589506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07ebca78-d87b-432d-8e5b-e38992cb8c11 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.616221 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07ebca78-d87b-432d-8e5b-e38992cb8c11 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.031889 Oct 24 08:51:36.617082 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 133/242] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:36 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:36.621511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed1489c6-4dc2-4b14-97cd-655a0d8e76ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-341622368"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.626698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-ed1489c6-4dc2-4b14-97cd-655a0d8e76ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid 98f6be01-3c54-40e7-bc41-7ad0282e3547 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:36.690111 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed1489c6-4dc2-4b14-97cd-655a0d8e76ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071877 Oct 24 08:51:36.690731 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 134/243] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.706037 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6652f700-0651-4973-90ea-26a174817342 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-174417318", "availability_zone": "tempest-test_az-725584060"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.712023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-6652f700-0651-4973-90ea-26a174817342 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid 520e9ab2-6a2d-4118-a9c1-65c1f921a9d0 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:36.757009 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=80,nova_api:DELETE=11 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:36.788506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:36.790582 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6652f700-0651-4973-90ea-26a174817342 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.095732 Oct 24 08:51:36.792038 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 135/244] 10.222.0.25 () {60 vars in 1165 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:36.797564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7bdf91f9-1cd0-4077-aed7-500ce18836d9 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1009633880"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:36.802853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-7bdf91f9-1cd0-4077-aed7-500ce18836d9 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Generated uuid e6519faa-dd38-4088-ab97-1f0338136aca for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:36.809725 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-89ed5cb2-2a54-4f84-a875-0b7aaf61d63b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.509549 Oct 24 08:51:36.813464 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 110/245] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:36 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:36.855396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7bdf91f9-1cd0-4077-aed7-500ce18836d9 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.061858 Oct 24 08:51:36.857164 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 136/246] 10.222.0.25 () {62 vars in 1205 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:36.873568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:36.875453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:36.887251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.888818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.889263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:36.891927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:36.892401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:36.892835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.139124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d0ea57c-5d3a-4ad9-86cc-1799e2401f97 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d0ea57c-5d3a-4ad9-86cc-1799e2401f97 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '1297fc6a7dd748e7ba7bf7a647ffd3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d0ea57c-5d3a-4ad9-86cc-1799e2401f97 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Request method failure captured: Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 39 Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHo1KHaKTRIXoyvhHJE1XD3hJTrr5_jJ1h9VTigcCMNPxgsRXEe58C0ahv1c9ePTEiutFRlYxNRof2gnlq0-kfVXYv_A4nbZpk5Yiwe26lH2em_DAPP3jWyLhSIuNS9wQmcBfm_i1n1S4FP31kehJj7cwxVXdmstwHvH1J0R8xTOBs Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:37.145546 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f35890b16448ec826fa5c1dd4e2c2c"}]}] Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1297fc6a7dd748e7ba7bf7a647ffd3da Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: {"add_host": {"host": "n-h2-master-1"}} Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:37.146821 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:37.147527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 24 08:51:37.150367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.151422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d0ea57c-5d3a-4ad9-86cc-1799e2401f97 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:37.151422 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d0ea57c-5d3a-4ad9-86cc-1799e2401f97 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.331372 Oct 24 08:51:37.152405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 111/247] 10.222.0.25 () {60 vars in 1191 bytes} [Mon Oct 24 08:51:36 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 338 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:37.167561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3b3dc85-3288-4487-a8dc-a426d087d9d1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-174417318_new", "availability_zone": "tempest-test_az-725584060_new"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.309347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:37.318485 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee816957-80c5-4c6a-b1bc-aadfd7e8cf99 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.459843 Oct 24 08:51:37.319070 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 137/248] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:36 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:37.325865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d8039bd-dcd4-4091-9833-005ea5201551 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-937120682"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.454565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3b3dc85-3288-4487-a8dc-a426d087d9d1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.456343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3b3dc85-3288-4487-a8dc-a426d087d9d1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.457525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3b3dc85-3288-4487-a8dc-a426d087d9d1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.494798 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d8039bd-dcd4-4091-9833-005ea5201551 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 299 microversion: 2.41 time: 0.172181 Oct 24 08:51:37.496331 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 138/249] 10.222.0.25 () {62 vars in 1213 bytes} [Mon Oct 24 08:51:37 2022] PUT /compute/v2.1/os-aggregates/11 => generated 299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:37.508548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61f6e9a2-c2ee-4178-aabd-cecb3922e060 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.535221 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61f6e9a2-c2ee-4178-aabd-cecb3922e060 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.030771 Oct 24 08:51:37.538485 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 139/250] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:37 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:37.545382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1055025d-7db7-4c2e-940b-4a6b1f186d40 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.561046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1055025d-7db7-4c2e-940b-4a6b1f186d40 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 299 microversion: 2.41 time: 0.021190 Oct 24 08:51:37.561684 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 140/251] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 08:51:37 2022] GET /compute/v2.1/os-aggregates/11 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:37.562499 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3b3dc85-3288-4487-a8dc-a426d087d9d1 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 334 microversion: 2.1 time: 0.408108 Oct 24 08:51:37.565520 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 112/252] 10.222.0.25 () {60 vars in 1173 bytes} [Mon Oct 24 08:51:37 2022] PUT /compute/v2.1/os-aggregates/10 => generated 334 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:37.576383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c912eef-8a1d-4c76-b472-202df5ad1116 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-67283563"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.578760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0fe60f06-21ab-4c81-acc4-dd6a8ad237c0 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.581274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-9c912eef-8a1d-4c76-b472-202df5ad1116 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid ab23ab7e-949f-4259-8d4a-ab310531941b for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:37.592661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fe60f06-21ab-4c81-acc4-dd6a8ad237c0 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.593156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fe60f06-21ab-4c81-acc4-dd6a8ad237c0 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.593630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fe60f06-21ab-4c81-acc4-dd6a8ad237c0 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.607132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c912eef-8a1d-4c76-b472-202df5ad1116 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035281 Oct 24 08:51:37.607636 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 141/253] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:37.620457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf89169b-2c1d-491e-a292-c95422bf7a78 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.632234 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf89169b-2c1d-491e-a292-c95422bf7a78 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 788 microversion: 2.1 time: 0.023426 Oct 24 08:51:37.633149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 142/254] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:51:37 2022] GET /compute/v2.1/os-aggregates => generated 788 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:37.642202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-182526881"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.655880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.658377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.659103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.670348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.671045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.671416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.683159 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-182526881 could not be found. Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 57 Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:37.685456 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: {"add_host": {"host": "tempest-nonexist_host-182526881"}} Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:37.687038 n-d-master-1 devstack@n-api.service[126920]: exception: Compute host tempest-nonexist_host-182526881 could not be found. Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-182526881'}}} Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-182526881' is not mapped to any cell Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.687776 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 24 08:51:37.691981 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-182526881 could not be found. Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-182526881 could not be found. Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.693011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-182526881 could not be found. Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-182526881 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32c50b53-2544-4f59-9f21-bd0c4cd0ca23 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.052588 Oct 24 08:51:37.696965 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 143/255] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 08:51:37 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:37.698865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db3178f4-6cb0-44e3-b05a-0c4d2f3d9daa tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.719664 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db3178f4-6cb0-44e3-b05a-0c4d2f3d9daa tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.030795 Oct 24 08:51:37.720439 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 144/256] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:37 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:37.728288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bd06d6f-ca5f-4dc6-a126-4a8aa04610e5 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.775697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9bd06d6f-ca5f-4dc6-a126-4a8aa04610e5 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.053155 Oct 24 08:51:37.778057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 145/257] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:37 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:37.794283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1fe83b9-6c38-43b1-b8d9-35f43fdfc62d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1729095262"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.807319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-d1fe83b9-6c38-43b1-b8d9-35f43fdfc62d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Generated uuid 4b6fe84a-4dac-46c5-8ecd-ac76412150d4 for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:37.848726 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0fe60f06-21ab-4c81-acc4-dd6a8ad237c0 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 314 microversion: 2.41 time: 0.277891 Oct 24 08:51:37.849369 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 113/258] 10.222.0.25 () {62 vars in 1235 bytes} [Mon Oct 24 08:51:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:37.854674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2b3da58-0527-4c67-8b3a-8239d8de9dc5 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.867738 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1fe83b9-6c38-43b1-b8d9-35f43fdfc62d tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.078581 Oct 24 08:51:37.877567 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 146/259] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:37.882834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2b3da58-0527-4c67-8b3a-8239d8de9dc5 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 283 Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:37.884011 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:37.885180 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:51:37.885945 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:37.886540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:37.887828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:37.889880 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:51:37.889880 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:51:37.889880 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 08:51:37.889880 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:37.889880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2b3da58-0527-4c67-8b3a-8239d8de9dc5 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:37.890193 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2b3da58-0527-4c67-8b3a-8239d8de9dc5 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.034778 Oct 24 08:51:37.892157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 114/260] 10.222.0.25 () {60 vars in 1165 bytes} [Mon Oct 24 08:51:37 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:51:37.898225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:37.898429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-486a9fdf-a0f3-4189-a469-0e256c04ac42 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:37.906403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.909203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.909781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.910609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.911426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.911896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.913846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486a9fdf-a0f3-4189-a469-0e256c04ac42 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.914524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486a9fdf-a0f3-4189-a469-0e256c04ac42 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.915154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486a9fdf-a0f3-4189-a469-0e256c04ac42 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.096382 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-486a9fdf-a0f3-4189-a469-0e256c04ac42 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 299 microversion: 2.41 time: 0.202795 Oct 24 08:51:38.097667 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 115/261] 10.222.0.25 () {62 vars in 1235 bytes} [Mon Oct 24 08:51:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:38.104650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8129f997-f273-4743-8b94-3347b28e0746 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.116956 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8129f997-f273-4743-8b94-3347b28e0746 tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 469 microversion: 2.1 time: 0.017899 Oct 24 08:51:38.124881 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 116/262] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-aggregates => generated 469 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.125056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.133890 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57df8347-ad33-434a-838b-1869f6d47a6a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.254899 Oct 24 08:51:38.148092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 147/263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:37 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:38.148288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7312476e-1f8a-422b-b64b-be23b1876f67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:38.148395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6efdf91a-b1a5-466d-aec9-53845d27a165 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7312476e-1f8a-422b-b64b-be23b1876f67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 27 Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:38.148507 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: {"aggregate": {"name": ""}} Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:38.149843 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '' Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:38.150726 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 08:51:38.153561 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.163474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7312476e-1f8a-422b-b64b-be23b1876f67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:38.163474 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7312476e-1f8a-422b-b64b-be23b1876f67 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.020567 Oct 24 08:51:38.163474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 117/264] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:38 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:51:38.163474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38c5af52-b0d8-4a28-89da-480ed585221a tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.192358 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6efdf91a-b1a5-466d-aec9-53845d27a165 tempest-AggregatesAdminTestV241-658200791 tempest-AggregatesAdminTestV241-658200791-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.055847 Oct 24 08:51:38.193826 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 148/265] 10.222.0.25 () {60 vars in 1196 bytes} [Mon Oct 24 08:51:38 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.198081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38c5af52-b0d8-4a28-89da-480ed585221a tempest-AggregatesAdminTestJSON-1681439917 tempest-AggregatesAdminTestJSON-1681439917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.048461 Oct 24 08:51:38.198491 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 118/266] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:38 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:38.204777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bfea873-3ae3-4d7a-9ccb-cbba302db1d0 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2143055286"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:38.208889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2bfea873-3ae3-4d7a-9ccb-cbba302db1d0 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '1297fc6a7dd748e7ba7bf7a647ffd3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bfea873-3ae3-4d7a-9ccb-cbba302db1d0 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Request method failure captured: Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 60 Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo1KHaKTRIXoyvhHJE1XD3hJTrr5_jJ1h9VTigcCMNPxgsRXEe58C0ahv1c9ePTEiutFRlYxNRof2gnlq0-kfVXYv_A4nbZpk5Yiwe26lH2em_DAPP3jWyLhSIuNS9wQmcBfm_i1n1S4FP31kehJj7cwxVXdmstwHvH1J0R8xTOBs Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:38.211264 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f35890b16448ec826fa5c1dd4e2c2c"}]}] Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 1297fc6a7dd748e7ba7bf7a647ffd3da Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: {"aggregate": {"name": "tempest-test_aggregate-2143055286"}} Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:38.212418 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2143055286'}}} Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:38.213196 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:38.214234 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 24 08:51:38.215324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.215324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bfea873-3ae3-4d7a-9ccb-cbba302db1d0 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:38.215324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bfea873-3ae3-4d7a-9ccb-cbba302db1d0 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012674 Oct 24 08:51:38.215324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 149/267] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:38 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:38.215593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.215671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:38.224807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a5ce1bb5-da99-4e06-9399-068d4ffb815b tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-642602657"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:38.232243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.234224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.234700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.238286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-a5ce1bb5-da99-4e06-9399-068d4ffb815b tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid 5c606e59-b950-430c-9c36-6f9f207d825e for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:38.239197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.239704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.242220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.267794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] HTTP exception thrown: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Request method failure captured: Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e HTTP/1.1 Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHm6wXAXFRafGH0CzH44CXHh7Rr1HqHD5lii5axfGblFVRYtu-O6ZrVuhUyRVRSVeBzxWS7rQW__CLj7M50emGFMdCnqlDhiJA7N6psoJzPVhn5JQ_cXKfpxiAEPZV5IfM0OKLySh1u2BCVwAy7Q9uvqjD5XU9p6wg-JF5qQKPF4-w Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b6c53bdfc24c4cb0a6c9b02779cc7d62 Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:38.270250 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}] Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b6c53bdfc24c4cb0a6c9b02779cc7d62 Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminTestJSON-1705809586-project Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: f8347b4e37424f499f5756ca8b88fab4 Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminTestJSON-1705809586-project Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.272284 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f6fbbe4c-b7bf-4396-ae31-0280d971fa9e'} Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:38.273079 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.275086 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.277164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Returning 404 to user: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:38.277164 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3d23b9e-3922-421a-a759-e6c2d5268033 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 404 len: 111 microversion: 2.1 time: 0.069890 Oct 24 08:51:38.277164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 119/268] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:51:38 2022] DELETE /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:38.282720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8daba5daf0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.290147 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a5ce1bb5-da99-4e06-9399-068d4ffb815b tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068676 Oct 24 08:51:38.290613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.291665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.292185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.292648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 150/269] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.293499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.294173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.294835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.313521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.322326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] [instance: f6fbbe4c-b7bf-4396-ae31-0280d971fa9e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:38.337186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a276c815-2ef0-43c5-a84e-604b0cacf02a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.061403 Oct 24 08:51:38.338548 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 120/270] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.344624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-389ad413-8008-47f0-90b7-9ca61808294a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-642602657"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:38.346659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.348754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-389ad413-8008-47f0-90b7-9ca61808294a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid bc2de4bd-603c-4ede-bab4-21b8a3f882cd for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:38.348887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.349361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.350132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.350599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.351047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.365088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-389ad413-8008-47f0-90b7-9ca61808294a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-642602657 already exists. Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-389ad413-8008-47f0-90b7-9ca61808294a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 59 Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:38.368996 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: {"aggregate": {"name": "tempest-test_aggregate-642602657"}} Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:38.370209 n-d-master-1 devstack@n-api.service[126919]: exception: Aggregate tempest-test_aggregate-642602657 already exists. Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-642602657'}}} Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 24 08:51:38.370923 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-642602657 already exists. Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:38.372225 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-642602657 already exists. Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-642602657 already exists. Oct 24 08:51:38.373342 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.377692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-389ad413-8008-47f0-90b7-9ca61808294a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-642602657 already exists. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:38.379121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-389ad413-8008-47f0-90b7-9ca61808294a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.038717 Oct 24 08:51:38.380126 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 121/271] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:38 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:38.388756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.389615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:38.397465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.398276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.398803 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] HTTP exception thrown: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.399296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.400301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Request method failure captured: Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e HTTP/1.1 Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHm6wXAXFRafGH0CzH44CXHh7Rr1HqHD5lii5axfGblFVRYtu-O6ZrVuhUyRVRSVeBzxWS7rQW__CLj7M50emGFMdCnqlDhiJA7N6psoJzPVhn5JQ_cXKfpxiAEPZV5IfM0OKLySh1u2BCVwAy7Q9uvqjD5XU9p6wg-JF5qQKPF4-w Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b6c53bdfc24c4cb0a6c9b02779cc7d62 Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:38.400671 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6c53bdfc24c4cb0a6c9b02779cc7d62"}]}] Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b6c53bdfc24c4cb0a6c9b02779cc7d62 Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705809586 Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminTestJSON-1705809586-project Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f8347b4e37424f499f5756ca8b88fab4 Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminTestJSON-1705809586-project Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: exception: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.401844 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'f6fbbe4c-b7bf-4396-ae31-0280d971fa9e'} Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:38.402476 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. Oct 24 08:51:38.403491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.404838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] Returning 404 to user: Instance f6fbbe4c-b7bf-4396-ae31-0280d971fa9e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:38.406404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.407887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.416084 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9dbcd607-e9b1-4ca3-844a-e18cc17493d1 tempest-AggregatesAdminTestJSON-1705809586 tempest-AggregatesAdminTestJSON-1705809586-project] 10.222.0.25 "GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e" status: 404 len: 111 microversion: 2.1 time: 0.122228 Oct 24 08:51:38.416762 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 151/272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/servers/f6fbbe4c-b7bf-4396-ae31-0280d971fa9e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:38.435752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8dab7d89d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.440712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.442326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.444470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.446090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.446736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.447197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.518428 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c86123a-d0e0-48a6-9fae-5bc3d91c0412 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.097346 Oct 24 08:51:38.524748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 152/273] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.531341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82287eac-45e6-4432-9dd7-3fed69743585 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.564650 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-82287eac-45e6-4432-9dd7-3fed69743585 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.035782 Oct 24 08:51:38.565637 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 153/274] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:38 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:38.580852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8dab9f2430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.585680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.597197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.597894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.601680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.605782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.606514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.685936 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7df9d111-ff38-415c-8b3b-1e198adc403a tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.110216 Oct 24 08:51:38.703436 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 154/275] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.709861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1bdbe009-be6a-49d6-ad1a-aff2336b241b tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-823021778"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:38.728600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.aggregate [None req-1bdbe009-be6a-49d6-ad1a-aff2336b241b tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid db8959a6-8489-44a8-9f5d-6cc341421fdf for aggregate {{(pid=126920) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:38.729396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.739038 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49b6ecd3-c680-4d98-87d5-02ed51091aa1 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.356910 Oct 24 08:51:38.758697 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 122/276] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:38.768797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8daba1e040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.791368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.793477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.795268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.796351 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1bdbe009-be6a-49d6-ad1a-aff2336b241b tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088269 Oct 24 08:51:38.797151 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 155/277] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.842471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.843034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.843548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.904539 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee9e42ae-3eab-4474-add5-55fc11925df7 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.144576 Oct 24 08:51:38.910141 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 123/278] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:38.920004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0f94fac-6906-48bf-bb6e-b0d9c41a29ed tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.924067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0f94fac-6906-48bf-bb6e-b0d9c41a29ed tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '1297fc6a7dd748e7ba7bf7a647ffd3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0f94fac-6906-48bf-bb6e-b0d9c41a29ed tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Request method failure captured: Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHo1KHaKTRIXoyvhHJE1XD3hJTrr5_jJ1h9VTigcCMNPxgsRXEe58C0ahv1c9ePTEiutFRlYxNRof2gnlq0-kfVXYv_A4nbZpk5Yiwe26lH2em_DAPP3jWyLhSIuNS9wQmcBfm_i1n1S4FP31kehJj7cwxVXdmstwHvH1J0R8xTOBs Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:38.932924 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f35890b16448ec826fa5c1dd4e2c2c"}]}] Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1297fc6a7dd748e7ba7bf7a647ffd3da Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 24 08:51:38.934512 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '15'} Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:38.935354 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 24 08:51:38.936421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:38.938338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0f94fac-6906-48bf-bb6e-b0d9c41a29ed tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:38.939710 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0f94fac-6906-48bf-bb6e-b0d9c41a29ed tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.027761 Oct 24 08:51:38.940458 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 124/279] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:38.949618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Calling method '.version_select at 0x7f8dab8e31f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.958361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.959226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.959864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.976389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.977431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.978148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.995403 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0f42b93-d889-4d2e-b7aa-2f4051a775c6 tempest-HostsAdminTestJSON-92423217 tempest-HostsAdminTestJSON-92423217-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.049806 Oct 24 08:51:38.996607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 125/280] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 467 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:39.009010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3001c016-35e4-48c1-b260-1b67e4235d6f tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.038180 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3001c016-35e4-48c1-b260-1b67e4235d6f tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.038041 Oct 24 08:51:39.041544 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 126/281] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:39.055757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3cbb84f4-f5a8-4330-93e4-ea94fb2f33ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.086877 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3cbb84f4-f5a8-4330-93e4-ea94fb2f33ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3cbb84f4-f5a8-4330-93e4-ea94fb2f33ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:39.088558 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: exception: Aggregate -1 could not be found. Oct 24 08:51:39.089793 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '-1'} Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 08:51:39.090436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.095835 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3cbb84f4-f5a8-4330-93e4-ea94fb2f33ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3cbb84f4-f5a8-4330-93e4-ea94fb2f33ab tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042974 Oct 24 08:51:39.098153 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 127/282] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:39 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:39.100275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db71e8ea-93c6-4697-9bcd-49af6de1740e tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1060634331"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:39.109624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-db71e8ea-93c6-4697-9bcd-49af6de1740e tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid 97d47fa7-c88d-4237-bdca-6f408204ca2c for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:39.128382 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:39.172595 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db71e8ea-93c6-4697-9bcd-49af6de1740e tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.075448 Oct 24 08:51:39.184350 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 128/283] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:39.195122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.198200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:39.215948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.216736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.218303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.219409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.219879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.221510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.340768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-daebc869-0d84-4c53-829c-e5403514eaea tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Calling method '.version_select at 0x7f8dab7c3160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.497119 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-daebc869-0d84-4c53-829c-e5403514eaea tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.694459 Oct 24 08:51:39.497824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 156/284] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:39.503975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-915dca7e-6c27-4bac-936b-6ec9169f89a1 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.507024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-915dca7e-6c27-4bac-936b-6ec9169f89a1 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '1297fc6a7dd748e7ba7bf7a647ffd3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-915dca7e-6c27-4bac-936b-6ec9169f89a1 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Request method failure captured: Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo1KHaKTRIXoyvhHJE1XD3hJTrr5_jJ1h9VTigcCMNPxgsRXEe58C0ahv1c9ePTEiutFRlYxNRof2gnlq0-kfVXYv_A4nbZpk5Yiwe26lH2em_DAPP3jWyLhSIuNS9wQmcBfm_i1n1S4FP31kehJj7cwxVXdmstwHvH1J0R8xTOBs Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:39.508990 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f35890b16448ec826fa5c1dd4e2c2c"}]}] Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 1297fc6a7dd748e7ba7bf7a647ffd3da Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 24 08:51:39.510315 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '16'} Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:39.510986 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 24 08:51:39.511961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.517321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-915dca7e-6c27-4bac-936b-6ec9169f89a1 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:39.518473 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-915dca7e-6c27-4bac-936b-6ec9169f89a1 tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.019439 Oct 24 08:51:39.519260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 157/285] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:39 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:39.527278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cc29fa1-fd69-4383-99b4-020f4a3c9647 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Action: 'create', calling method: .version_select at 0x7f8dabc5b430>, body: {"pool": "non_exist_pool"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:39.564705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:39.574409 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e71e6649-29e5-4eda-bd85-fbeba628fc76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.388724 Oct 24 08:51:39.574998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 129/286] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:39 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:39.580071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23fbfefc-432d-48c5-8533-2714abd35419 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.626414 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23fbfefc-432d-48c5-8533-2714abd35419 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.049704 Oct 24 08:51:39.627185 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 130/287] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:39 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:39.644207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37602b9c-b3a4-4a8d-9d8e-29c0b22083be tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.655512 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-37602b9c-b3a4-4a8d-9d8e-29c0b22083be tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37602b9c-b3a4-4a8d-9d8e-29c0b22083be tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:39.657424 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: exception: Aggregate -1 could not be found. Oct 24 08:51:39.658971 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '-1'} Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.659614 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 24 08:51:39.660685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.663969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37602b9c-b3a4-4a8d-9d8e-29c0b22083be tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:39.664248 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8cc29fa1-fd69-4383-99b4-020f4a3c9647 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] HTTP exception thrown: Floating IP pool not found. Oct 24 08:51:39.665436 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37602b9c-b3a4-4a8d-9d8e-29c0b22083be tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031619 Oct 24 08:51:39.666543 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 131/288] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cc29fa1-fd69-4383-99b4-020f4a3c9647 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Request method failure captured: Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 26 Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIaUUEch_rMDZ_W3o4KZW7Pw-rVZVQlWFpSnsEcwQGaIHbG3WzubVi5EwnAQD3h0F-tNEdt4LP1kf5XuFZC76sMhbuVmcn2u4gLVMZOkmPdZwTUyKZ7ZhENslJtifSckob-sZ63uA65sJp2qNmm4xSrHSuJgr490gPn2siC0TO04cg Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e306129f54ed47fc8682f46b3cb7c955 Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-676717474 Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:39.667720 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e306129f54ed47fc8682f46b3cb7c955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e306129f54ed47fc8682f46b3cb7c955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e306129f54ed47fc8682f46b3cb7c955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e306129f54ed47fc8682f46b3cb7c955"}]}] Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-676717474 Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e306129f54ed47fc8682f46b3cb7c955 Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-676717474 Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsNegativeTestJSON-676717474-project Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f30ed27bff6c406a987841dcf1ade4a1 Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-676717474-project Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: {"pool": "non_exist_pool"} Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP pool not found. Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 24 08:51:39.669134 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:39.670184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 24 08:51:39.671477 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.673287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cc29fa1-fd69-4383-99b4-020f4a3c9647 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Returning 404 to user: Floating IP pool not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:39.674668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8cc29fa1-fd69-4383-99b4-020f4a3c9647 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.154041 Oct 24 08:51:39.675559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 158/289] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 08:51:39 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:39.678633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8fe571b3-3183-4011-bfde-0dfff679391c tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.680671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8fe571b3-3183-4011-bfde-0dfff679391c tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '1297fc6a7dd748e7ba7bf7a647ffd3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8fe571b3-3183-4011-bfde-0dfff679391c tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Request method failure captured: Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHo1KHaKTRIXoyvhHJE1XD3hJTrr5_jJ1h9VTigcCMNPxgsRXEe58C0ahv1c9ePTEiutFRlYxNRof2gnlq0-kfVXYv_A4nbZpk5Yiwe26lH2em_DAPP3jWyLhSIuNS9wQmcBfm_i1n1S4FP31kehJj7cwxVXdmstwHvH1J0R8xTOBs Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:39.682625 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f35890b16448ec826fa5c1dd4e2c2c"}]}] Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1297fc6a7dd748e7ba7bf7a647ffd3da Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 24 08:51:39.683936 n-d-master-1 devstack@n-api.service[126919]: action_args: {} Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:39.684783 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 24 08:51:39.686040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.689761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8fe571b3-3183-4011-bfde-0dfff679391c tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:39.691247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8fe571b3-3183-4011-bfde-0dfff679391c tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018078 Oct 24 08:51:39.692489 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 132/290] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:51:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:39.693776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7451873c-e2cd-4fb4-bc3a-a6e2b32f38f6 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Calling method '.version_select at 0x7f8dab731ee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.703953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2f9952f-2440-44ef-8c50-683eb016c362 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1696868618"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:39.717965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-e2f9952f-2440-44ef-8c50-683eb016c362 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid 3c1e9c77-e28b-43f4-9a55-5111a6817bdf for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:39.782864 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2f9952f-2440-44ef-8c50-683eb016c362 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084317 Oct 24 08:51:39.792359 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 133/291] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:39.802901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.804129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:39.809500 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-7451873c-e2cd-4fb4-bc3a-a6e2b32f38f6 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 could not be found", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:51:39.810588 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-7451873c-e2cd-4fb4-bc3a-a6e2b32f38f6 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] HTTP exception thrown: Floating IP not found for ID d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 Oct 24 08:51:39.822292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.824415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.825670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.828495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.829922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.832229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7451873c-e2cd-4fb4-bc3a-a6e2b32f38f6 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Request method failure captured: Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-floating-ips/d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 HTTP/1.1 Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIaUUEch_rMDZ_W3o4KZW7Pw-rVZVQlWFpSnsEcwQGaIHbG3WzubVi5EwnAQD3h0F-tNEdt4LP1kf5XuFZC76sMhbuVmcn2u4gLVMZOkmPdZwTUyKZ7ZhENslJtifSckob-sZ63uA65sJp2qNmm4xSrHSuJgr490gPn2siC0TO04cg Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e306129f54ed47fc8682f46b3cb7c955 Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-676717474 Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:39.839603 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e306129f54ed47fc8682f46b3cb7c955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e306129f54ed47fc8682f46b3cb7c955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e306129f54ed47fc8682f46b3cb7c955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e306129f54ed47fc8682f46b3cb7c955"}]}] Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-676717474 Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e306129f54ed47fc8682f46b3cb7c955 Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-676717474 Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsNegativeTestJSON-676717474-project Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f30ed27bff6c406a987841dcf1ade4a1 Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-676717474-project Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP not found for ID d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'd4ba14d9-5c5b-49d7-97e6-25d38a2ada61'} Oct 24 08:51:39.840940 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:51:39.841669 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 could not be found Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a5a1c5c-52be-445a-8106-cf451334da28'] Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d4ba14d9-5c5b-49d7-97e6-25d38a2ada61. Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.842643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:39.843676 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:39.844714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 Oct 24 08:51:39.844714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:39.846492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7451873c-e2cd-4fb4-bc3a-a6e2b32f38f6 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] Returning 404 to user: Floating IP not found for ID d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:39.848361 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7451873c-e2cd-4fb4-bc3a-a6e2b32f38f6 tempest-FloatingIPsNegativeTestJSON-676717474 tempest-FloatingIPsNegativeTestJSON-676717474-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d4ba14d9-5c5b-49d7-97e6-25d38a2ada61" status: 404 len: 111 microversion: 2.1 time: 0.166840 Oct 24 08:51:39.849063 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 159/292] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:51:39 2022] DELETE /compute/v2.1/os-floating-ips/d4ba14d9-5c5b-49d7-97e6-25d38a2ada61 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:51:39.854543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbcae2df-d0bf-436f-9b33-da2d7185b87a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:39.886376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbcae2df-d0bf-436f-9b33-da2d7185b87a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.887158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbcae2df-d0bf-436f-9b33-da2d7185b87a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.887813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbcae2df-d0bf-436f-9b33-da2d7185b87a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.997614 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:40.191595 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbcae2df-d0bf-436f-9b33-da2d7185b87a tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.338552 Oct 24 08:51:40.192946 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 160/293] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 08:51:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:40.206282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed9083ab-1bba-4a52-8a5b-2b2b7fa6850b tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:40.217350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed9083ab-1bba-4a52-8a5b-2b2b7fa6850b tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '1297fc6a7dd748e7ba7bf7a647ffd3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed9083ab-1bba-4a52-8a5b-2b2b7fa6850b tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Request method failure captured: Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 42 Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHo1KHaKTRIXoyvhHJE1XD3hJTrr5_jJ1h9VTigcCMNPxgsRXEe58C0ahv1c9ePTEiutFRlYxNRof2gnlq0-kfVXYv_A4nbZpk5Yiwe26lH2em_DAPP3jWyLhSIuNS9wQmcBfm_i1n1S4FP31kehJj7cwxVXdmstwHvH1J0R8xTOBs Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:40.219409 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0f35890b16448ec826fa5c1dd4e2c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0f35890b16448ec826fa5c1dd4e2c2c"}]}] Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b0f35890b16448ec826fa5c1dd4e2c2c Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-948446787 Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 1297fc6a7dd748e7ba7bf7a647ffd3da Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-948446787-project Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: {"remove_host": {"host": "n-h2-master-1"}} Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:40.220855 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-master-1'}}} Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:40.221843 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 24 08:51:40.223072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.227505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed9083ab-1bba-4a52-8a5b-2b2b7fa6850b tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:40.235083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed9083ab-1bba-4a52-8a5b-2b2b7fa6850b tempest-AggregatesAdminNegativeTestJSON-948446787 tempest-AggregatesAdminNegativeTestJSON-948446787-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.033943 Oct 24 08:51:40.236261 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 161/294] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 08:51:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:51:40.245276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fd4a6dd-6b43-4055-b28d-7fc345d4e610 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:40.270156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd4a6dd-6b43-4055-b28d-7fc345d4e610 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.272577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd4a6dd-6b43-4055-b28d-7fc345d4e610 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.273191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd4a6dd-6b43-4055-b28d-7fc345d4e610 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.336606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:40.344919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38ce20a1-5727-4bd1-bb69-0dd608865359 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.551064 Oct 24 08:51:40.350127 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 134/295] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:39 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:40.542616 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fd4a6dd-6b43-4055-b28d-7fc345d4e610 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.302137 Oct 24 08:51:40.543536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 162/296] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 08:51:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:40.555977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cfb0ba7d-e908-49ac-a345-831b3b99e22e tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:40.599926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:40.600543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:40.616656 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cfb0ba7d-e908-49ac-a345-831b3b99e22e tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.065296 Oct 24 08:51:40.618555 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 135/297] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:40 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:40.626139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.626643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.635862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2628321-70b0-463c-8e48-1afbc7387c34 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1715832016"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:40.639304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-f2628321-70b0-463c-8e48-1afbc7387c34 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Generated uuid 24de9977-f19e-4fbc-b7d3-85cf84fb2e4b for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 08:51:40.640870 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=80,nova_cell0:UPDATE=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:40.643702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.645864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.648014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.648676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.691402 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2628321-70b0-463c-8e48-1afbc7387c34 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067074 Oct 24 08:51:40.698697 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 136/298] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 08:51:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:40.710993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:40.736519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.737447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.739361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.755815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.758787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.763026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.785521 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.compute.aggregates [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 24 08:51:40.788662 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Request method failure captured: Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 42 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHqu8I_Vhfj-l2LUSIsgyaX32PTV5oHZEuGktZvsk7RzYGGQyN9b8YU9M-Pj1pkU8Qg4zUX_ZO08Mh3rhY4CzPbxt25ussYhiHb24OCicUh-cbsnovnHnLHBf4rGzGWrsJ4_ZEU4rkxDWVeN8E-RdToL2ZgNgg-Qpp7R2YPOa_Y-NI Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:40.791869 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b8b8b36f82984eb9bbbbda190dca1bb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b8b8b36f82984eb9bbbbda190dca1bb9"}]}] Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b8b8b36f82984eb9bbbbda190dca1bb9 Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-392101386 Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2a4e66ab55bf4171ad321a7dc89b98b1 Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: {"remove_host": {"host": "nonexist_host"}} Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:40.793148 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 24 08:51:40.794186 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 24 08:51:40.795235 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.796278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:40.797378 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:40.797378 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:40.797378 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:40.797378 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:40.797378 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 24 08:51:40.797378 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:40.799829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:40.804934 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08d77862-c0c9-4aaf-93f6-7cbbde49ca02 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.104872 Oct 24 08:51:40.809665 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 137/299] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 08:51:40 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:40.822274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19091ffa-cc41-475b-85eb-fbad1beb24a0 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:40.863684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19091ffa-cc41-475b-85eb-fbad1beb24a0 tempest-AggregatesAdminNegativeTestJSON-392101386 tempest-AggregatesAdminNegativeTestJSON-392101386-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.048651 Oct 24 08:51:40.864524 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 138/300] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 08:51:40 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 08:51:41.065064 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=98 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:41.164535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:41.174063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ffc0f99c-3cf5-40f7-9ae9-43b128ed9916 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.578102 Oct 24 08:51:41.175889 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 163/301] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:40 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:41.371316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:41.372120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:41.383693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:41.384808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:41.385795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:41.390927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:41.393402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:41.394039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:42.023526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:42.038397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43a8e6ba-1b3a-4a26-b8e3-f7bc16c99dab tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.672297 Oct 24 08:51:42.039293 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 139/302] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:41 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:42.200191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:42.202012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:42.204229 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=11 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:42.232183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:42.232911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:42.233830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:42.234787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:42.235456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:42.236089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:42.557986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:42.573392 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12f2d62a-8c14-4084-b5be-1c08a98c9530 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.376459 Oct 24 08:51:42.574276 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 164/303] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:42 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:42.869493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-859dd82a-2363-4a73-8b2e-d695765e92e0 req-f17685b5-4db9-4bc6-9573-793fdd4a92f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06a0c8a-abf1-42ee-ac72-f5c8af112443", "name": "network-vif-plugged", "status": "completed", "tag": "444f49df-70cc-4f5d-80b6-9145c6637381"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:42.910842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-859dd82a-2363-4a73-8b2e-d695765e92e0 req-f17685b5-4db9-4bc6-9573-793fdd4a92f4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:42.913580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-859dd82a-2363-4a73-8b2e-d695765e92e0 req-f17685b5-4db9-4bc6-9573-793fdd4a92f4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:42.915391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-859dd82a-2363-4a73-8b2e-d695765e92e0 req-f17685b5-4db9-4bc6-9573-793fdd4a92f4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:42.983738 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-859dd82a-2363-4a73-8b2e-d695765e92e0 req-f17685b5-4db9-4bc6-9573-793fdd4a92f4 service nova] Creating event network-vif-plugged:444f49df-70cc-4f5d-80b6-9145c6637381 for instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 on n-h1-master-1 Oct 24 08:51:43.007125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-859dd82a-2363-4a73-8b2e-d695765e92e0 req-f17685b5-4db9-4bc6-9573-793fdd4a92f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142872 Oct 24 08:51:43.011914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 165/304] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:43.062383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:43.069364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:43.100693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:43.101227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:43.102963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:43.106859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:43.107456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:43.107905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:43.240656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1961139755", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:43.356303 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:51:43.414388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:43.427241 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-570bb3a4-cde6-4d24-86c6-a65d3968d12d tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.366555 Oct 24 08:51:43.441324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 166/305] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:43 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:43.600264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:43.601107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:43.620705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:43.621239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:43.622055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:43.622869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:43.623334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:43.623768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:43.918442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:43.926720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3d481b7-0907-43a4-a8e6-070c628b13d0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.331208 Oct 24 08:51:43.929808 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 167/306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:43 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:43.947860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:51:43.948907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:51:43.949437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:51:43.949851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:51:43.950285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:51:43.968613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:43.970792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:43.971993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:43.972744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:43.973210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:43.973671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:44.020298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Getting quotas for project 51f58b19f97f4eb7a30c2106758088d6. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:44.032662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Getting quotas for user cc1ba89738f2407abcbc8eb5cbc6d356 and project 51f58b19f97f4eb7a30c2106758088d6. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:44.067527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:51:44.070984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:51:44.139436 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c5b2336-4137-4ded-8611-c6531da763fb tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717811 Oct 24 08:51:44.140673 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 140/307] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:51:44.152743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-651edae8-621c-474b-a0eb-e7e2ba987f25 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:44.153565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-651edae8-621c-474b-a0eb-e7e2ba987f25 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:44.456802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:44.457458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:44.466307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-651edae8-621c-474b-a0eb-e7e2ba987f25 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:44.471788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:44.472190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:44.475835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:44.476650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:44.477141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:44.477606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:44.485678 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-651edae8-621c-474b-a0eb-e7e2ba987f25 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1223 microversion: 2.1 time: 0.337263 Oct 24 08:51:44.494343 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 168/308] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:44 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1223 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:44.954620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:44.956063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:44.972982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:44.980450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:44.980895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:44.981885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:44.985124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:44.985584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:45.254697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:45.283901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cee295e9-a5c8-47bb-b099-60ea057b8bf0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 0.332319 Oct 24 08:51:45.287530 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 169/309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:44 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:45.293341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b4b1b858-8ee2-49a3-aea2-c94f31a44457 req-5e542096-054c-4bda-9c3a-7e1fce31ec13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ae30e9-993b-4756-97fd-4e52861acaa3", "name": "network-vif-plugged", "status": "completed", "tag": "5e0ef215-44b7-4229-a74d-7a8b0e943828"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:45.327076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b4b1b858-8ee2-49a3-aea2-c94f31a44457 req-5e542096-054c-4bda-9c3a-7e1fce31ec13 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:45.331376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b4b1b858-8ee2-49a3-aea2-c94f31a44457 req-5e542096-054c-4bda-9c3a-7e1fce31ec13 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:45.335212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b4b1b858-8ee2-49a3-aea2-c94f31a44457 req-5e542096-054c-4bda-9c3a-7e1fce31ec13 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:45.378768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b4b1b858-8ee2-49a3-aea2-c94f31a44457 req-5e542096-054c-4bda-9c3a-7e1fce31ec13 service nova] Creating event network-vif-plugged:5e0ef215-44b7-4229-a74d-7a8b0e943828 for instance 61ae30e9-993b-4756-97fd-4e52861acaa3 on n-h2-master-1 Oct 24 08:51:45.388580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b4b1b858-8ee2-49a3-aea2-c94f31a44457 req-5e542096-054c-4bda-9c3a-7e1fce31ec13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099732 Oct 24 08:51:45.395131 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 170/310] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:45.440410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:45.450575 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd3cbe09-eeff-4015-81ad-c268bb280954 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1319 microversion: 2.1 time: 0.997713 Oct 24 08:51:45.451648 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 141/311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:44 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1319 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:45.515173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:45.516646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:45.541343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:45.542102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:45.542696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:45.544013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:45.550200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:45.551150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:45.833122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:45.846369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ade742e-dfb6-401b-aebb-588e091a8c1b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1219 microversion: 2.1 time: 0.337302 Oct 24 08:51:45.846973 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 171/312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:45 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1219 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:46.314034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:46.315077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:46.334595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.335132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.335571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.337918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.339119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.339980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.373736 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:46.475726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:46.476451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:46.491543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.493977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.495295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.497766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.499680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.500269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.701785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:46.715726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d5c803c-3d80-4ae7-863e-edc3972494ee tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1468 microversion: 2.1 time: 0.246115 Oct 24 08:51:46.730725 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 172/313] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:46 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:46.744136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:46.749382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:46.757631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.758520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.759197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.760348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.761923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.763527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.059669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50d8ebb4-cbe8-431b-b27b-3302bbdd0a7b tempest-DeleteServersAdminTestJSON-597984618 tempest-DeleteServersAdminTestJSON-597984618-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443/action" status: 202 len: 0 microversion: 2.1 time: 0.320971 Oct 24 08:51:47.061839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 173/314] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:51:46 2022] POST /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:47.070761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:47.071407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:47.078898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.079454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.079946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.080751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.081221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.081725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.185401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:47.195825 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db72c4c2-e9fd-4f0f-a0fe-698855b872ae tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1281 microversion: 2.1 time: 0.131422 Oct 24 08:51:47.200678 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 174/315] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:47 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:47.207262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:47.213182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:47.227976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.228858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.235927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.237240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.240787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.244917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.323132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.323631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.324078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.324672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lazy-loading 'fault' on Instance uuid f06a0c8a-abf1-42ee-ac72-f5c8af112443 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:47.432603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:47.452209 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0ff791c-8d56-4819-9893-ff96580085df tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1310 microversion: 2.1 time: 1.135036 Oct 24 08:51:47.458585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 142/316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:46 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1310 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:47.644477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:47.658944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a200a89e-98c9-4efc-bf6b-5d8abb6295f4 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1451 microversion: 2.1 time: 0.456401 Oct 24 08:51:47.662272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 175/317] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:47 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1451 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:47.723011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:47.726939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:47.759923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.760899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.763322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.765470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.768334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.772797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.845807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:51:48.019998 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7d69fc1-251c-45bf-ba8f-4555dc12cfc8 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 204 len: 0 microversion: 2.1 time: 0.314394 Oct 24 08:51:48.022205 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 143/318] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:51:47 2022] DELETE /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:51:48.042366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:48.044581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:48.086521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.098348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.100556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.101892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.107329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.111341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.182605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.184747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.185550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.186273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lazy-loading 'fault' on Instance uuid f06a0c8a-abf1-42ee-ac72-f5c8af112443 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:48.228514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:48.228773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:48.244092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.244987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.247273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.249029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.250643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.251858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.400257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:48.418920 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ba2b36e-3e99-404d-86c9-6e1914a4dd5a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1281 microversion: 2.1 time: 0.192717 Oct 24 08:51:48.419586 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 144/319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:48 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:48.482272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:48.483127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:48.512161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.513374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.516021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.519601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.521438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.522419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.595116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:48.626939 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93bf9c52-afab-4e24-bfb2-928bd5f3e114 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1457 microversion: 2.1 time: 0.588688 Oct 24 08:51:48.629203 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 176/320] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:48 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1457 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:48.806862 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:48.983579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:48.991826 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97253fd6-6397-4394-8e88-1fa7b64b2e14 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1491 microversion: 2.1 time: 0.516530 Oct 24 08:51:48.993574 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 145/321] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:48 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1491 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:49.352981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab714280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:49.358833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.359695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.364305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.392696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.393384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.393965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.439258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.439758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.447308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.461888 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2307add0-6d0c-4c2e-81eb-127c5fdc7fdb tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.661139 Oct 24 08:51:49.463969 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 177/322] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:49.476618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:49.477344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:49.492190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:49.493769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:49.495704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.496226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.496922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.505891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.507865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.508546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.509043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.513369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.518114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.528257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:49.528907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:49.529486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.969771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:49.979946 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84ed0fb8-55f4-48c9-a369-63a238037f3b tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.514758 Oct 24 08:51:49.993103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 178/323] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:49 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:49.993103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab731f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:49.993450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.006639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.007263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.013154 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:50.023675 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc4accc4-f04e-42c1-8a6e-09a963fbe688 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1642 microversion: 2.1 time: 1.009183 Oct 24 08:51:50.028129 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 146/324] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:49 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1642 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:50.035285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.036816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:50.045825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.046339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.048890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.051891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.053106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.054193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.055161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.055922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.056773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.079374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.079870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.080311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.094867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.096051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.096863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.097667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lazy-loading 'fault' on Instance uuid f06a0c8a-abf1-42ee-ac72-f5c8af112443 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:50.101559 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16d40982-21c5-459c-bd5d-d8bba7d31dce tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.114608 Oct 24 08:51:50.102547 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 179/325] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 08:51:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:50.468788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96ee0a47-85df-433e-9eaa-b92da8d345b8 tempest-InstanceUsageAuditLogTestJSON-1552763274 tempest-InstanceUsageAuditLogTestJSON-1552763274-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.511055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:50.514725 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96ee0a47-85df-433e-9eaa-b92da8d345b8 tempest-InstanceUsageAuditLogTestJSON-1552763274 tempest-InstanceUsageAuditLogTestJSON-1552763274-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24 08:51:49" status: 200 len: 318 microversion: 2.1 time: 0.395042 Oct 24 08:51:50.518992 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-759be577-990f-49d8-bb7c-826c32670c13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1457 microversion: 2.1 time: 0.489185 Oct 24 08:51:50.519398 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 180/326] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24%2008%3A51%3A49 => generated 318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:50.545389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 147/327] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1457 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:50.564284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.565592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:50.566448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab884ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.576151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.578338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.580647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.591849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.593062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.595641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.596796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.598138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.599988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.628192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.631439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.631889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.667542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.670062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.671335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.689515 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7fbae63-de65-46bb-a34e-df8d434ba6bd tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.142765 Oct 24 08:51:50.705457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 148/328] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:50.717015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bca5a95b-a319-47e7-a387-1b6980aaa326 tempest-InstanceUsageAuditLogTestJSON-1552763274 tempest-InstanceUsageAuditLogTestJSON-1552763274-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.796889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bca5a95b-a319-47e7-a387-1b6980aaa326 tempest-InstanceUsageAuditLogTestJSON-1552763274 tempest-InstanceUsageAuditLogTestJSON-1552763274-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.087952 Oct 24 08:51:50.809830 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 149/329] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:50.814902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab8a43a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.816751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.817330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.817853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.859871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.860363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.860795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.874709 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c18ac40-2972-4ea3-bfe5-05f3f396e587 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.063370 Oct 24 08:51:50.885334 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 150/330] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:50.904829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83db2e90-fe5d-4cdf-9f3d-c9599d311001 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab9f4ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.913218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83db2e90-fe5d-4cdf-9f3d-c9599d311001 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.914189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83db2e90-fe5d-4cdf-9f3d-c9599d311001 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.916426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83db2e90-fe5d-4cdf-9f3d-c9599d311001 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.979585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f318025-77d4-4d51-9eee-25cc8d4d3a03 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1642 microversion: 2.1 time: 0.434862 Oct 24 08:51:50.990490 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83db2e90-fe5d-4cdf-9f3d-c9599d311001 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.096397 Oct 24 08:51:50.993094 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 151/331] 10.222.0.25 () {58 vars in 1179 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:50.994313 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 181/332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1642 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:51.012924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.014793 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.022425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:51.029713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.035288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.037451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.038321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.039316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.040032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.042214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.042832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.044842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.045110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.045763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.049045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.120027 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6365f2d6-6032-4677-bf68-03dc17ed3eac tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.110691 Oct 24 08:51:51.120853 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 182/333] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 08:51:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:51.134623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab6e8550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.136714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.139055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.139664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.161188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.164214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.166526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.184777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.185190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.185660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.197734 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37d71d0e-c353-48f2-a2fb-d74b5e122cf5 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075183 Oct 24 08:51:51.199177 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 183/334] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:51.205583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:51.208496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:51.218741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.219563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.220236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.221152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.221866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.222353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.398110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:51.407126 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bcfd45bf-aec8-4af2-94d2-15040d8c559c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.406430 Oct 24 08:51:51.407719 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 152/335] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:51.412325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d97ceee8-a36c-458d-8e72-29162acab4ee req-8b1c053e-7481-45e3-9427-7768f86b9633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06a0c8a-abf1-42ee-ac72-f5c8af112443", "name": "network-vif-deleted", "tag": "444f49df-70cc-4f5d-80b6-9145c6637381"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:51.444022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d97ceee8-a36c-458d-8e72-29162acab4ee req-8b1c053e-7481-45e3-9427-7768f86b9633 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.444510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d97ceee8-a36c-458d-8e72-29162acab4ee req-8b1c053e-7481-45e3-9427-7768f86b9633 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.444940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d97ceee8-a36c-458d-8e72-29162acab4ee req-8b1c053e-7481-45e3-9427-7768f86b9633 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.464428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d97ceee8-a36c-458d-8e72-29162acab4ee req-8b1c053e-7481-45e3-9427-7768f86b9633 service nova] Creating event network-vif-deleted:444f49df-70cc-4f5d-80b6-9145c6637381 for instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 on n-h1-master-1 Oct 24 08:51:51.479603 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d97ceee8-a36c-458d-8e72-29162acab4ee req-8b1c053e-7481-45e3-9427-7768f86b9633 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070606 Oct 24 08:51:51.486097 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 153/336] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:51.497051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab8e3550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.504705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.506654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.507777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.535937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.537268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.537887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.546518 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bfc7b969-feee-400d-b369-259045f5cf7f tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.058820 Oct 24 08:51:51.547470 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 154/337] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:51.552939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.553989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:51.561964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.562752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.563513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.564444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.565112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.565795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.597408 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=87,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:51.602684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.603359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.604002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.604991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lazy-loading 'fault' on Instance uuid f06a0c8a-abf1-42ee-ac72-f5c8af112443 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:51.665823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327f1d46d859423982fab017258b9ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:51.678037 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c9736b4-e293-4e04-9e30-0a67fc4c9317 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 200 len: 1309 microversion: 2.1 time: 0.128858 Oct 24 08:51:51.679682 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 155/338] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:51 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:51.694124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8daba5d670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.696120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.697011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.697581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.712411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.713650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.714173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.723012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-90ad8c0e-1caa-42a9-935f-915aee7e794a tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.042052 Oct 24 08:51:51.729833 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 156/339] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:51:51 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:51.958034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lazy-loading 'flavor' on Instance uuid 61ae30e9-993b-4756-97fd-4e52861acaa3 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:51:52.033727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Going to try to live migrate instance to n-h1-master-1 {{(pid=126920) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:51:52.139029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d085bc26-d201-422b-8c1c-2f2a6cc34dc8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1207381269", "id": 591759184, "os-flavor-access:is_public": "False"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:52.167771 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d085bc26-d201-422b-8c1c-2f2a6cc34dc8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.436688 Oct 24 08:51:52.176381 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 157/340] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:52.197314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Calling method '.version_select at 0x7f8dab93f040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:52.199747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.200806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.201923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.231197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.231941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.232659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.245104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.245975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.246926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.292004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b6ad2fc-1a79-4737-a94a-3bf5cc6f5490 tempest-HypervisorAdminTestJSON-1925688671 tempest-HypervisorAdminTestJSON-1925688671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.110593 Oct 24 08:51:52.295245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 158/341] 10.222.0.25 () {58 vars in 1173 bytes} [Mon Oct 24 08:51:52 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:52.672755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:52.674524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.675000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.675432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.676193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.676641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.676988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.704442 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b00370e-e62f-4323-b972-9f4d309d9b64 tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.407195 Oct 24 08:51:52.705029 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 159/342] 10.222.0.25 () {58 vars in 1164 bytes} [Mon Oct 24 08:51:52 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:52.710000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-555cb8cc-45f8-4dc3-a5b9-1f275f359846 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:53.203441 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-555cb8cc-45f8-4dc3-a5b9-1f275f359846 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/591759184/action" status: 200 len: 96 microversion: 2.1 time: 0.497204 Oct 24 08:51:53.204242 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 160/343] 10.222.0.25 () {60 vars in 1197 bytes} [Mon Oct 24 08:51:52 2022] POST /compute/v2.1/flavors/591759184/action => generated 96 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:53.210101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:53.211378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:53.220138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.220719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.221226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.222027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.222716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.223223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.541403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:53.556253 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-338a23ff-a270-4f04-8715-1fe06c1c8944 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.350629 Oct 24 08:51:53.556878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 161/344] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:53 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:53.577388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:53.577800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:53.584025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.584751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.585431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.586496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.587249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.587877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.606301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] HTTP exception thrown: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Request method failure captured: Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 HTTP/1.1 Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHshbzmBQGnL4UuUNPnfyXZfzUmWXxd2ddGm-pLmtKHk66r6tTBoELsmCs9381oAYnw9_BxbDd-EA0-e5IYpuXlvCmvi6008XfmLovYS8MyURsvV8zPwR3Wr7F7qybf9trlTWKVqSP6qug6SlgTYh7V_6SHWwMoKpO2QkserkQalLk Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:53.608444 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}] Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 327f1d46d859423982fab017258b9ada Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:53.609961 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f06a0c8a-abf1-42ee-ac72-f5c8af112443'} Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:53.610876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:53.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:53.615843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Returning 404 to user: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:53.616926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19ac71c7-f7c1-4256-ab88-50af5199be13 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 404 len: 111 microversion: 2.1 time: 0.043620 Oct 24 08:51:53.617750 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 162/345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:53 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:53.632056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:53.637812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.638492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.639007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.641526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.643033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.643558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.663799 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=20 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:53.668363 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:53.720528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2603bbfa-d75a-42d6-abba-5ab6e5894fba tempest-AZAdminV2TestJSON-427403194 tempest-AZAdminV2TestJSON-427403194-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.099517 Oct 24 08:51:53.722555 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 163/346] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 08:51:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:53.737609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76c1a268-e2e4-4a71-b004-4bd8e376bff8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:54.483234 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-76c1a268-e2e4-4a71-b004-4bd8e376bff8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project c7b62320759146fc883679048eac1fec combination. Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76c1a268-e2e4-4a71-b004-4bd8e376bff8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Request method failure captured: Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/flavors/591759184/action HTTP/1.1 Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 67 Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIlrH4lAschqNyo0GMWYVUAhOnCYFBvY7nYabC65Cd2yUkW59-cH1m1Jr9kH94-TeKlBA9dZI5XGX7T4abI590ukuBJsexhPiRjx0QguKTYMZhVkTKYua-ecE_YY8jW0Qex4fS0WkrtTBLA4fAMq4Vnx_F-1qEguVzES4kXGExG8RQ Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 4144a752f1494a5e964cfb38db5c1d45 Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:51:54.497941 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4144a752f1494a5e964cfb38db5c1d45"}]}] Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 4144a752f1494a5e964cfb38db5c1d45 Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2458c3818faa409dbb95cd5d7cacc32a Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: {"addTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} Oct 24 08:51:54.500350 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: exception: Flavor access already exists for flavor 29 and project c7b62320759146fc883679048eac1fec combination. Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '591759184', 'body': {'addTenantAccess': {'tenant': 'c7b62320759146fc883679048eac1fec'}}} Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result.read() Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:51:54.501693 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-c7b62320759146fc883679048eac1fec' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi session.flush() Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:51:54.503932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:51:54.508321 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:51:54.513866 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result.read() Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-c7b62320759146fc883679048eac1fec' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 24, 8, 51, 54, 477344), 'updated_at': None, 'flavor_id': 29, 'project_id': 'c7b62320759146fc883679048eac1fec'}] Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:54.518018 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project c7b62320759146fc883679048eac1fec combination. Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:54.523456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project c7b62320759146fc883679048eac1fec combination. Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:54.527244 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:54.533640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project c7b62320759146fc883679048eac1fec combination. Oct 24 08:51:54.533640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.533640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76c1a268-e2e4-4a71-b004-4bd8e376bff8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project c7b62320759146fc883679048eac1fec combination. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:54.533640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76c1a268-e2e4-4a71-b004-4bd8e376bff8 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/591759184/action" status: 409 len: 152 microversion: 2.1 time: 0.775778 Oct 24 08:51:54.533640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 164/347] 10.222.0.25 () {60 vars in 1197 bytes} [Mon Oct 24 08:51:53 2022] POST /compute/v2.1/flavors/591759184/action => generated 152 bytes in 777 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:54.533640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c436745f-85ef-4316-ba0c-4e9427ccb30f req-b4ac1990-c2c3-49a7-84ed-594b1dd58eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9383a06f-f840-4932-b490-a09e84708eb9", "tag": "50a108c9-5b3a-4849-b990-b984077ea61f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:54.537260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c436745f-85ef-4316-ba0c-4e9427ccb30f req-b4ac1990-c2c3-49a7-84ed-594b1dd58eb7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.537260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c436745f-85ef-4316-ba0c-4e9427ccb30f req-b4ac1990-c2c3-49a7-84ed-594b1dd58eb7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.537260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c436745f-85ef-4316-ba0c-4e9427ccb30f req-b4ac1990-c2c3-49a7-84ed-594b1dd58eb7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:54.544160 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c436745f-85ef-4316-ba0c-4e9427ccb30f req-b4ac1990-c2c3-49a7-84ed-594b1dd58eb7 service nova] Creating event network-changed:50a108c9-5b3a-4849-b990-b984077ea61f for instance 9383a06f-f840-4932-b490-a09e84708eb9 on n-h1-master-1 Oct 24 08:51:54.551225 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c436745f-85ef-4316-ba0c-4e9427ccb30f req-b4ac1990-c2c3-49a7-84ed-594b1dd58eb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044735 Oct 24 08:51:54.551829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 165/348] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:54.564912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:54.564912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:54.567469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.567987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.568415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:54.569105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.569578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.569991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:54.590836 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] HTTP exception thrown: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Request method failure captured: Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 HTTP/1.1 Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHshbzmBQGnL4UuUNPnfyXZfzUmWXxd2ddGm-pLmtKHk66r6tTBoELsmCs9381oAYnw9_BxbDd-EA0-e5IYpuXlvCmvi6008XfmLovYS8MyURsvV8zPwR3Wr7F7qybf9trlTWKVqSP6qug6SlgTYh7V_6SHWwMoKpO2QkserkQalLk Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:54.592658 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}] Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 327f1d46d859423982fab017258b9ada Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:54.594237 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f06a0c8a-abf1-42ee-ac72-f5c8af112443'} Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:54.594978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:54.596266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:54.597842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Returning 404 to user: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:54.597842 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ef9c888e-609a-4469-b376-2ac913f6e1b7 tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 404 len: 111 microversion: 2.1 time: 0.044265 Oct 24 08:51:54.601245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 166/349] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:51:54 2022] DELETE /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:54.606925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3554aa6d-cf35-47d2-8b05-3f4ff32d9817 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:55.306241 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3554aa6d-cf35-47d2-8b05-3f4ff32d9817 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/591759184/action" status: 200 len: 21 microversion: 2.1 time: 0.703746 Oct 24 08:51:55.317245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 167/350] 10.222.0.25 () {60 vars in 1197 bytes} [Mon Oct 24 08:51:54 2022] POST /compute/v2.1/flavors/591759184/action => generated 21 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:55.324911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.326009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:55.334619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.335297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.350884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.352760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.354386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.355828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.673045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:55.684284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db0ec2f0-abb3-4781-b973-e3c6daadf9cd tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.364152 Oct 24 08:51:55.685979 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 168/351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:55 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:55.692743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.695092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: f06a0c8a-abf1-42ee-ac72-f5c8af112443] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:55.726861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.735045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.737488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.739750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.743731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.744468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.771624 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] HTTP exception thrown: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Request method failure captured: Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 HTTP/1.1 Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHshbzmBQGnL4UuUNPnfyXZfzUmWXxd2ddGm-pLmtKHk66r6tTBoELsmCs9381oAYnw9_BxbDd-EA0-e5IYpuXlvCmvi6008XfmLovYS8MyURsvV8zPwR3Wr7F7qybf9trlTWKVqSP6qug6SlgTYh7V_6SHWwMoKpO2QkserkQalLk Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:55.773719 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}] Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 327f1d46d859423982fab017258b9ada Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:55.774875 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f06a0c8a-abf1-42ee-ac72-f5c8af112443'} Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:55.775844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. Oct 24 08:51:55.777167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.778376 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Returning 404 to user: Instance f06a0c8a-abf1-42ee-ac72-f5c8af112443 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:55.778376 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3897805-820f-46d8-8f9c-bb3317e413ca tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443" status: 404 len: 111 microversion: 2.1 time: 0.087579 Oct 24 08:51:55.779054 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 169/352] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:55 2022] GET /compute/v2.1/servers/f06a0c8a-abf1-42ee-ac72-f5c8af112443 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:55.784070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d6c1150-d1f2-4440-908f-3d5d0f5356e3 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab820af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.844480 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-207e9175-9697-4280-9f98-e9c300719f97 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3/action" status: 202 len: 0 microversion: 2.1 time: 4.643855 Oct 24 08:51:55.845740 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 184/353] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:51:51 2022] POST /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3/action => generated 0 bytes in 4646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:55.852954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e61dd530-3d76-4fb7-8cef-51cf04d82c5e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.866286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d6c1150-d1f2-4440-908f-3d5d0f5356e3 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37" status: 200 len: 637 microversion: 2.1 time: 0.084926 Oct 24 08:51:55.869087 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 170/354] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:55 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37 => generated 637 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:55.876406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.877192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:55.897869 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e61dd530-3d76-4fb7-8cef-51cf04d82c5e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/591759184" status: 202 len: 0 microversion: 2.1 time: 0.049724 Oct 24 08:51:55.899175 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 185/355] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:51:55 2022] DELETE /compute/v2.1/flavors/591759184 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:55.905229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.906171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:55.911158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.913702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.915923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.916534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.916893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.917167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.917996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.918121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.918662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.919014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.919316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.919927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.957276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] HTTP exception thrown: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Request method failure captured: Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 HTTP/1.1 Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlHshbzmBQGnL4UuUNPnfyXZfzUmWXxd2ddGm-pLmtKHk66r6tTBoELsmCs9381oAYnw9_BxbDd-EA0-e5IYpuXlvCmvi6008XfmLovYS8MyURsvV8zPwR3Wr7F7qybf9trlTWKVqSP6qug6SlgTYh7V_6SHWwMoKpO2QkserkQalLk Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:51:55.961539 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}] Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 327f1d46d859423982fab017258b9ada Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:55.971466 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '44f6ddb8-3b73-4594-9437-7a83c138b456'} Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:55.972991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:55.980645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:51:55.995661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Returning 404 to user: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:55.995661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f61ad8b4-d2ec-43a2-9baa-08a586bb400a tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 404 len: 111 microversion: 2.1 time: 0.092362 Oct 24 08:51:55.995661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 171/356] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:51:55 2022] DELETE /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:55.995661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb8c0826-e6a1-4bf0-be18-477253fd627c tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab8a4b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:56.081982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-fb8c0826-e6a1-4bf0-be18-477253fd627c tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:56.102703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-fb8c0826-e6a1-4bf0-be18-477253fd627c tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:56.168263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:56.180698 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2be12e97-b775-4ae6-b00e-d008fd47b7e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.280008 Oct 24 08:51:56.193695 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 186/357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:55 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:56.203910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b0574f7-20fd-44de-9fe8-473c4a850f65 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.225841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b0574f7-20fd-44de-9fe8-473c4a850f65 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030906 Oct 24 08:51:56.236755 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 187/358] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:56.243040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.243876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] [instance: 44f6ddb8-3b73-4594-9437-7a83c138b456] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:56.260875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.261402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.262130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:56.263028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.263493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.263919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:56.304164 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] HTTP exception thrown: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Request method failure captured: Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 HTTP/1.1 Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlHshbzmBQGnL4UuUNPnfyXZfzUmWXxd2ddGm-pLmtKHk66r6tTBoELsmCs9381oAYnw9_BxbDd-EA0-e5IYpuXlvCmvi6008XfmLovYS8MyURsvV8zPwR3Wr7F7qybf9trlTWKVqSP6qug6SlgTYh7V_6SHWwMoKpO2QkserkQalLk Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:56.305902 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d7b9d4b5ef5454fbed4733abbd15bbe"}]}] Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 3d7b9d4b5ef5454fbed4733abbd15bbe Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-396379848 Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 327f1d46d859423982fab017258b9ada Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersAdminTestJSON-396379848-project Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:56.307136 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '44f6ddb8-3b73-4594-9437-7a83c138b456'} Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:56.307833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. Oct 24 08:51:56.308914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.309998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] Returning 404 to user: Instance 44f6ddb8-3b73-4594-9437-7a83c138b456 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:56.309998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e80ef1f-861f-4d94-8183-40e202df059b tempest-DeleteServersAdminTestJSON-396379848 tempest-DeleteServersAdminTestJSON-396379848-project] 10.222.0.25 "GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456" status: 404 len: 111 microversion: 2.1 time: 0.069489 Oct 24 08:51:56.309998 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 188/359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/servers/44f6ddb8-3b73-4594-9437-7a83c138b456 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:56.312721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-385db921-7a24-456c-91d1-3a837f4c4750 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-124487870", "id": 2091871965, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:56.351477 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-385db921-7a24-456c-91d1-3a837f4c4750 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.042244 Oct 24 08:51:56.359260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 189/360] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:56 2022] POST /compute/v2.1/flavors => generated 437 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:56.378428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb8c3f74-3933-4cd5-98b7-ea40e0edf0c5 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.390172 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-cb8c3f74-3933-4cd5-98b7-ea40e0edf0c5 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb8c3f74-3933-4cd5-98b7-ea40e0edf0c5 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Request method failure captured: Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/flavors/2091871965/os-flavor-access HTTP/1.1 Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIlrH4lAschqNyo0GMWYVUAhOnCYFBvY7nYabC65Cd2yUkW59-cH1m1Jr9kH94-TeKlBA9dZI5XGX7T4abI590ukuBJsexhPiRjx0QguKTYMZhVkTKYua-ecE_YY8jW0Qex4fS0WkrtTBLA4fAMq4Vnx_F-1qEguVzES4kXGExG8RQ Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4144a752f1494a5e964cfb38db5c1d45 Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:51:56.392560 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4144a752f1494a5e964cfb38db5c1d45"}]}] Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4144a752f1494a5e964cfb38db5c1d45 Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 2458c3818faa409dbb95cd5d7cacc32a Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: exception: Access list not available for public flavors. Oct 24 08:51:56.393897 n-d-master-1 devstack@n-api.service[126920]: action_args: {'flavor_id': '2091871965'} Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 24 08:51:56.394571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:56.397426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb8c3f74-3933-4cd5-98b7-ea40e0edf0c5 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:56.401945 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb8c3f74-3933-4cd5-98b7-ea40e0edf0c5 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2091871965/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038998 Oct 24 08:51:56.404449 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 190/361] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/flavors/2091871965/os-flavor-access => generated 91 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:51:56.415632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8af2f950-937e-4cc4-85de-9679c4de1602 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.435603 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8af2f950-937e-4cc4-85de-9679c4de1602 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2091871965" status: 202 len: 0 microversion: 2.1 time: 0.026436 Oct 24 08:51:56.440800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 191/362] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:51:56 2022] DELETE /compute/v2.1/flavors/2091871965 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:51:56.447667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90481b2f-0208-437e-9046-35589b0cddcc tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.471961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90481b2f-0208-437e-9046-35589b0cddcc tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029170 Oct 24 08:51:56.473022 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 192/363] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:56.494249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58b298e7-3f30-47d4-9b3f-cc682a335028 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1741772321", "id": 2132708085, "os-flavor-access:is_public": "False"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:56.524612 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58b298e7-3f30-47d4-9b3f-cc682a335028 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.033932 Oct 24 08:51:56.536537 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 193/364] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:56 2022] POST /compute/v2.1/flavors => generated 439 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:56.729924 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb8c0826-e6a1-4bf0-be18-477253fd627c tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.761143 Oct 24 08:51:56.732108 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 172/365] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:51:55 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:56.740405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.742847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:56.764658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.765504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.766053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:56.766806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.767277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.767759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:57.101399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.112053 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-257d7b7c-8540-432d-8797-59d161a1b29a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.377909 Oct 24 08:51:57.112658 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 173/366] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:57.124121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d058c5a-a090-4213-afe7-fe8f8b9c9237 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab817820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:57.489241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb6f9e7d-fed4-4a0c-87e4-48fca132c357 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:57.493421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb6f9e7d-fed4-4a0c-87e4-48fca132c357 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '271bfaad0d2c44a1b26f59aece15ebb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b62320759146fc883679048eac1fec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb6f9e7d-fed4-4a0c-87e4-48fca132c357 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Request method failure captured: Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/flavors/2132708085/action HTTP/1.1 Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 67 Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIiOjjrqt5NwJNR2BtbhjIfkYrbGXEYWAM6WB8ID3u5_F4HU8xcxEvlnjTdDtbfXib8D-Uy5hzjQj-Cw81ZS61LeLvumfs288SzZo1zpSl2f4CDwubw8ppgg3TaneUmQnYM1grPS3HUBTR1I27AKsfNcMhCjLYD0ykhocWWmyQZvQQ Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c7b62320759146fc883679048eac1fec Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1037578133 Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:57.495072 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7b62320759146fc883679048eac1fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7b62320759146fc883679048eac1fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7b62320759146fc883679048eac1fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7b62320759146fc883679048eac1fec"}]}] Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1037578133 Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c7b62320759146fc883679048eac1fec Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1037578133 Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsAccessNegativeTestJSON-1037578133-project Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 271bfaad0d2c44a1b26f59aece15ebb4 Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1037578133-project Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: {"addTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} Oct 24 08:51:57.496496 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '2132708085', 'body': {'addTenantAccess': {'tenant': 'c7b62320759146fc883679048eac1fec'}}} Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:57.501259 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 24 08:51:57.502683 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:57.506270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb6f9e7d-fed4-4a0c-87e4-48fca132c357 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:57.506270 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb6f9e7d-fed4-4a0c-87e4-48fca132c357 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] 10.222.0.25 "POST /compute/v2.1/flavors/2132708085/action" status: 403 len: 130 microversion: 2.1 time: 0.958058 Oct 24 08:51:57.506270 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 194/367] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:51:56 2022] POST /compute/v2.1/flavors/2132708085/action => generated 130 bytes in 959 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:51:57.511134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:57.512462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:57.524652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:57.525211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:57.525624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:57.526341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:57.526800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:57.527232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:57.577578 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:57.578220 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d058c5a-a090-4213-afe7-fe8f8b9c9237 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "DELETE /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.464282 Oct 24 08:51:57.582832 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 174/368] 10.222.0.25 () {58 vars in 1296 bytes} [Mon Oct 24 08:51:57 2022] DELETE /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata/os_version => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:51:57.589657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d299ecce-3e2c-4882-ae8e-00dd76fa2953 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:57.616690 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d299ecce-3e2c-4882-ae8e-00dd76fa2953 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2132708085" status: 202 len: 0 microversion: 2.1 time: 0.031869 Oct 24 08:51:57.618284 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 175/369] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:51:57 2022] DELETE /compute/v2.1/flavors/2132708085 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:57.625678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-944d876d-7cd3-4cf7-87c3-0a542d59ee8a tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab8e3160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:57.689340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-944d876d-7cd3-4cf7-87c3-0a542d59ee8a tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 37 microversion: 2.1 time: 0.069748 Oct 24 08:51:57.690810 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 176/370] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:51:57 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:57.702225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f177fd5e-8a20-4537-a505-ed4d80f84081 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:57.749832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.762095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4969ef5c-0eb1-4a33-bc44-bd0d5b18fa35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.261618 Oct 24 08:51:57.763379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 195/371] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:57 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:57.769654 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f177fd5e-8a20-4537-a505-ed4d80f84081 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070815 Oct 24 08:51:57.771463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43a7cc0d-e829-4ab1-8ce4-3cde9a41e827 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab5d3c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:57.771608 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 177/372] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:51:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:57.799289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d5dae96-191c-4f2b-912c-79e052548da7 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1009196380", "id": 1917847422, "os-flavor-access:is_public": "False"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:57.874343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d5dae96-191c-4f2b-912c-79e052548da7 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.080686 Oct 24 08:51:57.876540 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 178/373] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:51:57 2022] POST /compute/v2.1/flavors => generated 439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:51:57.890328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29db1e45-b595-463b-830b-2f3e82f5c469 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:57.895808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-43a7cc0d-e829-4ab1-8ce4-3cde9a41e827 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:57.913469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-43a7cc0d-e829-4ab1-8ce4-3cde9a41e827 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:58.337701 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43a7cc0d-e829-4ab1-8ce4-3cde9a41e827 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.572796 Oct 24 08:51:58.338607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 196/374] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:51:57 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:58.345649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b3f49631-66aa-482b-a01b-433ed1e57254 req-a2cdd0f1-6883-48c9-96af-9e1fed02b440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ae30e9-993b-4756-97fd-4e52861acaa3", "name": "network-vif-unplugged", "status": "completed", "tag": "5e0ef215-44b7-4229-a74d-7a8b0e943828"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:58.359006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b3f49631-66aa-482b-a01b-433ed1e57254 req-a2cdd0f1-6883-48c9-96af-9e1fed02b440 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.359563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b3f49631-66aa-482b-a01b-433ed1e57254 req-a2cdd0f1-6883-48c9-96af-9e1fed02b440 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.360305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b3f49631-66aa-482b-a01b-433ed1e57254 req-a2cdd0f1-6883-48c9-96af-9e1fed02b440 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.376358 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b3f49631-66aa-482b-a01b-433ed1e57254 req-a2cdd0f1-6883-48c9-96af-9e1fed02b440 service nova] Creating event network-vif-unplugged:5e0ef215-44b7-4229-a74d-7a8b0e943828 for instance 61ae30e9-993b-4756-97fd-4e52861acaa3 on n-h2-master-1 Oct 24 08:51:58.384589 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b3f49631-66aa-482b-a01b-433ed1e57254 req-a2cdd0f1-6883-48c9-96af-9e1fed02b440 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043644 Oct 24 08:51:58.386016 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 197/375] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:58.392003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:58.392895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:58.402309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.402896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.403865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.404902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.405506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.406003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.665974 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29db1e45-b595-463b-830b-2f3e82f5c469 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1917847422/action" status: 200 len: 97 microversion: 2.1 time: 0.779385 Oct 24 08:51:58.670268 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 179/376] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:51:57 2022] POST /compute/v2.1/flavors/1917847422/action => generated 97 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:51:58.685005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e561336-d302-4058-aa9c-0cb47dc7f0af tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab817af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:58.703919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:58.730625 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd042df2-2d96-49fe-a6d8-624e8fa24730 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.343298 Oct 24 08:51:58.737476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 198/377] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:58 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:58.756669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a2697eb-cf70-4f7b-89de-a8ab11214077 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:58.765627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a2697eb-cf70-4f7b-89de-a8ab11214077 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '271bfaad0d2c44a1b26f59aece15ebb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b62320759146fc883679048eac1fec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a2697eb-cf70-4f7b-89de-a8ab11214077 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Request method failure captured: Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/flavors/1917847422/action HTTP/1.1 Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 70 Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIiOjjrqt5NwJNR2BtbhjIfkYrbGXEYWAM6WB8ID3u5_F4HU8xcxEvlnjTdDtbfXib8D-Uy5hzjQj-Cw81ZS61LeLvumfs288SzZo1zpSl2f4CDwubw8ppgg3TaneUmQnYM1grPS3HUBTR1I27AKsfNcMhCjLYD0ykhocWWmyQZvQQ Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c7b62320759146fc883679048eac1fec Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1037578133 Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:51:58.767714 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7b62320759146fc883679048eac1fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7b62320759146fc883679048eac1fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7b62320759146fc883679048eac1fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7b62320759146fc883679048eac1fec"}]}] Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1037578133 Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c7b62320759146fc883679048eac1fec Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1037578133 Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsAccessNegativeTestJSON-1037578133-project Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 271bfaad0d2c44a1b26f59aece15ebb4 Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1037578133-project Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: {"removeTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} Oct 24 08:51:58.769088 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1917847422', 'body': {'removeTenantAccess': {'tenant': 'c7b62320759146fc883679048eac1fec'}}} Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can( Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:51:58.769923 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 24 08:51:58.771678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:51:58.772702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a2697eb-cf70-4f7b-89de-a8ab11214077 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:51:58.773376 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a2697eb-cf70-4f7b-89de-a8ab11214077 tempest-FlavorsAccessNegativeTestJSON-1037578133 tempest-FlavorsAccessNegativeTestJSON-1037578133-project] 10.222.0.25 "POST /compute/v2.1/flavors/1917847422/action" status: 403 len: 133 microversion: 2.1 time: 0.033716 Oct 24 08:51:58.774489 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 199/378] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:51:58 2022] POST /compute/v2.1/flavors/1917847422/action => generated 133 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:58.782640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0af1fb69-3cf9-4378-bc8b-52d6f25dcfdf req-159b2689-3efd-447b-a8ae-ba22bfe65282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9383a06f-f840-4932-b490-a09e84708eb9", "name": "network-vif-plugged", "status": "completed", "tag": "50a108c9-5b3a-4849-b990-b984077ea61f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:58.797858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0af1fb69-3cf9-4378-bc8b-52d6f25dcfdf req-159b2689-3efd-447b-a8ae-ba22bfe65282 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.798548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0af1fb69-3cf9-4378-bc8b-52d6f25dcfdf req-159b2689-3efd-447b-a8ae-ba22bfe65282 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.798990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0af1fb69-3cf9-4378-bc8b-52d6f25dcfdf req-159b2689-3efd-447b-a8ae-ba22bfe65282 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.801106 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e561336-d302-4058-aa9c-0cb47dc7f0af tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.126743 Oct 24 08:51:58.802312 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 180/379] 10.222.0.25 () {58 vars in 1290 bytes} [Mon Oct 24 08:51:58 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata/os_distro => generated 33 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:58.809262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96489a1d-5691-4195-823a-b8de19d1dc58 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c7b62320759146fc883679048eac1fec"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:58.821231 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0af1fb69-3cf9-4378-bc8b-52d6f25dcfdf req-159b2689-3efd-447b-a8ae-ba22bfe65282 service nova] Creating event network-vif-plugged:50a108c9-5b3a-4849-b990-b984077ea61f for instance 9383a06f-f840-4932-b490-a09e84708eb9 on n-h1-master-1 Oct 24 08:51:58.832410 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0af1fb69-3cf9-4378-bc8b-52d6f25dcfdf req-159b2689-3efd-447b-a8ae-ba22bfe65282 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056287 Oct 24 08:51:58.832952 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 200/380] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:58.847228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:58.849050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:58.866937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.867493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.867942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.869705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.870190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.870662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:59.153998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:59.163918 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be414a61-d168-4a33-9304-7a54782948e8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.328959 Oct 24 08:51:59.181036 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 201/381] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:58 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:59.185864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87a7ccf8-d572-4914-a08c-7bb5f9daa6f4 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab5d34c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:59.263213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-87a7ccf8-d572-4914-a08c-7bb5f9daa6f4 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:59.272032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-87a7ccf8-d572-4914-a08c-7bb5f9daa6f4 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:51:59.539767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87a7ccf8-d572-4914-a08c-7bb5f9daa6f4 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.357605 Oct 24 08:51:59.541030 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 202/382] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:51:59 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:59.550333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a947100d-3af8-410e-aec9-7adbc53a7e15 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab5d35e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:59.598247 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a947100d-3af8-410e-aec9-7adbc53a7e15 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.052026 Oct 24 08:51:59.599422 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 203/383] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:51:59 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:51:59.774244 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96489a1d-5691-4195-823a-b8de19d1dc58 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1917847422/action" status: 200 len: 21 microversion: 2.1 time: 0.970171 Oct 24 08:51:59.774854 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 181/384] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:51:58 2022] POST /compute/v2.1/flavors/1917847422/action => generated 21 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:51:59.780870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4b5769e-43ba-4b63-8599-3448cc78cc37 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab8a4550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:59.845127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d4b5769e-43ba-4b63-8599-3448cc78cc37 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:51:59.851785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d4b5769e-43ba-4b63-8599-3448cc78cc37 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:00.075738 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4b5769e-43ba-4b63-8599-3448cc78cc37 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.299400 Oct 24 08:52:00.076343 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 182/385] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:51:59 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:00.081367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.082005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:00.089111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.090018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.090621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.091491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.092108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.092885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.204493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8829c42c-c0b0-44d1-8ee5-778a0a68dc40 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Calling method '.version_select at 0x7f8dab5cd0d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.207481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8829c42c-c0b0-44d1-8ee5-778a0a68dc40 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'a7742b2fc8d247ce95d98e7d5babc7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3097fe2baef4179a11083d1adad3edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8829c42c-c0b0-44d1-8ee5-778a0a68dc40 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Request method failure captured: Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIsr5FH95vLoM6SO7n6YGIfP_yleMbd_TH2nPGqNW_1tk4ZZHb7Lok1qiH4v6nV6UWi0ch57xn0NfNdnG9qBNri6ywlaLOVq6YgTObtCFAGaRXVSMowSjZJmHoqReGCPpfCGPCuGWqp_S8UA3IEqPp1cQTfnFKYD6QmaMYdXTJOj_E Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:00.214384 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3097fe2baef4179a11083d1adad3edd"}]}] Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a7742b2fc8d247ce95d98e7d5babc7e3 Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:52:00.216838 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:00.218376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 24 08:52:00.220404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.228979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8829c42c-c0b0-44d1-8ee5-778a0a68dc40 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:00.230854 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8829c42c-c0b0-44d1-8ee5-778a0a68dc40 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.630049 Oct 24 08:52:00.232530 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 204/386] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 08:51:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 632 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:00.243707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b0d533c-4dbd-4113-b3c4-f9ea9eb5f9b9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.272555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b0d533c-4dbd-4113-b3c4-f9ea9eb5f9b9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1917847422" status: 202 len: 0 microversion: 2.1 time: 0.038141 Oct 24 08:52:00.273839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 205/387] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:52:00 2022] DELETE /compute/v2.1/flavors/1917847422 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:00.282340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7630e45-2be9-41df-b287-8a1556740283 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab5cd550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:00.307917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:00.324000 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc285c81-547d-4fa2-b823-06af46c10957 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1323 microversion: 2.1 time: 0.246204 Oct 24 08:52:00.337901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 183/388] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:00.363781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.365459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:00.366568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d7630e45-2be9-41df-b287-8a1556740283 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:00.376061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.376870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d7630e45-2be9-41df-b287-8a1556740283 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:00.377425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.378653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.380120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.380949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.381709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.676789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:00.685997 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12d4626c-9222-47a3-b366-e6722e66bcc1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.346483 Oct 24 08:52:00.701601 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 184/389] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:00.804507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7630e45-2be9-41df-b287-8a1556740283 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 64 microversion: 2.1 time: 0.528570 Oct 24 08:52:00.805951 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 206/390] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:52:00 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 64 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:00.815542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24dbacaa-613b-45ea-9407-dc9fb08f2927 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Calling method '.version_select at 0x7f8dab5cd040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.819507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24dbacaa-613b-45ea-9407-dc9fb08f2927 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'a7742b2fc8d247ce95d98e7d5babc7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3097fe2baef4179a11083d1adad3edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24dbacaa-613b-45ea-9407-dc9fb08f2927 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Request method failure captured: Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIsr5FH95vLoM6SO7n6YGIfP_yleMbd_TH2nPGqNW_1tk4ZZHb7Lok1qiH4v6nV6UWi0ch57xn0NfNdnG9qBNri6ywlaLOVq6YgTObtCFAGaRXVSMowSjZJmHoqReGCPpfCGPCuGWqp_S8UA3IEqPp1cQTfnFKYD6QmaMYdXTJOj_E Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:00.822270 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3097fe2baef4179a11083d1adad3edd"}]}] Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a7742b2fc8d247ce95d98e7d5babc7e3 Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:52:00.823847 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:00.824778 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 24 08:52:00.826018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.827307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24dbacaa-613b-45ea-9407-dc9fb08f2927 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:00.827905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24dbacaa-613b-45ea-9407-dc9fb08f2927 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.020150 Oct 24 08:52:00.829256 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 207/391] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:00.834132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5afa407-6592-433b-93d3-203dc89a12a3 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.856549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5afa407-6592-433b-93d3-203dc89a12a3 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026159 Oct 24 08:52:00.857238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 208/392] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:00.862022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-56575841-7a0e-4133-a74b-8b590027e16d req-f5a25ae7-5277-45b3-ba56-ec811dddbe47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ae30e9-993b-4756-97fd-4e52861acaa3", "tag": "5e0ef215-44b7-4229-a74d-7a8b0e943828"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:00.875528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56575841-7a0e-4133-a74b-8b590027e16d req-f5a25ae7-5277-45b3-ba56-ec811dddbe47 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.876092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56575841-7a0e-4133-a74b-8b590027e16d req-f5a25ae7-5277-45b3-ba56-ec811dddbe47 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.876607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56575841-7a0e-4133-a74b-8b590027e16d req-f5a25ae7-5277-45b3-ba56-ec811dddbe47 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.888778 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-56575841-7a0e-4133-a74b-8b590027e16d req-f5a25ae7-5277-45b3-ba56-ec811dddbe47 service nova] Creating event network-changed:5e0ef215-44b7-4229-a74d-7a8b0e943828 for instance 61ae30e9-993b-4756-97fd-4e52861acaa3 on n-h2-master-1 Oct 24 08:52:00.894167 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-56575841-7a0e-4133-a74b-8b590027e16d req-f5a25ae7-5277-45b3-ba56-ec811dddbe47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035457 Oct 24 08:52:00.895000 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 209/393] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:00.901856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dff209e0-b75c-4278-9a91-2b9cef0fd868 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab5db1f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.958081 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dff209e0-b75c-4278-9a91-2b9cef0fd868 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 64 microversion: 2.1 time: 0.061571 Oct 24 08:52:00.958690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 210/394] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 64 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:00.964188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37c60cea-8692-4b8b-8633-e8c7bfb16f2f tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Calling method '.version_select at 0x7f8dab5d48b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.966321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37c60cea-8692-4b8b-8633-e8c7bfb16f2f tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'a7742b2fc8d247ce95d98e7d5babc7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3097fe2baef4179a11083d1adad3edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37c60cea-8692-4b8b-8633-e8c7bfb16f2f tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Request method failure captured: Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIsr5FH95vLoM6SO7n6YGIfP_yleMbd_TH2nPGqNW_1tk4ZZHb7Lok1qiH4v6nV6UWi0ch57xn0NfNdnG9qBNri6ywlaLOVq6YgTObtCFAGaRXVSMowSjZJmHoqReGCPpfCGPCuGWqp_S8UA3IEqPp1cQTfnFKYD6QmaMYdXTJOj_E Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:00.968135 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3097fe2baef4179a11083d1adad3edd"}]}] Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a7742b2fc8d247ce95d98e7d5babc7e3 Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:52:00.969604 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:00.970480 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 24 08:52:00.971694 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:00.974316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37c60cea-8692-4b8b-8633-e8c7bfb16f2f tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:00.975384 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37c60cea-8692-4b8b-8633-e8c7bfb16f2f tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015186 Oct 24 08:52:00.976561 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 211/395] 10.222.0.25 () {58 vars in 1179 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:00.981708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d86df67-3c8c-4396-b41e-31c10f9d0951 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1503608241", "id": 1852803929, "os-flavor-access:is_public": "False"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:01.016127 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d86df67-3c8c-4396-b41e-31c10f9d0951 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.037607 Oct 24 08:52:01.017599 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 212/396] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:00 2022] POST /compute/v2.1/flavors => generated 439 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:01.030538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de275b83-c040-4765-b80e-def73caae4c7 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab5d4af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:01.082171 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:01.093635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab5b38b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:01.127359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-de275b83-c040-4765-b80e-def73caae4c7 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:01.137834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-de275b83-c040-4765-b80e-def73caae4c7 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:01.183754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.184277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.184708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.185672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.186209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.187128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.239213 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:01.359723 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2530bd8-6e30-4bc2-a918-2b725d3a69bf tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75" status: 200 len: 240 microversion: 2.36 time: 0.659484 Oct 24 08:52:01.360278 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 185/397] 10.222.0.25 () {62 vars in 1303 bytes} [Mon Oct 24 08:52:00 2022] PUT /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75 => generated 240 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:01.569562 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de275b83-c040-4765-b80e-def73caae4c7 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.550198 Oct 24 08:52:01.570944 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 213/398] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:52:01 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:01.584490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a668aa0e-70f7-407b-974f-9263fd93cc41 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d676b7239abf444ca090dc4d06dd2db0"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:01.717006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Calling method '.version_select at 0x7f8dab5b9700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:01.718881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.719365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.719803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.735723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.736522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.737148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.751036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.751849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.752900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.761049 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56ed4912-d510-4135-885a-0a83de61bbc7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.392682 Oct 24 08:52:01.761948 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 186/399] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:52:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:01.767071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:01.768190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:01.780365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.782991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.783662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.786385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.787977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.788638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.039140 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a668aa0e-70f7-407b-974f-9263fd93cc41 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] HTTP exception thrown: Flavor access not found for 33 / d676b7239abf444ca090dc4d06dd2db0 combination. Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a668aa0e-70f7-407b-974f-9263fd93cc41 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Request method failure captured: Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/flavors/1852803929/action HTTP/1.1 Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 70 Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIlrH4lAschqNyo0GMWYVUAhOnCYFBvY7nYabC65Cd2yUkW59-cH1m1Jr9kH94-TeKlBA9dZI5XGX7T4abI590ukuBJsexhPiRjx0QguKTYMZhVkTKYua-ecE_YY8jW0Qex4fS0WkrtTBLA4fAMq4Vnx_F-1qEguVzES4kXGExG8RQ Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4144a752f1494a5e964cfb38db5c1d45 Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:52:02.042859 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4144a752f1494a5e964cfb38db5c1d45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4144a752f1494a5e964cfb38db5c1d45"}]}] Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4144a752f1494a5e964cfb38db5c1d45 Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-295244454 Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 2458c3818faa409dbb95cd5d7cacc32a Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: {"removeTenantAccess": {"tenant": "d676b7239abf444ca090dc4d06dd2db0"}} Oct 24 08:52:02.044256 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: exception: Flavor access not found for 33 / d676b7239abf444ca090dc4d06dd2db0 combination. Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1852803929', 'body': {'removeTenantAccess': {'tenant': 'd676b7239abf444ca090dc4d06dd2db0'}}} Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 24 08:52:02.044916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / d676b7239abf444ca090dc4d06dd2db0 combination. Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / d676b7239abf444ca090dc4d06dd2db0 combination. Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.049368 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / d676b7239abf444ca090dc4d06dd2db0 combination. Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a668aa0e-70f7-407b-974f-9263fd93cc41 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Returning 404 to user: Flavor access not found for 33 / d676b7239abf444ca090dc4d06dd2db0 combination. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a668aa0e-70f7-407b-974f-9263fd93cc41 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1852803929/action" status: 404 len: 124 microversion: 2.1 time: 0.472391 Oct 24 08:52:02.050912 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 214/400] 10.222.0.25 () {60 vars in 1200 bytes} [Mon Oct 24 08:52:01 2022] POST /compute/v2.1/flavors/1852803929/action => generated 124 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:02.052987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Calling method '.version_select at 0x7f8dab52f1f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:02.158528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:02.172235 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e117d26a-fa48-4890-a59f-e2fe67004319 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1472 microversion: 2.1 time: 0.408844 Oct 24 08:52:02.185332 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 187/401] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:01 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:02.197166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-659dc9ec-c530-4401-bf1d-b66a07352ab1 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update', calling method: .version_select at 0x7f8daba5d550>, body: {"meta": {"os_version": "alt"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:02.268241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-659dc9ec-c530-4401-bf1d-b66a07352ab1 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:02.278184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-659dc9ec-c530-4401-bf1d-b66a07352ab1 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:02.492463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.493248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.493887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.494808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.495425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.496084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.530534 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed130467-0dd5-4f75-95db-50abcf030125 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75/detail" status: 200 len: 672 microversion: 2.36 time: 0.483351 Oct 24 08:52:02.546009 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 215/402] 10.222.0.25 () {60 vars in 1304 bytes} [Mon Oct 24 08:52:02 2022] GET /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75/detail => generated 672 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:02.551577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:02.553730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:02.560659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.561478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.562612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.564228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.565566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.566341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.724933 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-659dc9ec-c530-4401-bf1d-b66a07352ab1 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.534190 Oct 24 08:52:02.730936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 188/403] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Oct 24 08:52:02 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata/os_version => generated 31 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:02.742212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89f53176-9f90-43d4-8e48-067a92a6e9d0 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Calling method '.version_select at 0x7f8dab5b3f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:02.746311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-89f53176-9f90-43d4-8e48-067a92a6e9d0 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'a7742b2fc8d247ce95d98e7d5babc7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3097fe2baef4179a11083d1adad3edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89f53176-9f90-43d4-8e48-067a92a6e9d0 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Request method failure captured: Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIsr5FH95vLoM6SO7n6YGIfP_yleMbd_TH2nPGqNW_1tk4ZZHb7Lok1qiH4v6nV6UWi0ch57xn0NfNdnG9qBNri6ywlaLOVq6YgTObtCFAGaRXVSMowSjZJmHoqReGCPpfCGPCuGWqp_S8UA3IEqPp1cQTfnFKYD6QmaMYdXTJOj_E Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:02.748759 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3097fe2baef4179a11083d1adad3edd"}]}] Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a7742b2fc8d247ce95d98e7d5babc7e3 Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1'} Oct 24 08:52:02.750244 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:02.751093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 24 08:52:02.752285 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.754423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89f53176-9f90-43d4-8e48-067a92a6e9d0 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:02.756444 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-89f53176-9f90-43d4-8e48-067a92a6e9d0 tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.022890 Oct 24 08:52:02.757856 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 189/404] 10.222.0.25 () {58 vars in 1173 bytes} [Mon Oct 24 08:52:02 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:02.763113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3eaba54d-d771-4e7c-a629-b506bacc4c13 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:02.790125 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3eaba54d-d771-4e7c-a629-b506bacc4c13 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1852803929" status: 202 len: 0 microversion: 2.1 time: 0.030704 Oct 24 08:52:02.790829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 190/405] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:52:02 2022] DELETE /compute/v2.1/flavors/1852803929 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:02.798143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:02.798737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:02.806722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.807455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.807896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.808628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.809089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.809557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.842193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Request method failure captured: Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9/diagnostics HTTP/1.1 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIb3GkK-7xebGcX0XIb4l23fx1ENaLCkqktGbqchqUK6PYSrX3qTD0B-dyZUO_MKteBPAQ7yO3vQv34Dlb32M4z4uX9bR8So65owAY8FCx-x0oWXpNbzVqs-qhVGdu9qCkVWPMZY2OzBGXA5zofvwiiuZunXWkqc7YIeUteNCMvo54 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 51f58b19f97f4eb7a30c2106758088d6 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1589790929 Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:02.844352 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51f58b19f97f4eb7a30c2106758088d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51f58b19f97f4eb7a30c2106758088d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51f58b19f97f4eb7a30c2106758088d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51f58b19f97f4eb7a30c2106758088d6"}]}] Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1589790929 Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 51f58b19f97f4eb7a30c2106758088d6 Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1589790929 Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerDiagnosticsNegativeTest-1589790929-project Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: cc1ba89738f2407abcbc8eb5cbc6d356 Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1589790929-project Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:52:02.845743 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '9383a06f-f840-4932-b490-a09e84708eb9'} Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:02.846423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 24 08:52:02.847478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:02.850170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:02.851067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31af0ac0-53c8-4bd0-b4e9-9480923414e5 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.059184 Oct 24 08:52:02.851947 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 191/406] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:52:02 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9/diagnostics => generated 117 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:03.023026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-137bc264-2761-4504-9bc0-ddb09ecbc4eb tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-537552072", "ram": 512, "vcpus": 1, "disk": 10, "id": 1073183557, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:03.050067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-137bc264-2761-4504-9bc0-ddb09ecbc4eb tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.196650 Oct 24 08:52:03.051202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 192/407] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:03.058138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd261fee-5741-4bfe-8f71-273c0e9e58f9 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab5b3160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.110683 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd261fee-5741-4bfe-8f71-273c0e9e58f9 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 58 microversion: 2.1 time: 0.056585 Oct 24 08:52:03.111850 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 193/408] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:52:03 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 58 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:03.118718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c47be641-18e7-4ffe-a055-2b25ed8668d7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Calling method '.version_select at 0x7f8dab93ff70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.120540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c47be641-18e7-4ffe-a055-2b25ed8668d7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] HTTP exception thrown: Hypervisor with ID '587b35a3-c79b-44d5-82cd-a73edc5e9967' could not be found. Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c47be641-18e7-4ffe-a055-2b25ed8668d7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Request method failure captured: Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/587b35a3-c79b-44d5-82cd-a73edc5e9967/uptime HTTP/1.1 Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIvWZGTcDCcMwlk7Emho3fVje0HqPPI6GFF4vzhU9m-eTkAdsalgF6w5L1whsMP0P0uEgZM3QdsV9c0rdGu1JLj3T3IuM2FU2YfKO8qxUgkwC1M-9Pl4L7Z2Qfgw2laszg0gV56OrBRrXogutVwX6zCeSda3d5qUQEX3DVtMHXLMac Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3efeb744e42e47c8b1ae636da01d5293 Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1005986514 Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:52:03.138707 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3efeb744e42e47c8b1ae636da01d5293"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3efeb744e42e47c8b1ae636da01d5293"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3efeb744e42e47c8b1ae636da01d5293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3efeb744e42e47c8b1ae636da01d5293"}]}] Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1005986514 Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3efeb744e42e47c8b1ae636da01d5293 Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1005986514 Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 374c711a83a94c2dabf0376e881f0e4f Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: exception: Hypervisor with ID '587b35a3-c79b-44d5-82cd-a73edc5e9967' could not be found. Oct 24 08:52:03.140062 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '587b35a3-c79b-44d5-82cd-a73edc5e9967'} Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '587b35a3-c79b-44d5-82cd-a73edc5e9967' Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 24 08:52:03.140990 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '587b35a3-c79b-44d5-82cd-a73edc5e9967' could not be found. Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:03.143328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '587b35a3-c79b-44d5-82cd-a73edc5e9967' could not be found. Oct 24 08:52:03.145615 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.149409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c47be641-18e7-4ffe-a055-2b25ed8668d7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Returning 404 to user: Hypervisor with ID '587b35a3-c79b-44d5-82cd-a73edc5e9967' could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:03.151597 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c47be641-18e7-4ffe-a055-2b25ed8668d7 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/587b35a3-c79b-44d5-82cd-a73edc5e9967/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037654 Oct 24 08:52:03.152971 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 194/409] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 08:52:03 2022] GET /compute/v2.1/os-hypervisors/587b35a3-c79b-44d5-82cd-a73edc5e9967/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:03.163055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Action: 'update', calling method: .version_select at 0x7f8dabce0700>, body: {"quota_set": {"ram": "2048"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:03.202020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:03.211681 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e52ab979-8af5-457d-9beb-09385aad1194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.664038 Oct 24 08:52:03.212821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 216/410] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:02 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:03.237736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bb95084e-1ed2-4ff5-a9b6-1a388b0e4738 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.254276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.255812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.256410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.257328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.258516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.259145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.291989 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bb95084e-1ed2-4ff5-a9b6-1a388b0e4738 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.076459 Oct 24 08:52:03.300247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.301119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.302610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.303565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.304206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.304931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.305949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 217/411] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:03.332836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.334477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:03.352134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.353670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.355027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.356675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.357770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.358733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.423968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:52:03.444577 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a3bad76-4e44-403a-acdc-42e95941f7bb tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75?user_id=2723d19a46984e9d8b0b7cda28825e7a" status: 200 len: 240 microversion: 2.36 time: 0.289851 Oct 24 08:52:03.457232 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 195/412] 10.222.0.25 () {62 vars in 1384 bytes} [Mon Oct 24 08:52:03 2022] PUT /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75?user_id=2723d19a46984e9d8b0b7cda28825e7a => generated 240 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:03.608028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac205aee-d78d-42cc-8eb4-d113a579202c tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 204 len: 0 microversion: 2.1 time: 0.299493 Oct 24 08:52:03.610419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 218/413] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:52:03 2022] DELETE /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:52:03.617969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61e08364-7e2b-4588-935d-9f27f5532eac tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'update_all', calling method: .version_select at 0x7f8dab58cdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:03.698485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-61e08364-7e2b-4588-935d-9f27f5532eac tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:03.705805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5adb726f-ec69-463b-85f7-e476be52c328 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.706240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-61e08364-7e2b-4588-935d-9f27f5532eac tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:03.721447 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5adb726f-ec69-463b-85f7-e476be52c328 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] HTTP exception thrown: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5adb726f-ec69-463b-85f7-e476be52c328 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Request method failure captured: Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/flavors/1073183557/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIxYbZpXrW7uFxsuBI4QijqvhjORs20QpEV3ku0cPx8kG6aHYljAF4rL7oYabO9bXJ7pozzq-aY8BSNOsKyeZghdHD4qKdlbWJ0eEoyyISei1_4xWEdwsXA8qp_CtE9yEV4myVkPjqN0nKN2nGlp-J2DpH88ZtMHKty-ZR7CFBnW1I Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:03.724523 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ebf4f99c926d4eee8f70a3cd64e87929"}]}] Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7358bc8b21184699a0ff8187ebe46aeb Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:52:03.726094 n-d-master-1 devstack@n-api.service[126919]: exception: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: action_args: {'flavor_id': '1073183557', 'id': 'hw:cpu_thread_policy'} Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:03.726696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:03.727905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:03.733959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5adb726f-ec69-463b-85f7-e476be52c328 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Returning 404 to user: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:03.735699 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5adb726f-ec69-463b-85f7-e476be52c328 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] 10.222.0.25 "GET /compute/v2.1/flavors/1073183557/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.275552 Oct 24 08:52:03.736662 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 196/414] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 08:52:03 2022] GET /compute/v2.1/flavors/1073183557/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:03.755606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Calling method '.version_select at 0x7f8dab5b35e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.766696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.767422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.768155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.836664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.837460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.838060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.870112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.870715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.871021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.880868 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ed75540-5b3f-40d9-afdc-5e5f856e6e50 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.139130 Oct 24 08:52:03.888886 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 197/415] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:52:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:03.903284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f51a95ea-e03a-47ed-8fe4-4ee538132ad3 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Calling method '.version_select at 0x7f8dab820280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.272908 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61e08364-7e2b-4588-935d-9f27f5532eac tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 61 microversion: 2.1 time: 0.660565 Oct 24 08:52:04.273851 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 219/416] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:52:03 2022] PUT /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 61 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:04.285192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.288393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:04.299569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:04.300240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:04.301134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.302643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:04.304046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:04.304965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.384081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f51a95ea-e03a-47ed-8fe4-4ee538132ad3 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75?user_id=2723d19a46984e9d8b0b7cda28825e7a" status: 200 len: 282 microversion: 2.36 time: 0.493720 Oct 24 08:52:04.384614 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 198/417] 10.222.0.25 () {60 vars in 1364 bytes} [Mon Oct 24 08:52:03 2022] GET /compute/v2.1/os-quota-sets/a743bd48f4bf499ab2b51dd37b9b2d75?user_id=2723d19a46984e9d8b0b7cda28825e7a => generated 282 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:04.389248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88d163b1-ed89-4d7d-b1f1-4d24c657ba94 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:04.393075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88d163b1-ed89-4d7d-b1f1-4d24c657ba94 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7358bc8b21184699a0ff8187ebe46aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf4f99c926d4eee8f70a3cd64e87929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88d163b1-ed89-4d7d-b1f1-4d24c657ba94 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Request method failure captured: Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/flavors/1073183557/os-extra_specs HTTP/1.1 Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 66 Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIxYbZpXrW7uFxsuBI4QijqvhjORs20QpEV3ku0cPx8kG6aHYljAF4rL7oYabO9bXJ7pozzq-aY8BSNOsKyeZghdHD4qKdlbWJ0eEoyyISei1_4xWEdwsXA8qp_CtE9yEV4myVkPjqN0nKN2nGlp-J2DpH88ZtMHKty-ZR7CFBnW1I Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:04.394804 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ebf4f99c926d4eee8f70a3cd64e87929"}]}] Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7358bc8b21184699a0ff8187ebe46aeb Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 24 08:52:04.396054 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: action_args: {'flavor_id': '1073183557', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:04.396808 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 24 08:52:04.402464 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.404655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88d163b1-ed89-4d7d-b1f1-4d24c657ba94 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:04.404655 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88d163b1-ed89-4d7d-b1f1-4d24c657ba94 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] 10.222.0.25 "POST /compute/v2.1/flavors/1073183557/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010723 Oct 24 08:52:04.404655 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 199/418] 10.222.0.25 () {60 vars in 1224 bytes} [Mon Oct 24 08:52:04 2022] POST /compute/v2.1/flavors/1073183557/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:04.404655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8ab8a8a0-621d-4196-b022-4a78ae343f0c tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Calling method '.version_select at 0x7f8dab8e3a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.405520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8ab8a8a0-621d-4196-b022-4a78ae343f0c tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'a7742b2fc8d247ce95d98e7d5babc7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3097fe2baef4179a11083d1adad3edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8ab8a8a0-621d-4196-b022-4a78ae343f0c tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Request method failure captured: Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIsr5FH95vLoM6SO7n6YGIfP_yleMbd_TH2nPGqNW_1tk4ZZHb7Lok1qiH4v6nV6UWi0ch57xn0NfNdnG9qBNri6ywlaLOVq6YgTObtCFAGaRXVSMowSjZJmHoqReGCPpfCGPCuGWqp_S8UA3IEqPp1cQTfnFKYD6QmaMYdXTJOj_E Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:04.407307 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3097fe2baef4179a11083d1adad3edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3097fe2baef4179a11083d1adad3edd"}]}] Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b3097fe2baef4179a11083d1adad3edd Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783 Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a7742b2fc8d247ce95d98e7d5babc7e3 Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1773631783-project Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1'} Oct 24 08:52:04.410515 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:04.412451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 24 08:52:04.414802 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.418370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8ab8a8a0-621d-4196-b022-4a78ae343f0c tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:04.418370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8ab8a8a0-621d-4196-b022-4a78ae343f0c tempest-HypervisorAdminNegativeTestJSON-1773631783 tempest-HypervisorAdminNegativeTestJSON-1773631783-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.011015 Oct 24 08:52:04.418370 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 200/419] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 08:52:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:04.420492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.421288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:04.428830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:04.429380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:04.429811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.429811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:04.431017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:04.431406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.633668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:04.644122 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8bd2685e-a8bd-4762-a470-bba523950e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.227160 Oct 24 08:52:04.645048 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 201/420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:04 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:04.651256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abd06a93-9c09-4244-8353-936ee316d826 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Action: 'create', calling method: .version_select at 0x7f8dab817a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:04.746390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-abd06a93-9c09-4244-8353-936ee316d826 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:04.762953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-abd06a93-9c09-4244-8353-936ee316d826 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Getting quotas for user 8f26fa5efd704f25a17ca0965944aae5 and project 183affc84fd84194961f02ea40a757f3. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:04.784657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:04.806057 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4584bdbb-bb52-49db-96f1-e7c65c9a9ca1 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1478 microversion: 2.1 time: 0.522335 Oct 24 08:52:04.807495 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 220/421] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:04 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1478 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:04.812563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c56b6b91-2c32-420e-b2bb-cc67ca286e02 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:04.873779 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:04.913775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c56b6b91-2c32-420e-b2bb-cc67ca286e02 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1073183557/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104819 Oct 24 08:52:04.914426 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 221/422] 10.222.0.25 () {60 vars in 1224 bytes} [Mon Oct 24 08:52:04 2022] POST /compute/v2.1/flavors/1073183557/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:04.919377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a08647cc-258b-4f22-8d7d-97cabb9e09c3 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Calling method '.version_select at 0x7f8dab5cd0d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.927523 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a08647cc-258b-4f22-8d7d-97cabb9e09c3 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] HTTP exception thrown: Hypervisor with ID 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb' could not be found. Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a08647cc-258b-4f22-8d7d-97cabb9e09c3 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Request method failure captured: Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-hypervisors/a3ff3bab-7bba-4322-84ab-18ac1b5730fb HTTP/1.1 Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIvWZGTcDCcMwlk7Emho3fVje0HqPPI6GFF4vzhU9m-eTkAdsalgF6w5L1whsMP0P0uEgZM3QdsV9c0rdGu1JLj3T3IuM2FU2YfKO8qxUgkwC1M-9Pl4L7Z2Qfgw2laszg0gV56OrBRrXogutVwX6zCeSda3d5qUQEX3DVtMHXLMac Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 3efeb744e42e47c8b1ae636da01d5293 Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1005986514 Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:52:04.936271 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3efeb744e42e47c8b1ae636da01d5293"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3efeb744e42e47c8b1ae636da01d5293"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3efeb744e42e47c8b1ae636da01d5293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3efeb744e42e47c8b1ae636da01d5293"}]}] Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1005986514 Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 3efeb744e42e47c8b1ae636da01d5293 Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1005986514 Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 374c711a83a94c2dabf0376e881f0e4f Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: exception: Hypervisor with ID 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb' could not be found. Oct 24 08:52:04.937609 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb'} Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb' Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 24 08:52:04.938358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:52:04.939533 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb' could not be found. Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb' could not be found. Oct 24 08:52:04.940601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.943632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a08647cc-258b-4f22-8d7d-97cabb9e09c3 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] Returning 404 to user: Hypervisor with ID 'a3ff3bab-7bba-4322-84ab-18ac1b5730fb' could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:04.946305 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a08647cc-258b-4f22-8d7d-97cabb9e09c3 tempest-HypervisorAdminNegativeTestJSON-1005986514 tempest-HypervisorAdminNegativeTestJSON-1005986514-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/a3ff3bab-7bba-4322-84ab-18ac1b5730fb" status: 404 len: 123 microversion: 2.1 time: 0.030622 Oct 24 08:52:04.951596 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 222/423] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 08:52:04 2022] GET /compute/v2.1/os-hypervisors/a3ff3bab-7bba-4322-84ab-18ac1b5730fb => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:04.957757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe70edb0-a456-4f9b-a0e1-5d5b23a40aeb tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.960932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe70edb0-a456-4f9b-a0e1-5d5b23a40aeb tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7358bc8b21184699a0ff8187ebe46aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf4f99c926d4eee8f70a3cd64e87929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe70edb0-a456-4f9b-a0e1-5d5b23a40aeb tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Request method failure captured: Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIxYbZpXrW7uFxsuBI4QijqvhjORs20QpEV3ku0cPx8kG6aHYljAF4rL7oYabO9bXJ7pozzq-aY8BSNOsKyeZghdHD4qKdlbWJ0eEoyyISei1_4xWEdwsXA8qp_CtE9yEV4myVkPjqN0nKN2nGlp-J2DpH88ZtMHKty-ZR7CFBnW1I Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:04.963059 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ebf4f99c926d4eee8f70a3cd64e87929"}]}] Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7358bc8b21184699a0ff8187ebe46aeb Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:52:04.964515 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: action_args: {'flavor_id': '1073183557', 'id': 'hw:numa_nodes'} Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:04.965277 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 24 08:52:04.966605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:04.967902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe70edb0-a456-4f9b-a0e1-5d5b23a40aeb tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:04.969155 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe70edb0-a456-4f9b-a0e1-5d5b23a40aeb tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016317 Oct 24 08:52:04.970491 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 223/424] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 08:52:04 2022] DELETE /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:04.988026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d97caec6-9a3c-4369-b193-6d1019fb3e5f tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:05.017843 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d97caec6-9a3c-4369-b193-6d1019fb3e5f tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1073183557/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039998 Oct 24 08:52:05.018877 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 224/425] 10.222.0.25 () {60 vars in 1224 bytes} [Mon Oct 24 08:52:04 2022] POST /compute/v2.1/flavors/1073183557/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:05.045220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b794b9da-2324-4c36-92a2-4d9675e86a2d tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:05.052842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b794b9da-2324-4c36-92a2-4d9675e86a2d tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7358bc8b21184699a0ff8187ebe46aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf4f99c926d4eee8f70a3cd64e87929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b794b9da-2324-4c36-92a2-4d9675e86a2d tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Request method failure captured: Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 22 Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIxYbZpXrW7uFxsuBI4QijqvhjORs20QpEV3ku0cPx8kG6aHYljAF4rL7oYabO9bXJ7pozzq-aY8BSNOsKyeZghdHD4qKdlbWJ0eEoyyISei1_4xWEdwsXA8qp_CtE9yEV4myVkPjqN0nKN2nGlp-J2DpH88ZtMHKty-ZR7CFBnW1I Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:05.055940 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ebf4f99c926d4eee8f70a3cd64e87929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ebf4f99c926d4eee8f70a3cd64e87929"}]}] Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ebf4f99c926d4eee8f70a3cd64e87929 Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7358bc8b21184699a0ff8187ebe46aeb Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: {"hw:numa_nodes": "1"} Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:52:05.057443 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: action_args: {'flavor_id': '1073183557', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:52:05.058265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 24 08:52:05.059397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.064543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b794b9da-2324-4c36-92a2-4d9675e86a2d tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:05.066094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b794b9da-2324-4c36-92a2-4d9675e86a2d tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227 tempest-FlavorsExtraSpecsNegativeTestJSON-1886587227-project] 10.222.0.25 "PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.031351 Oct 24 08:52:05.066711 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 225/426] 10.222.0.25 () {60 vars in 1265 bytes} [Mon Oct 24 08:52:05 2022] PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:05.097481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b569284-7860-47b0-a3de-705592f7602c tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.129477 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-4b569284-7860-47b0-a3de-705592f7602c tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] HTTP exception thrown: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b569284-7860-47b0-a3de-705592f7602c tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Request method failure captured: Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/flavors/1073183557/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIylh6DUdFKjY0Dqg1EjG79LlOdVKXZKpXeAzcamZLChQwnvIa5l4-ZQOMx3sCrxJQMSV0JbokaCoREQcV3MOyQZN5Nd6Zy6pS7SnyS1L3mFitvHa8mLHo21Cp0abxfRgfOAxRDyN5MJuHrh18F5slDywFLCUEgQdLEoyxFYDafT10 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: fdf16fe0aaed4cc9a9902ad18f196131 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:52:05.131675 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdf16fe0aaed4cc9a9902ad18f196131"}]}] Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: fdf16fe0aaed4cc9a9902ad18f196131 Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 65cc97d97cf4411db950583c39062337 Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:52:05.133045 n-d-master-1 devstack@n-api.service[126920]: exception: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: action_args: {'flavor_id': '1073183557', 'id': 'hw:cpu_thread_policy'} Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:05.133817 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. Oct 24 08:52:05.135162 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.137468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b569284-7860-47b0-a3de-705592f7602c tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Returning 404 to user: Flavor 1073183557 has no extra specs with key hw:cpu_thread_policy. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:05.138506 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b569284-7860-47b0-a3de-705592f7602c tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1073183557/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.054465 Oct 24 08:52:05.153632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 226/427] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 08:52:05 2022] DELETE /compute/v2.1/flavors/1073183557/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:05.169312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76f1b247-461a-4c38-88fd-abc022de9737 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:05.178927 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-76f1b247-461a-4c38-88fd-abc022de9737 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76f1b247-461a-4c38-88fd-abc022de9737 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Request method failure captured: Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 27 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIylh6DUdFKjY0Dqg1EjG79LlOdVKXZKpXeAzcamZLChQwnvIa5l4-ZQOMx3sCrxJQMSV0JbokaCoREQcV3MOyQZN5Nd6Zy6pS7SnyS1L3mFitvHa8mLHo21Cp0abxfRgfOAxRDyN5MJuHrh18F5slDywFLCUEgQdLEoyxFYDafT10 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: fdf16fe0aaed4cc9a9902ad18f196131 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:52:05.182501 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdf16fe0aaed4cc9a9902ad18f196131"}]}] Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: fdf16fe0aaed4cc9a9902ad18f196131 Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 65cc97d97cf4411db950583c39062337 Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: {"hw:cpu_policy": "shared"} Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:52:05.184133 n-d-master-1 devstack@n-api.service[126920]: exception: Request body and URI mismatch Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: action_args: {'flavor_id': '1073183557', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.185105 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.186960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:05.186960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:05.186960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 24 08:52:05.186960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.187635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76f1b247-461a-4c38-88fd-abc022de9737 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:05.191786 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76f1b247-461a-4c38-88fd-abc022de9737 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.036628 Oct 24 08:52:05.193261 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 227/428] 10.222.0.25 () {60 vars in 1265 bytes} [Mon Oct 24 08:52:05 2022] PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes => generated 73 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:05.206092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-195801a1-fa1c-48d8-baa5-cced9407de83 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-195801a1-fa1c-48d8-baa5-cced9407de83 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Request method failure captured: Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 49 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIylh6DUdFKjY0Dqg1EjG79LlOdVKXZKpXeAzcamZLChQwnvIa5l4-ZQOMx3sCrxJQMSV0JbokaCoREQcV3MOyQZN5Nd6Zy6pS7SnyS1L3mFitvHa8mLHo21Cp0abxfRgfOAxRDyN5MJuHrh18F5slDywFLCUEgQdLEoyxFYDafT10 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: fdf16fe0aaed4cc9a9902ad18f196131 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:52:05.218669 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdf16fe0aaed4cc9a9902ad18f196131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdf16fe0aaed4cc9a9902ad18f196131"}]}] Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: fdf16fe0aaed4cc9a9902ad18f196131 Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 65cc97d97cf4411db950583c39062337 Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 24 08:52:05.219983 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: action_args: {'flavor_id': '1073183557', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance: Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 24 08:52:05.220645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.221920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:05.223018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:05.223018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:05.223018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:52:05.223018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:52:05.223018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 08:52:05.223018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:05.225973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-195801a1-fa1c-48d8-baa5-cced9407de83 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:05.228085 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-195801a1-fa1c-48d8-baa5-cced9407de83 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.029486 Oct 24 08:52:05.234320 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 228/429] 10.222.0.25 () {60 vars in 1265 bytes} [Mon Oct 24 08:52:05 2022] PUT /compute/v2.1/flavors/1073183557/os-extra_specs/hw:numa_nodes => generated 117 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 08:52:05.248668 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d70bcd1b-edde-40f5-9570-43147e1aeb6e tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.316484 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d70bcd1b-edde-40f5-9570-43147e1aeb6e tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1073183557" status: 202 len: 0 microversion: 2.1 time: 0.075269 Oct 24 08:52:05.330198 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 229/430] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:52:05 2022] DELETE /compute/v2.1/flavors/1073183557 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:52:05.352210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4ddef6b-b8f7-48c6-9461-55f0b487f637 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.457892 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4ddef6b-b8f7-48c6-9461-55f0b487f637 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662 tempest-FlavorsExtraSpecsNegativeTestJSON-1455805662-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.113474 Oct 24 08:52:05.459092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 230/431] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:52:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:05.485264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abd06a93-9c09-4244-8353-936ee316d826 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "POST /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 85 microversion: 2.1 time: 0.837787 Oct 24 08:52:05.486590 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 202/432] 10.222.0.25 () {60 vars in 1281 bytes} [Mon Oct 24 08:52:04 2022] POST /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 85 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:05.498651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42c3073e-e545-4d6f-a78d-c13659695931 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] Calling method '.version_select at 0x7f8dab5d3160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.577985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42c3073e-e545-4d6f-a78d-c13659695931 tempest-ImagesMetadataTestJSON-583757942 tempest-ImagesMetadataTestJSON-583757942-project] 10.222.0.25 "GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata" status: 200 len: 85 microversion: 2.1 time: 0.083389 Oct 24 08:52:05.587388 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 231/433] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:52:05 2022] GET /compute/v2.1/images/c5203376-bd0e-4c94-8cb6-5f96bd577d37/metadata => generated 85 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:05.673541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.674398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:05.694796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.695321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.701761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.704045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.706779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.709167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.835046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.836060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:05.849353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.849855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.850382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.862368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.863013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.863470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.874365 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:06.277589 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:06.285749 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14edb97e-5017-427f-a832-00dec8433352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.618917 Oct 24 08:52:06.292549 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 203/434] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:05 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:06.343253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:06.366814 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7f72223-6469-4387-9042-e2c904e96f2a tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1478 microversion: 2.1 time: 0.537226 Oct 24 08:52:06.373623 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 232/435] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:05 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1478 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:06.895193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1e53e3cd-6a9c-427f-b414-dbce1792bf7c req-837cfd87-5f6e-4bae-a77e-d5849ebeafd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9383a06f-f840-4932-b490-a09e84708eb9", "name": "network-vif-deleted", "tag": "50a108c9-5b3a-4849-b990-b984077ea61f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:06.930124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1e53e3cd-6a9c-427f-b414-dbce1792bf7c req-837cfd87-5f6e-4bae-a77e-d5849ebeafd1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:06.930508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1e53e3cd-6a9c-427f-b414-dbce1792bf7c req-837cfd87-5f6e-4bae-a77e-d5849ebeafd1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:06.935635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1e53e3cd-6a9c-427f-b414-dbce1792bf7c req-837cfd87-5f6e-4bae-a77e-d5849ebeafd1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:06.984226 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1e53e3cd-6a9c-427f-b414-dbce1792bf7c req-837cfd87-5f6e-4bae-a77e-d5849ebeafd1 service nova] Creating event network-vif-deleted:50a108c9-5b3a-4849-b990-b984077ea61f for instance 9383a06f-f840-4932-b490-a09e84708eb9 on n-h1-master-1 Oct 24 08:52:07.002933 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1e53e3cd-6a9c-427f-b414-dbce1792bf7c req-837cfd87-5f6e-4bae-a77e-d5849ebeafd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112970 Oct 24 08:52:07.004787 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 204/436] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:07.315434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:07.316527 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:07.331835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.333362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.334030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.334998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.337471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.340418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.393951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:07.394919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:07.405064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.406703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.409753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.415522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.427140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.427626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.494828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.497814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.498511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.499844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lazy-loading 'fault' on Instance uuid 9383a06f-f840-4932-b490-a09e84708eb9 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:07.738796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1ba89738f2407abcbc8eb5cbc6d356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f58b19f97f4eb7a30c2106758088d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:07.761972 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0434075e-19cc-4919-8472-ffc535d9f338 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 200 len: 1313 microversion: 2.1 time: 0.372514 Oct 24 08:52:07.764994 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 205/437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:07 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:07.991207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:08.006996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c65eafb6-9059-4763-b67c-5d3a546c596a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.695501 Oct 24 08:52:08.008220 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 233/438] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:07 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:08.816853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:08.824796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] [instance: 9383a06f-f840-4932-b490-a09e84708eb9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:08.847740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:08.849342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:08.850059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:08.851046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:08.851758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:08.852766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:08.892111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] HTTP exception thrown: Instance 9383a06f-f840-4932-b490-a09e84708eb9 could not be found. Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Request method failure captured: Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 HTTP/1.1 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIb3GkK-7xebGcX0XIb4l23fx1ENaLCkqktGbqchqUK6PYSrX3qTD0B-dyZUO_MKteBPAQ7yO3vQv34Dlb32M4z4uX9bR8So65owAY8FCx-x0oWXpNbzVqs-qhVGdu9qCkVWPMZY2OzBGXA5zofvwiiuZunXWkqc7YIeUteNCMvo54 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 51f58b19f97f4eb7a30c2106758088d6 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1589790929 Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:08.898325 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51f58b19f97f4eb7a30c2106758088d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51f58b19f97f4eb7a30c2106758088d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51f58b19f97f4eb7a30c2106758088d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51f58b19f97f4eb7a30c2106758088d6"}]}] Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1589790929 Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 51f58b19f97f4eb7a30c2106758088d6 Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1589790929 Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerDiagnosticsNegativeTest-1589790929-project Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: cc1ba89738f2407abcbc8eb5cbc6d356 Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1589790929-project Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 9383a06f-f840-4932-b490-a09e84708eb9 could not be found. Oct 24 08:52:08.900888 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9383a06f-f840-4932-b490-a09e84708eb9'} Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9383a06f-f840-4932-b490-a09e84708eb9 could not be found. Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:08.908960 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9383a06f-f840-4932-b490-a09e84708eb9 could not be found. Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9383a06f-f840-4932-b490-a09e84708eb9 could not be found. Oct 24 08:52:08.911627 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:08.913744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] Returning 404 to user: Instance 9383a06f-f840-4932-b490-a09e84708eb9 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:08.913744 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-51e0ee18-92eb-4ade-aad9-686ee09f6118 tempest-ServerDiagnosticsNegativeTest-1589790929 tempest-ServerDiagnosticsNegativeTest-1589790929-project] 10.222.0.25 "GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9" status: 404 len: 111 microversion: 2.1 time: 0.116902 Oct 24 08:52:08.913744 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 206/439] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:08 2022] GET /compute/v2.1/servers/9383a06f-f840-4932-b490-a09e84708eb9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:09.037874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:09.043097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:09.086782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:09.087431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:09.088213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:09.089208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:09.091672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:09.092289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:09.919528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:09.971882 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96216efd-1bb6-4769-a17b-391978a825f0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1501 microversion: 2.1 time: 0.939806 Oct 24 08:52:09.982241 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 234/440] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:09 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1501 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:11.009734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:11.011714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:11.027498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.032299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.033724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:11.035143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.037410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.043576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:11.636448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:11.653071 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f89740ab-9d62-487b-b7a0-2f244a0a7446 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1491 microversion: 2.1 time: 0.647339 Oct 24 08:52:11.654802 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 207/441] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:11 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1491 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:11.687690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4877f45-b9d0-42c7-bf06-2ad2abf3724d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '.version_select at 0x7f8dab52fdc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:11.703398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4877f45-b9d0-42c7-bf06-2ad2abf3724d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.704954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4877f45-b9d0-42c7-bf06-2ad2abf3724d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.706065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4877f45-b9d0-42c7-bf06-2ad2abf3724d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:11.746592 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e4877f45-b9d0-42c7-bf06-2ad2abf3724d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.072646 Oct 24 08:52:11.748185 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 235/442] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:52:11 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:11.765726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:11.767471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:11.772761 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:11.787956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.794353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.794973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:11.796114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.797388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.801095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:12.002628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7869651d-87e2-4efc-b979-c2fdeb6cc9cc tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1642 microversion: 2.1 time: 0.244560 Oct 24 08:52:12.014302 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 208/443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:11 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1642 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:12.576057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1410944304", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "a1e84f6c-6a1f-4a59-a284-a0213f1972ff"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:12.598855 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:12.697551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] validate_networks() for [('a1e84f6c-6a1f-4a59-a284-a0213f1972ff', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:13.590912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:13.591351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:13.591828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:13.592238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:13.592669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:13.603037 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=29 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:13.605284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:13.606259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:13.607255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:13.608455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:13.609412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:13.610067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:13.637544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:13.644050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for user b43a269fe8b746b88c38db6b9e9bfa12 and project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:13.666752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:13.670007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:13.759844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f016bf63-341e-42c8-b594-c3ea0414d04c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182958 Oct 24 08:52:13.760945 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 236/444] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:13.773191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e21573a8-b515-4504-9dc3-0ddd972d80a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:13.773946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e21573a8-b515-4504-9dc3-0ddd972d80a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:13.776413 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:13.932664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e21573a8-b515-4504-9dc3-0ddd972d80a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:13.939733 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=51 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:13.941779 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e21573a8-b515-4504-9dc3-0ddd972d80a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1211 microversion: 2.1 time: 0.173210 Oct 24 08:52:13.945172 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 209/445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:13 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1211 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:14.969506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:14.970854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:14.980421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:14.981364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:14.981981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:14.982868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:14.983480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:14.984625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:15.013261 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:15.074590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:15.083799 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c50e55bd-83c1-4d92-8612-5a4eba364f69 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1263 microversion: 2.1 time: 0.118134 Oct 24 08:52:15.094828 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 210/446] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:14 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1263 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:15.313720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-212d1881-1156-4207-bb7f-7ca6a4ebb1cc tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Calling method '.version_select at 0x7f8dab52fdc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:15.364936 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-212d1881-1156-4207-bb7f-7ca6a4ebb1cc tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] HTTP exception thrown: Image not found. Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-212d1881-1156-4207-bb7f-7ca6a4ebb1cc tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Request method failure captured: Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/8323fa0f-d381-44dc-b136-7830e86bcb09/metadata/os_distro HTTP/1.1 Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlI-4xJ6g_Lf7-vit1eYlyUvRUQ5JO_7joq08b6yZKvFLbyFPJiBLHZ84-6gacSbKuDbxk9EzZ3j_y8xblrPJ8hWWIBhGkWhCy_dQdhgvRsQoBg-k-tFAvRTkm0e3kI-bwFQSLdmhKwaARcHgqgZ0i-5d3YFYVBMO78I2u8wAQB8wGU Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:15.389868 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d67aceff3f74eb09e51d10c4a2c2c34"}]}] Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ef6d87df863045b4bfa04f6bbec25d85 Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: action_args: {'image_id': '8323fa0f-d381-44dc-b136-7830e86bcb09', 'id': 'os_distro'} Oct 24 08:52:15.392363 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.393735 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8323fa0f-d381-44dc-b136-7830e86bcb09 Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.394872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8323fa0f-d381-44dc-b136-7830e86bcb09 could not be found. Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:15.396527 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.398557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-212d1881-1156-4207-bb7f-7ca6a4ebb1cc tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:15.402277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-212d1881-1156-4207-bb7f-7ca6a4ebb1cc tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] 10.222.0.25 "DELETE /compute/v2.1/images/8323fa0f-d381-44dc-b136-7830e86bcb09/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.677298 Oct 24 08:52:15.407754 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 237/447] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 08:52:14 2022] DELETE /compute/v2.1/images/8323fa0f-d381-44dc-b136-7830e86bcb09/metadata/os_distro => generated 62 bytes in 695 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:15.423069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01c27e25-9e3d-432d-a3fe-fec9760faf64 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Calling method '.version_select at 0x7f8dab5b3790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:15.480047 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-01c27e25-9e3d-432d-a3fe-fec9760faf64 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] HTTP exception thrown: Image not found. Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01c27e25-9e3d-432d-a3fe-fec9760faf64 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Request method failure captured: Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/images/4d447c00-d916-49ef-832a-674c54af1068/metadata/os_version HTTP/1.1 Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI-4xJ6g_Lf7-vit1eYlyUvRUQ5JO_7joq08b6yZKvFLbyFPJiBLHZ84-6gacSbKuDbxk9EzZ3j_y8xblrPJ8hWWIBhGkWhCy_dQdhgvRsQoBg-k-tFAvRTkm0e3kI-bwFQSLdmhKwaARcHgqgZ0i-5d3YFYVBMO78I2u8wAQB8wGU Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:15.487163 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d67aceff3f74eb09e51d10c4a2c2c34"}]}] Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ef6d87df863045b4bfa04f6bbec25d85 Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: action_args: {'image_id': '4d447c00-d916-49ef-832a-674c54af1068', 'id': 'os_version'} Oct 24 08:52:15.488576 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.489560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4d447c00-d916-49ef-832a-674c54af1068 Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.490995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d447c00-d916-49ef-832a-674c54af1068 could not be found. Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:15.492317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.493795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01c27e25-9e3d-432d-a3fe-fec9760faf64 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:15.495155 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01c27e25-9e3d-432d-a3fe-fec9760faf64 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] 10.222.0.25 "GET /compute/v2.1/images/4d447c00-d916-49ef-832a-674c54af1068/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.080118 Oct 24 08:52:15.495155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 211/448] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 08:52:15 2022] GET /compute/v2.1/images/4d447c00-d916-49ef-832a-674c54af1068/metadata/os_version => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:15.509280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da519e9c-9228-4526-9d69-922fe74493f5 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Calling method '.version_select at 0x7f8dab4df040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:15.543621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-da519e9c-9228-4526-9d69-922fe74493f5 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] HTTP exception thrown: Image not found. Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da519e9c-9228-4526-9d69-922fe74493f5 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Request method failure captured: Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/images/ade21f7e-1c15-4d5f-ac9f-e7b0961405f3/metadata HTTP/1.1 Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlI-4xJ6g_Lf7-vit1eYlyUvRUQ5JO_7joq08b6yZKvFLbyFPJiBLHZ84-6gacSbKuDbxk9EzZ3j_y8xblrPJ8hWWIBhGkWhCy_dQdhgvRsQoBg-k-tFAvRTkm0e3kI-bwFQSLdmhKwaARcHgqgZ0i-5d3YFYVBMO78I2u8wAQB8wGU Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:15.552948 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d67aceff3f74eb09e51d10c4a2c2c34"}]}] Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ef6d87df863045b4bfa04f6bbec25d85 Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: action_args: {'image_id': 'ade21f7e-1c15-4d5f-ac9f-e7b0961405f3'} Oct 24 08:52:15.554264 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.555036 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ade21f7e-1c15-4d5f-ac9f-e7b0961405f3 Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.556166 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ade21f7e-1c15-4d5f-ac9f-e7b0961405f3 could not be found. Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:15.557367 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.559965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da519e9c-9228-4526-9d69-922fe74493f5 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:15.563956 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da519e9c-9228-4526-9d69-922fe74493f5 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] 10.222.0.25 "GET /compute/v2.1/images/ade21f7e-1c15-4d5f-ac9f-e7b0961405f3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055732 Oct 24 08:52:15.566348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 238/449] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:52:15 2022] GET /compute/v2.1/images/ade21f7e-1c15-4d5f-ac9f-e7b0961405f3/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:15.589866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-094cd298-1fc4-463b-83bc-f198a78d1b3f tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Action: 'update_all', calling method: .version_select at 0x7f8dab817a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:15.647223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-094cd298-1fc4-463b-83bc-f198a78d1b3f tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] HTTP exception thrown: Image not found. Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-094cd298-1fc4-463b-83bc-f198a78d1b3f tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Request method failure captured: Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: request: PUT /compute/v2.1/images/e5a76f10-8589-45cc-9659-2123acab1a08/metadata HTTP/1.1 Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 57 Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI-4xJ6g_Lf7-vit1eYlyUvRUQ5JO_7joq08b6yZKvFLbyFPJiBLHZ84-6gacSbKuDbxk9EzZ3j_y8xblrPJ8hWWIBhGkWhCy_dQdhgvRsQoBg-k-tFAvRTkm0e3kI-bwFQSLdmhKwaARcHgqgZ0i-5d3YFYVBMO78I2u8wAQB8wGU Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:15.649738 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d67aceff3f74eb09e51d10c4a2c2c34"}]}] Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ef6d87df863045b4bfa04f6bbec25d85 Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 08:52:15.650962 n-d-master-1 devstack@n-api.service[126919]: action_args: {'image_id': 'e5a76f10-8589-45cc-9659-2123acab1a08', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.651742 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5a76f10-8589-45cc-9659-2123acab1a08 Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.652734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5a76f10-8589-45cc-9659-2123acab1a08 could not be found. Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:15.654478 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:52:15.655487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.657144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-094cd298-1fc4-463b-83bc-f198a78d1b3f tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:15.657144 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-094cd298-1fc4-463b-83bc-f198a78d1b3f tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] 10.222.0.25 "PUT /compute/v2.1/images/e5a76f10-8589-45cc-9659-2123acab1a08/metadata" status: 404 len: 62 microversion: 2.1 time: 0.073133 Oct 24 08:52:15.657144 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 212/450] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:52:15 2022] PUT /compute/v2.1/images/e5a76f10-8589-45cc-9659-2123acab1a08/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:15.667256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e6ef4ef-8ffb-429f-8cd2-2848985be848 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Action: 'update', calling method: .version_select at 0x7f8dab51d1f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:15.705595 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2e6ef4ef-8ffb-429f-8cd2-2848985be848 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] HTTP exception thrown: Image not found. Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e6ef4ef-8ffb-429f-8cd2-2848985be848 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Request method failure captured: Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/images/0fcc06a6-524f-49f5-ad5d-00f3d31ea39e/metadata/os_distro HTTP/1.1 Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 30 Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlI-4xJ6g_Lf7-vit1eYlyUvRUQ5JO_7joq08b6yZKvFLbyFPJiBLHZ84-6gacSbKuDbxk9EzZ3j_y8xblrPJ8hWWIBhGkWhCy_dQdhgvRsQoBg-k-tFAvRTkm0e3kI-bwFQSLdmhKwaARcHgqgZ0i-5d3YFYVBMO78I2u8wAQB8wGU Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:52:15.708344 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d67aceff3f74eb09e51d10c4a2c2c34"}]}] Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ef6d87df863045b4bfa04f6bbec25d85 Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: {"meta": {"os_distro": "alt"}} Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 08:52:15.709888 n-d-master-1 devstack@n-api.service[126920]: action_args: {'image_id': '0fcc06a6-524f-49f5-ad5d-00f3d31ea39e', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.710642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0fcc06a6-524f-49f5-ad5d-00f3d31ea39e Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.711584 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fcc06a6-524f-49f5-ad5d-00f3d31ea39e could not be found. Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:15.712568 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:52:15.714858 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.719298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e6ef4ef-8ffb-429f-8cd2-2848985be848 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:15.720496 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e6ef4ef-8ffb-429f-8cd2-2848985be848 tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] 10.222.0.25 "PUT /compute/v2.1/images/0fcc06a6-524f-49f5-ad5d-00f3d31ea39e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.057923 Oct 24 08:52:15.721719 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 239/451] 10.222.0.25 () {60 vars in 1310 bytes} [Mon Oct 24 08:52:15 2022] PUT /compute/v2.1/images/0fcc06a6-524f-49f5-ad5d-00f3d31ea39e/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:15.733012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a256e543-9a89-47e8-91c3-a796e671d5cd tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Action: 'create', calling method: .version_select at 0x7f8dab817700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:15.768560 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a256e543-9a89-47e8-91c3-a796e671d5cd tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] HTTP exception thrown: Image not found. Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a256e543-9a89-47e8-91c3-a796e671d5cd tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Request method failure captured: Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/images/d65b335f-3003-4b10-822d-65a68a81a0ef/metadata HTTP/1.1 Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 57 Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI-4xJ6g_Lf7-vit1eYlyUvRUQ5JO_7joq08b6yZKvFLbyFPJiBLHZ84-6gacSbKuDbxk9EzZ3j_y8xblrPJ8hWWIBhGkWhCy_dQdhgvRsQoBg-k-tFAvRTkm0e3kI-bwFQSLdmhKwaARcHgqgZ0i-5d3YFYVBMO78I2u8wAQB8wGU Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:52:15.771049 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d67aceff3f74eb09e51d10c4a2c2c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d67aceff3f74eb09e51d10c4a2c2c34"}]}] Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7d67aceff3f74eb09e51d10c4a2c2c34 Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-908834445 Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ef6d87df863045b4bfa04f6bbec25d85 Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-908834445-project Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 08:52:15.772270 n-d-master-1 devstack@n-api.service[126919]: action_args: {'image_id': 'd65b335f-3003-4b10-822d-65a68a81a0ef', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.773030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d65b335f-3003-4b10-822d-65a68a81a0ef Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:52:15.774008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d65b335f-3003-4b10-822d-65a68a81a0ef could not be found. Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:15.775209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:52:15.776191 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:52:15.777393 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a256e543-9a89-47e8-91c3-a796e671d5cd tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:15.777393 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a256e543-9a89-47e8-91c3-a796e671d5cd tempest-ImagesMetadataNegativeTestJSON-908834445 tempest-ImagesMetadataNegativeTestJSON-908834445-project] 10.222.0.25 "POST /compute/v2.1/images/d65b335f-3003-4b10-822d-65a68a81a0ef/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046555 Oct 24 08:52:15.777393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 213/452] 10.222.0.25 () {60 vars in 1281 bytes} [Mon Oct 24 08:52:15 2022] POST /compute/v2.1/images/d65b335f-3003-4b10-822d-65a68a81a0ef/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:16.107974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:16.108585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:16.118253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:16.118763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:16.119193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:16.127822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:16.131829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:16.132708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:16.361127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:16.373782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1269 microversion: 2.1 time: 0.269355 Oct 24 08:52:16.375273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 240/453] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:16 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:17.401867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:17.402635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:17.422367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:17.422945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:17.423394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:17.424147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:17.424599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:17.432234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:18.167385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:18.180236 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb30d3c9-e0b1-4149-a98d-4f79385407a5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.785869 Oct 24 08:52:18.202335 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 214/454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:17 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:18.415314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:18.417111 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e8709a1-86c0-4885-b9c2-2a270cf706f3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002470 Oct 24 08:52:18.418138 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 241/455] 10.222.0.25 () {56 vars in 886 bytes} [Mon Oct 24 08:52:18 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 08:52:19.211050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.211692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:19.234160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-097a4508-843e-4086-a5b1-768c75a4a0bd tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-379430819", "id": 311306876, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:19.245779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:19.246501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:19.248482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:19.253468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:19.255307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:19.256957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:19.277593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-097a4508-843e-4086-a5b1-768c75a4a0bd tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.669523 Oct 24 08:52:19.278182 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 215/456] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:52:18 2022] POST /compute/v2.1/flavors => generated 445 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:19.530435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94e7b788-eb0a-45ed-a2ae-1731d0e8aa4b tempest-FlavorsV255TestJSON-1138199772 tempest-FlavorsV255TestJSON-1138199772-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.543673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94e7b788-eb0a-45ed-a2ae-1731d0e8aa4b tempest-FlavorsV255TestJSON-1138199772 tempest-FlavorsV255TestJSON-1138199772-project] 10.222.0.25 "GET /compute/v2.1/flavors/311306876" status: 200 len: 445 microversion: 2.55 time: 0.255683 Oct 24 08:52:19.544633 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 216/457] 10.222.0.25 () {60 vars in 1196 bytes} [Mon Oct 24 08:52:19 2022] GET /compute/v2.1/flavors/311306876 => generated 445 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:52:19.559695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e585ffc4-cfcd-4783-ab59-400d1c107941 tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] Action: 'update', calling method: .version_select at 0x7f8dacd8eb80>, body: {"flavor": {"description": "new"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:19.645451 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e585ffc4-cfcd-4783-ab59-400d1c107941 tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/311306876" status: 200 len: 446 microversion: 2.55 time: 0.090730 Oct 24 08:52:19.646704 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 217/458] 10.222.0.25 () {62 vars in 1216 bytes} [Mon Oct 24 08:52:19 2022] PUT /compute/v2.1/flavors/311306876 => generated 446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:52:19.691953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-893d9b19-155b-4be0-b282-dd6355a60629 tempest-FlavorsV255TestJSON-1138199772 tempest-FlavorsV255TestJSON-1138199772-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.762415 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-893d9b19-155b-4be0-b282-dd6355a60629 tempest-FlavorsV255TestJSON-1138199772 tempest-FlavorsV255TestJSON-1138199772-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.106031 Oct 24 08:52:19.765841 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 218/459] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:52:19 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:52:19.787866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e40d6f83-bd3d-46de-9242-2c33bd9aea14 tempest-FlavorsV255TestJSON-1138199772 tempest-FlavorsV255TestJSON-1138199772-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.825019 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e40d6f83-bd3d-46de-9242-2c33bd9aea14 tempest-FlavorsV255TestJSON-1138199772 tempest-FlavorsV255TestJSON-1138199772-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.044704 Oct 24 08:52:19.827282 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 219/460] 10.222.0.25 () {60 vars in 1166 bytes} [Mon Oct 24 08:52:19 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:52:19.846432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62ad4f9b-517f-4614-ad12-16623f9f8a45 tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.874208 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62ad4f9b-517f-4614-ad12-16623f9f8a45 tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/311306876" status: 202 len: 0 microversion: 2.55 time: 0.032693 Oct 24 08:52:19.879215 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 220/461] 10.222.0.25 () {60 vars in 1199 bytes} [Mon Oct 24 08:52:19 2022] DELETE /compute/v2.1/flavors/311306876 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:52:19.884422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0177ecea-6588-448b-bc29-c27e63cd8a60 tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.911426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0177ecea-6588-448b-bc29-c27e63cd8a60 tempest-FlavorsV255TestJSON-2073906841 tempest-FlavorsV255TestJSON-2073906841-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.030102 Oct 24 08:52:19.938755 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 221/462] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:52:19 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:52:20.339234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:20.356258 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef45889d-ddc5-46dc-aded-bf520a19071b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 1.151406 Oct 24 08:52:20.357490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 242/463] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:19 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:21.387685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:21.388832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:21.404351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.406853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.408107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:21.411980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.414193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.415212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:22.208745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1100951549", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:22.293668 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:22.450167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:22.458564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba86c2c9-8fe5-4296-866b-62bc29a0f58b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 1.076159 Oct 24 08:52:22.474809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 222/464] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:21 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:22.482223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c822f0dc-0ed8-44e4-a43e-6257326ff240 req-2b5af7e4-d12a-4bfb-89d3-572e0f64c9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79fd1ba6-d19b-4759-b494-1f85ffee607e", "tag": "01b4c797-8d6c-4aed-b6fb-57e62d04db3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:22.492465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c822f0dc-0ed8-44e4-a43e-6257326ff240 req-2b5af7e4-d12a-4bfb-89d3-572e0f64c9a8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:22.493238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c822f0dc-0ed8-44e4-a43e-6257326ff240 req-2b5af7e4-d12a-4bfb-89d3-572e0f64c9a8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:22.493839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c822f0dc-0ed8-44e4-a43e-6257326ff240 req-2b5af7e4-d12a-4bfb-89d3-572e0f64c9a8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:22.508200 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c822f0dc-0ed8-44e4-a43e-6257326ff240 req-2b5af7e4-d12a-4bfb-89d3-572e0f64c9a8 service nova] Creating event network-changed:01b4c797-8d6c-4aed-b6fb-57e62d04db3a for instance 79fd1ba6-d19b-4759-b494-1f85ffee607e on n-h2-master-1 Oct 24 08:52:22.516160 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c822f0dc-0ed8-44e4-a43e-6257326ff240 req-2b5af7e4-d12a-4bfb-89d3-572e0f64c9a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038203 Oct 24 08:52:22.516982 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 223/465] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:23.488774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:23.490511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:23.507267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:23.508120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:23.508767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:23.509768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:23.510643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:23.511306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:23.626113 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:23.661376 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:23.746536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:23.747291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:23.748209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:23.749096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:23.749714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:23.788753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:23.790597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:23.791194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:23.796333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:23.796959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:23.797816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:23.852239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Getting quotas for project 96ab82000972421c96022c2711beb014. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:23.866899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Getting quotas for user c2b9360313da41e1905c695c37020876 and project 96ab82000972421c96022c2711beb014. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:23.915121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:23.918564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:24.023810 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f25f06e-032e-43af-875d-9a5a82c1a85d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014266 Oct 24 08:52:24.041057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 243/466] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:24.086012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ac12dd8-7109-46d8-9b02-11f1999bc7ec tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:24.100159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ac12dd8-7109-46d8-9b02-11f1999bc7ec tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:24.292573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:24.302454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-50e339c1-bb6f-40fa-82b3-5d7fee2393f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.819570 Oct 24 08:52:24.312833 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 224/467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:23 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:24.349912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ac12dd8-7109-46d8-9b02-11f1999bc7ec tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:24.387208 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ac12dd8-7109-46d8-9b02-11f1999bc7ec tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1217 microversion: 2.1 time: 0.338223 Oct 24 08:52:24.408053 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 244/468] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:24 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1217 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:25.335911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:25.336524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:25.339092 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:25.358003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.358636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.359182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.359952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.368141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.368756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.433651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:25.434948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:25.451640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.458997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.459883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.461206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.461931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.462562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.668543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:25.688896 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-396bfd16-52fc-411b-b9fa-336acb832da2 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1213 microversion: 2.1 time: 0.255266 Oct 24 08:52:25.690007 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 245/469] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:25 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:26.676853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:26.736411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:26.737905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:26.745218 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2c8b0eb-e089-43f1-bf24-6bdede2860bd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 1.408296 Oct 24 08:52:26.749863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:26.750071 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 225/470] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:25 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:26.752105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:26.753267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:26.756194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:26.756877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:26.758319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.453040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:27.462012 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad82618d-7d1d-4d20-87ad-11e2b607e434 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1275 microversion: 2.1 time: 0.731175 Oct 24 08:52:27.469538 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 246/471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:26 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1275 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:27.711671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Calling method '.version_select at 0x7f8dab608e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:27.715051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.724348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.727940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.771796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:27.772336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.772425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:27.772501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.772846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.782618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.783118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.783557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.784273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.784729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.785154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.811632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.812139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.812575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.833197 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f609f0c-ad21-46bb-848b-d00af3d44cf4 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.828680 Oct 24 08:52:27.844227 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 226/472] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:52:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:27.856505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Calling method '.version_select at 0x7f8dabde9a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:27.865092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.866264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.875242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.902113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.903098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.904271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.919471 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e33aaa8c-3963-44b4-b189-897d95f4c147 tempest-HypervisorAdminV228Test-1291354654 tempest-HypervisorAdminV228Test-1291354654-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.073820 Oct 24 08:52:27.920355 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 227/473] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 08:52:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:28.496885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:28.499338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:28.519389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.520716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.521441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.523039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.531147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.531912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.545591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:28.553438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b101fca-e67a-40c6-96ec-21383c9368fa tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.785524 Oct 24 08:52:28.565847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 247/474] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:27 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:28.805711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:28.814808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-91d71cb8-2c1b-4c2d-8c2d-72b3809093da tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1275 microversion: 2.1 time: 0.330241 Oct 24 08:52:28.822969 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 228/475] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:28 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:29.577654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:29.578893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:29.595072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:29.595625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:29.596316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:29.597266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:29.598015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:29.598716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.044305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2a651c7-4e75-4279-ba53-7166122c9cd1 tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-676423544", "id": 552777225, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:30.084277 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2a651c7-4e75-4279-ba53-7166122c9cd1 tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.314090 Oct 24 08:52:30.096212 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 229/476] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:52:29 2022] POST /compute/v2.1/flavors => generated 464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:30.105218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:30.109887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:30.122784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:30.124293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:30.124935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.127030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:30.130043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:30.130787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.407008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:30.438018 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13bad3e0-5be1-4be9-8b11-6e4b6c38e08a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1275 microversion: 2.1 time: 0.336312 Oct 24 08:52:30.440770 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 230/477] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:30 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:30.539017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:30.547139 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03ccc1ee-6c3b-4c6a-8206-814c5f80b2fb tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.973614 Oct 24 08:52:30.558288 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 248/478] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:29 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:30.711550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62a3d8b6-4c81-435a-81c9-b48665d092b2 tempest-FlavorsV261TestJSON-1645175987 tempest-FlavorsV261TestJSON-1645175987-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:30.722407 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62a3d8b6-4c81-435a-81c9-b48665d092b2 tempest-FlavorsV261TestJSON-1645175987 tempest-FlavorsV261TestJSON-1645175987-project] 10.222.0.25 "GET /compute/v2.1/flavors/552777225" status: 200 len: 464 microversion: 2.61 time: 0.278997 Oct 24 08:52:30.732540 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 231/479] 10.222.0.25 () {60 vars in 1196 bytes} [Mon Oct 24 08:52:30 2022] GET /compute/v2.1/flavors/552777225 => generated 464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:30.755180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-084b4ca2-e8f5-469a-81f0-740cb429d2c0 tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] Action: 'update', calling method: .version_select at 0x7f8dacd8fb80>, body: {"flavor": {"description": "new"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:30.849517 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-084b4ca2-e8f5-469a-81f0-740cb429d2c0 tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/552777225" status: 200 len: 465 microversion: 2.61 time: 0.098339 Oct 24 08:52:30.856260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 249/480] 10.222.0.25 () {62 vars in 1216 bytes} [Mon Oct 24 08:52:30 2022] PUT /compute/v2.1/flavors/552777225 => generated 465 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:52:30.874575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58471d92-b0b0-46fc-9dc4-ca8eb76ddedc tempest-FlavorsV261TestJSON-1645175987 tempest-FlavorsV261TestJSON-1645175987-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:30.929127 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58471d92-b0b0-46fc-9dc4-ca8eb76ddedc tempest-FlavorsV261TestJSON-1645175987 tempest-FlavorsV261TestJSON-1645175987-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.057716 Oct 24 08:52:30.931783 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 232/481] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:52:30 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:52:30.957032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7c4f6b9-3ada-457e-a42d-7fad0c61138e tempest-FlavorsV261TestJSON-1645175987 tempest-FlavorsV261TestJSON-1645175987-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.008412 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7c4f6b9-3ada-457e-a42d-7fad0c61138e tempest-FlavorsV261TestJSON-1645175987 tempest-FlavorsV261TestJSON-1645175987-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.055233 Oct 24 08:52:31.009275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 250/482] 10.222.0.25 () {60 vars in 1166 bytes} [Mon Oct 24 08:52:30 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:52:31.032093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f0e09a9-abbc-433c-a454-b3c093cd7255 tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.081106 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f0e09a9-abbc-433c-a454-b3c093cd7255 tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/552777225" status: 202 len: 0 microversion: 2.61 time: 0.052481 Oct 24 08:52:31.083999 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 233/483] 10.222.0.25 () {60 vars in 1199 bytes} [Mon Oct 24 08:52:31 2022] DELETE /compute/v2.1/flavors/552777225 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:52:31.091041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8594978-7e85-4db9-a630-6338fe40e58d tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.139198 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8594978-7e85-4db9-a630-6338fe40e58d tempest-FlavorsV261TestJSON-1059058173 tempest-FlavorsV261TestJSON-1059058173-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.051696 Oct 24 08:52:31.139649 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 251/484] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:52:31 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:52:31.470266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.471167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:31.489056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.491263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.493347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.496521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.500359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.502453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.588330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.589056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:31.600902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.604633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.605118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.605895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.606371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.606801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:32.167540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:32.179982 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-590d2912-08d7-495c-ba8a-4f88c6d6fe88 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.599461 Oct 24 08:52:32.180574 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 252/485] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:31 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:32.734081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:32.743768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3860102-6334-470b-8547-ac1ae7a8772a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 1.278619 Oct 24 08:52:32.765437 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 234/486] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:31 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:33.206254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:33.208130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:33.230079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.230913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.231635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.232763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.233476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.234054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.780625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:33.782094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:33.796370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.801949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.802699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.803722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.804463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.805415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.821167 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:33.942884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:33.969769 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf1e80ad-2cc4-42f8-b73b-61c626c3f1f6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.764318 Oct 24 08:52:33.974897 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 253/487] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:33 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:33.995424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-02ab1a77-ed55-46f5-8d3e-b657ceb7d8ac req-810bb20c-0e56-47f8-a3c5-29df0f848110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fd1ba6-d19b-4759-b494-1f85ffee607e", "name": "network-vif-plugged", "status": "completed", "tag": "01b4c797-8d6c-4aed-b6fb-57e62d04db3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:34.054935 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:INSERT=7,nova_api:RELEASE=3,nova_api:SELECT=84,nova_api:SAVEPOINT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:34.071184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02ab1a77-ed55-46f5-8d3e-b657ceb7d8ac req-810bb20c-0e56-47f8-a3c5-29df0f848110 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:34.079889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02ab1a77-ed55-46f5-8d3e-b657ceb7d8ac req-810bb20c-0e56-47f8-a3c5-29df0f848110 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:34.081583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02ab1a77-ed55-46f5-8d3e-b657ceb7d8ac req-810bb20c-0e56-47f8-a3c5-29df0f848110 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:34.185482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-02ab1a77-ed55-46f5-8d3e-b657ceb7d8ac req-810bb20c-0e56-47f8-a3c5-29df0f848110 service nova] Creating event network-vif-plugged:01b4c797-8d6c-4aed-b6fb-57e62d04db3a for instance 79fd1ba6-d19b-4759-b494-1f85ffee607e on n-h2-master-1 Oct 24 08:52:34.220591 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-02ab1a77-ed55-46f5-8d3e-b657ceb7d8ac req-810bb20c-0e56-47f8-a3c5-29df0f848110 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241596 Oct 24 08:52:34.221256 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 254/488] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:34.994848 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:35.007261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:35.009795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:35.040285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.045073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.047879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.048756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.049235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.057608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.913825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:35.926130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a537eb89-59b4-46b6-be30-05e4b2b062d3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1311 microversion: 2.1 time: 0.933119 Oct 24 08:52:35.946135 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 255/489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:34 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1311 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:36.419449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:36.444879 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61abf68f-c610-4ed4-8ce1-71eaa8d55d42 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 2.664702 Oct 24 08:52:36.447515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 235/490] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:33 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 2671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:36.781857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ead50fab-ae4e-428c-9227-5debb73e74be req-99215993-f678-49a8-9508-9ec22d94a5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:36.816961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ead50fab-ae4e-428c-9227-5debb73e74be req-99215993-f678-49a8-9508-9ec22d94a5b6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:36.817658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ead50fab-ae4e-428c-9227-5debb73e74be req-99215993-f678-49a8-9508-9ec22d94a5b6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:36.818295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ead50fab-ae4e-428c-9227-5debb73e74be req-99215993-f678-49a8-9508-9ec22d94a5b6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:36.822900 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=80 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:36.841755 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ead50fab-ae4e-428c-9227-5debb73e74be req-99215993-f678-49a8-9508-9ec22d94a5b6 service nova] Creating event network-changed:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:52:36.859238 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ead50fab-ae4e-428c-9227-5debb73e74be req-99215993-f678-49a8-9508-9ec22d94a5b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083552 Oct 24 08:52:36.860201 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 256/491] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:36.971990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:36.974105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:36.992938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:36.997556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:36.998181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:37.000200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.002370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.003105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:37.486194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:37.489202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:37.521462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.523173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.523907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:37.527934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.532070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.532937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:38.156527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:38.173762 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b90adb98-60e3-4c9e-903b-347d2e3e0215 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1492 microversion: 2.1 time: 1.218747 Oct 24 08:52:38.175318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 236/492] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:36 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1492 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:38.219219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:38.221802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:38.236365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:38.237237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:38.238127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:38.241008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:38.241734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:38.244311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:38.729040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:38.742951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e30dade-7509-414b-b149-0cf23f43a03e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 1.271285 Oct 24 08:52:38.751602 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 257/493] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:37 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:39.137503 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f9010ce-1a55-4ab4-8c4d-15c4db60abf1 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1643 microversion: 2.1 time: 0.927960 Oct 24 08:52:39.138476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 237/494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:38 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1643 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:39.232826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1572514606", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:39.362488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:39.370896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2069634846", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "37d96780-2455-4d33-8875-f6279ac9d08e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:39.484557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] validate_networks() for [('37d96780-2455-4d33-8875-f6279ac9d08e', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:40.218308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:40.218982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:40.219766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:40.220284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:40.220942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:40.247266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.248864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.258207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.260044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.261562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.262576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.296469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Getting quotas for project 961eeb9727ed45d9874a81d495c0069a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:40.302797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Getting quotas for user f6e3382f1fcd40108c9d79cfbdf4337a and project 961eeb9727ed45d9874a81d495c0069a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:40.318570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:40.321187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:40.413797 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4bba35ee-caa3-4956-89d2-296aeed91742 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660290 Oct 24 08:52:40.421702 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 258/495] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:40.435165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:40.436343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:40.458337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.459462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.461227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.462833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.465084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.467384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.614026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:40.614725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:40.615304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:40.615946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:40.616810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:40.645453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.648663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.649790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.656388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.657010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.657687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.693652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Getting quotas for project 4bf7adacd2ba40e6b67fa07d8baefc4b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:40.707471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Getting quotas for user 89ee4538fd234ed7b8137861bfb534d3 and project 4bf7adacd2ba40e6b67fa07d8baefc4b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:40.740833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:40.744350 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:40.814291 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c26e2fa-ae35-45b6-b6e9-d0801db3be98 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1643 microversion: 2.1 time: 0.388463 Oct 24 08:52:40.814949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 259/496] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:40 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1643 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:40.879954 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd474e3a-64aa-4115-8584-83ba4cbda9ea tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725179 Oct 24 08:52:40.882707 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 238/497] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:40.894613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:40.913129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:40.928590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.929838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.932119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.933436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.934077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.934712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:41.297039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-868601891", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9255d6aa-996f-44ee-a152-5187bbb96214"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:41.423502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] validate_networks() for [('9255d6aa-996f-44ee-a152-5187bbb96214', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:41.880222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:41.891424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df599323-cba2-4bdf-94b6-8613ac4acfcb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 1.007348 Oct 24 08:52:41.893529 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 239/498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:40 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:42.170310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8aeb731b-35e6-4692-82f7-afbf1080b30d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.183815 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8aeb731b-35e6-4692-82f7-afbf1080b30d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.288417 Oct 24 08:52:42.186159 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 240/499] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:52:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:42.188032 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:42.199684 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.202930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.223510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.224048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.224507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.225485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.225787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.226221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.302412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:42.303308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:42.304785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:42.305357 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:42.306345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:42.339054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.340869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.343308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.344358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.346231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.348221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.417602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Getting quotas for project 47f9a6b369c645e6b8cc4216374b303a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:42.424181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Getting quotas for user 6c77bcaf1bd040678e9baa743607257b and project 47f9a6b369c645e6b8cc4216374b303a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:42.452684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:42.459954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:42.464406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:42.468366 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-16df2e3e-d5ee-4f4b-b927-80eba8d90b47 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1274 microversion: 2.1 time: 0.280858 Oct 24 08:52:42.469693 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 241/500] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:42 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:42.474958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.478870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.479510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.480115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.481261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.481886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.482460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.527042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1668ec39-5e75-44af-8835-5633566152ed tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055988 Oct 24 08:52:42.527927 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 242/501] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 08:52:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:42.543663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.560811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.568270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.570608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.577559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.578708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.579346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.579964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.624190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52425355-d63b-4f08-a7e7-39975c22abe9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808028 Oct 24 08:52:42.635379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 260/502] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:42.871084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:42.887695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe706f3c-b18d-46ba-89b2-7412706548fd tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-483269761", "id": 730286020, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:42.895289 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1acdc539-1a7f-42b6-89ac-a97772c22077 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1220 microversion: 2.1 time: 0.361912 Oct 24 08:52:42.898754 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 243/503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:42 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1220 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:42.948304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:42.950924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.990755 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe706f3c-b18d-46ba-89b2-7412706548fd tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.351461 Oct 24 08:52:42.997031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 261/504] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:42 2022] POST /compute/v2.1/flavors => generated 421 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:43.000740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.001234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.002199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.002384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.002833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.008202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-482f3eb9-32fe-4635-96ed-c1a08a7943de tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:43.008828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-482f3eb9-32fe-4635-96ed-c1a08a7943de tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:43.020090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.087376 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:43.153080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-482f3eb9-32fe-4635-96ed-c1a08a7943de tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:43.160534 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-482f3eb9-32fe-4635-96ed-c1a08a7943de tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1231 microversion: 2.1 time: 0.162172 Oct 24 08:52:43.179367 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 262/505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:42 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1231 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:43.188337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:43.189127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:43.210906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.211801 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bfb14ac7-4eca-4c6b-9c55-de637016f420 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e/action" status: 202 len: 0 microversion: 2.1 time: 0.304401 Oct 24 08:52:43.213126 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 244/506] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:42 2022] POST /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:43.216605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.217353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.218380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.219001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.219602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.235010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4d3972b-d211-49e8-84ca-76dc0a46fc9f tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:43.253020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4d3972b-d211-49e8-84ca-76dc0a46fc9f tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036332 Oct 24 08:52:43.260430 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 245/507] 10.222.0.25 () {58 vars in 1182 bytes} [Mon Oct 24 08:52:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:43.287029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:43.289137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:43.307297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.318152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.320934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.321948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.325983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.326584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.891235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:43.906403 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9aaaa35-3d98-4106-a07c-ad3cd72ec38e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 0.719610 Oct 24 08:52:43.907051 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 263/508] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:43 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:43.912335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0edf8716-3cf4-4aa5-8336-c779997849fa tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-79657471", "id": 1099244565, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:44.011380 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0edf8716-3cf4-4aa5-8336-c779997849fa tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.097472 Oct 24 08:52:44.023635 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 264/509] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:43 2022] POST /compute/v2.1/flavors => generated 423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:44.041680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:44.042729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:44.064151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.074068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.076717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.077436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.087036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.087496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.344139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:44.368119 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5eef7bf2-16a6-4004-92b3-1c6c145b9c03 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1280 microversion: 2.1 time: 0.340411 Oct 24 08:52:44.370326 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 265/510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:44 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1280 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:44.392210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:44.392865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:44.408620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.410722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.411259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.411989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.413990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.414437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.434290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e93309a8-6c55-411a-9737-a10dfae3811b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1648 microversion: 2.1 time: 1.170000 Oct 24 08:52:44.450299 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 246/511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:43 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1648 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:44.456880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-028b1bed-d49b-464b-80b0-604ed0d8ad62 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:44.465755 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-028b1bed-d49b-464b-80b0-604ed0d8ad62 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013980 Oct 24 08:52:44.486546 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 247/512] 10.222.0.25 () {58 vars in 1182 bytes} [Mon Oct 24 08:52:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:44.494512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:44.496837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:44.511389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.512095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.514118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.515035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.517520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.518124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.625084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:44.637579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f9ca396-0b20-412d-a314-249d65b2eb91 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1282 microversion: 2.1 time: 0.264910 Oct 24 08:52:44.655134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 266/513] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:44 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:44.670107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09c38ea5-1ae1-4b27-8521-414fe1598120 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Action: 'create', calling method: .version_select at 0x7f8dab4088b0>, body: {"keypair": {"name": "tempest-keypair-1822886237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3hoXOvETnxObgHDUwFYXNTiEUw9zlzbdbNnVP51W+5k3OpcTJJdb7+/WwF6NKww1JQnykFypwH73juy/EgLVkZ6MzdfEiRNMl6vPG37YjtNrzBqkR7YDSVDT7NqpWf9w=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:44.736002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-09c38ea5-1ae1-4b27-8521-414fe1598120 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Getting quotas for project 8d2c394d0ceb40f298afa7355102bfd5. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:44.752057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-09c38ea5-1ae1-4b27-8521-414fe1598120 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Getting quotas for user 4099c569c4fe489fa349ee29e6974713 and project 8d2c394d0ceb40f298afa7355102bfd5. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:44.818372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09c38ea5-1ae1-4b27-8521-414fe1598120 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160592 Oct 24 08:52:44.823922 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 267/514] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:52:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:44.903801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:44.915735 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2166096c-af65-4341-85d8-b86560c0f398 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1283 microversion: 2.1 time: 0.425638 Oct 24 08:52:44.919640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 248/515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:44 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1283 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:44.947111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:44.948430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:44.969019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.981070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.981549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.982308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.982784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.983225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:45.393723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:45.395611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:45.406078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:45.407393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:45.408024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:45.411390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:45.412319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:45.414110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:45.928625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:45.953411 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58bafb51-8e04-44f6-9d15-fcc888e3e7b8 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1280 microversion: 2.1 time: 0.563947 Oct 24 08:52:45.955648 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 249/516] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:45 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1280 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:45.974991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:45.977722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:45.998055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:45.999667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.007015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.009395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.011085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.013110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.286168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:46.328639 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98a8168a-f6d5-4b21-9872-0f8074caaf96 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 1.378286 Oct 24 08:52:46.329912 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 268/517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:44 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:46.348754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:46.349581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:46.365605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.368748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.369983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.371417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.374766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.375506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.640547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:46.650744 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34b474fb-4560-48b5-8ed9-4fbcab34c4ac tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1282 microversion: 2.1 time: 0.318864 Oct 24 08:52:46.658428 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 269/518] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:46 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:46.664780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:46.668691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:46.686592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.687400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.688027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.688940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.689621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.690208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.883598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:46.898150 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5776051f-0ac0-4583-ad66-68623769c0cb tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1289 microversion: 2.1 time: 0.237609 Oct 24 08:52:46.899116 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 270/519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:46 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1289 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:46.981826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:46.982832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:46.996197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.997370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.998059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.999037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.001853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.004295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.239004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0546797e-fa45-471f-9979-f0168476b2d6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1628 microversion: 2.1 time: 1.280643 Oct 24 08:52:47.239588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:47.240742 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 250/520] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:45 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1628 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:47.258721 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b632e4e3-bbec-4ef7-97aa-cbf2a6dcf9af tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1280 microversion: 2.1 time: 0.279454 Oct 24 08:52:47.261914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 271/521] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:46 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:47.285612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:47.292716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:47.308026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.308475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.309066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.309803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.311010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.311617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.358138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:47.359989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:47.384542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.385477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.386133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.387196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.392136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.397684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.742349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lazy-loading 'flavor' on Instance uuid 79fd1ba6-d19b-4759-b494-1f85ffee607e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:47.830523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Going to try to live migrate instance to n-h1-master-1 {{(pid=126919) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:52:48.705944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:48.735164 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-630eefc0-e1f8-4dc8-acdc-796fecda3a6d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 1.386516 Oct 24 08:52:48.736357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 272/522] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:47 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:48.759238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:48.764336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:48.775755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:48.788701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:48.789851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:48.792330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:48.793119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:48.793848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.404884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:49.416549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd1c8dec-ac35-4cd1-b010-807a6c9e828b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.673016 Oct 24 08:52:49.420190 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 273/523] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:48 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:49.434916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:49.435878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:49.444198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.449285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.449943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.457833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.458811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.459427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.652126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:49.662934 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32e72fcc-ff2e-4ee2-a006-ae79213d66b4 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1289 microversion: 2.1 time: 0.241387 Oct 24 08:52:49.666796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 274/524] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:49 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1289 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:49.672918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:49.682246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:49.698435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.699024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.699557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.700354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.701107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.701562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:50.731087 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:51.475287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:51.490024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a13bfa9f-0eb0-43f9-bf43-39a9ff1b1c51 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1322 microversion: 2.1 time: 1.821486 Oct 24 08:52:51.497477 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 275/525] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:49 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1322 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:51.515278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:51.523161 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:51.552117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.554000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.554449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.565505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.567423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.569485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.883110 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a927bcc8-7804-422f-bf00-cc0c5f585239 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e/action" status: 202 len: 0 microversion: 2.1 time: 4.602288 Oct 24 08:52:51.885152 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 251/526] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:47 2022] POST /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e/action => generated 0 bytes in 4605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:51.893254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:51.911644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:51.938456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.943244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.943902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.944703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.945141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.945614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.995359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:52.022820 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca131481-c4cc-4e02-ba27-f2ccd5740d31 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 0.523272 Oct 24 08:52:52.033690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 276/527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:51 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:52.045654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:52.046181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:52.069661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:52.070478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:52.074929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:52.075931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:52.076559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:52.077143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:52.399719 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:52.502492 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:52.746488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:52.765512 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9b9c2b6-dae0-4b7c-ae17-b6285d744947 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 0.723756 Oct 24 08:52:52.799911 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 277/528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:52 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:52.810751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:52.811833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:52.829102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:52.830044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:52.830714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:52.832950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:52.834581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:52.835320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.242547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:53.255994 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e99e49aa-6a39-49f7-9dd5-a390a6d54cc2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 1.369230 Oct 24 08:52:53.272389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 252/529] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:51 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:53.288628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4a89e736-9e51-40eb-8547-fab9606777d0 req-94a1fe97-c15f-46f7-9343-f1efe155ce60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa819ff1-4bb7-46be-8f11-827cfbf22d9a", "tag": "c6bb9412-f7d3-47d4-996e-6fbdf09e66b4"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:53.338879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4a89e736-9e51-40eb-8547-fab9606777d0 req-94a1fe97-c15f-46f7-9343-f1efe155ce60 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:53.342129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4a89e736-9e51-40eb-8547-fab9606777d0 req-94a1fe97-c15f-46f7-9343-f1efe155ce60 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:53.342881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4a89e736-9e51-40eb-8547-fab9606777d0 req-94a1fe97-c15f-46f7-9343-f1efe155ce60 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.370973 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4a89e736-9e51-40eb-8547-fab9606777d0 req-94a1fe97-c15f-46f7-9343-f1efe155ce60 service nova] Creating event network-changed:c6bb9412-f7d3-47d4-996e-6fbdf09e66b4 for instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a on n-h2-master-1 Oct 24 08:52:53.385989 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4a89e736-9e51-40eb-8547-fab9606777d0 req-94a1fe97-c15f-46f7-9343-f1efe155ce60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110760 Oct 24 08:52:53.390061 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 253/530] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:53.403815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:53.404920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:53.420764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:53.423831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:53.424493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.426142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:53.428762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:53.429501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.766529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:53.774629 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:53.787710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-26238be2-835b-4ab1-ab59-a48db232b9a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.984265 Oct 24 08:52:53.788664 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 278/531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:52 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:53.795186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e2b009c1-37a6-4073-b4f6-70c858b87a5d req-b4647eed-6f90-4b0a-866f-114a244f349d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:53.831773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e2b009c1-37a6-4073-b4f6-70c858b87a5d req-b4647eed-6f90-4b0a-866f-114a244f349d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:53.832459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e2b009c1-37a6-4073-b4f6-70c858b87a5d req-b4647eed-6f90-4b0a-866f-114a244f349d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:53.835557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e2b009c1-37a6-4073-b4f6-70c858b87a5d req-b4647eed-6f90-4b0a-866f-114a244f349d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.880391 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e2b009c1-37a6-4073-b4f6-70c858b87a5d req-b4647eed-6f90-4b0a-866f-114a244f349d service nova] Creating event network-changed:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:52:53.893669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e2b009c1-37a6-4073-b4f6-70c858b87a5d req-b4647eed-6f90-4b0a-866f-114a244f349d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099810 Oct 24 08:52:53.897367 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 279/532] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:53.914491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:53.915383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:53.930500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:53.931730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:53.932499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.933522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:53.934737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:53.935397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.372294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:54.382920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc6f4525-3f0f-4474-a262-555dd7369a01 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 0.482796 Oct 24 08:52:54.386348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 280/533] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:53 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:54.393086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-86b51bfb-5a2f-4e49-8111-f8439170ab3d req-ac6fdf30-8a80-4332-82f1-80ba5bda1db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "name": "network-vif-plugged", "status": "completed", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:54.419102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-86b51bfb-5a2f-4e49-8111-f8439170ab3d req-ac6fdf30-8a80-4332-82f1-80ba5bda1db7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.421681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-86b51bfb-5a2f-4e49-8111-f8439170ab3d req-ac6fdf30-8a80-4332-82f1-80ba5bda1db7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.424490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-86b51bfb-5a2f-4e49-8111-f8439170ab3d req-ac6fdf30-8a80-4332-82f1-80ba5bda1db7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.450400 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-86b51bfb-5a2f-4e49-8111-f8439170ab3d req-ac6fdf30-8a80-4332-82f1-80ba5bda1db7 service nova] Creating event network-vif-plugged:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:52:54.474563 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-86b51bfb-5a2f-4e49-8111-f8439170ab3d req-ac6fdf30-8a80-4332-82f1-80ba5bda1db7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084845 Oct 24 08:52:54.475436 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 281/534] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:54.481372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:54.482472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:54.485967 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:54.491177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.492692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.493389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.494328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.495036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.495684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.628980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:54.640030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4aa679dc-8a98-4d20-9057-3e3960e4e382 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1322 microversion: 2.1 time: 1.247376 Oct 24 08:52:54.643372 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 254/535] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:53 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1322 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:54.653945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:54.654617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:54.671832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.673335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.674114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.675216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.677176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.680003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.772592 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=18 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:55.189985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:55.204787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40a22907-6030-492b-89bc-312cbbe8bfd5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 0.727871 Oct 24 08:52:55.207802 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 282/536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:54 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:55.235202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:55.238845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:55.252451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.252956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.257970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.259209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.259857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.260444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.570319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:55.592454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d33eb6a7-9fb2-44f1-9b38-b9739cdb8cfd tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.946371 Oct 24 08:52:55.601263 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 255/537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:54 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:55.610232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:55.611069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:55.629763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.630898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.631491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.632348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.632962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.634706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.850459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:55.860780 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6367eba0-4a3b-44cd-ab57-8bada93afe95 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.651643 Oct 24 08:52:55.861396 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 283/538] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:55 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:55.878870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:55.879946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:55.898972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.899913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.900358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.901410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.901864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.902294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:56.725850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:56.735531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86eec20f-27d6-4d56-b3d1-936dc662c9d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1317 microversion: 2.1 time: 1.132849 Oct 24 08:52:56.744294 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 256/539] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:55 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1317 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:56.769685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-475598056", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "1099244565", "adminPass": "***", "networks": [{"uuid": "cfe5645f-097c-4ff9-ae1f-567ed4f8cc90"}], "security_groups": [{"name": "tempest-securitygroup--2137931310"}], "key_name": "tempest-keypair-1822886237", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:56.994321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] validate_networks() for [('cfe5645f-097c-4ff9-ae1f-567ed4f8cc90', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:57.117742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:57.127579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc36d3cb-cc72-44d0-b8ed-a450f2503bd0 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1322 microversion: 2.1 time: 1.260667 Oct 24 08:52:57.128848 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 284/540] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:55 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1322 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:57.134119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0c081320-2c63-4c04-b069-191fa6168e82 req-9b888f34-8c19-4f36-a5cb-1597747ee76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fd1ba6-d19b-4759-b494-1f85ffee607e", "name": "network-vif-unplugged", "status": "completed", "tag": "01b4c797-8d6c-4aed-b6fb-57e62d04db3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:57.151674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c081320-2c63-4c04-b069-191fa6168e82 req-9b888f34-8c19-4f36-a5cb-1597747ee76f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.152166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c081320-2c63-4c04-b069-191fa6168e82 req-9b888f34-8c19-4f36-a5cb-1597747ee76f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.152819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c081320-2c63-4c04-b069-191fa6168e82 req-9b888f34-8c19-4f36-a5cb-1597747ee76f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.165198 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0c081320-2c63-4c04-b069-191fa6168e82 req-9b888f34-8c19-4f36-a5cb-1597747ee76f service nova] Creating event network-vif-unplugged:01b4c797-8d6c-4aed-b6fb-57e62d04db3a for instance 79fd1ba6-d19b-4759-b494-1f85ffee607e on n-h2-master-1 Oct 24 08:52:57.171753 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0c081320-2c63-4c04-b069-191fa6168e82 req-9b888f34-8c19-4f36-a5cb-1597747ee76f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041361 Oct 24 08:52:57.172361 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 285/541] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:57.179796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-952d84aa-8beb-452c-8da3-069af2f0e09c req-b3dac648-a62b-4420-990f-6e151c68d4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f", "tag": "8ac36376-cebc-4541-845e-2f1d74e3c15e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:57.196593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-952d84aa-8beb-452c-8da3-069af2f0e09c req-b3dac648-a62b-4420-990f-6e151c68d4cf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.197344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-952d84aa-8beb-452c-8da3-069af2f0e09c req-b3dac648-a62b-4420-990f-6e151c68d4cf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.197940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-952d84aa-8beb-452c-8da3-069af2f0e09c req-b3dac648-a62b-4420-990f-6e151c68d4cf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.211354 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-952d84aa-8beb-452c-8da3-069af2f0e09c req-b3dac648-a62b-4420-990f-6e151c68d4cf service nova] Creating event network-changed:8ac36376-cebc-4541-845e-2f1d74e3c15e for instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f on n-h1-master-1 Oct 24 08:52:57.217702 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-952d84aa-8beb-452c-8da3-069af2f0e09c req-b3dac648-a62b-4420-990f-6e151c68d4cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043687 Oct 24 08:52:57.218586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 286/542] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:57.224915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:57.225839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:57.233150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.233834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.234557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.235454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.236067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.241307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.632856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:57.663517 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fb5c6c6-f2e9-41e8-9297-d48e577bd6ac tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 0.442524 Oct 24 08:52:57.687493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 287/543] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:57 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:57.695678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:57.696308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:57.712638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.713374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.714006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.714886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.715723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.716315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.082773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:58.083967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:58.085148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:58.088375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:58.089006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:58.101226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.102604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.103217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.104162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.104784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.105889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.139878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Getting quotas for project 8d2c394d0ceb40f298afa7355102bfd5. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:58.159981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Getting quotas for user 4099c569c4fe489fa349ee29e6974713 and project 8d2c394d0ceb40f298afa7355102bfd5. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:58.175732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:58.182458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:58.184006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:58.196116 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b76ebab1-a767-4154-8d54-66acd3f42cb0 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.505819 Oct 24 08:52:58.197020 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 288/544] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:57 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:58.207979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:58.212422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:58.230825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.232233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.232841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.235352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.236019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.236610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.305350 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e93b72f-de3d-40dc-810a-7a6548d83e8b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.545570 Oct 24 08:52:58.307614 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 257/545] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:58.313764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:58.315025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:58.322150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.323357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.323999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.326193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.327198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.327782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.690355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:58.709740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6332c85-6c43-4413-a553-a6bf3be16247 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1466 microversion: 2.1 time: 0.400647 Oct 24 08:52:58.710708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 258/546] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:58 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1466 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:58.718704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:58.721327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:58.738121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.738626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.739068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.741916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:58.742471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:58.742889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.793849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:58.810659 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95a65159-1a6f-44d5-9449-0021a01e3f4d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.610325 Oct 24 08:52:58.812151 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 289/547] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:58 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:58.829625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e64e2c4d-88f9-4f33-91fb-8abe6263fe33 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:58.830348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e64e2c4d-88f9-4f33-91fb-8abe6263fe33 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:58.990372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e64e2c4d-88f9-4f33-91fb-8abe6263fe33 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:59.005267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e64e2c4d-88f9-4f33-91fb-8abe6263fe33 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1264 microversion: 2.1 time: 0.191287 Oct 24 08:52:59.022017 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 290/548] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:58 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:59.034243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:59.034864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:59.053149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.053690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.054127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.054850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.055295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.055823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.199988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:59.211103 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-da3dbce0-cfeb-4860-8f67-1200cc46613b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1322 microversion: 2.1 time: 0.499012 Oct 24 08:52:59.211790 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 259/549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:58 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:59.217728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1103467975", "metadata": {"image_type": "test"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:59.223352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:59.236637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.241524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.248593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.249725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.250398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.251019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.323462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Getting quotas for project 96ab82000972421c96022c2711beb014. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:59.329539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Getting quotas for user c2b9360313da41e1905c695c37020876 and project 96ab82000972421c96022c2711beb014. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:59.337641 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:59.704219 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05630ba6-62e7-4ce7-a33f-7d71d446204d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "POST /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98/action" status: 202 len: 0 microversion: 2.1 time: 0.489501 Oct 24 08:52:59.707001 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 260/550] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:59 2022] POST /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 08:52:59.719453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2bea692d-a00e-4221-a8b5-502e9032c198 req-171c598a-1bce-4e72-82a6-ce00fa104654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79fd1ba6-d19b-4759-b494-1f85ffee607e", "tag": "01b4c797-8d6c-4aed-b6fb-57e62d04db3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:59.745374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bea692d-a00e-4221-a8b5-502e9032c198 req-171c598a-1bce-4e72-82a6-ce00fa104654 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.747975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bea692d-a00e-4221-a8b5-502e9032c198 req-171c598a-1bce-4e72-82a6-ce00fa104654 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.748717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bea692d-a00e-4221-a8b5-502e9032c198 req-171c598a-1bce-4e72-82a6-ce00fa104654 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.775995 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2bea692d-a00e-4221-a8b5-502e9032c198 req-171c598a-1bce-4e72-82a6-ce00fa104654 service nova] Creating event network-changed:01b4c797-8d6c-4aed-b6fb-57e62d04db3a for instance 79fd1ba6-d19b-4759-b494-1f85ffee607e on n-h2-master-1 Oct 24 08:52:59.795281 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2bea692d-a00e-4221-a8b5-502e9032c198 req-171c598a-1bce-4e72-82a6-ce00fa104654 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080512 Oct 24 08:52:59.796781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 261/551] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:59.804795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:59.813348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:59.813750 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c50a6fd3-72a9-47bf-bd34-a46528de102c tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 0.786641 Oct 24 08:52:59.814330 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 291/552] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:59 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:59.827703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:59.828705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1cbf3762-7217-46bd-abac-e3d031e2f783 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab408550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:59.852898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.853441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.853886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.854797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.855053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.855475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.926767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1cbf3762-7217-46bd-abac-e3d031e2f783 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.111305 Oct 24 08:52:59.929940 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 292/553] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:59 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:59.939899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:59.941669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:59.959646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.961026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.962800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.964937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.966753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.968563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.251659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:00.271305 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f0b95e6-4ed2-456f-baab-10258950def0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.339903 Oct 24 08:53:00.272157 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 293/554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:59 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:00.277103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:00.278016 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:00.285024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.285878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.286543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.287554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.288259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.289323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.393863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:00.421151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e31f8c44-41e4-4555-b863-7243d5b6f63c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1316 microversion: 2.1 time: 0.147659 Oct 24 08:53:00.439945 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 294/555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:00 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:00.750140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:00.764751 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cde054c9-5f93-4172-b612-c730266c852e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.964079 Oct 24 08:53:00.765687 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 262/556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:59 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:00.770947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:00.771837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:00.783391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1595601032", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "50ce0676-de1a-4c1e-8b5e-2aa8413c2173"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:00.790174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.791308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.791762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.792488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.792948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.793422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.865520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] validate_networks() for [('50ce0676-de1a-4c1e-8b5e-2aa8413c2173', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:01.155488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:01.167432 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-071f2151-d64d-4f4c-8170-a9c433620cbd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1322 microversion: 2.1 time: 0.400387 Oct 24 08:53:01.168031 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 263/557] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:00 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:01.184490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:01.186333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:01.195108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.196005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.196781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.197680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.200500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.201151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.492026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:01.501423 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53cb7d35-85cc-469c-9dd2-5404e02aed70 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 0.327075 Oct 24 08:53:01.502178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 264/558] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:01 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:01.506891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f61a3a2b-dbef-40dc-b620-1d3fb28dbbaf tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab8175e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:01.562165 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f61a3a2b-dbef-40dc-b620-1d3fb28dbbaf tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.058665 Oct 24 08:53:01.571237 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 265/559] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:01 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:01.576402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:01.577360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:01.584260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.585100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.585819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.586762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.587467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.588166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.771672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:01.781192 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f9f3e50-5c80-4d88-9c86-50f2a0811804 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.208464 Oct 24 08:53:01.794611 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 266/560] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:01 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:01.810421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ffcf9b0a-406e-4113-bc51-61907bfec296 req-c4d20dd8-1941-4d2f-a138-8c825efda41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa819ff1-4bb7-46be-8f11-827cfbf22d9a", "name": "network-vif-plugged", "status": "completed", "tag": "c6bb9412-f7d3-47d4-996e-6fbdf09e66b4"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:01.826979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ffcf9b0a-406e-4113-bc51-61907bfec296 req-c4d20dd8-1941-4d2f-a138-8c825efda41f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.827724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ffcf9b0a-406e-4113-bc51-61907bfec296 req-c4d20dd8-1941-4d2f-a138-8c825efda41f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.828310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ffcf9b0a-406e-4113-bc51-61907bfec296 req-c4d20dd8-1941-4d2f-a138-8c825efda41f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.844340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ffcf9b0a-406e-4113-bc51-61907bfec296 req-c4d20dd8-1941-4d2f-a138-8c825efda41f service nova] Creating event network-vif-plugged:c6bb9412-f7d3-47d4-996e-6fbdf09e66b4 for instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a on n-h2-master-1 Oct 24 08:53:01.851189 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ffcf9b0a-406e-4113-bc51-61907bfec296 req-c4d20dd8-1941-4d2f-a138-8c825efda41f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044814 Oct 24 08:53:01.852034 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 267/561] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:01.857861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:01.858796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:01.894893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.894893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.897359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.899806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.901323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.902051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.052326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:02.067583 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83f9460f-4e98-40d8-b1c9-8234757d6892 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1322 microversion: 2.1 time: 0.214137 Oct 24 08:53:02.070357 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 268/562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:01 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:02.086255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.089607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:02.110635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.112204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.113002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.114457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.116716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.117409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.259463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:02.260364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:02.261694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:02.263494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:02.264851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:02.280140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.281284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.281958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.282880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.283911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.284550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.319032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:02.332617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for user cc0be0ed857d4c96b26724144e20d766 and project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:02.359184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:02.371268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:02.394184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:02.407730 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bb10032-4e4c-49fb-a73f-3db4d1d2933d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.333449 Oct 24 08:53:02.426321 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 269/563] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:02.438880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.440412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:02.447095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.457750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.459467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d3c2951-4d19-4188-bdc6-84ea72b208bd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.017707 Oct 24 08:53:02.466559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.468960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.469676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 295/564] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 08:53:02.470340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.474695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.475185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b83da9a7-e438-4d14-a6ab-746327d47f93 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.475823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b83da9a7-e438-4d14-a6ab-746327d47f93 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:02.660325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b83da9a7-e438-4d14-a6ab-746327d47f93 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:02.671674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b83da9a7-e438-4d14-a6ab-746327d47f93 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:02.678143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b83da9a7-e438-4d14-a6ab-746327d47f93 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:02.679584 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b83da9a7-e438-4d14-a6ab-746327d47f93 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1262 microversion: 2.25 time: 0.208846 Oct 24 08:53:02.683428 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 296/565] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1262 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:02.698017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.698213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:02.741508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.742661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.743134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.743899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.744409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.744838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.804171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:02.815838 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c753aa4-b774-4bc1-bf6b-9180ed652120 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1322 microversion: 2.1 time: 0.388049 Oct 24 08:53:02.830688 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 270/566] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:02.841650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f63d415-0f77-453d-8757-6414da1b82b8 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab48d430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.898587 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f63d415-0f77-453d-8757-6414da1b82b8 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.066106 Oct 24 08:53:02.899440 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 271/567] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:02.924340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.929451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:02.941254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.941791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.942239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.948524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.949145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.949854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.228906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:03.255220 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-40e62f08-e536-48fe-906d-9479a8ea2ad4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.347655 Oct 24 08:53:03.258271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 272/568] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:03.265713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:03.267897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:03.295028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.296534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.298005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.308240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.312732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.313876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.686092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:03.695339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-385cd3bc-be96-433b-b1bd-b7e3bac6f184 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 0.434547 Oct 24 08:53:03.696655 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 273/569] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:03 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:03.701835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:03.702783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:03.712824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.713595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.714269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.715570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.716382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.717056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.002403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.026057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-404d9d73-20b2-45d0-ac62-1ff02ba2e79f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.327502 Oct 24 08:53:04.039684 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 274/570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:03 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:04.047309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.052707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:04.053624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:04.060272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.061029 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aca61a9e-2e3a-427e-abf4-0e79d948c2bc tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 1.375849 Oct 24 08:53:04.061167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.061791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.062431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 297/571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:04.063644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.064310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.064956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.076462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:04.077420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:04.090312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.092559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.094497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.101377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.103552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.104718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.154491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.170232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.171947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.173430 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bfb7155a-0c77-458b-b968-c1a352ed8ad1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1258 microversion: 2.25 time: 0.132149 Oct 24 08:53:04.174610 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 275/572] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:04 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1258 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:04.181675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d51e1d0-1941-4f20-b575-f0c0983cf53d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab8170d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:04.315082 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d51e1d0-1941-4f20-b575-f0c0983cf53d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.137300 Oct 24 08:53:04.326171 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 276/573] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:04 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:04.330174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:04.330790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:04.340903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.345510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.346090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.357715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.358359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.358834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.654894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.665835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12da3034-797f-4f70-952a-d5e66dbd0ac7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.345980 Oct 24 08:53:04.666314 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 277/574] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:04 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:04.726142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:04.727025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:04.733803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.740653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.741465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.742109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.742976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.743582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.744155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.758299 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4429d4f9-6875-4d3c-997f-49c07243b5dd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1471 microversion: 2.1 time: 0.691453 Oct 24 08:53:04.760831 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 298/575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:04 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1471 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:05.074450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1036ffc-5af1-4a6b-ae7b-bd70cf6e9814 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:05.076022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1036ffc-5af1-4a6b-ae7b-bd70cf6e9814 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] [instance: 32a930b1-6fee-42d4-9d2a-553393a4f1fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:05.085034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:05.089832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e1036ffc-5af1-4a6b-ae7b-bd70cf6e9814 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] HTTP exception thrown: Instance 32a930b1-6fee-42d4-9d2a-553393a4f1fe could not be found. Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1036ffc-5af1-4a6b-ae7b-bd70cf6e9814 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Request method failure captured: Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/32a930b1-6fee-42d4-9d2a-553393a4f1fe/action HTTP/1.1 Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWSdD1BsWdGF1J4V-2PZDmZo9uj9k23CBhIjXVL7vnGvJ1wMdoAGMAjMDYLIl3uFvsIhuOSwNrVCH1HL61ng6NmJbzILJUpHeQR26k78Da-hieHE44o-7mEwq9iYl8QKJED7McO9WJfHbBhg3ikmnfxSBg_nCbfHPZENwNOD0Mxmk Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:53:05.092981 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb51316d29514a1092aa662ee0875f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb51316d29514a1092aa662ee0875f04"}]}] Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3cf59bb388b348268df3b67e9dfae7cc Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: {"migrate": {}} Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:53:05.094749 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 32a930b1-6fee-42d4-9d2a-553393a4f1fe could not be found. Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '32a930b1-6fee-42d4-9d2a-553393a4f1fe', 'body': {'migrate': {}}} Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a930b1-6fee-42d4-9d2a-553393a4f1fe could not be found. Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:05.095772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a930b1-6fee-42d4-9d2a-553393a4f1fe could not be found. Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a930b1-6fee-42d4-9d2a-553393a4f1fe could not be found. Oct 24 08:53:05.099190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:05.100318 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6629c06-e875-4990-8870-1d03bc570344 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 0.372201 Oct 24 08:53:05.100318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 278/576] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:04 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:05.104585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1036ffc-5af1-4a6b-ae7b-bd70cf6e9814 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Returning 404 to user: Instance 32a930b1-6fee-42d4-9d2a-553393a4f1fe could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:05.108053 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1036ffc-5af1-4a6b-ae7b-bd70cf6e9814 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/32a930b1-6fee-42d4-9d2a-553393a4f1fe/action" status: 404 len: 111 microversion: 2.1 time: 0.312290 Oct 24 08:53:05.110411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:05.111705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:05.128507 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:05.133448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.135777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.138891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.140458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.140458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.150925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.151117 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 299/577] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:04 2022] POST /compute/v2.1/servers/32a930b1-6fee-42d4-9d2a-553393a4f1fe/action => generated 111 bytes in 356 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:05.181170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:05.185948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:05.220778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.223154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.224981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.228664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.231324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.232813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.492429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:05.506250 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e48802a9-7e4f-49b2-ba0f-d5c684c8c4f6 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.403751 Oct 24 08:53:05.507184 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 279/578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:05 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:05.514331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:05.515343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:05.524371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.526872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.527661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.528679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.529394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.530063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.537481 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:05.622389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:05.632652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:05.634282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:05.635837 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bda2460-43e8-4e27-a9ee-93a432592b28 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1320 microversion: 2.25 time: 0.127367 Oct 24 08:53:05.637377 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 280/579] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:05 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1320 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:05.642387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aee945ef-c3d1-43cf-8517-225ef61223b5 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab488790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:05.735661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aee945ef-c3d1-43cf-8517-225ef61223b5 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.097157 Oct 24 08:53:05.739282 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 281/580] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:05 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:05.751377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-803782771", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:05.870427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:06.214379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:06.215015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:06.216910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:06.217912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:06.218436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:06.232766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.233378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.233773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.234586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.235144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.235738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.273071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Getting quotas for project 961eeb9727ed45d9874a81d495c0069a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:06.281030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Getting quotas for user f6e3382f1fcd40108c9d79cfbdf4337a and project 961eeb9727ed45d9874a81d495c0069a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:06.328594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:06.332332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:06.366681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:06.378781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1a3bed2-0113-4a66-986d-7967cbdf612b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 1.225070 Oct 24 08:53:06.381072 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 300/581] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:05 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:06.387514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:06.388402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:06.406194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.407315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.408113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.409378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.410013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.410653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.435317 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37b46aae-510a-4413-808c-b63cc1c1bea2 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694457 Oct 24 08:53:06.436068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 282/582] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:53:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:53:06.441432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-be29f13e-aa69-426a-b229-db1fc377d1d3 req-00d648fd-01ec-4fd0-bfcd-3dbd789df8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f", "name": "network-vif-plugged", "status": "completed", "tag": "8ac36376-cebc-4541-845e-2f1d74e3c15e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:06.455073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-be29f13e-aa69-426a-b229-db1fc377d1d3 req-00d648fd-01ec-4fd0-bfcd-3dbd789df8be service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.455562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-be29f13e-aa69-426a-b229-db1fc377d1d3 req-00d648fd-01ec-4fd0-bfcd-3dbd789df8be service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.456029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-be29f13e-aa69-426a-b229-db1fc377d1d3 req-00d648fd-01ec-4fd0-bfcd-3dbd789df8be service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.470283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-be29f13e-aa69-426a-b229-db1fc377d1d3 req-00d648fd-01ec-4fd0-bfcd-3dbd789df8be service nova] Creating event network-vif-plugged:8ac36376-cebc-4541-845e-2f1d74e3c15e for instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f on n-h1-master-1 Oct 24 08:53:06.485000 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-be29f13e-aa69-426a-b229-db1fc377d1d3 req-00d648fd-01ec-4fd0-bfcd-3dbd789df8be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047572 Oct 24 08:53:06.490078 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 283/583] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:06.496389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:06.497420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:06.510622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.511095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.511546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.513990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.514684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.518569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.879982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:06.894861 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2960b2c3-adc7-42c1-b4c3-a82058d4e93c tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 0.403365 Oct 24 08:53:06.897980 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 284/584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:06 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:06.908322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1dd95a0-ebec-48a7-bafa-faa122a05d10 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:06.911572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1dd95a0-ebec-48a7-bafa-faa122a05d10 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:07.098478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1dd95a0-ebec-48a7-bafa-faa122a05d10 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.108022 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1dd95a0-ebec-48a7-bafa-faa122a05d10 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1221 microversion: 2.1 time: 0.208796 Oct 24 08:53:07.108622 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 285/585] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:06 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:07.136162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:07.136918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:07.159650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.160153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.160596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.161332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.161799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.162226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.293043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.304287 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b56bf8ff-6f3d-401a-a93a-9c9556532aa8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.921854 Oct 24 08:53:07.304871 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 301/586] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:06 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:07.325034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:07.334430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:07.370488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.372290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.373136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.374204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.375547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.376397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.622404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.637738 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5caf1c93-1ce6-4385-bd4a-46b586479eaa tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 0.507142 Oct 24 08:53:07.650139 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 286/587] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:07 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:07.662222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-103a75bf-1d95-4e94-b14e-d41ff20859f7 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab590430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:07.689962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.693239 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:07.708021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.720758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.731320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8f452a7-d0ac-4ced-b701-8bd9fc7da498 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1320 microversion: 2.25 time: 0.409340 Oct 24 08:53:07.732635 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 302/588] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:07 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:07.764018 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-103a75bf-1d95-4e94-b14e-d41ff20859f7 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.112285 Oct 24 08:53:07.766837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:07.767332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:07.772327 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 287/589] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:07 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:07.828149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.828952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.832204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.833248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.836444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.837108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.920491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:07.921492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:07.944954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.950506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.951658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.952268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.952784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.953221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:08.585851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:08.610603 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6dd6efae-820d-4e0c-9ba9-6e63c1993362 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 0.694291 Oct 24 08:53:08.611193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 288/590] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:07 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:08.620721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:08.621345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:08.643788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:08.644414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:08.644734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:08.645503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:08.646147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:08.646739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:08.912136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:08.922398 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64fd8c96-1507-4a9e-b702-73ca9e414d05 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1273 microversion: 2.1 time: 0.307886 Oct 24 08:53:08.928769 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 289/591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:08 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:08.948348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:08.979691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:09.004737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.005697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.006657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:09.007903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.008596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.009800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:09.251811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:09.261960 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9109ba7-b727-412b-8e3b-59de2a969b08 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1331 microversion: 2.1 time: 1.514261 Oct 24 08:53:09.273641 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 303/592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:07 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1331 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:09.289637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "name": "network-vif-plugged", "status": "completed", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}, {"server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "name": "network-vif-plugged", "status": "completed", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:09.330833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.334167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.335666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:09.396574 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] Creating event network-vif-plugged:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:53:09.397386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] Creating event network-vif-plugged:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:53:09.407009 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-925fcc88-877a-43f3-b7a3-aa5af50930ca req-24181d04-385a-4087-b870-2217440f3266 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.131674 Oct 24 08:53:09.408208 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 304/593] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:09.414467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:09.416282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:09.423700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.424962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.425598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:09.426620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.427223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.427835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:09.786840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:09.797330 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e648fda0-919a-4432-af65-882c865a73d4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1502 microversion: 2.1 time: 0.866817 Oct 24 08:53:09.798794 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 290/594] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:08 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1502 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:09.842388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:09.843919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:09.852154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.853043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.854047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:09.855033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:09.855762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:09.858316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.184195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:10.193797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:10.195224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:10.196343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-91a2a503-23a0-4df0-94ef-942184bdc56d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1362 microversion: 2.25 time: 0.360101 Oct 24 08:53:10.209937 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 291/595] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:09 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:10.233759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0adc0166-bb69-4085-845e-d0c2ecdb61d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3ae4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:10.353077 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0adc0166-bb69-4085-845e-d0c2ecdb61d4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.138887 Oct 24 08:53:10.356795 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 292/596] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:10 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:10.365998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5ff41686-6dff-4461-9f40-69f7c062a6e1 req-fd8ebe25-e78e-4640-9c2d-25ff0e230d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267d3905-ae46-421f-bafd-76dfad07ef6b", "tag": "6b874ace-2256-458d-b7ef-e92b59844ade"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:10.400779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5ff41686-6dff-4461-9f40-69f7c062a6e1 req-fd8ebe25-e78e-4640-9c2d-25ff0e230d5e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.401449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5ff41686-6dff-4461-9f40-69f7c062a6e1 req-fd8ebe25-e78e-4640-9c2d-25ff0e230d5e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.408146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5ff41686-6dff-4461-9f40-69f7c062a6e1 req-fd8ebe25-e78e-4640-9c2d-25ff0e230d5e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.435919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5ff41686-6dff-4461-9f40-69f7c062a6e1 req-fd8ebe25-e78e-4640-9c2d-25ff0e230d5e service nova] Creating event network-changed:6b874ace-2256-458d-b7ef-e92b59844ade for instance 267d3905-ae46-421f-bafd-76dfad07ef6b on n-h2-master-1 Oct 24 08:53:10.462773 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5ff41686-6dff-4461-9f40-69f7c062a6e1 req-fd8ebe25-e78e-4640-9c2d-25ff0e230d5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101471 Oct 24 08:53:10.466502 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 293/597] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:10.477265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:10.479244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:10.488975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.489808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.490714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.491661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.498520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.505242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.815690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:10.834735 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28c1807f-3eff-4fe5-bfa2-fc8d630b25c9 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1324 microversion: 2.1 time: 1.424393 Oct 24 08:53:10.847286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 305/598] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:09 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1324 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:10.861353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:10.878326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:10.879360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:10.891010 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-945d55b0-0a59-4945-b64d-21a9480fdaa8 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 0.422127 Oct 24 08:53:10.892046 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 294/599] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:10 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:10.895138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.896767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.898327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.904095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.908706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.910510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.915258 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:10.920534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:10.934741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.940785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.941607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:10.942607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:10.943755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:10.945844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.120946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.135190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddc580a1-1777-4a52-aa18-a62cc7c0ccda tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1279 microversion: 2.1 time: 0.283564 Oct 24 08:53:11.137818 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 306/600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:10 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:11.150717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:11.150837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:11.170854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.171652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.173975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.175373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.175882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.177761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.258124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.269160 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a158859b-da46-4943-9c47-d33d528326d5 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1534 microversion: 2.1 time: 0.360515 Oct 24 08:53:11.270816 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 295/601] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:10 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1534 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:11.276228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:11.277038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:11.286323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.287129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.288130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.289053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.289759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.290320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.539153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.558670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.562880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.567601 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9dc64a75-01fc-483a-bba5-8eb5ea492431 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1362 microversion: 2.25 time: 0.294826 Oct 24 08:53:11.570374 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 296/602] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:11 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:11.580246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-962cd674-73ab-4bdd-94e9-222787c02950 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'create', calling method: .version_select at 0x7f8dab5903a0>, body: {"pool": "6336a572-8747-4a12-b442-56936ece2af2"} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:11.893169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.904572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ecb07daa-8f3a-4a3d-9787-e12d30fa383e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1477 microversion: 2.1 time: 0.764128 Oct 24 08:53:11.905477 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 307/603] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:11 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1477 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:11.911038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-047379f3-91d4-4ed5-935c-6605beeed671 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3d5e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:11.962803 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-047379f3-91d4-4ed5-935c-6605beeed671 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.056068 Oct 24 08:53:11.963684 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 308/604] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:11 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:11.969053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:11.969947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:11.977908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.978677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.979319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.980214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.980847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.981464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:12.305889 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:12.533491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:12.553028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3db2c4d3-0039-4a8d-b620-bc1ac4f6067b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1519 microversion: 2.1 time: 0.584468 Oct 24 08:53:12.554275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 309/605] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:11 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1519 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:12.566573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:12.567374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:12.603308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:12.604200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:12.606007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:12.606959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:12.609334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:12.609972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:12.683034 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:13.555564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-962cd674-73ab-4bdd-94e9-222787c02950 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.974323 Oct 24 08:53:13.565483 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 297/606] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 08:53:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:13.570825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd49db7e-1b47-4849-a1a5-f745b7ec45eb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '.version_select at 0x7f8dab56a4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:13.579428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd49db7e-1b47-4849-a1a5-f745b7ec45eb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.582702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd49db7e-1b47-4849-a1a5-f745b7ec45eb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.583265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd49db7e-1b47-4849-a1a5-f745b7ec45eb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.621247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd49db7e-1b47-4849-a1a5-f745b7ec45eb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.053995 Oct 24 08:53:13.622622 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 298/607] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:53:13 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:13.627312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:13.629888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:13.644898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.645783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.649431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.650490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.651201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.651845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.749594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:13.766279 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-467a91b1-2e1c-4ec2-9a94-93209e212c76 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 1.204995 Oct 24 08:53:13.767311 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 310/608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:12 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:13.772137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c2eb43d-e1c8-4b70-bf38-522b02e16f22 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'create', calling method: .version_select at 0x7f8dab5cd3a0>, body: {"pool": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:14.264256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.280059 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d0c045b-9bca-4785-97dd-5cc8096e7c36 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1321 microversion: 2.1 time: 0.656243 Oct 24 08:53:14.280658 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 299/609] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:13 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:14.331249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:14.332189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:14.343840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.344623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.345214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.347574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.348223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.350974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.641776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.660934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.662780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.664926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aebf619c-2284-4d8b-a74f-3cd6761e9721 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1362 microversion: 2.25 time: 0.354605 Oct 24 08:53:14.673639 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 300/610] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:14 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:14.683500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4eb7c84-771c-494b-8840-535b51f46540 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3c5ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:14.757448 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4eb7c84-771c-494b-8840-535b51f46540 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.082623 Oct 24 08:53:14.758046 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 301/611] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:14 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:14.776969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'action', calling method: .version_select at 0x7f8dacc48af0>, body: {"addFloatingIp": {"address": "172.35.3.194"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:14.779451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:14.803551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.804088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.804643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.805458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.805911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.812100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.989422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:14.992457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquired lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:16.251929 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:17.104869 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=14 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:18.528332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c2eb43d-e1c8-4b70-bf38-522b02e16f22 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.759514 Oct 24 08:53:18.528944 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 311/612] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 08:53:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:18.545971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:18.546671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:18.570802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.571325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.571777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.575367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.578621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.587705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.904505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ce2cbda-b5e1-43aa-ad8e-9d1f8df694f6 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1628 microversion: 2.1 time: 0.365335 Oct 24 08:53:18.905731 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 312/613] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:18 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1628 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:18.912541 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1dcdf73b-60c3-462e-a1d3-51a1d345844e req-1197b0b8-ff71-44eb-a560-fc6c4d0b2454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95b3010-cd07-42e1-81e5-e1cc4800988b", "tag": "da9d9831-4f58-409e-b129-af4960d568db"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:18.934112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1dcdf73b-60c3-462e-a1d3-51a1d345844e req-1197b0b8-ff71-44eb-a560-fc6c4d0b2454 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.934867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1dcdf73b-60c3-462e-a1d3-51a1d345844e req-1197b0b8-ff71-44eb-a560-fc6c4d0b2454 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.935487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1dcdf73b-60c3-462e-a1d3-51a1d345844e req-1197b0b8-ff71-44eb-a560-fc6c4d0b2454 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.954500 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1dcdf73b-60c3-462e-a1d3-51a1d345844e req-1197b0b8-ff71-44eb-a560-fc6c4d0b2454 service nova] Creating event network-changed:da9d9831-4f58-409e-b129-af4960d568db for instance f95b3010-cd07-42e1-81e5-e1cc4800988b on n-h1-master-1 Oct 24 08:53:18.966089 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1dcdf73b-60c3-462e-a1d3-51a1d345844e req-1197b0b8-ff71-44eb-a560-fc6c4d0b2454 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058506 Oct 24 08:53:18.967537 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 313/614] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:18.979243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:18.980381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:18.989662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.990447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.991099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.992494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.993187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.994062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:19.304837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:19.313009 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb83f62c-ecf4-4446-946b-122501cd032f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 0.343902 Oct 24 08:53:19.331355 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 314/615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:18 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:19.336373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:19.337338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:19.343514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:19.344192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:19.344706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:19.345522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:19.346128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:19.347295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:19.657854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:19.670667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-210a50aa-468e-4e28-909d-aa2fb3f55f04 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1321 microversion: 2.1 time: 0.337899 Oct 24 08:53:19.681745 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 315/616] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:19 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:19.688603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:19.689453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:19.702693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:19.703223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:19.703656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:19.704366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:19.704805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:19.705228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:20.038769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.047994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.050655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.052146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28555125-b53b-45f6-bbc8-0b389b8c067b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1362 microversion: 2.25 time: 0.369637 Oct 24 08:53:20.086071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 316/617] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:19 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:20.093961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4ea1b19-6ee2-4d73-8b91-b27c0527158a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab4df040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:20.179876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4ea1b19-6ee2-4d73-8b91-b27c0527158a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.092226 Oct 24 08:53:20.180605 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 317/618] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:20 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:20.195813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7c5779e4-e59b-46e5-90d1-ac140bfdfe60 req-d38c8309-2610-4ced-844b-c67bab1cf0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d3905-ae46-421f-bafd-76dfad07ef6b", "name": "network-vif-plugged", "status": "completed", "tag": "6b874ace-2256-458d-b7ef-e92b59844ade"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:20.215830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7c5779e4-e59b-46e5-90d1-ac140bfdfe60 req-d38c8309-2610-4ced-844b-c67bab1cf0b3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:20.229862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7c5779e4-e59b-46e5-90d1-ac140bfdfe60 req-d38c8309-2610-4ced-844b-c67bab1cf0b3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:20.230356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7c5779e4-e59b-46e5-90d1-ac140bfdfe60 req-d38c8309-2610-4ced-844b-c67bab1cf0b3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:20.258272 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7c5779e4-e59b-46e5-90d1-ac140bfdfe60 req-d38c8309-2610-4ced-844b-c67bab1cf0b3 service nova] Creating event network-vif-plugged:6b874ace-2256-458d-b7ef-e92b59844ade for instance 267d3905-ae46-421f-bafd-76dfad07ef6b on n-h2-master-1 Oct 24 08:53:20.272049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7c5779e4-e59b-46e5-90d1-ac140bfdfe60 req-d38c8309-2610-4ced-844b-c67bab1cf0b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089797 Oct 24 08:53:20.273031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 318/619] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:20.278362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-320115593", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "37d96780-2455-4d33-8875-f6279ac9d08e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:20.406872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] validate_networks() for [('37d96780-2455-4d33-8875-f6279ac9d08e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:20.536764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:53:21.463210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:21.463772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:21.464078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:21.464483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:21.464899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:21.476168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.477125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.477861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.478832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.479521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.480171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.511888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Getting quotas for project 4bf7adacd2ba40e6b67fa07d8baefc4b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:21.528121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Getting quotas for user 89ee4538fd234ed7b8137861bfb534d3 and project 4bf7adacd2ba40e6b67fa07d8baefc4b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:21.554357 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:21.563779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:21.692525 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5ee629d-8140-4996-8b95-3d4c8c3bc471 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417896 Oct 24 08:53:21.692879 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 319/620] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:53:21.736391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-140808b1-62dc-4469-bfbe-cee69664eb0f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Action: 'create', calling method: .version_select at 0x7f8dab3c5820>, body: {"keypair": {"name": "tempest-keypair-1783171959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA002l2GHkQ3Sof3LzyYJMW0avQeeRFsJ1w6XVlF0eLqJIa2iPrPYIla1bptdgfM30PNQIyp88pPJeZKMS44csIEZctjT+yLoaFcOxDvMu+mdEvZ5DvKOUaszkRCYaTlQ=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:21.761732 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:21.794658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-140808b1-62dc-4469-bfbe-cee69664eb0f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for project bdb9aeb0656347798749c2b8e4434c56. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:21.808605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-140808b1-62dc-4469-bfbe-cee69664eb0f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for user b43a269fe8b746b88c38db6b9e9bfa12 and project bdb9aeb0656347798749c2b8e4434c56. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:21.891731 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-140808b1-62dc-4469-bfbe-cee69664eb0f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179524 Oct 24 08:53:21.892310 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 320/621] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:53:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:21.901083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:21.901744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:21.929715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.930187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.930631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.931347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.931806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.932231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.578206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Updating instance_info_cache with network_info: [{"id": "8ac36376-cebc-4541-845e-2f1d74e3c15e", "address": "fa:16:3e:df:05:21", "network": {"id": "9255d6aa-996f-44ee-a152-5187bbb96214", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-217046704-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47f9a6b369c645e6b8cc4216374b303a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ac36376-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:53:22.595309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Releasing lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:53:22.597036 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b7fbcb6d-e351-46ca-8271-aded19cef882 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action" status: 202 len: 0 microversion: 2.1 time: 7.837988 Oct 24 08:53:22.598101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 302/622] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:14 2022] POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action => generated 0 bytes in 7840 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 08:53:22.609443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e4b9b5e2-2afd-41cc-8498-0a43cfa78f93 req-201c6b3d-6ebe-4a8a-b2b8-3fa4c95db7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f", "tag": "8ac36376-cebc-4541-845e-2f1d74e3c15e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:22.637676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e4b9b5e2-2afd-41cc-8498-0a43cfa78f93 req-201c6b3d-6ebe-4a8a-b2b8-3fa4c95db7a0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:22.638610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e4b9b5e2-2afd-41cc-8498-0a43cfa78f93 req-201c6b3d-6ebe-4a8a-b2b8-3fa4c95db7a0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:22.639374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e4b9b5e2-2afd-41cc-8498-0a43cfa78f93 req-201c6b3d-6ebe-4a8a-b2b8-3fa4c95db7a0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.667954 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e4b9b5e2-2afd-41cc-8498-0a43cfa78f93 req-201c6b3d-6ebe-4a8a-b2b8-3fa4c95db7a0 service nova] Creating event network-changed:8ac36376-cebc-4541-845e-2f1d74e3c15e for instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f on n-h1-master-1 Oct 24 08:53:22.673548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e4b9b5e2-2afd-41cc-8498-0a43cfa78f93 req-201c6b3d-6ebe-4a8a-b2b8-3fa4c95db7a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071027 Oct 24 08:53:22.678162 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 303/623] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:22.688022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:22.688728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:22.703099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:22.703998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:22.704613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.705560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:22.708844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:22.709570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.976913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:22.985197 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1571c10c-ffeb-4a9b-bead-bf881e375dd3 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1321 microversion: 2.1 time: 0.305713 Oct 24 08:53:22.985835 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 304/624] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:22 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:22.997747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f0fa0e78-2f39-4b1d-a877-eb456e7f7da9 req-950f8b69-abc9-4357-af4c-8fa61ff5a02e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bed6dc-0c62-43ac-81c2-6197e5017264", "tag": "3c9aad7c-4166-4892-8470-6c0c890969d0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:23.026257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f0fa0e78-2f39-4b1d-a877-eb456e7f7da9 req-950f8b69-abc9-4357-af4c-8fa61ff5a02e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.026737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f0fa0e78-2f39-4b1d-a877-eb456e7f7da9 req-950f8b69-abc9-4357-af4c-8fa61ff5a02e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.027165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f0fa0e78-2f39-4b1d-a877-eb456e7f7da9 req-950f8b69-abc9-4357-af4c-8fa61ff5a02e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.072522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f0fa0e78-2f39-4b1d-a877-eb456e7f7da9 req-950f8b69-abc9-4357-af4c-8fa61ff5a02e service nova] Creating event network-changed:3c9aad7c-4166-4892-8470-6c0c890969d0 for instance 70bed6dc-0c62-43ac-81c2-6197e5017264 on n-h2-master-1 Oct 24 08:53:23.081417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f0fa0e78-2f39-4b1d-a877-eb456e7f7da9 req-950f8b69-abc9-4357-af4c-8fa61ff5a02e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094252 Oct 24 08:53:23.086128 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 305/625] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:23.097012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:23.098132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:23.111679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.117775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.118461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.119437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.120041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.120700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.184834 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:23.517267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.526585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5f12a7f-7fed-4ec4-838a-77a64110d688 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1390 microversion: 2.1 time: 1.633104 Oct 24 08:53:23.538734 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 321/626] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:21 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1390 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:23.546218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9257566c-3be5-406d-befa-86a230d3d1b4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3d5940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:23.571652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.580226 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.582105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.583240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ab69383-81cc-4fa7-ad88-a1fcaa72ab43 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1362 microversion: 2.25 time: 0.495448 Oct 24 08:53:23.587531 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 306/627] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:23 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:23.601375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:23.602008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:23.613442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.613957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.614415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.615117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.615565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.616003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.652587 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9257566c-3be5-406d-befa-86a230d3d1b4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.111594 Oct 24 08:53:23.653246 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 322/628] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:23 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:23.664968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f190787a-7564-44ce-bd30-7b1c4834b25e req-ca5ede4e-05aa-4ae5-bbef-4cc813e1bd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95b3010-cd07-42e1-81e5-e1cc4800988b", "name": "network-vif-plugged", "status": "completed", "tag": "da9d9831-4f58-409e-b129-af4960d568db"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:23.687653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f190787a-7564-44ce-bd30-7b1c4834b25e req-ca5ede4e-05aa-4ae5-bbef-4cc813e1bd21 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.688348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f190787a-7564-44ce-bd30-7b1c4834b25e req-ca5ede4e-05aa-4ae5-bbef-4cc813e1bd21 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.689346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f190787a-7564-44ce-bd30-7b1c4834b25e req-ca5ede4e-05aa-4ae5-bbef-4cc813e1bd21 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.712570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f190787a-7564-44ce-bd30-7b1c4834b25e req-ca5ede4e-05aa-4ae5-bbef-4cc813e1bd21 service nova] Creating event network-vif-plugged:da9d9831-4f58-409e-b129-af4960d568db for instance f95b3010-cd07-42e1-81e5-e1cc4800988b on n-h1-master-1 Oct 24 08:53:23.719583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f190787a-7564-44ce-bd30-7b1c4834b25e req-ca5ede4e-05aa-4ae5-bbef-4cc813e1bd21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065197 Oct 24 08:53:23.720187 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 323/629] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:23.731033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef3d0455-695b-4938-a0bf-3f31db0540aa tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'create', calling method: .version_select at 0x7f8dab3d5f70>, body: {"pool": "6336a572-8747-4a12-b442-56936ece2af2"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:23.748121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.758233 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa015fed-6ccf-46c5-8379-1171a99d65be tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1275 microversion: 2.1 time: 0.168798 Oct 24 08:53:23.759591 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 307/630] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:23 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:24.012058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:24.012609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:24.021768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.029119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.031179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.032820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.035811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.049804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.393893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:24.406229 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-466c8766-1bd1-4a83-809d-a7ebd366e3dc tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1321 microversion: 2.1 time: 0.398310 Oct 24 08:53:24.410689 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 308/631] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:24 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:24.549691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:24.550321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:24.563515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.564009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.564456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.565203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.566341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.566786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.917927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:24.930583 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0e6a051-54a8-4c37-b5e2-b88144480ba2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1588 microversion: 2.1 time: 0.384641 Oct 24 08:53:24.931173 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 309/632] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:24 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1588 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:24.952532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:24.957081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:24.976202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.977358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.977760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.978477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.978934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.979356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:25.457472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:25.481341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:25.485795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:25.491028 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15ad4295-c25d-412d-9907-ca264a0f78ff tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1362 microversion: 2.25 time: 0.549468 Oct 24 08:53:25.492245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 310/633] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:24 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:25.503773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c65d950a-591f-45c9-b553-10508dee2873 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab34f670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:25.632638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c65d950a-591f-45c9-b553-10508dee2873 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1418 microversion: 2.1 time: 0.137684 Oct 24 08:53:25.641447 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 311/634] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:25 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1418 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:25.653623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:25.659119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:25.667003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:25.667748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:25.668372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:25.669252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:25.669963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:25.670656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:25.778511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:25.788600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a2993f4-aae1-4c1c-b890-d09ebe533b8b tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1281 microversion: 2.1 time: 0.145140 Oct 24 08:53:25.795130 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 312/635] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:25 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:25.804154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:25.808830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:25.819547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:25.826166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:25.826790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:25.827664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:25.828259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:25.829502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:25.967891 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22b0a55d-2c54-43c4-ba5b-6970428901f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171415 Oct 24 08:53:25.969249 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 313/636] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:53:25 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:25.975810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:25.976767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:25.999432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.000050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.000564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:26.001376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.001921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.002449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:26.340102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:26.353536 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2b9cb42-ee14-4896-a8eb-127eaa40b32f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1321 microversion: 2.1 time: 0.382918 Oct 24 08:53:26.376021 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 314/637] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:25 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:26.382400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7a8fe1a5-4de7-4d5b-97ad-21bd4c23f939 req-fb177905-aa93-4c82-b10a-1d843fb62a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bed6dc-0c62-43ac-81c2-6197e5017264", "name": "network-vif-plugged", "status": "completed", "tag": "3c9aad7c-4166-4892-8470-6c0c890969d0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:26.407673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7a8fe1a5-4de7-4d5b-97ad-21bd4c23f939 req-fb177905-aa93-4c82-b10a-1d843fb62a4a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.408529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7a8fe1a5-4de7-4d5b-97ad-21bd4c23f939 req-fb177905-aa93-4c82-b10a-1d843fb62a4a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.412618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7a8fe1a5-4de7-4d5b-97ad-21bd4c23f939 req-fb177905-aa93-4c82-b10a-1d843fb62a4a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:26.435673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7a8fe1a5-4de7-4d5b-97ad-21bd4c23f939 req-fb177905-aa93-4c82-b10a-1d843fb62a4a service nova] Creating event network-vif-plugged:3c9aad7c-4166-4892-8470-6c0c890969d0 for instance 70bed6dc-0c62-43ac-81c2-6197e5017264 on n-h2-master-1 Oct 24 08:53:26.447264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7a8fe1a5-4de7-4d5b-97ad-21bd4c23f939 req-fb177905-aa93-4c82-b10a-1d843fb62a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071389 Oct 24 08:53:26.451358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 315/638] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:26.521269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:26.522271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:26.532994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.533631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.534253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:26.534984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.535453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.536496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:26.872809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:26.886554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:26.888409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:26.892532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02a70b27-b79c-43bd-aa94-c84ce1bffe71 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1557 microversion: 2.25 time: 0.375741 Oct 24 08:53:26.908870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 316/639] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:26 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1557 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:26.916218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28b482f9-f62d-45c0-960c-5215427e130d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab34f940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:26.973018 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28b482f9-f62d-45c0-960c-5215427e130d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1427 microversion: 2.1 time: 0.060333 Oct 24 08:53:26.974409 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 317/640] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:26 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:26.981825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:26.983019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:26.993681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.994183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.994625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:26.995340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:26.995797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:26.996809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:27.376539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:27.386947 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18a9e040-d855-4898-8337-9e3ccb646ac3 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1281 microversion: 2.1 time: 0.410848 Oct 24 08:53:27.389027 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 318/641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:26 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1281 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:27.548678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:27.550025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:27.561304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:27.561808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:27.562876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:27.564038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:27.565253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:27.565876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:27.933513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid f95b3010-cd07-42e1-81e5-e1cc4800988b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:28.037470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18755b35-316f-43b8-92cb-f7b0a5654f40 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 2050 microversion: 2.25 time: 0.631971 Oct 24 08:53:28.048508 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 319/642] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:27 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 2050 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:28.048508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18c4dae1-21a6-42e6-b277-3a90f4ef9551 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab361940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:28.129469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18c4dae1-21a6-42e6-b277-3a90f4ef9551 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 200 len: 1427 microversion: 2.1 time: 0.089969 Oct 24 08:53:28.130064 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 320/643] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:28 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:28.149476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:28.150622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:28.170258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.171128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.171766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.172866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.173511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.174128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.588968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:28.598148 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3197052b-f8ac-454d-8dfb-4162128db23b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1321 microversion: 2.1 time: 0.467016 Oct 24 08:53:28.603265 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 321/644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:28 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:28.616559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:28.617167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:28.631487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.637018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.637941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.645758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.646497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.647935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.106080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid f95b3010-cd07-42e1-81e5-e1cc4800988b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:29.138825 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b73197b8-c984-4748-b7cf-0941557bf513 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 2050 microversion: 2.25 time: 0.534225 Oct 24 08:53:29.153255 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 322/645] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:28 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 2050 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:29.153255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:29.153255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:29.168563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.169086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.169545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.170248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.170698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.171120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.430800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef3d0455-695b-4938-a0bf-3f31db0540aa tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.703850 Oct 24 08:53:29.432919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 324/646] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 08:53:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:29.443379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:29.444147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:29.456525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.457280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.457930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.458849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.460827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.461519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.527074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:29.537143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e705b4be-62a8-4f8b-8f7e-c40507e2f45d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1466 microversion: 2.1 time: 0.393688 Oct 24 08:53:29.558753 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 323/647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:29 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1466 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:29.565567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ab75885e-f0a9-4dd2-93b8-10bc198157f3 req-64614d03-5b63-4875-9b73-339c24c27fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267d3905-ae46-421f-bafd-76dfad07ef6b", "tag": "6b874ace-2256-458d-b7ef-e92b59844ade"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:29.585811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ab75885e-f0a9-4dd2-93b8-10bc198157f3 req-64614d03-5b63-4875-9b73-339c24c27fe9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.586611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ab75885e-f0a9-4dd2-93b8-10bc198157f3 req-64614d03-5b63-4875-9b73-339c24c27fe9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.587277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ab75885e-f0a9-4dd2-93b8-10bc198157f3 req-64614d03-5b63-4875-9b73-339c24c27fe9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.604730 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ab75885e-f0a9-4dd2-93b8-10bc198157f3 req-64614d03-5b63-4875-9b73-339c24c27fe9 service nova] Creating event network-changed:6b874ace-2256-458d-b7ef-e92b59844ade for instance 267d3905-ae46-421f-bafd-76dfad07ef6b on n-h2-master-1 Oct 24 08:53:29.614301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ab75885e-f0a9-4dd2-93b8-10bc198157f3 req-64614d03-5b63-4875-9b73-339c24c27fe9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053421 Oct 24 08:53:29.615519 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 324/648] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:29.624357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:29.625268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:29.636131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.636811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.637447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.639228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.640725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.641419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.766318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:29.781722 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22a9608e-52bb-45b0-a62b-f733f9af7802 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 200 len: 1588 microversion: 2.1 time: 0.348804 Oct 24 08:53:29.799461 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 325/649] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:29 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 1588 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:29.807468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1656745484", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "a1e84f6c-6a1f-4a59-a284-a0213f1972ff"}], "security_groups": [{"name": "tempest-securitygroup--643824660"}], "key_name": "tempest-keypair-1783171959", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:29.983055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:29.991978 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-500e9c75-5586-446d-ace1-f5f5cb1d7c5a tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1323 microversion: 2.1 time: 0.374365 Oct 24 08:53:30.009697 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 325/650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:29 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:30.020301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:30.024812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:30.025576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:30.026784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:30.027769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:30.028688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:30.030250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:30.063767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] validate_networks() for [('a1e84f6c-6a1f-4a59-a284-a0213f1972ff', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:30.075689 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-725addb5-fb4d-4941-b7df-8d89110d2e13 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064503 Oct 24 08:53:30.076589 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 326/651] 10.222.0.25 () {60 vars in 1217 bytes} [Mon Oct 24 08:53:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:30.084798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.159"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:30.089972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:30.120589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:30.122664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:30.123117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:30.125744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:30.126226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:30.126667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:30.163341 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:30.170401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:30.172280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquired lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:31.077059 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2.", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:53:31.078158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Releasing lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:53:31.078780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:31.079240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:31.079852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:31.080548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.080548 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] Oct 24 08:53:31.080995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:31.081518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Request method failure captured: Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action HTTP/1.1 Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 46 Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlJX6o4Tgp1dQ2MupMmWCh1kJVccS7m81oByACP9eTUS0U_6DPg6OtE0rpA1y_Pw5sF41jmRaBCntZPgESecsu6QbZVCZWhQ1M-k3M1Nyx5dwncC_pQjwvsTPx-pJsBPpoW8c_cN9utf78Z0ClWkg2SVvXr-qWqxMo_DpuqVym1O9gw Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:53:31.087559 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47f9a6b369c645e6b8cc4216374b303a"}]}] Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 6c77bcaf1bd040678e9baa743607257b Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: {"addFloatingIp": {"address": "172.35.3.159"}} Oct 24 08:53:31.089242 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f', 'body': {'addFloatingIp': {'address': '172.35.3.159'}}} Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:53:31.090435 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:53:31.091694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.092810 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.094640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] Oct 24 08:53:31.096822 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:31.098090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.098090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.098090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.098090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.098418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.098418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.099853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Returning 400 to user: Cannot associate floating IP 172.35.3.159 (d7950cd4-2975-4d05-b43e-db3a29b79c53) with port 8ac36376-cebc-4541-845e-2f1d74e3c15e using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 6336a572-8747-4a12-b442-56936ece2af2. Oct 24 08:53:31.099853 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-d2303830-7d99-4382-b1bb-3f51fe6a9f53'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:31.100541 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-618cb7ff-0afb-4907-9150-8501d04160a8 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action" status: 400 len: 381 microversion: 2.1 time: 1.021136 Oct 24 08:53:31.102348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 327/652] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:30 2022] POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action => generated 381 bytes in 1024 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:53:31.108934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98b6bccb-f988-493d-8d85-18d25f6f7fd8 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab242ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:31.118279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:31.124306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for user b43a269fe8b746b88c38db6b9e9bfa12 and project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:31.138616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:31.141518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:31.174235 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98b6bccb-f988-493d-8d85-18d25f6f7fd8 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2" status: 200 len: 784 microversion: 2.1 time: 0.070552 Oct 24 08:53:31.176135 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 328/653] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:31 2022] GET /compute/v2.1/images/a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2 => generated 784 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:31.183017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:31.184084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:31.192800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.193889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.194820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.196109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.196895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.197791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.227151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d97d6d0c-8821-44a5-aeda-a16d0267c45d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.426215 Oct 24 08:53:31.228358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 326/654] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:53:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:53:31.232778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ea4a4879-762f-4894-98d6-a6f965672376 req-e4095eeb-2018-4da5-a56f-cf75ab87943c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "name": "network-vif-unplugged", "status": "completed", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:31.243853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ea4a4879-762f-4894-98d6-a6f965672376 req-e4095eeb-2018-4da5-a56f-cf75ab87943c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.244595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ea4a4879-762f-4894-98d6-a6f965672376 req-e4095eeb-2018-4da5-a56f-cf75ab87943c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.245379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ea4a4879-762f-4894-98d6-a6f965672376 req-e4095eeb-2018-4da5-a56f-cf75ab87943c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.260893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ea4a4879-762f-4894-98d6-a6f965672376 req-e4095eeb-2018-4da5-a56f-cf75ab87943c service nova] Creating event network-vif-unplugged:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:53:31.266726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ea4a4879-762f-4894-98d6-a6f965672376 req-e4095eeb-2018-4da5-a56f-cf75ab87943c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037148 Oct 24 08:53:31.268286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 327/655] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:31.274590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:31.277288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:31.284892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.285665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.286290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.287184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.287797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.288401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.317676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'flavor' on Instance uuid f95b3010-cd07-42e1-81e5-e1cc4800988b {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:31.332088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Going to try to live migrate instance to n-h2-master-1 {{(pid=126920) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:53:31.380067 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:31.422432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:31.430665 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d58027d-63e3-4066-8632-5cd727edb51a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1471 microversion: 2.1 time: 0.252737 Oct 24 08:53:31.431247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 329/656] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:31 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:31.440762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-57f5e5cf-d7a8-4230-a20c-6668fab71d29 req-e0bf9e92-4554-4be8-9d56-79a3cea903e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7521a-d92d-4b96-aa95-37401af6f994", "tag": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:31.460391 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:31.465393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-57f5e5cf-d7a8-4230-a20c-6668fab71d29 req-e0bf9e92-4554-4be8-9d56-79a3cea903e1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.465758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-57f5e5cf-d7a8-4230-a20c-6668fab71d29 req-e0bf9e92-4554-4be8-9d56-79a3cea903e1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.469425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-57f5e5cf-d7a8-4230-a20c-6668fab71d29 req-e0bf9e92-4554-4be8-9d56-79a3cea903e1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.496197 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-57f5e5cf-d7a8-4230-a20c-6668fab71d29 req-e0bf9e92-4554-4be8-9d56-79a3cea903e1 service nova] Creating event network-changed:76ba2c49-878e-4e77-9bf7-f80d0562c8c5 for instance cdc7521a-d92d-4b96-aa95-37401af6f994 on n-h2-master-1 Oct 24 08:53:31.512374 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-57f5e5cf-d7a8-4230-a20c-6668fab71d29 req-e0bf9e92-4554-4be8-9d56-79a3cea903e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075372 Oct 24 08:53:31.513877 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 330/657] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:31.520485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:31.521241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:31.532486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.533283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.538304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.539278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.541577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.542036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.792839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:31.802470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e07e773-7b4e-4bac-ae16-d33ce1eac832 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1323 microversion: 2.1 time: 0.287065 Oct 24 08:53:31.818114 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 331/658] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:31 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:31.823828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0007ae8-0e56-4058-a15e-55be479f0015 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '.version_select at 0x7f8dab1f9550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:33.338172 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0007ae8-0e56-4058-a15e-55be479f0015 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d7950cd4-2975-4d05-b43e-db3a29b79c53" status: 202 len: 0 microversion: 2.1 time: 1.518923 Oct 24 08:53:33.339398 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 332/659] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:53:31 2022] DELETE /compute/v2.1/os-floating-ips/d7950cd4-2975-4d05-b43e-db3a29b79c53 => generated 0 bytes in 1521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:33.344387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-07a43656-12a3-4ba9-bc63-fd47ed4193ff tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:33.357104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-07a43656-12a3-4ba9-bc63-fd47ed4193ff tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016320 Oct 24 08:53:33.365112 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 333/660] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:53:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:33.370519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:33.374031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:33.384101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:33.384597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:33.385036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:33.385795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:33.386243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:33.386659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:33.504223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:33.520421 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-66cc07f8-f067-4678-baee-f7954967549d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1293 microversion: 2.1 time: 0.153808 Oct 24 08:53:33.529458 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 334/661] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:33 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:33.538002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:33.539248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:33.545896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:33.546809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:33.547415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:33.548136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:33.549147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:33.549606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:33.575879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lazy-loading 'flavor' on Instance uuid 70bed6dc-0c62-43ac-81c2-6197e5017264 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:33.650871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-545e0f02-41b3-4626-9b2e-369432fc8427 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264/action" status: 202 len: 0 microversion: 2.1 time: 0.117952 Oct 24 08:53:33.652343 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 335/662] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:33 2022] POST /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:33.658590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:33.659816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:33.666550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:33.667248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:33.667856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:33.668723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:33.669363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:33.669946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:33.968036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:33.981958 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-341941ab-e550-4205-a31b-63a8590c1758 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1323 microversion: 2.1 time: 0.327777 Oct 24 08:53:33.994059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 336/663] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:33 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:34.005007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'action', calling method: .version_select at 0x7f8dacc48c10>, body: {"removeFloatingIp": {"address": "172.35.3.194"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:34.231836 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6745d08a-42cd-4f29-b356-dc3444834014 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b/action" status: 202 len: 0 microversion: 2.25 time: 2.961856 Oct 24 08:53:34.237859 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 328/664] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:53:31 2022] POST /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b/action => generated 0 bytes in 2969 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:34.243947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a341ff62-64b3-4963-b257-fe082d5c7f2f tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab476820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:34.563779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:34.572405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:34.572896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:34.573384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:34.574098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:34.575213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:34.575648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:34.951460 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a341ff62-64b3-4963-b257-fe082d5c7f2f tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "DELETE /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 204 len: 0 microversion: 2.1 time: 0.706392 Oct 24 08:53:34.951460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 329/665] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:34 2022] DELETE /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:34.952250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:34.952862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:34.961476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:34.961967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:34.962582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:34.963446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:34.964049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:34.964613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:35.227472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:35.228743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquired lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:35.392807 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d92ec843-2900-4dcb-a2a7-65919bb9eccc tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1613 microversion: 2.1 time: 0.444479 Oct 24 08:53:35.395134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 330/666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:34 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1613 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:35.407429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:35.408888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:35.418907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:35.419814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:35.421182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:35.422234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:35.422955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:35.424268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:35.734542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:35.744845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:35.747848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:35.749274 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c629a20-9f06-40b9-a065-f61ca3aeaf18 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.352661 Oct 24 08:53:35.750123 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 331/667] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:35 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:35.754899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:35.755729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:35.762258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:35.763225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:35.764573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:35.765540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:35.766209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:35.766844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.109983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:36.131399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74a442c4-f44b-44c0-a028-078e21dc7a35 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.380060 Oct 24 08:53:36.132420 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 332/668] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:35 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:36.139688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e2859a3-1a92-49eb-8044-d1a19bc668c4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab476a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:36.180787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3e2859a3-1a92-49eb-8044-d1a19bc668c4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] HTTP exception thrown: Image not found. Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e2859a3-1a92-49eb-8044-d1a19bc668c4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Request method failure captured: Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca HTTP/1.1 Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJFs4XcMNiHmOfBVxQ1oXf0WMuOdjhEsj491XKStvFJ5roQcAGAkMafI9pviGYK3OiWilMWcCraamQvJ21ZDqJC1WvpWYUljh2WWUyiljVg6U0y9Dt9sBKyCqgZOXE2CAKhy3d41an8Ina_toBHg-RPGL2sYT7mfXuIeblAzhg810M Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 96ab82000972421c96022c2711beb014 Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:53:36.183707 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96ab82000972421c96022c2711beb014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96ab82000972421c96022c2711beb014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96ab82000972421c96022c2711beb014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96ab82000972421c96022c2711beb014"}]}] Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 96ab82000972421c96022c2711beb014 Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerTestJSON-9511904-project Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c2b9360313da41e1905c695c37020876 Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerTestJSON-9511904-project Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8a2f7cdd-88de-4e55-ad5c-55fd62e95fca'} Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:36.184956 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8a2f7cdd-88de-4e55-ad5c-55fd62e95fca Oct 24 08:53:36.185838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:53:36.187274 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a2f7cdd-88de-4e55-ad5c-55fd62e95fca could not be found. Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:53:36.188359 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e2859a3-1a92-49eb-8044-d1a19bc668c4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:36.189978 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e2859a3-1a92-49eb-8044-d1a19bc668c4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 404 len: 62 microversion: 2.1 time: 0.051657 Oct 24 08:53:36.191880 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 333/669] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:36 2022] GET /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:53:36.203612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:36.206253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:36.217851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.219199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.220151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.221920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.222681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.223931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.448012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:53:36.795814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:36.815536 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4567f03-ae0b-49bf-a5e6-f2130d8a7879 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1323 microversion: 2.1 time: 0.616749 Oct 24 08:53:36.816257 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 334/670] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:36 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1323 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:36.840035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1635b2b0-e995-49fc-8c1d-db1904d4c2d5 req-bc7dd01e-23be-41a8-a0e0-1312df5b27f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc7521a-d92d-4b96-aa95-37401af6f994", "name": "network-vif-plugged", "status": "completed", "tag": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:36.857400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1635b2b0-e995-49fc-8c1d-db1904d4c2d5 req-bc7dd01e-23be-41a8-a0e0-1312df5b27f2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.858158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1635b2b0-e995-49fc-8c1d-db1904d4c2d5 req-bc7dd01e-23be-41a8-a0e0-1312df5b27f2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.858812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1635b2b0-e995-49fc-8c1d-db1904d4c2d5 req-bc7dd01e-23be-41a8-a0e0-1312df5b27f2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.874817 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1635b2b0-e995-49fc-8c1d-db1904d4c2d5 req-bc7dd01e-23be-41a8-a0e0-1312df5b27f2 service nova] Creating event network-vif-plugged:76ba2c49-878e-4e77-9bf7-f80d0562c8c5 for instance cdc7521a-d92d-4b96-aa95-37401af6f994 on n-h2-master-1 Oct 24 08:53:36.883622 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1635b2b0-e995-49fc-8c1d-db1904d4c2d5 req-bc7dd01e-23be-41a8-a0e0-1312df5b27f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051073 Oct 24 08:53:36.884970 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 335/671] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:36.893482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:36.895135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:36.903754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.905230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.906032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.907018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.907691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.908481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.021315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] HTTP exception thrown: Cannot 'migrate' instance 70bed6dc-0c62-43ac-81c2-6197e5017264 while it is in vm_state suspended Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Request method failure captured: Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264/action HTTP/1.1 Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWSdD1BsWdGF1J4V-2PZDmZo9uj9k23CBhIjXVL7vnGvJ1wMdoAGMAjMDYLIl3uFvsIhuOSwNrVCH1HL61ng6NmJbzILJUpHeQR26k78Da-hieHE44o-7mEwq9iYl8QKJED7McO9WJfHbBhg3ikmnfxSBg_nCbfHPZENwNOD0Mxmk Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:53:37.025349 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb51316d29514a1092aa662ee0875f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb51316d29514a1092aa662ee0875f04"}]}] Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3cf59bb388b348268df3b67e9dfae7cc Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: {"migrate": {}} Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:53:37.026667 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'migrate' instance 70bed6dc-0c62-43ac-81c2-6197e5017264 while it is in vm_state suspended Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '70bed6dc-0c62-43ac-81c2-6197e5017264', 'body': {'migrate': {}}} Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 in vm_state suspended. Cannot resize while the instance is in this state. Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.027410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 70bed6dc-0c62-43ac-81c2-6197e5017264 while it is in vm_state suspended Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:37.028558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:37.029666 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:37.029666 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:37.029666 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 70bed6dc-0c62-43ac-81c2-6197e5017264 while it is in vm_state suspended Oct 24 08:53:37.029666 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.031882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Returning 409 to user: Cannot 'migrate' instance 70bed6dc-0c62-43ac-81c2-6197e5017264 while it is in vm_state suspended {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:37.033392 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7d8276b-7cf3-45e8-b5c2-b1b8d8236d3a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264/action" status: 409 len: 148 microversion: 2.1 time: 0.147061 Oct 24 08:53:37.034835 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 336/672] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:36 2022] POST /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264/action => generated 148 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:53:37.040073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-761032403"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:37.042766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:37.052321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.053116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.053798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.055177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.055852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.056537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.450423 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-645c9fb8-9033-49fd-8a0f-60fc232ce97d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "POST /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98/action" status: 202 len: 0 microversion: 2.1 time: 0.412956 Oct 24 08:53:37.466087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Updating instance_info_cache with network_info: [{"id": "8ac36376-cebc-4541-845e-2f1d74e3c15e", "address": "fa:16:3e:df:05:21", "network": {"id": "9255d6aa-996f-44ee-a152-5187bbb96214", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-217046704-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47f9a6b369c645e6b8cc4216374b303a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ac36376-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:53:37.481645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Releasing lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:53:37.482286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 337/673] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:37 2022] POST /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 08:53:37.485196 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7de5b79-1cae-4063-b0f9-7e9047f74719 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action" status: 202 len: 0 microversion: 2.1 time: 3.489109 Oct 24 08:53:37.489253 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 337/674] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:33 2022] POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action => generated 0 bytes in 3494 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 08:53:37.492287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-82a05cfb-4d09-488a-90b9-224cc80a5a4c req-a764c8ee-4c7f-4e03-b2b2-e5b7f8a26059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f", "tag": "8ac36376-cebc-4541-845e-2f1d74e3c15e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:37.502683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:37.502683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:37.505617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-82a05cfb-4d09-488a-90b9-224cc80a5a4c req-a764c8ee-4c7f-4e03-b2b2-e5b7f8a26059 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.506350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-82a05cfb-4d09-488a-90b9-224cc80a5a4c req-a764c8ee-4c7f-4e03-b2b2-e5b7f8a26059 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.506968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-82a05cfb-4d09-488a-90b9-224cc80a5a4c req-a764c8ee-4c7f-4e03-b2b2-e5b7f8a26059 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.515295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.515778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.517730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.520408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.521068 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-82a05cfb-4d09-488a-90b9-224cc80a5a4c req-a764c8ee-4c7f-4e03-b2b2-e5b7f8a26059 service nova] Creating event network-changed:8ac36376-cebc-4541-845e-2f1d74e3c15e for instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f on n-h1-master-1 Oct 24 08:53:37.523374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.524840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.526778 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-82a05cfb-4d09-488a-90b9-224cc80a5a4c req-a764c8ee-4c7f-4e03-b2b2-e5b7f8a26059 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 Oct 24 08:53:37.527757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 338/675] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:37.534620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d901ad37-f69e-48d7-85e7-fc91951d5913 req-7520f5cd-3588-41df-a779-a3f962507739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56a0887e-b5c7-47d7-ad5b-72297f386d40", "tag": "cdcac286-03e9-4041-84b1-896d805de241"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:37.547365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d901ad37-f69e-48d7-85e7-fc91951d5913 req-7520f5cd-3588-41df-a779-a3f962507739 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.548565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d901ad37-f69e-48d7-85e7-fc91951d5913 req-7520f5cd-3588-41df-a779-a3f962507739 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.549802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d901ad37-f69e-48d7-85e7-fc91951d5913 req-7520f5cd-3588-41df-a779-a3f962507739 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.576967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d901ad37-f69e-48d7-85e7-fc91951d5913 req-7520f5cd-3588-41df-a779-a3f962507739 service nova] Creating event network-changed:cdcac286-03e9-4041-84b1-896d805de241 for instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 on n-h1-master-1 Oct 24 08:53:37.585740 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d901ad37-f69e-48d7-85e7-fc91951d5913 req-7520f5cd-3588-41df-a779-a3f962507739 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055708 Oct 24 08:53:37.587535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 339/676] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:37.593931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-828c7bcf-2c56-4279-9e29-f2ce0ae33bf0 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-828c7bcf-2c56-4279-9e29-f2ce0ae33bf0 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Request method failure captured: Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a/action HTTP/1.1 Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 39 Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWSdD1BsWdGF1J4V-2PZDmZo9uj9k23CBhIjXVL7vnGvJ1wMdoAGMAjMDYLIl3uFvsIhuOSwNrVCH1HL61ng6NmJbzILJUpHeQR26k78Da-hieHE44o-7mEwq9iYl8QKJED7McO9WJfHbBhg3ikmnfxSBg_nCbfHPZENwNOD0Mxmk Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:53:37.598583 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb51316d29514a1092aa662ee0875f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb51316d29514a1092aa662ee0875f04"}]}] Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3cf59bb388b348268df3b67e9dfae7cc Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: {"os-resetState": {"state": "invalid"}} Oct 24 08:53:37.599904 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'aa819ff1-4bb7-46be-8f11-827cfbf22d9a', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:37.600963 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:53:37.602334 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 24 08:53:37.603441 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:37.603441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-828c7bcf-2c56-4279-9e29-f2ce0ae33bf0 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:37.603441 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-828c7bcf-2c56-4279-9e29-f2ce0ae33bf0 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a/action" status: 400 len: 144 microversion: 2.1 time: 0.011393 Oct 24 08:53:37.603441 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 340/677] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:37 2022] POST /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:53:37.616505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:37.617270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:37.626137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.626665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.627104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.627817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.628277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.628711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.812182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:37.825654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:37.827291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:37.828767 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41c3d050-3fc8-4c2d-96ba-aeed15e9319e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.338200 Oct 24 08:53:37.829668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 338/678] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:37 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:37.834789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e192c8c-82ec-4e76-825c-e81495ea593a tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '.version_select at 0x7f8dab48d430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:37.988773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:37.997565 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-699149d0-6393-4cef-b53c-53a0ad0f96a0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.395711 Oct 24 08:53:37.998814 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 341/679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:37 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:38.003776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e47a275b-5f08-497d-b7d7-a777a75f467e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3c5160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:38.081442 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e47a275b-5f08-497d-b7d7-a777a75f467e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.081227 Oct 24 08:53:38.082027 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 342/680] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:37 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:38.086734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d2c264f-6b7e-4150-a2d5-949d8761014a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d2c264f-6b7e-4150-a2d5-949d8761014a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Request method failure captured: Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a/action HTTP/1.1 Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 31 Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWSdD1BsWdGF1J4V-2PZDmZo9uj9k23CBhIjXVL7vnGvJ1wMdoAGMAjMDYLIl3uFvsIhuOSwNrVCH1HL61ng6NmJbzILJUpHeQR26k78Da-hieHE44o-7mEwq9iYl8QKJED7McO9WJfHbBhg3ikmnfxSBg_nCbfHPZENwNOD0Mxmk Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:53:38.098830 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb51316d29514a1092aa662ee0875f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb51316d29514a1092aa662ee0875f04"}]}] Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3cf59bb388b348268df3b67e9dfae7cc Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: {"os-resetState": {"state": 1}} Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:53:38.100155 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'aa819ff1-4bb7-46be-8f11-827cfbf22d9a', 'body': {'os-resetState': {'state': 1}}} Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 1 Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:38.101068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 24 08:53:38.104472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.107156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d2c264f-6b7e-4150-a2d5-949d8761014a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:38.107156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d2c264f-6b7e-4150-a2d5-949d8761014a tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a/action" status: 400 len: 120 microversion: 2.1 time: 0.017387 Oct 24 08:53:38.107156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 343/681] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:38 2022] POST /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:53:38.110577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:38.110577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:38.136228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.136737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.137203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.138000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.138466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.138890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.333730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:38.344003 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-68c30ce6-f777-4c9e-8337-33c39238ae30 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1323 microversion: 2.1 time: 0.238179 Oct 24 08:53:38.357967 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 344/682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:38 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:38.366052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ac0a52c-6f3e-48e9-8644-4ea96b26f663 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:38.373429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ac0a52c-6f3e-48e9-8644-4ea96b26f663 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Failed to fetch instance by id 999 {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 08:53:38.374202 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8ac0a52c-6f3e-48e9-8644-4ea96b26f663 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ac0a52c-6f3e-48e9-8644-4ea96b26f663 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Request method failure captured: Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 37 Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWSdD1BsWdGF1J4V-2PZDmZo9uj9k23CBhIjXVL7vnGvJ1wMdoAGMAjMDYLIl3uFvsIhuOSwNrVCH1HL61ng6NmJbzILJUpHeQR26k78Da-hieHE44o-7mEwq9iYl8QKJED7McO9WJfHbBhg3ikmnfxSBg_nCbfHPZENwNOD0Mxmk Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:53:38.376301 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb51316d29514a1092aa662ee0875f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb51316d29514a1092aa662ee0875f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb51316d29514a1092aa662ee0875f04"}]}] Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: bb51316d29514a1092aa662ee0875f04 Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-404208242 Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3cf59bb388b348268df3b67e9dfae7cc Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-404208242-project-admin Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: {"os-resetState": {"state": "error"}} Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:53:38.379042 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 999 could not be found. Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:38.379871 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ac0a52c-6f3e-48e9-8644-4ea96b26f663 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:38.381132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ac0a52c-6f3e-48e9-8644-4ea96b26f663 tempest-ServersAdminNegativeTestJSON-404208242 tempest-ServersAdminNegativeTestJSON-404208242-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019109 Oct 24 08:53:38.385970 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 345/683] 10.222.0.25 () {60 vars in 1179 bytes} [Mon Oct 24 08:53:38 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:53:38.391143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:38.391663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:38.401653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.402166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.402582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.403289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.403745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.404170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.438829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:38.536007 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d8651cc-4eba-445e-9892-134b32bb41fd tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "DELETE /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 204 len: 0 microversion: 2.1 time: 0.147940 Oct 24 08:53:38.536935 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 346/684] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:53:38 2022] DELETE /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:38.549785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:38.550670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:38.556848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.557410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.557821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.558517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.558966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.559553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.718888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:38.728603 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76636603-f04b-4063-9e2f-6d320fcdda9f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1468 microversion: 2.1 time: 0.187474 Oct 24 08:53:38.729178 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 347/685] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:38 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1468 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:38.827034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e192c8c-82ec-4e76-825c-e81495ea593a tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/4a375b1f-336a-4284-9fa3-6867c59af6e4" status: 202 len: 0 microversion: 2.1 time: 0.995610 Oct 24 08:53:38.827607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 339/686] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:53:37 2022] DELETE /compute/v2.1/os-floating-ips/4a375b1f-336a-4284-9fa3-6867c59af6e4 => generated 0 bytes in 997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:38.839081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c2d1f3f-04dc-4d67-bd8d-4bd31f4744c2 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'action', calling method: .version_select at 0x7f8dacc49af0>, body: {"addFloatingIp": {"address": ""}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c2d1f3f-04dc-4d67-bd8d-4bd31f4744c2 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Request method failure captured: Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action HTTP/1.1 Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 34 Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJX6o4Tgp1dQ2MupMmWCh1kJVccS7m81oByACP9eTUS0U_6DPg6OtE0rpA1y_Pw5sF41jmRaBCntZPgESecsu6QbZVCZWhQ1M-k3M1Nyx5dwncC_pQjwvsTPx-pJsBPpoW8c_cN9utf78Z0ClWkg2SVvXr-qWqxMo_DpuqVym1O9gw Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:53:38.843080 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47f9a6b369c645e6b8cc4216374b303a"}]}] Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 6c77bcaf1bd040678e9baa743607257b Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: {"addFloatingIp": {"address": ""}} Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:53:38.844462 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f', 'body': {'addFloatingIp': {'address': ''}}} Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '' Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:38.846206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:53:38.847465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:53:38.848663 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 24 08:53:38.848663 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:38.848663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c2d1f3f-04dc-4d67-bd8d-4bd31f4744c2 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:38.848663 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c2d1f3f-04dc-4d67-bd8d-4bd31f4744c2 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action" status: 400 len: 142 microversion: 2.1 time: 0.010472 Oct 24 08:53:38.848663 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 348/687] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:38 2022] POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action => generated 142 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:53:38.854968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:38.857613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:38.857738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:38.858228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:38.864872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.865062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.865387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.865545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.865824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.866358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.866662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.871080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.871305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.871657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.871849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.871849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.915919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:38.916409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquired lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:39.019737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.020763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Releasing lock "refresh_cache-bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:53:39.021358 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] HTTP exception thrown: floating IP not found Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Request method failure captured: Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action HTTP/1.1 Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 41 Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlJX6o4Tgp1dQ2MupMmWCh1kJVccS7m81oByACP9eTUS0U_6DPg6OtE0rpA1y_Pw5sF41jmRaBCntZPgESecsu6QbZVCZWhQ1M-k3M1Nyx5dwncC_pQjwvsTPx-pJsBPpoW8c_cN9utf78Z0ClWkg2SVvXr-qWqxMo_DpuqVym1O9gw Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:53:39.023118 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47f9a6b369c645e6b8cc4216374b303a"}]}] Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 6c77bcaf1bd040678e9baa743607257b Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:53:39.024476 n-d-master-1 devstack@n-api.service[126919]: exception: floating IP not found Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:39.025320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 24 08:53:39.026456 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.028480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.028971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Returning 404 to user: floating IP not found {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:39.030011 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b7af81be-2355-4789-a818-9fdd6442f2d9 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action" status: 404 len: 67 microversion: 2.1 time: 0.178970 Oct 24 08:53:39.030188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.030585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 340/688] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:38 2022] POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action => generated 67 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:53:39.031393 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-078a9f5d-78ce-422c-af1d-e46caffac5b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.177846 Oct 24 08:53:39.032611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 349/689] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:38 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:53:39.036866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.037650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.044679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.045453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.046081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.046774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.047381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.047939 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-253e2807-5069-4fc8-bb73-047388ee9921 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Action: 'action', calling method: .version_select at 0x7f8dacc49c10>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:39.048228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.099860 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-253e2807-5069-4fc8-bb73-047388ee9921 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-253e2807-5069-4fc8-bb73-047388ee9921 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Request method failure captured: Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action HTTP/1.1 Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 44 Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJX6o4Tgp1dQ2MupMmWCh1kJVccS7m81oByACP9eTUS0U_6DPg6OtE0rpA1y_Pw5sF41jmRaBCntZPgESecsu6QbZVCZWhQ1M-k3M1Nyx5dwncC_pQjwvsTPx-pJsBPpoW8c_cN9utf78Z0ClWkg2SVvXr-qWqxMo_DpuqVym1O9gw Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:53:39.101606 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47f9a6b369c645e6b8cc4216374b303a"}]}] Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 6c77bcaf1bd040678e9baa743607257b Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:53:39.102895 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP not found for address 0.0.0.0. Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:39.103743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 24 08:53:39.104859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:39.106795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-253e2807-5069-4fc8-bb73-047388ee9921 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:39.107635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-253e2807-5069-4fc8-bb73-047388ee9921 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action" status: 404 len: 88 microversion: 2.1 time: 0.066231 Oct 24 08:53:39.108500 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 350/690] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:39 2022] POST /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 08:53:39.116208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c32afbad-e246-4f3d-ac68-2381d0e32f46 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab39a8b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.162084 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c32afbad-e246-4f3d-ac68-2381d0e32f46 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.052302 Oct 24 08:53:39.162659 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 351/691] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:39.167130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.167623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.174882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.175371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.176015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.176722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.177175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.177618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.207941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:39.213744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.222285 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e98ede90-c387-46e6-84ad-1cebbcfbef76 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.189976 Oct 24 08:53:39.237366 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 341/692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:39.237705 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:39.292128 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-556e2268-bbc6-4878-ac38-fa4c76a27bbf tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 204 len: 0 microversion: 2.1 time: 0.128255 Oct 24 08:53:39.292729 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 352/693] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:53:39 2022] DELETE /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:39.300939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.301679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.308322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.308792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.309220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.309939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.310381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.310794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.373335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.374119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.386075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.386576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.388507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.390860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.391332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.392695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.534390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.542315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5de91077-1294-4223-858e-dbfc610a2d66 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1540 microversion: 2.1 time: 0.245372 Oct 24 08:53:39.542886 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 342/694] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1540 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:39.558464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.566143 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7a0704e-2d6c-4b31-b710-1f4b7cc926f4 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 200 len: 1518 microversion: 2.1 time: 0.197752 Oct 24 08:53:39.566645 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 353/695] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:39.589391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.33"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:39.592542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.599383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.599879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.600372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.601009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.601497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.601924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.629351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:39.629351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquired lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:39.665113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95b3010-cd07-42e1-81e5-e1cc4800988b", "name": "network-vif-unplugged", "status": "completed", "tag": "da9d9831-4f58-409e-b129-af4960d568db"}, {"name": "network-changed", "server_uuid": "f95b3010-cd07-42e1-81e5-e1cc4800988b", "tag": "da9d9831-4f58-409e-b129-af4960d568db"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:39.675140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.675527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.675949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.691884 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] Creating event network-vif-unplugged:da9d9831-4f58-409e-b129-af4960d568db for instance f95b3010-cd07-42e1-81e5-e1cc4800988b on n-h1-master-1 Oct 24 08:53:39.692590 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] Creating event network-changed:da9d9831-4f58-409e-b129-af4960d568db for instance f95b3010-cd07-42e1-81e5-e1cc4800988b on n-h1-master-1 Oct 24 08:53:39.699400 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-75590474-f447-475c-810c-5eb97e6ebb5a req-7a694a0e-5d31-46e0-88cb-92b377f02d78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037715 Oct 24 08:53:39.700305 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 354/696] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:53:39.868945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-560afdcf-88be-4862-953e-94f1d33849af tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] Calling method '.version_select at 0x7f8dab317b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.881230 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-560afdcf-88be-4862-953e-94f1d33849af tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.136636 Oct 24 08:53:39.881825 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 355/697] 10.222.0.25 () {60 vars in 1226 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:53:39.886515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.887361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.894462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.894950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.895383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.896084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.896537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.896959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.041458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:40.044445 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:40.051727 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfef6fac-cff0-442c-9dc0-53ee0d910610 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1468 microversion: 2.1 time: 0.168711 Oct 24 08:53:40.052876 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 356/698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:40.060724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-735b1a65-8b0d-42be-8515-4e411cbe0884 tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab4dfd30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:40.114240 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:40.186743 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-735b1a65-8b0d-42be-8515-4e411cbe0884 tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.130282 Oct 24 08:53:40.193587 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 357/699] 10.222.0.25 () {62 vars in 1247 bytes} [Mon Oct 24 08:53:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:40.201020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:40.203225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:40.212113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.213861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.214335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.215099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.215627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.216071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.368764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:40.380723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:40.382268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:40.383438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f2b1c74-981c-496f-9368-491ac0e40f35 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.188426 Oct 24 08:53:40.384148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 358/700] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:40 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:40.400985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2453308-3f33-4f2f-b88f-4d7750a370ef tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3c5700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:40.459830 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2453308-3f33-4f2f-b88f-4d7750a370ef tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.074594 Oct 24 08:53:40.460614 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 359/701] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:40 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:40.464837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-133f6087-6fd6-4028-9d1a-d4f227672777 tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] Calling method '.version_select at 0x7f8dab4df9d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:40.477868 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-133f6087-6fd6-4028-9d1a-d4f227672777 tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016099 Oct 24 08:53:40.484738 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 360/702] 10.222.0.25 () {60 vars in 1226 bytes} [Mon Oct 24 08:53:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:40.484738 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:40.484966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:40.492035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.492726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.493216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.493953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.494940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.494940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.746925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:40.755347 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2804fd2c-02ce-4686-be05-5645087ede55 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.275258 Oct 24 08:53:40.756075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 361/703] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:40 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:40.760382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d00f30fe-c3ba-42a0-9915-20633a463983 tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab3d58b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:40.834875 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d00f30fe-c3ba-42a0-9915-20633a463983 tempest-QuotaClassesAdmin257Test-975889108 tempest-QuotaClassesAdmin257Test-975889108-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.077871 Oct 24 08:53:40.835654 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 362/704] 10.222.0.25 () {62 vars in 1247 bytes} [Mon Oct 24 08:53:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:40.841831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:40.842449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:40.852191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.853282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.853759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.855062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.855889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.856436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:41.096024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:41.107380 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3aeafa1b-bb6d-4c15-a0b7-e7151a5690a0 tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1540 microversion: 2.1 time: 0.270849 Oct 24 08:53:41.107971 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 363/705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:40 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1540 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:41.110330 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:41.130402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:41.131068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:41.138101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:41.138919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:41.139033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:41.139722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:41.143797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:41.144266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:41.261039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:41.269667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c34d036-9ea3-4c86-bbd4-eee136d66675 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 200 len: 1426 microversion: 2.1 time: 0.160622 Oct 24 08:53:41.271983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:53:41.281816 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 364/706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:41 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 1426 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:41.323366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-eabf896b-afd0-457b-8700-0365f0dfbbf5 req-fed4708c-3fa4-4b97-b9a9-4f57bd1a6557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:41.340801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eabf896b-afd0-457b-8700-0365f0dfbbf5 req-fed4708c-3fa4-4b97-b9a9-4f57bd1a6557 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:41.353175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eabf896b-afd0-457b-8700-0365f0dfbbf5 req-fed4708c-3fa4-4b97-b9a9-4f57bd1a6557 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:41.357136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eabf896b-afd0-457b-8700-0365f0dfbbf5 req-fed4708c-3fa4-4b97-b9a9-4f57bd1a6557 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:41.391981 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-eabf896b-afd0-457b-8700-0365f0dfbbf5 req-fed4708c-3fa4-4b97-b9a9-4f57bd1a6557 service nova] Creating event network-changed:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:53:41.415229 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-eabf896b-afd0-457b-8700-0365f0dfbbf5 req-fed4708c-3fa4-4b97-b9a9-4f57bd1a6557 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096079 Oct 24 08:53:41.418172 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 365/707] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:41.426616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:41.427262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:41.447242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:41.447749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:41.448211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:41.448916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:41.455244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:41.455823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.047513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:42.086676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:42.089520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:42.092150 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48dc155c-f072-44b6-8dd6-78a4af4c0c6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.672820 Oct 24 08:53:42.096884 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 366/708] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:41 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:42.142801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de60e8f6-db2c-453b-a679-703d5beed6bb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab2d1670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:42.223637 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de60e8f6-db2c-453b-a679-703d5beed6bb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.098351 Oct 24 08:53:42.224237 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 367/709] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:42 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:42.250145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3bf63e03-2cc8-423f-b674-66382dd7bbc0 req-aca11a62-2966-47d2-a439-99b0a13bdcad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bed6dc-0c62-43ac-81c2-6197e5017264", "name": "network-vif-deleted", "tag": "3c9aad7c-4166-4892-8470-6c0c890969d0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:42.281581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bf63e03-2cc8-423f-b674-66382dd7bbc0 req-aca11a62-2966-47d2-a439-99b0a13bdcad service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.286577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bf63e03-2cc8-423f-b674-66382dd7bbc0 req-aca11a62-2966-47d2-a439-99b0a13bdcad service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.287231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bf63e03-2cc8-423f-b674-66382dd7bbc0 req-aca11a62-2966-47d2-a439-99b0a13bdcad service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.306591 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3bf63e03-2cc8-423f-b674-66382dd7bbc0 req-aca11a62-2966-47d2-a439-99b0a13bdcad service nova] Creating event network-vif-deleted:3c9aad7c-4166-4892-8470-6c0c890969d0 for instance 70bed6dc-0c62-43ac-81c2-6197e5017264 on n-h2-master-1 Oct 24 08:53:42.312684 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3bf63e03-2cc8-423f-b674-66382dd7bbc0 req-aca11a62-2966-47d2-a439-99b0a13bdcad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075921 Oct 24 08:53:42.313949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 368/710] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:42.322258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:42.323425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:42.331544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.332340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.333007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.333979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.334646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.335221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.711312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:42.723476 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e812a19-604e-4cf4-b4aa-2f64c60f79c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.407151 Oct 24 08:53:42.724758 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 369/711] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:42 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:42.746333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:42.747628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:42.761855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.765643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.769571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.771856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.772406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.772962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.218702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:43.227678 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b0149320-c432-4548-b760-532b54921f0b tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1498 microversion: 2.1 time: 0.501621 Oct 24 08:53:43.249591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 370/712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:42 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1498 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:43.254862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:43.255480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: 70bed6dc-0c62-43ac-81c2-6197e5017264] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:43.272717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.273512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.274107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.274993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.275600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.286058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.307185 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] HTTP exception thrown: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 could not be found. Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Request method failure captured: Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 HTTP/1.1 Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJUOEHcNrxYrd9ZEpqwHUOZ4dpsT2_8I9CxtEEXTyU02QKoU5qmNYQpfMhU0dnkN6soIUqQTC0ayYrKoT389K7-RJuZ212CsRuAzF7vRZMevB4Ib1-DQy1fl7NWlqEgy7gSwk1b7D_I8im8Pp1xWIPqLliYyslhybTjKvTkKKz2GbQ Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 961eeb9727ed45d9874a81d495c0069a Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1640976008 Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:53:43.308887 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/961eeb9727ed45d9874a81d495c0069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_961eeb9727ed45d9874a81d495c0069a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/961eeb9727ed45d9874a81d495c0069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/961eeb9727ed45d9874a81d495c0069a"}]}] Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1640976008 Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 961eeb9727ed45d9874a81d495c0069a Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1640976008 Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-1640976008-project Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f6e3382f1fcd40108c9d79cfbdf4337a Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1640976008-project Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 could not be found. Oct 24 08:53:43.316636 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '70bed6dc-0c62-43ac-81c2-6197e5017264'} Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 could not be found. Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:43.317521 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 could not be found. Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 could not be found. Oct 24 08:53:43.318678 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:43.319819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Returning 404 to user: Instance 70bed6dc-0c62-43ac-81c2-6197e5017264 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:43.319819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f233f0b-e9cf-412a-9f12-b261b0a1121f tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264" status: 404 len: 111 microversion: 2.1 time: 0.059567 Oct 24 08:53:43.319819 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 371/713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:43 2022] GET /compute/v2.1/servers/70bed6dc-0c62-43ac-81c2-6197e5017264 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:43.319819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:43.319819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:43.343715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.344490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.345096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.346465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.346937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.347361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.448020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Updating instance_info_cache with network_info: [{"id": "d95c40ef-3336-41c3-aece-9d1376ac44f0", "address": "fa:16:3e:fc:1d:fe", "network": {"id": "37d96780-2455-4d33-8875-f6279ac9d08e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709907634-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4bf7adacd2ba40e6b67fa07d8baefc4b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd95c40ef-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:53:43.456048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Releasing lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:53:43.459227 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0dd5240-2fe6-43a2-863c-08cde78f8d0c tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action" status: 202 len: 0 microversion: 2.1 time: 3.873986 Oct 24 08:53:43.459949 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 343/714] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:39 2022] POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action => generated 0 bytes in 3875 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 08:53:43.468403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cadd4dd9-a31a-4acb-b6ac-a66bd21215ce tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab1b04c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:43.520763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cadd4dd9-a31a-4acb-b6ac-a66bd21215ce tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.059658 Oct 24 08:53:43.521972 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 344/715] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:43 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:43.527561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:43.528336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:43.536560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.537404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.538476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.539452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.540212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.540852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.549572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:43.559400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:43.561588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:43.563443 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5152f8e4-922e-4cca-a5e7-1e2c761b5ab5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.251054 Oct 24 08:53:43.581938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:43.583305 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 372/716] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:43 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:43.589628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.33"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:43.592199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:43.600788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.601355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.601796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.602508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.602960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.603434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.647559 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:43.698223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e0ea1bf-dce0-4ccd-8e68-db21bb6613d7 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 204 len: 0 microversion: 2.1 time: 0.174731 Oct 24 08:53:43.699915 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 345/717] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:53:43 2022] DELETE /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:43.706856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c2722272-766a-447a-9523-d6a7aeb4e3c5 req-c11fbd4c-10e6-42d2-99a3-d13f6e4354e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a0887e-b5c7-47d7-ad5b-72297f386d40", "name": "network-vif-plugged", "status": "completed", "tag": "cdcac286-03e9-4041-84b1-896d805de241"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:43.719373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "refresh_cache-cdc7521a-d92d-4b96-aa95-37401af6f994" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:43.719851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquired lock "refresh_cache-cdc7521a-d92d-4b96-aa95-37401af6f994" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:43.726565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c2722272-766a-447a-9523-d6a7aeb4e3c5 req-c11fbd4c-10e6-42d2-99a3-d13f6e4354e4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.729700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c2722272-766a-447a-9523-d6a7aeb4e3c5 req-c11fbd4c-10e6-42d2-99a3-d13f6e4354e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.730279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c2722272-766a-447a-9523-d6a7aeb4e3c5 req-c11fbd4c-10e6-42d2-99a3-d13f6e4354e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.753281 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c2722272-766a-447a-9523-d6a7aeb4e3c5 req-c11fbd4c-10e6-42d2-99a3-d13f6e4354e4 service nova] Creating event network-vif-plugged:cdcac286-03e9-4041-84b1-896d805de241 for instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 on n-h1-master-1 Oct 24 08:53:43.780596 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c2722272-766a-447a-9523-d6a7aeb4e3c5 req-c11fbd4c-10e6-42d2-99a3-d13f6e4354e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077331 Oct 24 08:53:43.782058 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 346/718] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:43.789903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4b26c135-8e05-4552-8470-f99bf7e67009 req-82e3e66a-88b1-43aa-8582-a3f1edc011af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f", "name": "network-vif-deleted", "tag": "8ac36376-cebc-4541-845e-2f1d74e3c15e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:43.807149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4b26c135-8e05-4552-8470-f99bf7e67009 req-82e3e66a-88b1-43aa-8582-a3f1edc011af service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.808001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4b26c135-8e05-4552-8470-f99bf7e67009 req-82e3e66a-88b1-43aa-8582-a3f1edc011af service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.808664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4b26c135-8e05-4552-8470-f99bf7e67009 req-82e3e66a-88b1-43aa-8582-a3f1edc011af service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.824479 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4b26c135-8e05-4552-8470-f99bf7e67009 req-82e3e66a-88b1-43aa-8582-a3f1edc011af service nova] Creating event network-vif-deleted:8ac36376-cebc-4541-845e-2f1d74e3c15e for instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f on n-h1-master-1 Oct 24 08:53:43.830591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4b26c135-8e05-4552-8470-f99bf7e67009 req-82e3e66a-88b1-43aa-8582-a3f1edc011af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046277 Oct 24 08:53:43.833072 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 347/719] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:43.838616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:43.839585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:43.852698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.853711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.855026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.858214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.858966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.859612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.318297 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:44.328257 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68d06f89-2708-49ae-a7d3-26d931e8b548 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1477 microversion: 2.1 time: 0.493651 Oct 24 08:53:44.341830 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 348/720] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:43 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1477 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:44.350329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:44.352006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:44.358359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.359050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.359640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.360649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.361908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.362852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.690670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:44.700012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15619f37-806f-42ad-a563-17012871591a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.356995 Oct 24 08:53:44.710252 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 349/721] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:44 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:44.717171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:44.717932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:44.724910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.725575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.726104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.726895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.727445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.727980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.769839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.770377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.770791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.771241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lazy-loading 'fault' on Instance uuid bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:44.817575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c77bcaf1bd040678e9baa743607257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f9a6b369c645e6b8cc4216374b303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:44.833634 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0211b33-a558-4bd9-aa07-63f254f8183d tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 200 len: 1321 microversion: 2.1 time: 0.121850 Oct 24 08:53:44.834212 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 350/722] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:44 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 1321 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:44.839078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d3e3270-407c-46ff-9d05-f4e9c718c3ff tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab229f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:44.888943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d3e3270-407c-46ff-9d05-f4e9c718c3ff tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.053594 Oct 24 08:53:44.897990 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 351/723] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:44 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:44.903432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:44.904262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:44.912534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.913364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.914148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.915070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.915689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.916289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:45.154815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:45.163712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:45.165148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:45.166346 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f986a869-ec54-44f9-aeec-c85127f18376 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.267127 Oct 24 08:53:45.166893 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 352/724] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:44 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:45.354882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:45.355785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:45.365926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:45.366689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:45.368051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:45.368985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:45.370052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:45.370703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:45.739251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:45.774496 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36cbc2ff-d6aa-4868-bf35-7980e5a33303 tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1477 microversion: 2.1 time: 0.420207 Oct 24 08:53:45.777311 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 353/725] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:45 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:45.802105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:45.808534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:45.826434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:45.827126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:45.827725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:45.828686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:45.829328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:45.830613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.219208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:46.227683 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6de3e5e0-9ad6-46f3-b1a3-e92322f84430 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1360 microversion: 2.1 time: 0.443357 Oct 24 08:53:46.245782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 354/726] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:45 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1360 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:46.267771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:46.274377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] [instance: bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:46.300470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.300979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.301455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.302173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.302635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.303071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.354097 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] HTTP exception thrown: Instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f could not be found. Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Request method failure captured: Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f HTTP/1.1 Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlJX6o4Tgp1dQ2MupMmWCh1kJVccS7m81oByACP9eTUS0U_6DPg6OtE0rpA1y_Pw5sF41jmRaBCntZPgESecsu6QbZVCZWhQ1M-k3M1Nyx5dwncC_pQjwvsTPx-pJsBPpoW8c_cN9utf78Z0ClWkg2SVvXr-qWqxMo_DpuqVym1O9gw Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:53:46.360091 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47f9a6b369c645e6b8cc4216374b303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47f9a6b369c645e6b8cc4216374b303a"}]}] Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 47f9a6b369c645e6b8cc4216374b303a Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352 Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 6c77bcaf1bd040678e9baa743607257b Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:53:46.361525 n-d-master-1 devstack@n-api.service[126919]: exception: Instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f could not be found. Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f'} Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f could not be found. Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:46.362201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f could not be found. Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f could not be found. Oct 24 08:53:46.363320 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:46.366330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] Returning 404 to user: Instance bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:46.367414 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-473fb42c-f348-4f13-8bc4-233694c2b12f tempest-FloatingIPsAssociationNegativeTestJSON-355055352 tempest-FloatingIPsAssociationNegativeTestJSON-355055352-project] 10.222.0.25 "GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f" status: 404 len: 111 microversion: 2.1 time: 0.120103 Oct 24 08:53:46.373810 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 355/727] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:46 2022] GET /compute/v2.1/servers/bb57e94d-5c16-4cac-9c1c-9a1ba6539e5f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:46.386635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a3b6888f-b8a8-4863-916b-8176b981c9ff req-456ecdbd-a90f-498a-bc88-743bf000a934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "name": "network-vif-plugged", "status": "completed", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:46.410562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a3b6888f-b8a8-4863-916b-8176b981c9ff req-456ecdbd-a90f-498a-bc88-743bf000a934 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.416026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a3b6888f-b8a8-4863-916b-8176b981c9ff req-456ecdbd-a90f-498a-bc88-743bf000a934 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.416963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a3b6888f-b8a8-4863-916b-8176b981c9ff req-456ecdbd-a90f-498a-bc88-743bf000a934 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.445046 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a3b6888f-b8a8-4863-916b-8176b981c9ff req-456ecdbd-a90f-498a-bc88-743bf000a934 service nova] Creating event network-vif-plugged:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:53:46.461323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a3b6888f-b8a8-4863-916b-8176b981c9ff req-456ecdbd-a90f-498a-bc88-743bf000a934 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085723 Oct 24 08:53:46.462182 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 356/728] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:46.474975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ec679f3-69e7-4aab-9fb7-b5d88dcb09e3 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab229ca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:46.624449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ec679f3-69e7-4aab-9fb7-b5d88dcb09e3 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.156503 Oct 24 08:53:46.625534 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 357/729] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:46 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:46.638426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:46.639556 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:46.650916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.653962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.654698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.659161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.661026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.662133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:47.183845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:47.198334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:47.203984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:47.208951 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6ba2332-dd83-4a13-a41e-cad83b3517df tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.580807 Oct 24 08:53:47.212706 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 358/730] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:46 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:47.221437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:47.224309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:47.238221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:47.239329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:47.239940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:47.241474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:47.246918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:47.247605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:47.450843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:47.459721 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dafc01d7-7ac6-4f00-a0cb-230d2a99481a tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1435 microversion: 2.1 time: 0.245625 Oct 24 08:53:47.479844 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 359/731] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:47 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1435 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:47.491647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:47.496087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:47.512215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:47.512825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:47.513429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:47.514233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:47.514929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:47.515568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:47.909380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:47.924417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14b88ba9-7716-4eb6-851b-d7dd8f27db2e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1541 microversion: 2.1 time: 0.443000 Oct 24 08:53:47.925013 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 360/732] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:47 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1541 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:47.944723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2d5c00d-21ab-4ea1-99ed-5f365f59bbe8 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3cb670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:48.039712 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2d5c00d-21ab-4ea1-99ed-5f365f59bbe8 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.110646 Oct 24 08:53:48.041220 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 361/733] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:47 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:48.052480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:48.061623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:48.073041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:48.073997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:48.075310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:48.076292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:48.076980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:48.078249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:48.431290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fee8e127-f972-477f-913f-b9adba42a51d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.387732 Oct 24 08:53:48.445895 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 362/734] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:53:48 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-interface => generated 284 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:48.455852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-aad5621c-9ef3-4a6b-b203-4a730643ac01 req-4b2da58d-f14f-43ac-84f0-fb8d99ca9ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa819ff1-4bb7-46be-8f11-827cfbf22d9a", "name": "network-vif-deleted", "tag": "c6bb9412-f7d3-47d4-996e-6fbdf09e66b4"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:48.492335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aad5621c-9ef3-4a6b-b203-4a730643ac01 req-4b2da58d-f14f-43ac-84f0-fb8d99ca9ea4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:48.493657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aad5621c-9ef3-4a6b-b203-4a730643ac01 req-4b2da58d-f14f-43ac-84f0-fb8d99ca9ea4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:48.495350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aad5621c-9ef3-4a6b-b203-4a730643ac01 req-4b2da58d-f14f-43ac-84f0-fb8d99ca9ea4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:48.521738 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-aad5621c-9ef3-4a6b-b203-4a730643ac01 req-4b2da58d-f14f-43ac-84f0-fb8d99ca9ea4 service nova] Creating event network-vif-deleted:c6bb9412-f7d3-47d4-996e-6fbdf09e66b4 for instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a on n-h2-master-1 Oct 24 08:53:48.534169 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-aad5621c-9ef3-4a6b-b203-4a730643ac01 req-4b2da58d-f14f-43ac-84f0-fb8d99ca9ea4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084995 Oct 24 08:53:48.536009 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 363/735] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:48.546468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:48.548731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:48.561510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:48.562874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:48.565093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:48.566803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:48.568055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:48.570640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:49.215099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:49.234689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:49.248054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:49.251936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c1cde0c-cc1e-41d8-a876-000f48f1401f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.713265 Oct 24 08:53:49.256077 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 364/736] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:48 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:49.262215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:49.291024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:49.312441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:49.322431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:49.323561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:49.326554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:49.327406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:49.328286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:49.398730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:49.399202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:49.399673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:49.401051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lazy-loading 'fault' on Instance uuid aa819ff1-4bb7-46be-8f11-827cfbf22d9a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:49.512333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e3382f1fcd40108c9d79cfbdf4337a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961eeb9727ed45d9874a81d495c0069a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:49.520505 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49c2da1d-6469-499f-8f36-d17e66d3baec tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 200 len: 1312 microversion: 2.1 time: 0.263170 Oct 24 08:53:49.555143 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 365/737] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:49 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:49.561228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44fab7eb-afd7-466b-97b5-62f4385a4929 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab229160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:49.631213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44fab7eb-afd7-466b-97b5-62f4385a4929 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.074824 Oct 24 08:53:49.639535 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 366/738] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:49 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:50.278769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:50.279392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:50.295579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:50.296087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:50.296538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:50.297281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:50.297795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:50.298249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:50.832596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:50.833404 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=30,nova_cell0:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:50.853673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:50.855327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:50.856638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb91f417-24c8-4df0-96d5-19f6eb36b797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 0.582483 Oct 24 08:53:50.888549 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 367/739] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:50 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:53:50.893545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:50.894171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] [instance: aa819ff1-4bb7-46be-8f11-827cfbf22d9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:50.904326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:50.910636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:50.911335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:50.912164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:50.912893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:50.914990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:50.948604 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] HTTP exception thrown: Instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a could not be found. Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Request method failure captured: Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a HTTP/1.1 Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlJUOEHcNrxYrd9ZEpqwHUOZ4dpsT2_8I9CxtEEXTyU02QKoU5qmNYQpfMhU0dnkN6soIUqQTC0ayYrKoT389K7-RJuZ212CsRuAzF7vRZMevB4Ib1-DQy1fl7NWlqEgy7gSwk1b7D_I8im8Pp1xWIPqLliYyslhybTjKvTkKKz2GbQ Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 961eeb9727ed45d9874a81d495c0069a Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1640976008 Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:53:50.953243 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/961eeb9727ed45d9874a81d495c0069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_961eeb9727ed45d9874a81d495c0069a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/961eeb9727ed45d9874a81d495c0069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/961eeb9727ed45d9874a81d495c0069a"}]}] Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1640976008 Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 961eeb9727ed45d9874a81d495c0069a Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1640976008 Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersAdminNegativeTestJSON-1640976008-project Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: f6e3382f1fcd40108c9d79cfbdf4337a Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1640976008-project Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: exception: Instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a could not be found. Oct 24 08:53:50.954890 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'aa819ff1-4bb7-46be-8f11-827cfbf22d9a'} Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a could not be found. Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:50.955721 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a could not be found. Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a could not be found. Oct 24 08:53:50.957048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:53:50.961748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] Returning 404 to user: Instance aa819ff1-4bb7-46be-8f11-827cfbf22d9a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:50.965355 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b780657f-87fe-4c86-a75c-ee6d512ae48b tempest-ServersAdminNegativeTestJSON-1640976008 tempest-ServersAdminNegativeTestJSON-1640976008-project] 10.222.0.25 "GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a" status: 404 len: 111 microversion: 2.1 time: 0.075285 Oct 24 08:53:50.969633 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 368/740] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:50 2022] GET /compute/v2.1/servers/aa819ff1-4bb7-46be-8f11-827cfbf22d9a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:50.976602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9819da8b-71b4-4bfe-9c8a-98e6f996bc57 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab2294c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:51.081329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9819da8b-71b4-4bfe-9c8a-98e6f996bc57 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.072379 Oct 24 08:53:51.081329 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 369/741] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:50 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:51.081329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-503f43f3-7269-447b-8ada-66a7909365ea req-63f1cf65-772f-4aa0-8f11-21b302538547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:51.097166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-503f43f3-7269-447b-8ada-66a7909365ea req-63f1cf65-772f-4aa0-8f11-21b302538547 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:51.097678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-503f43f3-7269-447b-8ada-66a7909365ea req-63f1cf65-772f-4aa0-8f11-21b302538547 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:51.098114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-503f43f3-7269-447b-8ada-66a7909365ea req-63f1cf65-772f-4aa0-8f11-21b302538547 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:51.123674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-503f43f3-7269-447b-8ada-66a7909365ea req-63f1cf65-772f-4aa0-8f11-21b302538547 service nova] Creating event network-changed:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:53:51.138956 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-503f43f3-7269-447b-8ada-66a7909365ea req-63f1cf65-772f-4aa0-8f11-21b302538547 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091791 Oct 24 08:53:51.139780 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 370/742] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:51.891348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:51.893653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:51.908554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:51.909324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:51.909923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:51.910832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:51.911442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:51.912023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:51.935515 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:52.086735 n-d-master-1 devstack@n-api.service[126920]: INFO nova.network.neutron [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] re-assign floating IP 172.35.3.33 from instance 30e0d237-fa1e-487c-ad63-48324bb20a2b Oct 24 08:53:52.239134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Building network info cache for instance {{(pid=126920) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:53:52.992038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:53.001325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:53.007068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:53.013107 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76880d21-ccfe-4ced-9559-838f109c76b9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 1.128752 Oct 24 08:53:53.013967 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 371/743] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:51 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:53.036897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11419d18-fafc-4df3-84d6-7a34c344f0df tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3c5ca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:53.111057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11419d18-fafc-4df3-84d6-7a34c344f0df tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.080299 Oct 24 08:53:53.111921 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 372/744] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:53 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:53.293097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f946fcf1-95e5-472f-82a9-9a2dedaf2f35 req-bf7efab7-61a8-401e-a9f7-f69e9946e9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7521a-d92d-4b96-aa95-37401af6f994", "tag": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:53.312973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f946fcf1-95e5-472f-82a9-9a2dedaf2f35 req-bf7efab7-61a8-401e-a9f7-f69e9946e9fd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:53.314206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f946fcf1-95e5-472f-82a9-9a2dedaf2f35 req-bf7efab7-61a8-401e-a9f7-f69e9946e9fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:53.316233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f946fcf1-95e5-472f-82a9-9a2dedaf2f35 req-bf7efab7-61a8-401e-a9f7-f69e9946e9fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:53.340295 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f946fcf1-95e5-472f-82a9-9a2dedaf2f35 req-bf7efab7-61a8-401e-a9f7-f69e9946e9fd service nova] Creating event network-changed:76ba2c49-878e-4e77-9bf7-f80d0562c8c5 for instance cdc7521a-d92d-4b96-aa95-37401af6f994 on n-h2-master-1 Oct 24 08:53:53.355894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f946fcf1-95e5-472f-82a9-9a2dedaf2f35 req-bf7efab7-61a8-401e-a9f7-f69e9946e9fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066224 Oct 24 08:53:53.357092 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 373/745] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:53.597748 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=9,nova_api:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:54.044123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:54.049261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:54.087001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:54.087886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:54.088583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:54.089647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:54.090334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:54.090989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.426783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Updating instance_info_cache with network_info: [{"id": "d95c40ef-3336-41c3-aece-9d1376ac44f0", "address": "fa:16:3e:fc:1d:fe", "network": {"id": "37d96780-2455-4d33-8875-f6279ac9d08e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709907634-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4bf7adacd2ba40e6b67fa07d8baefc4b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd95c40ef-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126920) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:53:55.426783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Building network info cache for instance {{(pid=126920) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:53:55.428401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:55.448551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:55.462826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:55.464418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-783f3c8f-92c1-4227-8a1b-741e96514b38 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1567 microversion: 2.25 time: 1.424198 Oct 24 08:53:55.464738 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 374/746] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:54 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1567 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:55.492110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64a8d6d8-59fb-43e9-bc3f-1ef7ca9e1ab4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3aea60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:55.595738 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64a8d6d8-59fb-43e9-bc3f-1ef7ca9e1ab4 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.119309 Oct 24 08:53:55.596253 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 375/747] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:55 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:55.600974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-14192708-1347-4d6f-a067-ddd70fe85710 req-c12fe514-88fe-4ff0-82fa-088e4866ecd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56a0887e-b5c7-47d7-ad5b-72297f386d40", "tag": "cdcac286-03e9-4041-84b1-896d805de241"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:55.629931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-14192708-1347-4d6f-a067-ddd70fe85710 req-c12fe514-88fe-4ff0-82fa-088e4866ecd6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.630652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-14192708-1347-4d6f-a067-ddd70fe85710 req-c12fe514-88fe-4ff0-82fa-088e4866ecd6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.631619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-14192708-1347-4d6f-a067-ddd70fe85710 req-c12fe514-88fe-4ff0-82fa-088e4866ecd6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.658124 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-14192708-1347-4d6f-a067-ddd70fe85710 req-c12fe514-88fe-4ff0-82fa-088e4866ecd6 service nova] Creating event network-changed:cdcac286-03e9-4041-84b1-896d805de241 for instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 on n-h1-master-1 Oct 24 08:53:55.667191 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-14192708-1347-4d6f-a067-ddd70fe85710 req-c12fe514-88fe-4ff0-82fa-088e4866ecd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068105 Oct 24 08:53:55.670270 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 376/748] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:56.495363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:56.496058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:56.516188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:56.516693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:56.517168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:56.518547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:56.518632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:56.519026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:56.780996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Updating instance_info_cache with network_info: [{"id": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5", "address": "fa:16:3e:eb:c2:6a", "network": {"id": "37d96780-2455-4d33-8875-f6279ac9d08e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709907634-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4bf7adacd2ba40e6b67fa07d8baefc4b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76ba2c49-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126920) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:53:56.790021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Releasing lock "refresh_cache-cdc7521a-d92d-4b96-aa95-37401af6f994" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:53:56.790881 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11ee21fa-2af8-4d53-a8fb-040403b32c3e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994/action" status: 202 len: 0 microversion: 2.1 time: 13.206204 Oct 24 08:53:56.791504 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 373/749] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:43 2022] POST /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994/action => generated 0 bytes in 13208 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 08:53:56.814107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28533b16-b9ae-4e47-8c5e-5c10c6009abd tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab2d14c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:56.949220 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28533b16-b9ae-4e47-8c5e-5c10c6009abd tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.148540 Oct 24 08:53:56.950600 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 374/750] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:56 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:56.963872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.33"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:57.289337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:57.304936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:57.311816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:57.314558 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2de6c3be-67b4-40a2-b062-e3e599d2dac5 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1557 microversion: 2.25 time: 0.824147 Oct 24 08:53:57.320973 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 377/751] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:56 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1557 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:57.347746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5b7cb40-5e50-4c9d-8f03-c2300b0af0ef tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '.version_select at 0x7f8dab3aea60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:57.357590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5b7cb40-5e50-4c9d-8f03-c2300b0af0ef tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:57.358842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5b7cb40-5e50-4c9d-8f03-c2300b0af0ef tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:57.360143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5b7cb40-5e50-4c9d-8f03-c2300b0af0ef tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:57.389538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5b7cb40-5e50-4c9d-8f03-c2300b0af0ef tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.048013 Oct 24 08:53:57.402264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 378/752] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Oct 24 08:53:57 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:57.410706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:57.412146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:57.433141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:57.433967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:57.434589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:57.435633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:57.437093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:57.437803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:57.510951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:57.519348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:57.520197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:57.521954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:57.524443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:57.525199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:57.528191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:57.917470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid f95b3010-cd07-42e1-81e5-e1cc4800988b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:57.958452 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a889b3fc-6ada-425f-a805-bd31aafbedf0 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 2050 microversion: 2.25 time: 0.554506 Oct 24 08:53:57.959784 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 379/753] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:57 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 2050 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:53:57.982897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e59c0703-557c-4419-beb0-a38be393bc9d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3c5dc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:58.056721 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e59c0703-557c-4419-beb0-a38be393bc9d tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.089916 Oct 24 08:53:58.069632 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 380/754] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:57 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:58.277464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1427927999", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "50ce0676-de1a-4c1e-8b5e-2aa8413c2173"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:58.342848 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] HTTP exception thrown: Floating IP 172.35.3.33 is not associated with instance 30e0d237-fa1e-487c-ad63-48324bb20a2b. Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Request method failure captured: Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action HTTP/1.1 Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 48 Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWB-5tknYE7ONj7hbh-UicL5mWp0YcfPibdnwTlAMqiuulFiufBGwQoWEX_HpyHLoO2UeeqkSHH3bU-AU37No_KYxIXVJzZNVn9_uyPgfrT4x6IdBejixEm-zql_thNS_lcoAvNyNpvMH8Q-VhKq-uiziQx5Nv07mvM7a8JlJbw2w Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:53:58.345850 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}] Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 89ee4538fd234ed7b8137861bfb534d3 Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: {"removeFloatingIp": {"address": "172.35.3.33"}} Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:53:58.347498 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP 172.35.3.33 is not associated with instance 30e0d237-fa1e-487c-ad63-48324bb20a2b. Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '30e0d237-fa1e-487c-ad63-48324bb20a2b', 'body': {'removeFloatingIp': {'address': '172.35.3.33'}}} Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.3.33 is not associated with instance 30e0d237-fa1e-487c-ad63-48324bb20a2b. Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:58.348433 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.3.33 is not associated with instance 30e0d237-fa1e-487c-ad63-48324bb20a2b. Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:53:58.349808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Returning 409 to user: Floating IP 172.35.3.33 is not associated with instance 30e0d237-fa1e-487c-ad63-48324bb20a2b. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:58.350289 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f247f3e-d871-4c25-9a69-bfa543621bb2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action" status: 409 len: 145 microversion: 2.1 time: 1.397997 Oct 24 08:53:58.350647 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 375/755] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:56 2022] POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action => generated 145 bytes in 1399 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:53:58.359797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.33"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:58.394633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] validate_networks() for [('50ce0676-de1a-4c1e-8b5e-2aa8413c2173', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:58.553198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:58.561187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:58.561989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:58.562605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:58.564979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:58.565980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:58.566603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:58.572234 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:58.915009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "refresh_cache-cdc7521a-d92d-4b96-aa95-37401af6f994" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:53:58.915637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquired lock "refresh_cache-cdc7521a-d92d-4b96-aa95-37401af6f994" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:53:59.166960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:59.167502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:59.167838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:59.168248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:59.168662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:59.182298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:59.183089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:59.183721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:59.184985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:59.186372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:59.187372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:59.217558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:59.225829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for user cc0be0ed857d4c96b26724144e20d766 and project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:59.249134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:59.253393 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:59.290230 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:59.327207 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3cfd67ec-bdcd-4960-8022-7de5cf2b6e91 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.053848 Oct 24 08:53:59.328491 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 381/756] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 24 08:53:59.970715 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1561539273", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:00.156038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:54:00.156038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:54:00.156038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:54:00.156944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:54:00.159610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:54:00.173775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.175218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.176277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.178462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.179377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.180112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.210909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Getting quotas for project 22fe645c49214c7d84b9081e3f481de9. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:00.219198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Getting quotas for user 9fa08ec12fa74ec3af765850e8bbc609 and project 22fe645c49214c7d84b9081e3f481de9. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:00.238403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:54:00.241562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:54:00.384875 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ed1c3f8-6a04-4fb0-aeca-3140bd59c41d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.053646 Oct 24 08:54:00.396859 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 382/757] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 08:54:00.411331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f39ac55a-bf05-4c17-9128-63ce7331094c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3cb550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:00.517186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f39ac55a-bf05-4c17-9128-63ce7331094c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.116283 Oct 24 08:54:00.520495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 383/758] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:00 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:00.534527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:00.535823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:00.559537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.562219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.563255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.566598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.569034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.570000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.793796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:00.820670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:00.832464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:00.836671 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a4bcae5-48e0-4cda-a198-dbf260c3c17e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1266 microversion: 2.25 time: 0.312598 Oct 24 08:54:00.841414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 384/759] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:00 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:00.878129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2532ee88-ec9b-4c24-b203-6bf247455a14 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:00.881884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2532ee88-ec9b-4c24-b203-6bf247455a14 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:00.986875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2532ee88-ec9b-4c24-b203-6bf247455a14 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:00.998069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2532ee88-ec9b-4c24-b203-6bf247455a14 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:00.999430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2532ee88-ec9b-4c24-b203-6bf247455a14 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:01.028437 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2532ee88-ec9b-4c24-b203-6bf247455a14 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1454 microversion: 2.91 time: 0.172268 Oct 24 08:54:01.030748 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 385/760] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:00 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:01.535681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5098b83f-00f5-4d0b-afa5-a0b6954c522e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab56a550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:01.647700 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5098b83f-00f5-4d0b-afa5-a0b6954c522e tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.115933 Oct 24 08:54:01.659786 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 386/761] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:01 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:01.696932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Building network info cache for instance {{(pid=126920) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:54:01.711024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9d5f8ec9-b233-4e20-9f6b-e98d99122599 req-71fedb8f-fa31-42c4-aa2d-ec463088d696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7521a-d92d-4b96-aa95-37401af6f994", "tag": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:01.722475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9d5f8ec9-b233-4e20-9f6b-e98d99122599 req-71fedb8f-fa31-42c4-aa2d-ec463088d696 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:01.723224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9d5f8ec9-b233-4e20-9f6b-e98d99122599 req-71fedb8f-fa31-42c4-aa2d-ec463088d696 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:01.724034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9d5f8ec9-b233-4e20-9f6b-e98d99122599 req-71fedb8f-fa31-42c4-aa2d-ec463088d696 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:01.738312 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9d5f8ec9-b233-4e20-9f6b-e98d99122599 req-71fedb8f-fa31-42c4-aa2d-ec463088d696 service nova] Creating event network-changed:76ba2c49-878e-4e77-9bf7-f80d0562c8c5 for instance cdc7521a-d92d-4b96-aa95-37401af6f994 on n-h2-master-1 Oct 24 08:54:01.746271 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9d5f8ec9-b233-4e20-9f6b-e98d99122599 req-71fedb8f-fa31-42c4-aa2d-ec463088d696 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039545 Oct 24 08:54:01.747778 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 387/762] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:54:01.872548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:01.873278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:01.889334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:01.889852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:01.890299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:01.891057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:01.892101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:01.913282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:02.298209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:02.330833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:02.336389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:02.349282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a4fbbb89-d986-44b8-8cbf-7ec7d13feee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1314 microversion: 2.25 time: 0.481431 Oct 24 08:54:02.351148 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 388/763] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:01 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:02.364174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:02.369725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:02.421930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:02.424479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:02.428322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:02.435675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:02.440379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:02.441534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:02.949815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:02.963121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:02.965216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:02.981609 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f49c90e-f402-45ef-a922-16583b337a56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1506 microversion: 2.91 time: 0.628576 Oct 24 08:54:02.984925 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 389/764] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:02 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:03.331584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7499ed26-e44d-4006-8ebc-aed9cee9e946 tempest-ListImagesTestJSON-978844643 tempest-ListImagesTestJSON-978844643-project] Calling method '.version_select at 0x7f8dab3c5550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:03.449224 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7499ed26-e44d-4006-8ebc-aed9cee9e946 tempest-ListImagesTestJSON-978844643 tempest-ListImagesTestJSON-978844643-project] 10.222.0.25 "GET /compute/v2.1/images/a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2" status: 200 len: 784 microversion: 2.1 time: 0.461382 Oct 24 08:54:03.461715 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 390/765] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:02 2022] GET /compute/v2.1/images/a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2 => generated 784 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:03.465352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27c6168c-b65d-4a07-91bd-13ba9c7acd71 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab1b04c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:03.563961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27c6168c-b65d-4a07-91bd-13ba9c7acd71 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.103747 Oct 24 08:54:03.568987 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 391/766] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:03 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:03.582159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:03.584659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:03.600568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:03.606502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:03.610273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:03.611411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:03.620486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:03.622128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:03.974613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Updating instance_info_cache with network_info: [{"id": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5", "address": "fa:16:3e:eb:c2:6a", "network": {"id": "37d96780-2455-4d33-8875-f6279ac9d08e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709907634-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4bf7adacd2ba40e6b67fa07d8baefc4b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76ba2c49-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126920) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:54:03.983475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Releasing lock "refresh_cache-cdc7521a-d92d-4b96-aa95-37401af6f994" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:54:03.990163 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-83cf4841-f60d-45d3-b0fe-0a91fa2b42a8 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994/action" status: 202 len: 0 microversion: 2.1 time: 5.634649 Oct 24 08:54:03.998304 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 376/767] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:58 2022] POST /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994/action => generated 0 bytes in 5644 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 24 08:54:04.011110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f943a3cd-a940-4f99-b528-a3e9708886ce tempest-ListImagesTestJSON-978844643 tempest-ListImagesTestJSON-978844643-project] Calling method '.version_select at 0x7f8dab26c700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.069050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.083619 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.105157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.118063 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e75112d6-0f79-45a2-b82c-5544c625f1ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1320 microversion: 2.25 time: 0.545834 Oct 24 08:54:04.119245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 392/768] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:03 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1320 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:04.136748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.137915 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:04.156181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.164527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.165001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.165818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.166301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.166738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.173332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f943a3cd-a940-4f99-b528-a3e9708886ce tempest-ListImagesTestJSON-978844643 tempest-ListImagesTestJSON-978844643-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.168125 Oct 24 08:54:04.180296 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 377/769] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:03 2022] GET /compute/v2.1/images => generated 445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:04.187242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.196012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:04.211872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.212369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.212815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.219463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.220593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.221051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.224238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:04.415649 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7627e887-faad-40b2-8d0b-002030b338c2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 204 len: 0 microversion: 2.1 time: 0.294547 Oct 24 08:54:04.416627 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 393/770] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:04 2022] DELETE /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:04.428060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-880ed799-9a75-46d2-a42e-b5234ef24a1d tempest-ListImagesTestJSON-978844643 tempest-ListImagesTestJSON-978844643-project] Calling method '.version_select at 0x7f8dab3eea60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.515082 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-880ed799-9a75-46d2-a42e-b5234ef24a1d tempest-ListImagesTestJSON-978844643 tempest-ListImagesTestJSON-978844643-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.094368 Oct 24 08:54:04.516374 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 394/771] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:54:04 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:04.525794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.535219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.33"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:04.538534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:04.554322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.555797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.556168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.556870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.559763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.560803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.561486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.565646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.588541 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-429d972f-0167-48c9-9bbd-69bbaab3822c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1512 microversion: 2.91 time: 0.406736 Oct 24 08:54:04.589151 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 378/772] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:04 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:04.633694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-578c46b4-8fc0-4ac6-8f71-554db398d2fc tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab2d10d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.646705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:54:04.647527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquired lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:54:05.270773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-578c46b4-8fc0-4ac6-8f71-554db398d2fc tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.656277 Oct 24 08:54:05.294219 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 379/773] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:04 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:05.300089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:05.300721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:05.320601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:05.326134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:05.326885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:05.327841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:05.338083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:05.338807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:05.674428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.689810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.695993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.697684 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5750ab35-680e-438e-8ee5-c05b85b4be23 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.402124 Oct 24 08:54:05.701330 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 380/774] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:05 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:05.722732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:05.724445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:05.731993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:05.734840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:05.737065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:05.738119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:05.739717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:05.742258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:05.887243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.903204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.904868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.921751 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ee2f167-6561-4106-a1e2-747489f18949 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1512 microversion: 2.91 time: 0.217697 Oct 24 08:54:05.933339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 381/775] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:05 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:06.309329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f75cd02e-f30b-45b4-a749-da74a944ab0a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab408670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:06.401037 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f75cd02e-f30b-45b4-a749-da74a944ab0a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.103184 Oct 24 08:54:06.402058 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 382/776] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:06 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:06.727305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:06.728379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:06.746860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:06.747732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:06.748443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:06.749470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:06.750237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:06.751085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.206716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.221237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.226116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.234234 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb6167ea-9acb-4b72-a53c-9c9ee02c3f9b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.511356 Oct 24 08:54:07.236031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 383/777] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:06 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:07.247483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:07.248375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:07.265766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.268555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.269825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.270596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.273077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.276503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.407934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.420977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.426803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.442568 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e8f2646-cb89-448e-8c7d-dea87fe21aff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1512 microversion: 2.91 time: 0.202115 Oct 24 08:54:07.453322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 384/778] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:07 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:07.458414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:07.471690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:07.490522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.490988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.491443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.492166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.496128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.497106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.563264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:07.776413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ebe580e7-9cb5-4a91-a092-25b53abeb9a6 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 204 len: 0 microversion: 2.1 time: 0.326196 Oct 24 08:54:07.781177 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 385/779] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:07 2022] DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:07.801206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db6f24a5-59c2-4b2a-b23e-9ef1b2a9cff0 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab695d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:07.932676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db6f24a5-59c2-4b2a-b23e-9ef1b2a9cff0 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1422 microversion: 2.1 time: 0.144021 Oct 24 08:54:07.933282 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 386/780] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:07 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1422 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:08.041571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-770171729", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "730286020", "adminPass": "***", "networks": [{"uuid": "cfe5645f-097c-4ff9-ae1f-567ed4f8cc90"}], "security_groups": [{"name": "tempest-securitygroup--2137931310"}], "key_name": "tempest-keypair-1822886237", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:08.462792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] validate_networks() for [('cfe5645f-097c-4ff9-ae1f-567ed4f8cc90', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:54:09.485025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:54:10.195797 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:10.384831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:54:10.385379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:54:10.385828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:54:10.386293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:54:10.386756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:54:10.416236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:10.416753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:10.417650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:10.419815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:10.423739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:10.424577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:10.480271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Getting quotas for project 8d2c394d0ceb40f298afa7355102bfd5. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:10.495913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Getting quotas for user 4099c569c4fe489fa349ee29e6974713 and project 8d2c394d0ceb40f298afa7355102bfd5. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:10.534352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:54:10.538705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:54:10.673313 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eca9efbb-f566-4249-96eb-9d106eec83f2 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.636886 Oct 24 08:54:10.675922 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 387/781] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:54:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:54:10.689862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:10.692907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:10.718385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:10.721627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:10.724383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:10.727603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:10.731018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:10.734426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:10.991584 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=14 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:11.632473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:11.657905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:11.661609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:11.662745 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd99cde3-04e8-4595-b2e7-ee21ec8c719a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.984942 Oct 24 08:54:11.663319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 388/782] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:10 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:11.688353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:11.690007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:11.715119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:11.715625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:11.716066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:11.716780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:11.719939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:11.726485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:12.187231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:12.201364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:12.204782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:12.213062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-202c59e3-2776-40af-9fbc-935714a5870a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1533 microversion: 2.91 time: 0.546396 Oct 24 08:54:12.214182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 389/783] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:11 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1533 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:12.223867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-dca3e94a-5ce0-4f0c-87f8-6ea6d59a8af2 req-02e67847-f68e-4a42-810b-324306605979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc7521a-d92d-4b96-aa95-37401af6f994", "name": "network-vif-deleted", "tag": "76ba2c49-878e-4e77-9bf7-f80d0562c8c5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:12.239967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dca3e94a-5ce0-4f0c-87f8-6ea6d59a8af2 req-02e67847-f68e-4a42-810b-324306605979 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:12.240470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dca3e94a-5ce0-4f0c-87f8-6ea6d59a8af2 req-02e67847-f68e-4a42-810b-324306605979 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:12.240958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dca3e94a-5ce0-4f0c-87f8-6ea6d59a8af2 req-02e67847-f68e-4a42-810b-324306605979 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:12.253957 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-dca3e94a-5ce0-4f0c-87f8-6ea6d59a8af2 req-02e67847-f68e-4a42-810b-324306605979 service nova] Creating event network-vif-deleted:76ba2c49-878e-4e77-9bf7-f80d0562c8c5 for instance cdc7521a-d92d-4b96-aa95-37401af6f994 on n-h2-master-1 Oct 24 08:54:12.259646 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-dca3e94a-5ce0-4f0c-87f8-6ea6d59a8af2 req-02e67847-f68e-4a42-810b-324306605979 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043980 Oct 24 08:54:12.260582 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 390/784] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:12.267317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-352dbbf2-8d05-4e65-9318-388fb1a18eb1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3d5c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:12.340577 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-352dbbf2-8d05-4e65-9318-388fb1a18eb1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1431 microversion: 2.1 time: 0.077516 Oct 24 08:54:12.342132 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 391/785] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:12 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1431 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:12.359695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b1984f07-92b0-48cf-997b-032855c48d33 req-4ea63f12-8d40-4ed0-8e90-44aa5cbb8dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aac9f24-0a77-40c9-b1e3-9c852bf29fe8", "tag": "fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:12.386254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b1984f07-92b0-48cf-997b-032855c48d33 req-4ea63f12-8d40-4ed0-8e90-44aa5cbb8dba service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:12.387140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b1984f07-92b0-48cf-997b-032855c48d33 req-4ea63f12-8d40-4ed0-8e90-44aa5cbb8dba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:12.387882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b1984f07-92b0-48cf-997b-032855c48d33 req-4ea63f12-8d40-4ed0-8e90-44aa5cbb8dba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:12.409382 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b1984f07-92b0-48cf-997b-032855c48d33 req-4ea63f12-8d40-4ed0-8e90-44aa5cbb8dba service nova] Creating event network-changed:fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8 for instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 on n-h2-master-1 Oct 24 08:54:12.418411 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b1984f07-92b0-48cf-997b-032855c48d33 req-4ea63f12-8d40-4ed0-8e90-44aa5cbb8dba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072755 Oct 24 08:54:12.419362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 392/786] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:12.429227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:12.430797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:12.440755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:12.441966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:12.442535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:12.443538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:12.444400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:12.445731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:12.593781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Updating instance_info_cache with network_info: [{"id": "d95c40ef-3336-41c3-aece-9d1376ac44f0", "address": "fa:16:3e:fc:1d:fe", "network": {"id": "37d96780-2455-4d33-8875-f6279ac9d08e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709907634-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4bf7adacd2ba40e6b67fa07d8baefc4b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd95c40ef-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:54:12.641063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Releasing lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:54:12.644750 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9802595e-ecaf-4d92-a747-9918772d21dc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action" status: 202 len: 0 microversion: 2.1 time: 8.127176 Oct 24 08:54:12.650126 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 395/787] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:54:04 2022] POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action => generated 0 bytes in 8133 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 08:54:12.734622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:12.753899 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a61275ed-8d36-4a69-bc12-7f9103dd0d1d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1314 microversion: 2.1 time: 0.332375 Oct 24 08:54:12.761593 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 393/788] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:12 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:12.780646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d325beb-4822-480a-a99c-864afe16efdc tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3d5700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:12.904240 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d325beb-4822-480a-a99c-864afe16efdc tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 200 len: 1431 microversion: 2.1 time: 0.140014 Oct 24 08:54:12.904831 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 394/789] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:12 2022] GET /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 1431 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:12.921264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e8128654-02be-40e7-aba5-e007a4f183d2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '.version_select at 0x7f8dab464b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:13.159538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:13.160628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:13.174279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:13.176553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:13.177856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:13.179429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:13.180836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:13.181704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:13.440872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lazy-loading 'services' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:13.484207 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd3c67dd-2823-4637-841a-696ffcc560d0 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1938 microversion: 2.91 time: 0.827518 Oct 24 08:54:13.485479 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 396/790] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:12 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1938 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:13.509264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:13.510536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:13.517536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:13.517877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:13.518260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:13.518977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:13.519442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:13.519874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:13.661851 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e8128654-02be-40e7-aba5-e007a4f183d2 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/21c7b11b-703f-4679-995d-8e0b42628c16" status: 200 len: 183 microversion: 2.1 time: 0.748384 Oct 24 08:54:13.663225 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 395/791] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:54:12 2022] GET /compute/v2.1/os-floating-ips/21c7b11b-703f-4679-995d-8e0b42628c16 => generated 183 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:13.668394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:13.669323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:13.685603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:13.686113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:13.686557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:13.693079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:13.694410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:13.694880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:14.277568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:14.287358 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0593e88d-8a6e-429f-b17a-bea78bcf9c64 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1466 microversion: 2.1 time: 0.622797 Oct 24 08:54:14.301581 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 396/792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:13 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1466 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:14.329555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:14.334071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:14.347414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:14.351161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:14.351935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:14.354210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:14.362187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:14.374611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:14.376631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:14.376850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:14.379385 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee4b2951-67fc-4f53-8ea7-4076f1b83378 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.892209 Oct 24 08:54:14.379825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:14.381717 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 397/793] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:13 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:14.391278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.33"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:14.607770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lazy-loading 'services' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:14.686088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47aa387c-a81c-416e-8fd7-290376afd036 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1938 microversion: 2.91 time: 0.384328 Oct 24 08:54:14.687649 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 397/794] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:14 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1938 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:14.694072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:14.695055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:14.702408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:14.705927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:14.707321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:14.722538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:14.724957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:14.725790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:15.154815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:15.165627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:15.169405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:15.171857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:15.175896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:15.178870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:15.179656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:15.199410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:15.208763 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c2165fb-54b5-4c08-adf2-413306d3e5f1 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 0.519694 Oct 24 08:54:15.220673 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:15.224019 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 398/795] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:14 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:15.229133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5390421b-9aae-47f1-ba1e-954187fc6a12 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab456ca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:16.168274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:54:16.169220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquired lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:54:16.199557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5390421b-9aae-47f1-ba1e-954187fc6a12 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "DELETE /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b" status: 204 len: 0 microversion: 2.1 time: 0.974326 Oct 24 08:54:16.200226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 399/796] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:15 2022] DELETE /compute/v2.1/images/58f5e154-d1e7-4c2f-979e-b16c15cc788b => generated 0 bytes in 976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:16.206495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}, {"server_uuid": "267d3905-ae46-421f-bafd-76dfad07ef6b", "name": "network-vif-deleted", "tag": "6b874ace-2256-458d-b7ef-e92b59844ade"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:16.228668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:16.231155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:16.232163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:16.238390 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:16.270350 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] Creating event network-changed:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:54:16.271323 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] Creating event network-vif-deleted:6b874ace-2256-458d-b7ef-e92b59844ade for instance 267d3905-ae46-421f-bafd-76dfad07ef6b on n-h2-master-1 Oct 24 08:54:16.292501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c4b289cb-c6fa-403c-98ad-d900cd5dc8ca req-6fb8b03f-4331-4d97-a887-250301884a22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.090595 Oct 24 08:54:16.306625 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 400/797] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:16.316633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:16.334352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:16.334801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:16.335256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:16.338698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:16.339493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:16.341798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:16.409235 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe76c575-8f5c-43a3-82ee-1d8c681cae8c tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.100775 Oct 24 08:54:16.410549 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 401/798] 10.222.0.25 () {60 vars in 1217 bytes} [Mon Oct 24 08:54:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:54:16.420342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:16.421650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:16.435725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:16.436790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:16.437549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:16.438816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:16.439554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:16.440230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.339121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:17.353344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:17.354861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:17.356038 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7cef8b76-a706-49c3-a4c9-eef28c39ad92 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.944303 Oct 24 08:54:17.356611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 402/799] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:16 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:17.381376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-68e1d79d-88b3-44cb-8170-6c23100106ac req-4fd8a108-5fb9-4d94-bbc9-355ac41324d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "name": "network-vif-unplugged", "status": "completed", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:17.393919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68e1d79d-88b3-44cb-8170-6c23100106ac req-4fd8a108-5fb9-4d94-bbc9-355ac41324d8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.394774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68e1d79d-88b3-44cb-8170-6c23100106ac req-4fd8a108-5fb9-4d94-bbc9-355ac41324d8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.395453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68e1d79d-88b3-44cb-8170-6c23100106ac req-4fd8a108-5fb9-4d94-bbc9-355ac41324d8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.409617 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-68e1d79d-88b3-44cb-8170-6c23100106ac req-4fd8a108-5fb9-4d94-bbc9-355ac41324d8 service nova] Creating event network-vif-unplugged:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:54:17.416149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-68e1d79d-88b3-44cb-8170-6c23100106ac req-4fd8a108-5fb9-4d94-bbc9-355ac41324d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044965 Oct 24 08:54:17.418821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 403/800] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:17.426177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-524538c0-9975-403c-8508-c4a9c05502de tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '.version_select at 0x7f8dab3d5160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:17.468772 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-524538c0-9975-403c-8508-c4a9c05502de tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] HTTP exception thrown: Image not found. Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-524538c0-9975-403c-8508-c4a9c05502de tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Request method failure captured: Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca HTTP/1.1 Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJFs4XcMNiHmOfBVxQ1oXf0WMuOdjhEsj491XKStvFJ5roQcAGAkMafI9pviGYK3OiWilMWcCraamQvJ21ZDqJC1WvpWYUljh2WWUyiljVg6U0y9Dt9sBKyCqgZOXE2CAKhy3d41an8Ina_toBHg-RPGL2sYT7mfXuIeblAzhg810M Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 96ab82000972421c96022c2711beb014 Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:54:17.470763 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96ab82000972421c96022c2711beb014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96ab82000972421c96022c2711beb014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96ab82000972421c96022c2711beb014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96ab82000972421c96022c2711beb014"}]}] Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 96ab82000972421c96022c2711beb014 Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerTestJSON-9511904-project Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c2b9360313da41e1905c695c37020876 Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerTestJSON-9511904-project Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8a2f7cdd-88de-4e55-ad5c-55fd62e95fca'} Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:17.472204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8a2f7cdd-88de-4e55-ad5c-55fd62e95fca to delete Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.473174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a2f7cdd-88de-4e55-ad5c-55fd62e95fca could not be found. Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:17.475007 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-524538c0-9975-403c-8508-c4a9c05502de tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-524538c0-9975-403c-8508-c4a9c05502de tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "DELETE /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca" status: 404 len: 62 microversion: 2.1 time: 0.052282 Oct 24 08:54:17.477746 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 404/801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:17 2022] DELETE /compute/v2.1/images/8a2f7cdd-88de-4e55-ad5c-55fd62e95fca => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:54:17.480867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:17.482038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:17.490655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.491436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.492901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.493833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.494461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.495050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.850847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:17.865104 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f03dfe6-5641-4539-afa6-c194315ad128 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 0.387639 Oct 24 08:54:17.867359 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 405/802] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:17 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:17.880156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:17.881092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:17.895941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.897225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.897911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.898906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.899427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.899873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.958263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lazy-loading 'flavor' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:18.408036 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-872ee672-1bbf-4474-ab33-9f4a2cdf8df3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action" status: 202 len: 0 microversion: 2.91 time: 0.531044 Oct 24 08:54:18.409747 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 406/803] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:54:17 2022] POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:18.415561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:18.423033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:18.454553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:18.455427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:18.456167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:18.461196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:18.462084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:18.462757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:18.533986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:18.665438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 08:54:18.775030 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa11f868-9ecd-4ffe-aac6-b7663c811ccb tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 204 len: 0 microversion: 2.1 time: 0.361683 Oct 24 08:54:18.776198 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 407/804] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:18 2022] DELETE /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:18.783596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:18.790202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:18.805248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:18.809591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:18.812142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:18.814053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:18.816674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:18.818330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.292589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:19.310230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:19.318632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:19.327304 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c96abf90-8d66-419a-980e-29c16df6e7a6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.543545 Oct 24 08:54:19.331407 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 408/805] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:18 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:19.343762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:19.344773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:19.360795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.362190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.365157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.367156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.370316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.371007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.547212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:19.557324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:19.565548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:19.588951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd953fd6-6795-410d-a0e9-67cf7f81a4a6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.252259 Oct 24 08:54:19.590088 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 409/806] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:19 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:19.611579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5d9b4101-5a4c-4eda-858e-1a8ef63eb08f req-a5d592f0-dd95-4e93-8502-439424dd6d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:19.631103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5d9b4101-5a4c-4eda-858e-1a8ef63eb08f req-a5d592f0-dd95-4e93-8502-439424dd6d8d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.633867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5d9b4101-5a4c-4eda-858e-1a8ef63eb08f req-a5d592f0-dd95-4e93-8502-439424dd6d8d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.634361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5d9b4101-5a4c-4eda-858e-1a8ef63eb08f req-a5d592f0-dd95-4e93-8502-439424dd6d8d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.658023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5d9b4101-5a4c-4eda-858e-1a8ef63eb08f req-a5d592f0-dd95-4e93-8502-439424dd6d8d service nova] Creating event network-changed:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:54:19.673406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5d9b4101-5a4c-4eda-858e-1a8ef63eb08f req-a5d592f0-dd95-4e93-8502-439424dd6d8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079849 Oct 24 08:54:19.674075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 410/807] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:19.680972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:19.685428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:19.704156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.704667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.705258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.706137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.707650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.708145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.976634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Updating instance_info_cache with network_info: [{"id": "d95c40ef-3336-41c3-aece-9d1376ac44f0", "address": "fa:16:3e:fc:1d:fe", "network": {"id": "37d96780-2455-4d33-8875-f6279ac9d08e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709907634-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4bf7adacd2ba40e6b67fa07d8baefc4b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd95c40ef-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:54:19.996862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Releasing lock "refresh_cache-30e0d237-fa1e-487c-ad63-48324bb20a2b" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:54:19.997894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-823cfe7f-2d1d-4795-9983-9dd658e94bcc tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action" status: 202 len: 0 microversion: 2.1 time: 5.614379 Oct 24 08:54:19.999051 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 398/808] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:54:14 2022] POST /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b/action => generated 0 bytes in 5616 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 08:54:20.008913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:20.009742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:20.026582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.031644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.032245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.035715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.036270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.036729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.326412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:20.335197 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-885026bf-aa7b-4dd4-9979-a1e1026450c7 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 0.334774 Oct 24 08:54:20.342210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:20.350644 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 399/809] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:19 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:20.354045 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-142bca86-5a29-4bc6-8f55-ee685b71766a tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1472 microversion: 2.1 time: 0.678449 Oct 24 08:54:20.360200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 411/810] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:19 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1472 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:20.368950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-91285e92-7ed2-4049-9e32-ed9be437df13 req-b76bad77-7a3d-4b97-8b3c-54c06e48c4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aac9f24-0a77-40c9-b1e3-9c852bf29fe8", "name": "network-vif-plugged", "status": "completed", "tag": "fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:20.380343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:20.381007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:20.386021 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:20.401472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-91285e92-7ed2-4049-9e32-ed9be437df13 req-b76bad77-7a3d-4b97-8b3c-54c06e48c4e0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.401965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-91285e92-7ed2-4049-9e32-ed9be437df13 req-b76bad77-7a3d-4b97-8b3c-54c06e48c4e0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.402408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-91285e92-7ed2-4049-9e32-ed9be437df13 req-b76bad77-7a3d-4b97-8b3c-54c06e48c4e0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.405335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.414159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.414607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.418255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.418748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.419191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.447876 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-91285e92-7ed2-4049-9e32-ed9be437df13 req-b76bad77-7a3d-4b97-8b3c-54c06e48c4e0 service nova] Creating event network-vif-plugged:fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8 for instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 on n-h2-master-1 Oct 24 08:54:20.454347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-91285e92-7ed2-4049-9e32-ed9be437df13 req-b76bad77-7a3d-4b97-8b3c-54c06e48c4e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101560 Oct 24 08:54:20.456237 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 400/811] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:20.465564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:20.466785 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] HTTP exception thrown: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.467402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Request method failure captured: Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 HTTP/1.1 Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWB-5tknYE7ONj7hbh-UicL5mWp0YcfPibdnwTlAMqiuulFiufBGwQoWEX_HpyHLoO2UeeqkSHH3bU-AU37No_KYxIXVJzZNVn9_uyPgfrT4x6IdBejixEm-zql_thNS_lcoAvNyNpvMH8Q-VhKq-uiziQx5Nv07mvM7a8JlJbw2w Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:54:20.481451 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}] Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 89ee4538fd234ed7b8137861bfb534d3 Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: exception: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.482870 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'cdc7521a-d92d-4b96-aa95-37401af6f994'} Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:20.483594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.486048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.488817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Returning 404 to user: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:20.488817 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3f5abf5-9751-4589-a102-623e706b4821 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 404 len: 111 microversion: 2.1 time: 0.121407 Oct 24 08:54:20.497589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 412/812] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:20 2022] DELETE /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:20.519271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.520035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.520684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.521605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.522226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.522818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.522994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:20.524004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: cdc7521a-d92d-4b96-aa95-37401af6f994] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:20.620964 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:20.637784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.638413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.644824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.648663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.651550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.657934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.698823 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] HTTP exception thrown: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Request method failure captured: Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 HTTP/1.1 Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWB-5tknYE7ONj7hbh-UicL5mWp0YcfPibdnwTlAMqiuulFiufBGwQoWEX_HpyHLoO2UeeqkSHH3bU-AU37No_KYxIXVJzZNVn9_uyPgfrT4x6IdBejixEm-zql_thNS_lcoAvNyNpvMH8Q-VhKq-uiziQx5Nv07mvM7a8JlJbw2w Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:54:20.716827 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}] Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 89ee4538fd234ed7b8137861bfb534d3 Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: exception: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.718307 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'cdc7521a-d92d-4b96-aa95-37401af6f994'} Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:20.719078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. Oct 24 08:54:20.720212 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:20.721246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Returning 404 to user: Instance cdc7521a-d92d-4b96-aa95-37401af6f994 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:20.722748 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3a2906e-6041-48d6-bfa5-6f9e66b0f90f tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994" status: 404 len: 111 microversion: 2.1 time: 0.217191 Oct 24 08:54:20.723685 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 413/813] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:20 2022] GET /compute/v2.1/servers/cdc7521a-d92d-4b96-aa95-37401af6f994 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:20.737829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:20.738594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:20.746152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.747671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.748915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.750279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:20.751919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:20.752515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:20.910236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:20.934135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:20.946009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:20.965159 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d704ef62-9540-44fc-8411-097cf8853554 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.240294 Oct 24 08:54:20.967193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 414/814] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:20 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:20.991758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7f1bf0e-de6e-4566-93fb-8810d2c22e1e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '.version_select at 0x7f8dab476430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:21.435967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:21.448445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:21.452697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:21.455244 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-041dd068-67c3-4234-928f-88572b6ca47e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1362 microversion: 2.25 time: 0.995345 Oct 24 08:54:21.460060 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 401/815] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:20 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1362 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:21.785340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-876494541", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "31dc29dd-e555-4598-9b05-c8d1c0634162"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:21.887413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] validate_networks() for [('31dc29dd-e555-4598-9b05-c8d1c0634162', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:54:22.662665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:54:22.665156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:54:22.670018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:54:22.671639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:54:22.674031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:54:22.708490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:22.709282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:22.709752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:22.710536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:22.710930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:22.711530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:22.748929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Getting quotas for project c25289f0047040a393894b2eec720066. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:22.757585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Getting quotas for user aec89a12c88145e4b34615836b7a690b and project c25289f0047040a393894b2eec720066. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:22.793454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:54:22.800604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:54:22.863254 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401790 Oct 24 08:54:22.863946 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 402/816] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:54:22.880956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:22.893078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:22.901554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:22.902288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:22.902919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:22.903946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:22.904582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:22.905160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.174546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:23.183887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7f1bf0e-de6e-4566-93fb-8810d2c22e1e tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/21c7b11b-703f-4679-995d-8e0b42628c16" status: 202 len: 0 microversion: 2.1 time: 2.214708 Oct 24 08:54:23.185013 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 415/817] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:54:20 2022] DELETE /compute/v2.1/os-floating-ips/21c7b11b-703f-4679-995d-8e0b42628c16 => generated 0 bytes in 2217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:54:23.193874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.194924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:23.199593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4dbd53f3-6765-437e-8e89-df26f730ad78 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 0.331214 Oct 24 08:54:23.216742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.218872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.219380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.220145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.223835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.224224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.225966 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 403/818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:22 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:23.235402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-275fd4f7-6ab2-4552-9c95-8c6e56a083c8 req-a0639b72-c47b-49d5-b645-32bb04166e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b851cf-83c2-40f9-abe5-66ac8aaf6099", "tag": "30c0ac12-d466-4cba-a338-56de8f6d09ee"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:23.269719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-275fd4f7-6ab2-4552-9c95-8c6e56a083c8 req-a0639b72-c47b-49d5-b645-32bb04166e44 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.270199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-275fd4f7-6ab2-4552-9c95-8c6e56a083c8 req-a0639b72-c47b-49d5-b645-32bb04166e44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.278739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-275fd4f7-6ab2-4552-9c95-8c6e56a083c8 req-a0639b72-c47b-49d5-b645-32bb04166e44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.292581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.293534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.294252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.295427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lazy-loading 'fault' on Instance uuid 565c6be0-c950-4612-9894-4d46451b4d98 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:23.318443 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-275fd4f7-6ab2-4552-9c95-8c6e56a083c8 req-a0639b72-c47b-49d5-b645-32bb04166e44 service nova] Creating event network-changed:30c0ac12-d466-4cba-a338-56de8f6d09ee for instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 on n-h1-master-1 Oct 24 08:54:23.338269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-275fd4f7-6ab2-4552-9c95-8c6e56a083c8 req-a0639b72-c47b-49d5-b645-32bb04166e44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109751 Oct 24 08:54:23.338915 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 404/819] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:23.364003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.368694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:23.403015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.409691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.411677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.416208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.418885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.424895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.522226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b9360313da41e1905c695c37020876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab82000972421c96022c2711beb014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:23.551998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-26fafc68-7c3c-4a0e-967b-03e669f4ec2c tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 200 len: 1307 microversion: 2.1 time: 0.365616 Oct 24 08:54:23.556078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 416/820] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:23 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:23.569764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.571823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:23.621892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.624202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.626005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.627921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.630113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.630774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.796465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:23.809921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:23.811848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:23.823410 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cdc92242-7d93-4f61-ba0d-515663299cbf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.477221 Oct 24 08:54:23.825067 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 405/821] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:23 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:23.842055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6464d73-7030-4fce-a98a-8c6584c1a844 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.843148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6464d73-7030-4fce-a98a-8c6584c1a844 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:24.080099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a6464d73-7030-4fce-a98a-8c6584c1a844 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:24.090286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6464d73-7030-4fce-a98a-8c6584c1a844 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1216 microversion: 2.1 time: 0.263877 Oct 24 08:54:24.091207 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 406/822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:23 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:24.105344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:24.106246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:24.113461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.121199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.122766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.130047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.130633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.131151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.187021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:24.362790 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5401a962-ba18-4657-9e25-051e8c732689 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 204 len: 0 microversion: 2.1 time: 0.268939 Oct 24 08:54:24.364466 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 407/823] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:24 2022] DELETE /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:24.376234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:24.377418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:24.385830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.386616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.387317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.388255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.388928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.389634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.617556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:24.629311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:24.631487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:24.633760 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ea50cfe-8a98-41da-be7e-3c8d5d54c0a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1557 microversion: 2.25 time: 1.076371 Oct 24 08:54:24.637874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 417/824] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:23 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1557 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:24.653030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:24.657942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:24.690745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.691256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.691710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.692503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.692982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.695706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.912782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8db2221f-59b0-49d5-9612-06501c0a1a9b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1811 microversion: 2.1 time: 0.545821 Oct 24 08:54:24.915559 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 408/825] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:24 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1811 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:24.936430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:24.936984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:24.940445 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:24.952570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.953110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.953832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.955837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.956792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.957568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.023396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.026280 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:25.041714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f0f7849-be00-4e92-aedf-6cdb5b76212b tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 0.398088 Oct 24 08:54:25.055059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 418/826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:24 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:25.076388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.079389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] [instance: 565c6be0-c950-4612-9894-4d46451b4d98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:25.089082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.089632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.090236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.091142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.091615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.092049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.145946 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] HTTP exception thrown: Instance 565c6be0-c950-4612-9894-4d46451b4d98 could not be found. Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Request method failure captured: Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 HTTP/1.1 Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJFs4XcMNiHmOfBVxQ1oXf0WMuOdjhEsj491XKStvFJ5roQcAGAkMafI9pviGYK3OiWilMWcCraamQvJ21ZDqJC1WvpWYUljh2WWUyiljVg6U0y9Dt9sBKyCqgZOXE2CAKhy3d41an8Ina_toBHg-RPGL2sYT7mfXuIeblAzhg810M Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 96ab82000972421c96022c2711beb014 Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:54:25.151970 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96ab82000972421c96022c2711beb014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96ab82000972421c96022c2711beb014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96ab82000972421c96022c2711beb014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96ab82000972421c96022c2711beb014"}]}] Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 96ab82000972421c96022c2711beb014 Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-9511904 Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerTestJSON-9511904-project Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c2b9360313da41e1905c695c37020876 Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerTestJSON-9511904-project Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 565c6be0-c950-4612-9894-4d46451b4d98 could not be found. Oct 24 08:54:25.153372 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '565c6be0-c950-4612-9894-4d46451b4d98'} Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565c6be0-c950-4612-9894-4d46451b4d98 could not be found. Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:25.154204 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565c6be0-c950-4612-9894-4d46451b4d98 could not be found. Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565c6be0-c950-4612-9894-4d46451b4d98 could not be found. Oct 24 08:54:25.155960 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:25.158156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] Returning 404 to user: Instance 565c6be0-c950-4612-9894-4d46451b4d98 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:25.158156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4d01290-3397-410a-bc3a-eb62eb0924a1 tempest-ImagesOneServerTestJSON-9511904 tempest-ImagesOneServerTestJSON-9511904-project] 10.222.0.25 "GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98" status: 404 len: 111 microversion: 2.1 time: 0.095642 Oct 24 08:54:25.171050 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 419/827] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/servers/565c6be0-c950-4612-9894-4d46451b4d98 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:25.175899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.176528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:25.192804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.209102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.209418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d8c97a21-0068-490e-9103-9c58940c8132 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1525 microversion: 2.1 time: 0.286395 Oct 24 08:54:25.209637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.209911 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 409/828] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:24 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1525 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:25.211662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.212609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.216185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.216645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.237614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.239024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:25.246592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.247285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.248023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.249031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.249686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.250357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.345902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.357682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.361796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.372060 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38077871-8d5f-48ba-aaec-4d789eb25aee tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.139791 Oct 24 08:54:25.405175 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 410/829] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:25.414165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.419704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.420193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.420626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.421373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.421974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.422914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.493980 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9652ab5d-3664-4148-8852-f8a7436a870f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086619 Oct 24 08:54:25.494992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 411/830] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:25.517861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.520407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:25.534604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.536238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.539148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.540635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.541446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.542698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.642007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:25.686864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fef90e85-a2a7-47ff-98fc-4c012609f06e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 2050 microversion: 2.25 time: 0.514630 Oct 24 08:54:25.689087 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 420/831] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 2050 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:25.694292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d3d3f411-2bd2-4d6c-9c33-ccf4a53f5ee4 req-d7b596fb-3bbc-458a-8144-c0729ef3de0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c6be0-c950-4612-9894-4d46451b4d98", "name": "network-vif-deleted", "tag": "99c08ee8-07e2-41a2-b109-1340bea25190"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:25.716964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d3d3f411-2bd2-4d6c-9c33-ccf4a53f5ee4 req-d7b596fb-3bbc-458a-8144-c0729ef3de0a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.722311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d3d3f411-2bd2-4d6c-9c33-ccf4a53f5ee4 req-d7b596fb-3bbc-458a-8144-c0729ef3de0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.722999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d3d3f411-2bd2-4d6c-9c33-ccf4a53f5ee4 req-d7b596fb-3bbc-458a-8144-c0729ef3de0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.751984 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d3d3f411-2bd2-4d6c-9c33-ccf4a53f5ee4 req-d7b596fb-3bbc-458a-8144-c0729ef3de0a service nova] Creating event network-vif-deleted:99c08ee8-07e2-41a2-b109-1340bea25190 for instance 565c6be0-c950-4612-9894-4d46451b4d98 on n-h1-master-1 Oct 24 08:54:25.764607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.770271 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d3d3f411-2bd2-4d6c-9c33-ccf4a53f5ee4 req-d7b596fb-3bbc-458a-8144-c0729ef3de0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079249 Oct 24 08:54:25.774545 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 421/832] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:25.781337 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ec9e52b-9bcd-4d39-a396-5c0bbfbd983d tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1274 microversion: 2.1 time: 0.277575 Oct 24 08:54:25.785775 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 412/833] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:25.794453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.795179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:25.809630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.814211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.814902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.815813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.816445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.817036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:26.066765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:26.067393 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:26.081616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:26.083738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:26.085646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:26.088465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:26.089057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:26.097404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:26.200675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:26.245961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd3ecc19-a24b-468e-93a9-066b3749969a tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 2050 microversion: 2.25 time: 0.467575 Oct 24 08:54:26.249101 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 422/834] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 2050 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:26.260121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:26.261862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:26.270668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:26.271615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:26.281926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:26.283143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:26.284827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:26.289027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:26.366217 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:27.068797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:27.081552 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b34456b-ab5b-4ff2-a844-8cd2f30db519 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1525 microversion: 2.1 time: 0.831049 Oct 24 08:54:27.082355 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 423/835] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:26 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1525 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:27.098009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:27.103952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.104795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.106484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.107513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.110736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.111469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.166389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:27.176254 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d8fea10f-282c-4828-975a-2d0dcde21edb tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 1.113851 Oct 24 08:54:27.176868 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 413/836] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:26 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:27.186576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2cda1d23-4504-4489-a59e-b51a01ccdae7 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.101521 Oct 24 08:54:27.195717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 424/837] 10.222.0.25 () {60 vars in 1217 bytes} [Mon Oct 24 08:54:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:54:27.199913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:27.202672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:27.207107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:27.218208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:27.220671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.221250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.221724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.224254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.224731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.225163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.227002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.227721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.228395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.229364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.230032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.230662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.504627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:27.521133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:27.524721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:27.551211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b47ba920-6a16-4842-9188-8771ee0a8e0b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.373093 Oct 24 08:54:27.551829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 414/838] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:27 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:27.592087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-aec6da10-d625-4fbf-bb6b-9276677e6af6 req-06d72881-6332-454b-a55a-529a11b597e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b851cf-83c2-40f9-abe5-66ac8aaf6099", "name": "network-vif-plugged", "status": "completed", "tag": "30c0ac12-d466-4cba-a338-56de8f6d09ee"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:27.625259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aec6da10-d625-4fbf-bb6b-9276677e6af6 req-06d72881-6332-454b-a55a-529a11b597e7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.626019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aec6da10-d625-4fbf-bb6b-9276677e6af6 req-06d72881-6332-454b-a55a-529a11b597e7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.626457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aec6da10-d625-4fbf-bb6b-9276677e6af6 req-06d72881-6332-454b-a55a-529a11b597e7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.668568 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-aec6da10-d625-4fbf-bb6b-9276677e6af6 req-06d72881-6332-454b-a55a-529a11b597e7 service nova] Creating event network-vif-plugged:30c0ac12-d466-4cba-a338-56de8f6d09ee for instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 on n-h1-master-1 Oct 24 08:54:27.682848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-aec6da10-d625-4fbf-bb6b-9276677e6af6 req-06d72881-6332-454b-a55a-529a11b597e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100283 Oct 24 08:54:27.690351 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 415/839] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:27.709579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:27.714792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:27.740822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.741362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.741813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.751118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.751688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.752176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.810546 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:27.952398 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe5874b5-0420-4e16-8239-824e1605a8c6 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8/action" status: 202 len: 0 microversion: 2.25 time: 0.258554 Oct 24 08:54:27.960211 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 416/840] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:54:27 2022] POST /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:27.968152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:27.976763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:27.978380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:27.985373 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb063c72-43e8-4773-ac59-e18afd1350ff tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.783534 Oct 24 08:54:27.992876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.994428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.997539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.998541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.001661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.003911 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 425/841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:27 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:28.004528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.106634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:28.108029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:28.138326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.139200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.139869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.141505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.150791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.151461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.378582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:28.391969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:28.398876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ffba6a0-1f08-43ac-99d1-02b8b064654d tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1483 microversion: 2.1 time: 0.296024 Oct 24 08:54:28.403844 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 426/842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:28 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1483 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:28.415527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76841b4c-49a1-4697-804b-e1b6963191cc tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 2055 microversion: 2.25 time: 0.452923 Oct 24 08:54:28.416360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 417/843] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:27 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 2055 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:28.424619 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-76114830-0d86-4f7d-abe5-97c559dc96bd req-b46f6c7b-0448-41fc-b2f5-138fe23c6675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e0d237-fa1e-487c-ad63-48324bb20a2b", "name": "network-vif-deleted", "tag": "d95c40ef-3336-41c3-aece-9d1376ac44f0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:28.450818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:28.451625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:28.459651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76114830-0d86-4f7d-abe5-97c559dc96bd req-b46f6c7b-0448-41fc-b2f5-138fe23c6675 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.460213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76114830-0d86-4f7d-abe5-97c559dc96bd req-b46f6c7b-0448-41fc-b2f5-138fe23c6675 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.467026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76114830-0d86-4f7d-abe5-97c559dc96bd req-b46f6c7b-0448-41fc-b2f5-138fe23c6675 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.471361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.471950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.472401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.473150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.473841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.474284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.485481 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-76114830-0d86-4f7d-abe5-97c559dc96bd req-b46f6c7b-0448-41fc-b2f5-138fe23c6675 service nova] Creating event network-vif-deleted:d95c40ef-3336-41c3-aece-9d1376ac44f0 for instance 30e0d237-fa1e-487c-ad63-48324bb20a2b on n-h2-master-1 Oct 24 08:54:28.499493 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-76114830-0d86-4f7d-abe5-97c559dc96bd req-b46f6c7b-0448-41fc-b2f5-138fe23c6675 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081525 Oct 24 08:54:28.501176 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 418/844] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:28.585649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:28.587039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:28.601430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.602337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.604340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.606173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:28.612552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:28.613779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:28.860803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:28.887840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cca7d964-31bc-4965-8de5-23c1efa4f42d tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1388 microversion: 2.1 time: 0.480806 Oct 24 08:54:28.902124 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 427/845] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:28 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1388 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:29.011480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:29.012485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:29.025055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.026146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.026935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.027857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.028535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.029221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.211472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:29.228301 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-458e1f5a-ec9e-4e0d-8dd6-48dc01ac2431 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.220742 Oct 24 08:54:29.229329 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 428/846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:29 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:29.282079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:29.290079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:29.294029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:29.307183 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43f41f62-7db0-46b9-b14f-0fc15bbbbb4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.727314 Oct 24 08:54:29.313621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 419/847] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:28 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:29.436752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:29.442441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:29.448239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:29.449657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:29.460282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.466077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.467590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.468298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.469601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.470653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.472216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.472967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.475933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.477679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.479807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.482072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.608517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.611908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.614895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.615982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lazy-loading 'fault' on Instance uuid 30e0d237-fa1e-487c-ad63-48324bb20a2b {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:29.686045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ee4538fd234ed7b8137861bfb534d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:29.697819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44cdfde8-67f4-44ad-9138-466952367eff tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 200 len: 1314 microversion: 2.1 time: 0.265633 Oct 24 08:54:29.700846 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 429/848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:29 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:29.912920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:29.914072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:29.921123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.922131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.922802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.923771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.924511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.925171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.978269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:30.007410 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-03b06952-c499-49c0-b16e-2aaaa6da1648 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 2035 microversion: 2.25 time: 0.563399 Oct 24 08:54:30.009726 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 420/849] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:29 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 2035 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:30.034616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:30.037887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:30.050821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.051551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.052161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.053089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.053829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.054699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.104152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'flavor' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:30.121674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Going to try to live migrate instance to n-h1-master-1 {{(pid=126919) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:54:30.227183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:30.240787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07396b1c-e807-4a6c-a1a9-6fb956ede8ca tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1587 microversion: 2.1 time: 0.331858 Oct 24 08:54:30.259244 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 430/850] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:29 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1587 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:30.259244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:30.259244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:30.267285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.267800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.268568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.269345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.269812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.270250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.578456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:30.586785 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c951533-2d53-4cf1-94d3-5583e465c52e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.338609 Oct 24 08:54:30.603230 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 431/851] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:30 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:30.625502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:30.626545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:30.635563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.636428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.637153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.638168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.639042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.639679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.752419 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da1a5cc1-9c1b-4114-bd4a-af1869b1f550 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147603 Oct 24 08:54:30.753377 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 432/852] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:54:30 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:30.758702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:30.759321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:30.779551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.783868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.785495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.788041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.789536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.793763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.021763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:31.033256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:31.035108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:31.051294 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb2b7f5e-9d8e-43fa-b0ad-41d0ef019ab4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.296582 Oct 24 08:54:31.059040 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 433/853] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:30 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:31.063707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d7d094-9745-4c83-9014-68582971f6d0", "device": "/dev/xvdb"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:31.072586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:31.086381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.086873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.087520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.088385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.089870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.090658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.730937 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a204a4c-7c24-45f6-b55c-0b17a0631afe tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "POST /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671822 Oct 24 08:54:31.748539 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 434/854] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 08:54:31 2022] POST /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:31.778889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1de9e461-28eb-4255-ba24-c9f152fa13bf req-d302a4ca-908c-4aa6-9e88-8f8ef861c4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b764f391-fc04-4766-b3a8-8dfa6b955c69", "tag": "dd6f231e-21c6-4584-9de0-b38b8d78838d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:31.802209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1de9e461-28eb-4255-ba24-c9f152fa13bf req-d302a4ca-908c-4aa6-9e88-8f8ef861c4f2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.803793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1de9e461-28eb-4255-ba24-c9f152fa13bf req-d302a4ca-908c-4aa6-9e88-8f8ef861c4f2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.804395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1de9e461-28eb-4255-ba24-c9f152fa13bf req-d302a4ca-908c-4aa6-9e88-8f8ef861c4f2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.827641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1de9e461-28eb-4255-ba24-c9f152fa13bf req-d302a4ca-908c-4aa6-9e88-8f8ef861c4f2 service nova] Creating event network-changed:dd6f231e-21c6-4584-9de0-b38b8d78838d for instance b764f391-fc04-4766-b3a8-8dfa6b955c69 on n-h1-master-1 Oct 24 08:54:31.846585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1de9e461-28eb-4255-ba24-c9f152fa13bf req-d302a4ca-908c-4aa6-9e88-8f8ef861c4f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087306 Oct 24 08:54:31.849827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 435/855] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:31.874577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:31.879835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] [instance: 30e0d237-fa1e-487c-ad63-48324bb20a2b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:31.908258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.910602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.914019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.914343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.917286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.917764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.987453 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:31.990041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] HTTP exception thrown: Instance 30e0d237-fa1e-487c-ad63-48324bb20a2b could not be found. Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Request method failure captured: Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b HTTP/1.1 Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJWB-5tknYE7ONj7hbh-UicL5mWp0YcfPibdnwTlAMqiuulFiufBGwQoWEX_HpyHLoO2UeeqkSHH3bU-AU37No_KYxIXVJzZNVn9_uyPgfrT4x6IdBejixEm-zql_thNS_lcoAvNyNpvMH8Q-VhKq-uiziQx5Nv07mvM7a8JlJbw2w Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:54:31.993171 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4bf7adacd2ba40e6b67fa07d8baefc4b"}]}] Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4bf7adacd2ba40e6b67fa07d8baefc4b Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-337587244 Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 89ee4538fd234ed7b8137861bfb534d3 Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-337587244-project Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 30e0d237-fa1e-487c-ad63-48324bb20a2b could not be found. Oct 24 08:54:31.994784 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '30e0d237-fa1e-487c-ad63-48324bb20a2b'} Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e0d237-fa1e-487c-ad63-48324bb20a2b could not be found. Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:31.995636 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e0d237-fa1e-487c-ad63-48324bb20a2b could not be found. Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e0d237-fa1e-487c-ad63-48324bb20a2b could not be found. Oct 24 08:54:31.997124 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:31.999675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] Returning 404 to user: Instance 30e0d237-fa1e-487c-ad63-48324bb20a2b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:32.001530 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6faa4151-96cf-4fc1-a8f0-f4f77a65b684 tempest-FloatingIPsAssociationTestJSON-337587244 tempest-FloatingIPsAssociationTestJSON-337587244-project] 10.222.0.25 "GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b" status: 404 len: 111 microversion: 2.1 time: 0.150440 Oct 24 08:54:32.006105 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 436/856] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:31 2022] GET /compute/v2.1/servers/30e0d237-fa1e-487c-ad63-48324bb20a2b => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:32.011619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:32.012672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:32.023533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:32.024420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:32.025117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:32.026175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:32.027125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:32.027791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:32.677035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:32.692256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b82ddba1-6f2f-42cd-9c98-668f1e4bdd18 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.684724 Oct 24 08:54:32.693255 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 437/857] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:32 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:32.702302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:32.709211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:32.727651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:32.728978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:32.729729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:32.730974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:32.736848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:32.737786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:32.884110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:32.896981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:32.899716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:32.909620 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e95877f-ee3b-4c9d-9a39-5568d6feef3e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.214960 Oct 24 08:54:32.912782 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 438/858] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:32 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:33.160441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:33.161655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:33.176012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.177120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.178224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.179673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.180626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.181614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.426755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:33.445672 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-51103bdd-9c7b-4a31-853f-9bab3b96a888 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1587 microversion: 2.1 time: 0.297457 Oct 24 08:54:33.447586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 439/859] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:33 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1587 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:33.453658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-74a3ec5a-a123-4f9c-89cf-d6d330c71696 req-277d4e0a-9fac-43fc-9889-f372fec8f2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b851cf-83c2-40f9-abe5-66ac8aaf6099", "tag": "30c0ac12-d466-4cba-a338-56de8f6d09ee"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:33.465198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74a3ec5a-a123-4f9c-89cf-d6d330c71696 req-277d4e0a-9fac-43fc-9889-f372fec8f2e4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.466211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74a3ec5a-a123-4f9c-89cf-d6d330c71696 req-277d4e0a-9fac-43fc-9889-f372fec8f2e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.467438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74a3ec5a-a123-4f9c-89cf-d6d330c71696 req-277d4e0a-9fac-43fc-9889-f372fec8f2e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.492175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-74a3ec5a-a123-4f9c-89cf-d6d330c71696 req-277d4e0a-9fac-43fc-9889-f372fec8f2e4 service nova] Creating event network-changed:30c0ac12-d466-4cba-a338-56de8f6d09ee for instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 on n-h1-master-1 Oct 24 08:54:33.498553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-74a3ec5a-a123-4f9c-89cf-d6d330c71696 req-277d4e0a-9fac-43fc-9889-f372fec8f2e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049234 Oct 24 08:54:33.503591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 440/860] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:33.723596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:33.725547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:33.745750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.747867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.748793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.751569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.752542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.753206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.830379 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0a6c0cc-9c62-42a3-b1f3-9cbcd34bc575 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8/action" status: 202 len: 0 microversion: 2.25 time: 3.798276 Oct 24 08:54:33.833322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 421/861] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:54:30 2022] POST /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8/action => generated 0 bytes in 3804 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:54:33.862984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:33.875457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:33.896602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.897670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.898285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.899475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.903215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.903858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:34.088472 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:34.216862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:34.236882 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd7f17f0-514b-473f-b418-e412c13e41a9 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.519895 Oct 24 08:54:34.238033 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 441/862] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:33 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:34.250477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:34.253846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:34.264739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:34.266071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:34.266665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:34.267611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:34.268229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:34.268804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:34.387788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:34.407276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:34.412163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:34.430627 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60b9cae1-d777-4cd8-9a87-6950d9a4fa2b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.189606 Oct 24 08:54:34.432053 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 442/863] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:34 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:35.085698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.099423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.105864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.109170 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cebeaf7c-3e3a-4803-ba0a-a9c08e51bea9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 1.266749 Oct 24 08:54:35.112807 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 422/864] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:33 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:35.261118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:35.261925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:35.285392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.289736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.293101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.294017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.297812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.298401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.461609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:35.462376 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:35.464758 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:35.475263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.475765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.476196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.482797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.484725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.485369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.630545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.638896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.648772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.655149 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c977f83-b933-4665-bb23-c7cce37641f7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.197637 Oct 24 08:54:35.659047 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 423/865] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:35 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:35.747069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.763217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9459a0af-b9a1-4c6e-920e-a206bd075300 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.505784 Oct 24 08:54:35.777324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 443/866] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:35 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:35.948922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cca06535-5924-4456-9d28-ff5e5908dda6 req-af725545-f8a7-455d-8102-070a23cfcb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aac9f24-0a77-40c9-b1e3-9c852bf29fe8", "name": "network-vif-unplugged", "status": "completed", "tag": "fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:35.969272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cca06535-5924-4456-9d28-ff5e5908dda6 req-af725545-f8a7-455d-8102-070a23cfcb55 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.970102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cca06535-5924-4456-9d28-ff5e5908dda6 req-af725545-f8a7-455d-8102-070a23cfcb55 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.970725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cca06535-5924-4456-9d28-ff5e5908dda6 req-af725545-f8a7-455d-8102-070a23cfcb55 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.998694 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cca06535-5924-4456-9d28-ff5e5908dda6 req-af725545-f8a7-455d-8102-070a23cfcb55 service nova] Creating event network-vif-unplugged:fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8 for instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 on n-h2-master-1 Oct 24 08:54:36.007778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cca06535-5924-4456-9d28-ff5e5908dda6 req-af725545-f8a7-455d-8102-070a23cfcb55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061321 Oct 24 08:54:36.011547 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 424/867] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:36.136460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:36.137428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:36.145837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.149781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.160294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.165592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.166182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.169965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.629082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:36.642868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:36.644885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:36.646445 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59b5dea2-dd93-4319-80b0-df76b50b4347 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 0.513983 Oct 24 08:54:36.647607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 444/868] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:36 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:36.690975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:36.691698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:36.711244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.713929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.714927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.717141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.722638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.724292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.794678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:36.795685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:36.802140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.803123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.803777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.804812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.805532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.806190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.963572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:36.971734 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa9fdcf6-1176-4545-bd40-5b6ef9093869 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.180918 Oct 24 08:54:36.989783 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 445/869] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:36 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:37.024169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:37.038045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:37.039805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:37.046052 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf8c224c-993c-4430-a789-45c3708ba541 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.359661 Oct 24 08:54:37.050684 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 425/870] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:36 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:37.542867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-4ac5ce6b-1c0c-4cd8-afe0-47234250da00 req-e08e3319-fdae-442a-8cb4-e086d1d8bee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b764f391-fc04-4766-b3a8-8dfa6b955c69", "name": "network-vif-plugged", "status": "completed", "tag": "dd6f231e-21c6-4584-9de0-b38b8d78838d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:37.552505 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:37.555914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4ac5ce6b-1c0c-4cd8-afe0-47234250da00 req-e08e3319-fdae-442a-8cb4-e086d1d8bee4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:37.556475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4ac5ce6b-1c0c-4cd8-afe0-47234250da00 req-e08e3319-fdae-442a-8cb4-e086d1d8bee4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:37.557080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4ac5ce6b-1c0c-4cd8-afe0-47234250da00 req-e08e3319-fdae-442a-8cb4-e086d1d8bee4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:37.575783 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-4ac5ce6b-1c0c-4cd8-afe0-47234250da00 req-e08e3319-fdae-442a-8cb4-e086d1d8bee4 service nova] Creating event network-vif-plugged:dd6f231e-21c6-4584-9de0-b38b8d78838d for instance b764f391-fc04-4766-b3a8-8dfa6b955c69 on n-h1-master-1 Oct 24 08:54:37.581201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-4ac5ce6b-1c0c-4cd8-afe0-47234250da00 req-e08e3319-fdae-442a-8cb4-e086d1d8bee4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041873 Oct 24 08:54:37.582480 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 446/871] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:37.678415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:37.678946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:37.695423 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 08:54:37.696067 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 08:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 (ip 10.222.0.25) !!! Oct 24 08:54:37.720222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:37.720829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:37.721334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:37.722236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:37.722709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:37.723145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.008325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:38.009160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:38.021457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.021955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.022390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.023115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.028481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.029704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.452460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.462166 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d537e52-e529-4f89-99ff-ca44b58463d3 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1316 microversion: 2.1 time: 0.459527 Oct 24 08:54:38.464853 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 447/872] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:38 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:38.491455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-491bf408-8650-412d-ab1a-ed8bc8a85da8 req-73dcf71b-97a0-4dcb-8e5b-a064bf79890b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aac9f24-0a77-40c9-b1e3-9c852bf29fe8", "tag": "fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:38.519499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-491bf408-8650-412d-ab1a-ed8bc8a85da8 req-73dcf71b-97a0-4dcb-8e5b-a064bf79890b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.522315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-491bf408-8650-412d-ab1a-ed8bc8a85da8 req-73dcf71b-97a0-4dcb-8e5b-a064bf79890b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.523390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-491bf408-8650-412d-ab1a-ed8bc8a85da8 req-73dcf71b-97a0-4dcb-8e5b-a064bf79890b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.568735 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-491bf408-8650-412d-ab1a-ed8bc8a85da8 req-73dcf71b-97a0-4dcb-8e5b-a064bf79890b service nova] Creating event network-changed:fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8 for instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 on n-h2-master-1 Oct 24 08:54:38.580905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-491bf408-8650-412d-ab1a-ed8bc8a85da8 req-73dcf71b-97a0-4dcb-8e5b-a064bf79890b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110277 Oct 24 08:54:38.585117 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 448/873] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:38.592026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:38.592728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:38.600184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.600681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.601116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.601855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.602304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.602733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.667531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.677004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.683073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.684303 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ffb64339-1212-4b00-b9ec-392516c87810 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 1.013412 Oct 24 08:54:38.707738 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 426/874] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:37 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:38.768149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.784188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.790676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.804652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1529035-0221-4cea-a69c-4ada64f3bf63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.217484 Oct 24 08:54:38.806780 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 449/875] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:38 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:39.495096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:39.496055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:39.517200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.525263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.527095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.530916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.531667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.533055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.716598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:39.719767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:39.744799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.747254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.760162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.761328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.766064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.766992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.368278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.382624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.384273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.385791 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd7bfc6f-d1af-4789-9912-3786121588d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 0.674562 Oct 24 08:54:40.398504 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 450/876] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:39 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:40.420911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:40.427764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:40.441690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.446356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.447656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.448643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.453484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.454430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.749173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.773062 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4d971ba-588c-4a0d-adb4-ebcdd7cfb372 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1505 microversion: 2.1 time: 1.281750 Oct 24 08:54:40.773220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.787377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.792653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.793489 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 427/877] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:39 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1505 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:40.815562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:40.817863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:40.825038 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1b90e89-fcd2-4ac9-a6e4-cd75c539f673 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1560 microversion: 2.91 time: 0.424608 Oct 24 08:54:40.825038 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 451/878] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:40 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1560 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:40.849209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.849740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.850176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.850938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.851400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.851831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.944423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.945760 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22198109-1b35-4aaa-ac16-fa23491a5a95 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69/os-instance-actions/req-5bdec2b6-3576-4bac-9833-32c4add9f0b0" status: 200 len: 313 microversion: 2.1 time: 0.143503 Oct 24 08:54:40.946877 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 428/879] 10.222.0.25 () {58 vars in 1419 bytes} [Mon Oct 24 08:54:40 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69/os-instance-actions/req-5bdec2b6-3576-4bac-9833-32c4add9f0b0 => generated 313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:40.967235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:40.971482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:40.982239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.983442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.984381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.987390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.988490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.989190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.384832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a90a9967-6a74-449f-b6d6-c5df0d368d52 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "POST /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69/action" status: 202 len: 0 microversion: 2.1 time: 0.424441 Oct 24 08:54:41.401954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:41.403250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:41.409825 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 452/880] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:54:40 2022] POST /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:54:41.413623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.425263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.427582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.429481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.436339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:41.440593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.440593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.441621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:41.486348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.513525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.514736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.517629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.524374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.526635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:42.573524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:42.603443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:42.615980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:42.624008 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05ae2ce6-b5a3-47c4-84e3-2a31eb65728c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 1.198653 Oct 24 08:54:42.628184 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 453/881] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:41 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:42.690162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:42.690825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:42.746032 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:42.761662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:42.762325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:42.762765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:42.769289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:42.771706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:42.772473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:42.866063 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:42.978842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:42.994911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:43.006727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:43.029889 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0df7737e-b862-4947-bdf2-c26ce8e2c6c5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.397853 Oct 24 08:54:43.033606 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 454/882] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:42 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:43.447053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:43.480861 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4db1347-41f8-4b83-8fa2-1e02bd72be79 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1507 microversion: 2.1 time: 2.083597 Oct 24 08:54:43.494023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 429/883] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:41 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1507 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:43.656201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:43.657531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:43.670043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.684135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.684714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:43.685537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.686037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.686470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.069387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:44.071143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:44.092470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.093898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.103788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.109282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.111372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.115440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.284068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.312781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.319145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.327878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7dbe3e65-4c4d-4d37-abbe-b028ecd9c216 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 0.673347 Oct 24 08:54:44.346700 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 455/884] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:43 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:44.512495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:44.513225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:44.526582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.527091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.527543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.528260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.528728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.529163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.621507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.638449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.649895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.679264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-daeeb4bc-06a2-4762-9b97-cfffa1cba92c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.613857 Oct 24 08:54:44.695344 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 430/885] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:44 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:45.375879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:45.376663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:45.413457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.414181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.414742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:45.415619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.416193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.418447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:45.514408 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:45.532022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:45.545333 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb7be13a-2f7c-4d04-89ff-19c320d50d0e tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1507 microversion: 2.1 time: 1.036694 Oct 24 08:54:45.558565 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 456/886] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:44 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1507 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:45.734337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:45.735201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:45.751651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.753560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.754580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:45.759182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.761563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.771037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:46.251840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.273199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.282941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.334670 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e9652c0-6a6a-426e-947e-71dca98e3dd1 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.599615 Oct 24 08:54:46.341482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 457/887] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:45 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:46.576280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:46.577251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:46.618171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:46.618171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:46.618171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:46.632180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:46.632696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:46.633146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.281633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.294357 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca23f593-d2f1-4fa3-bcb0-51e61ac9f5bd tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1507 microversion: 2.1 time: 0.721858 Oct 24 08:54:47.301634 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 458/888] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:46 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1507 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:47.384191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:47.385269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:47.427373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:47.428075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:47.428529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.432635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:47.438133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:47.439094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.728506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.744324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.747771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.760219 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0758a400-9a20-4b96-aa2d-280cb49edd79 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.383536 Oct 24 08:54:47.786285 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 459/889] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:47 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:48.323928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:48.324883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:48.340458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.341897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.342505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.346134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.346982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.347591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.361658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.376843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.389067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.392702 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14367a4a-18ba-4ac9-b268-a34ceb7c3bb9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 3.021102 Oct 24 08:54:48.402362 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 431/890] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:45 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 3031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:48.775698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.825042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:48.826645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:48.831985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-554afb91-1d0c-4943-ba63-639c6f2152c6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1507 microversion: 2.1 time: 0.491710 Oct 24 08:54:48.834651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 460/891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:48 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:48.850720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.854887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.859782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.860929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.872082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.876486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.414397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:49.423315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:49.424949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:49.445112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:49.446202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:49.452241 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15950c5f-172c-4628-af8d-af10a32560a5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.634778 Oct 24 08:54:49.478141 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 432/892] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:48 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:49.484174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.484865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.485342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.486102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.493195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.493195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.889153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:49.891225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:49.904326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.911845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.912453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.915933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.915933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.915933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:50.527969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:50.538206 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e106a24c-dc20-4e53-adb6-0fcf1d4b6786 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1512 microversion: 2.1 time: 0.664850 Oct 24 08:54:50.553807 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 433/893] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:49 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1512 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:50.601023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:50.602509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:50.636838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:50.642398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:50.643881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:50.647282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:50.654028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:50.655915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:51.042105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.073124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.075103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.082386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d5d6536-3bc4-4c60-96c6-7b5da52e6074 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1567 microversion: 2.25 time: 1.638414 Oct 24 08:54:51.101910 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 461/894] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:49 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1567 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:51.234534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.244784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.249893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.274850 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-037d56ad-b9ac-429a-8bd6-be0ed5c93cbe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.718015 Oct 24 08:54:51.284923 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 434/895] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:50 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:51.594928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:51.595641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:51.622227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:51.622227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:51.622227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:51.624978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:51.630316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:51.630857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:52.118864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:52.120525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:52.137344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:52.151655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:52.159234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:52.160618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:52.165678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:52.166513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:52.316807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:52.330250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80cb6a13-e424-4eef-a73e-9a2258c8d978 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1512 microversion: 2.1 time: 0.738197 Oct 24 08:54:52.332913 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 462/896] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:51 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:52.574019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Calling method '.version_select at 0x7f8dab08e310>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:52.632523 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:54:52.633306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Neutron security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e not found {{(pid=126920) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 08:54:52.633951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] HTTP exception thrown: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.633951 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Request method failure captured: Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-security-groups/1b51b70f-f971-4aaf-ab19-bf481b7d291e HTTP/1.1 Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlLbmN2M-sr_MZNLTCm9GsXztPJDw1jBx2tW-Dx4VP3LNNBCaapAR1rK43x3_3wLYNT8OK9lU1nqGKas2Nx8eoZ79NQSDFm4singP6-ANQpWsblKuN01spuV0jASEXaybCT_SYEYYwu5W3Rm5hcDQUtmGkfW9Or8w6wK4B7rPmUWIFQ Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:54:52.650406 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4dfcb820b7984314b29f347ecd2b9141"}]}] Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c01bf3d88a2f4f6faaa46071612460c9 Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: exception: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] Oct 24 08:54:52.652388 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1b51b70f-f971-4aaf-ab19-bf481b7d291e'} Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:52.653730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 08:54:52.656785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.659031 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Returning 404 to user: Security group 1b51b70f-f971-4aaf-ab19-bf481b7d291e does not exist Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-858c1aa3-8cb7-4c9c-b802-d6fd7d520a79'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f112b03-1a28-4401-8d4f-ebf4adb16114 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1b51b70f-f971-4aaf-ab19-bf481b7d291e" status: 404 len: 194 microversion: 2.1 time: 0.321254 Oct 24 08:54:52.663482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 463/897] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:54:52 2022] DELETE /compute/v2.1/os-security-groups/1b51b70f-f971-4aaf-ab19-bf481b7d291e => generated 194 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:52.695918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:52.703693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:52.719347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:52.719980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:52.720755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:52.722004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:52.724355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:52.724878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:52.974233 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8fcfae3f-78d9-4ac6-b80e-1d8746023b13 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1857 microversion: 2.1 time: 0.307710 Oct 24 08:54:52.980324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 464/898] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:52 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1857 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:52.987638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:52.988568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:52.996584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:52.997823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.000062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.001059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.001787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.002476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.117176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.132577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.136461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.162252 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-919b5625-8ee5-42ab-831e-4ecc5d0211c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.180332 Oct 24 08:54:53.173321 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 465/899] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:52 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:53.178138 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79951ae8-026b-4e69-847f-5c151898be00 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.013628 Oct 24 08:54:53.179156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 466/900] 10.222.0.25 () {58 vars in 1164 bytes} [Mon Oct 24 08:54:53 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 08:54:53.188663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:53.192695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:53.210333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.212905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.213395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.214134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.214602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.215042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.233611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.242138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.247335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.253084 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b7b14a1-f24b-4fbf-8b08-9c4365f4b052 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1542 microversion: 2.25 time: 1.139469 Oct 24 08:54:53.254465 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 435/901] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:52 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1542 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:54:53.269190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8015aadc-2c32-4b50-aba4-60012276f21f tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Calling method '.version_select at 0x7f8dab93fca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:53.277137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lazy-loading 'flavor' on Instance uuid 56a0887e-b5c7-47d7-ad5b-72297f386d40 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:53.307316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Going to try to live migrate instance to n-h2-master-1 {{(pid=126920) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:54:53.882630 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8015aadc-2c32-4b50-aba4-60012276f21f tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.623163 Oct 24 08:54:53.893998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 436/902] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:54:53 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:53.899277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71b2f383-3a42-47bc-99eb-2dd6185a8926 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '.version_select at 0x7f8dab138dc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:53.904877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b2f383-3a42-47bc-99eb-2dd6185a8926 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.908648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b2f383-3a42-47bc-99eb-2dd6185a8926 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.909833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b2f383-3a42-47bc-99eb-2dd6185a8926 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.935688 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71b2f383-3a42-47bc-99eb-2dd6185a8926 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2313 microversion: 2.25 time: 0.036327 Oct 24 08:54:53.946585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 437/903] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Oct 24 08:54:53 2022] GET /compute/v2.1/os-migrations => generated 2313 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:53.947402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:53.948331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:53.959512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.961912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.962733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.964538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.967434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.968409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:54.360705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:54.379592 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e763711-7330-4cbd-aede-90606ef83c83 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1505 microversion: 2.1 time: 0.438756 Oct 24 08:54:54.380414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 438/904] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:53 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:54.394941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c81f95e3-ab92-4461-8550-564943c81a47 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Calling method '.version_select at 0x7f8dab817700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:55.214527 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-c81f95e3-ab92-4461-8550-564943c81a47 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:54:55.215527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c81f95e3-ab92-4461-8550-564943c81a47 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 24 08:54:55.215527 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c81f95e3-ab92-4461-8550-564943c81a47 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Request method failure captured: Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/39a16173-5d18-4df1-99d6-18e5d6b5b144 HTTP/1.1 Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLbmN2M-sr_MZNLTCm9GsXztPJDw1jBx2tW-Dx4VP3LNNBCaapAR1rK43x3_3wLYNT8OK9lU1nqGKas2Nx8eoZ79NQSDFm4singP6-ANQpWsblKuN01spuV0jASEXaybCT_SYEYYwu5W3Rm5hcDQUtmGkfW9Or8w6wK4B7rPmUWIFQ Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:54:55.219446 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4dfcb820b7984314b29f347ecd2b9141"}]}] Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c01bf3d88a2f4f6faaa46071612460c9 Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: exception: Insufficient rights for removing default security group. Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] Oct 24 08:54:55.220851 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '39a16173-5d18-4df1-99d6-18e5d6b5b144'} Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:55.221681 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 24 08:54:55.222868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:55.224002 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:55.225222 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:55.225222 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:55.225222 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:55.225222 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 24 08:54:55.225222 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] Oct 24 08:54:55.225222 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:55.230114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c81f95e3-ab92-4461-8550-564943c81a47 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 24 08:54:55.230114 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-45057566-321e-4e46-84a7-cd7b5f2327ba'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:55.231376 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c81f95e3-ab92-4461-8550-564943c81a47 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/39a16173-5d18-4df1-99d6-18e5d6b5b144" status: 400 len: 182 microversion: 2.1 time: 0.845755 Oct 24 08:54:55.232182 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 439/905] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:54:54 2022] DELETE /compute/v2.1/os-security-groups/39a16173-5d18-4df1-99d6-18e5d6b5b144 => generated 182 bytes in 847 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:54:55.251575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:55.254010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:55.282734 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=76 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:55.288744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:55.289320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:55.291399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.292170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:55.292637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:55.293068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.675257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:55.745317 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-302e0a45-235a-4e5d-a85a-c913602117ee tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 2035 microversion: 2.25 time: 0.511804 Oct 24 08:54:55.745938 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 440/906] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:55 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 2035 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:55.786600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:55.787562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:55.794253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:55.795016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:55.795630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.797032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:55.798723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:55.799392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.942746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.954032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.957161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.973466 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e3362be-ae17-4c00-bd7b-9663682c9deb tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.203204 Oct 24 08:54:55.991478 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 441/907] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:55 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:56.020028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '.version_select at 0x7f8dab93fd30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:56.023214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:56.038639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.043195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.045407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.049901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.051359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.054068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.121668 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a34965f-b87c-4a62-b5e2-7a067fa2aac0 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.118946 Oct 24 08:54:56.134432 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 442/908] 10.222.0.25 () {58 vars in 1296 bytes} [Mon Oct 24 08:54:55 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69/os-instance-actions => generated 611 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:56.143317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Calling method '.version_select at 0x7f8dab6084c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:56.204021 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-faca0b48-a443-466d-8487-9001c0bcc52f tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/action" status: 202 len: 0 microversion: 2.1 time: 3.023558 Oct 24 08:54:56.205955 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 467/909] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:54:53 2022] POST /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/action => generated 0 bytes in 3026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:54:56.212476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0bff8f8-82bd-471d-8d19-697d4f98a4a1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Action: 'create', calling method: .version_select at 0x7f8dab11b4c0>, body: {"keypair": {"name": "tempest-keypair-2094986771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr1eFFcOv3bWu5JMa5FIWVbf7uuneC7Vqt7qnzHIylA31p7eHpd33hU0PuseomyblkqcSDg8qIVOtzl7Z7Zdvq37rPl9QqxCVEhSu/US55d/9PXysrE/+Xcwmkci6Zd9g=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:56.273127 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:54:56.274311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Neutron security group 55359e1d-11f7-4aa0-835e-6db68504791b not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 08:54:56.274462 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] HTTP exception thrown: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.274462 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Request method failure captured: Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-security-groups/55359e1d-11f7-4aa0-835e-6db68504791b HTTP/1.1 Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLbmN2M-sr_MZNLTCm9GsXztPJDw1jBx2tW-Dx4VP3LNNBCaapAR1rK43x3_3wLYNT8OK9lU1nqGKas2Nx8eoZ79NQSDFm4singP6-ANQpWsblKuN01spuV0jASEXaybCT_SYEYYwu5W3Rm5hcDQUtmGkfW9Or8w6wK4B7rPmUWIFQ Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:54:56.276865 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4dfcb820b7984314b29f347ecd2b9141"}]}] Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c01bf3d88a2f4f6faaa46071612460c9 Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: exception: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] Oct 24 08:54:56.278490 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '55359e1d-11f7-4aa0-835e-6db68504791b'} Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:56.279476 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 08:54:56.280746 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.282127 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Returning 404 to user: Security group 55359e1d-11f7-4aa0-835e-6db68504791b does not exist Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4185ff6e-019e-4e36-a8b3-eefbfa5b1840'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:56.283720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb606112-6519-418a-8b80-1f7f42fa9572 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/55359e1d-11f7-4aa0-835e-6db68504791b" status: 404 len: 194 microversion: 2.1 time: 0.142046 Oct 24 08:54:56.284676 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 443/910] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 08:54:56 2022] GET /compute/v2.1/os-security-groups/55359e1d-11f7-4aa0-835e-6db68504791b => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:56.289449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d0bff8f8-82bd-471d-8d19-697d4f98a4a1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:56.293516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:56.294034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:56.308480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d0bff8f8-82bd-471d-8d19-697d4f98a4a1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for user cc0be0ed857d4c96b26724144e20d766 and project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:56.323791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.324587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.325199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.326105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.326761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.327900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.359848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:56.367413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0bff8f8-82bd-471d-8d19-697d4f98a4a1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.160147 Oct 24 08:54:56.379268 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 468/911] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 08:54:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 08:54:56.401363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:56.402083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:56.427329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.427859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.428311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.435852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.436381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.436826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.583815 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7bd7f757-0a56-4fd9-9075-8bd2cbb0e318 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 204 len: 0 microversion: 2.1 time: 0.294569 Oct 24 08:54:56.589470 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 444/912] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:56 2022] DELETE /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:56.605889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Action: 'update', calling method: .version_select at 0x7f8dab462310>, body: {"security_group": {"name": "tempest-sg-1894901968", "description": "tempest-description-696667858"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:56.995000 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:54:56.996580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Neutron security group b97b94c8-77f2-4be5-b473-79f1356bbeaf not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 08:54:56.997358 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] HTTP exception thrown: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:56.997358 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Request method failure captured: Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: request: PUT /compute/v2.1/os-security-groups/b97b94c8-77f2-4be5-b473-79f1356bbeaf HTTP/1.1 Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 101 Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLbmN2M-sr_MZNLTCm9GsXztPJDw1jBx2tW-Dx4VP3LNNBCaapAR1rK43x3_3wLYNT8OK9lU1nqGKas2Nx8eoZ79NQSDFm4singP6-ANQpWsblKuN01spuV0jASEXaybCT_SYEYYwu5W3Rm5hcDQUtmGkfW9Or8w6wK4B7rPmUWIFQ Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:54:56.999738 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4dfcb820b7984314b29f347ecd2b9141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4dfcb820b7984314b29f347ecd2b9141"}]}] Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 4dfcb820b7984314b29f347ecd2b9141 Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5035091 Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c01bf3d88a2f4f6faaa46071612460c9 Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5035091-project Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: {"security_group": {"name": "tempest-sg-1894901968", "description": "tempest-description-696667858"}} Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:54:57.001143 n-d-master-1 devstack@n-api.service[126919]: exception: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b97b94c8-77f2-4be5-b473-79f1356bbeaf', 'body': {'security_group': {'name': 'tempest-sg-1894901968', 'description': 'tempest-description-696667858'}}} Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:54:57.002076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 08:54:57.003147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] Oct 24 08:54:57.004293 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] Oct 24 08:54:57.008592 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.011723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] Returning 404 to user: Security group b97b94c8-77f2-4be5-b473-79f1356bbeaf does not exist Oct 24 08:54:57.011723 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-3281e46a-ccce-4360-8c51-7ef28260e0d9'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:57.012945 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb433634-44e9-45d5-802c-88065cf92893 tempest-SecurityGroupsNegativeTestJSON-5035091 tempest-SecurityGroupsNegativeTestJSON-5035091-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/b97b94c8-77f2-4be5-b473-79f1356bbeaf" status: 404 len: 194 microversion: 2.1 time: 0.420429 Oct 24 08:54:57.013815 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 445/913] 10.222.0.25 () {60 vars in 1290 bytes} [Mon Oct 24 08:54:56 2022] PUT /compute/v2.1/os-security-groups/b97b94c8-77f2-4be5-b473-79f1356bbeaf => generated 194 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:57.033251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:57.034590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:57.054653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.055816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.056939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.062810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.063620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.065648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.159813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:57.193119 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a82d3557-64f8-4b93-8d9a-c5feaeb94e03 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.810886 Oct 24 08:54:57.197141 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 469/914] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:56 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:57.209817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:57.211923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:57.231876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.236028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.236850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.240468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.242240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.244801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.563809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:57.585586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:57.600191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:57.624775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1538dcc0-1236-4195-88c9-1c8d3a887f2e tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.420983 Oct 24 08:54:57.675386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 470/915] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:57 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:58.023729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:58.038913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-358b0de1-11ce-4fd4-b5f5-200e1b390f05 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1511 microversion: 2.1 time: 1.019309 Oct 24 08:54:58.040779 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 446/916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:57 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1511 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:58.226686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:58.228013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:58.239493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:58.241894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:58.244294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:58.246568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:58.247570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:58.248605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:58.664158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:58.664784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:58.685610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:58.689875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:58.690338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:58.691099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:58.691570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:58.692001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:58.956857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:58.967784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60411cdb-f159-4f16-afab-507888506277 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.746549 Oct 24 08:54:58.968388 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 471/917] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:58 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:59.000146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.011069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.013876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.025572 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b103653-1a89-4694-88da-6a495701fccd tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.365663 Oct 24 08:54:59.027437 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 447/918] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:58 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:59.074737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:59.078902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:59.089281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:59.092268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:59.094531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:59.096499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:59.097182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:59.099601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:59.109588 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:59.670466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.679903 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c17555a2-d240-48e8-9557-3bd934f1c697 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1511 microversion: 2.1 time: 0.615324 Oct 24 08:54:59.682226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 472/919] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:59 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1511 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:59.994200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:59.995154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:00.011776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.015683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.019905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.023571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.029831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.033873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.101724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:00.102661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:00.136747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.137580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.138249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.142938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.143825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.144553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.321326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:00.321326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:00.321717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:00.324382 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95cbe12f-4629-4562-b4c0-4c10e04cbe5d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.226678 Oct 24 08:55:00.326668 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 473/920] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:00 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:55:00.711393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:00.712934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:00.724603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.730094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.732960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.734164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.736923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.742998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:01.026654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:01.044025 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a8c39e2-96b3-4fa4-a22d-cd3d6241f2b6 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1469 microversion: 2.1 time: 0.335047 Oct 24 08:55:01.047004 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 474/921] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:00 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:01.155278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f50c762e-3e74-44a2-b288-7c3487a8ef8e req-4fc50584-c5f9-4b99-9309-7bbcecf4949f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b764f391-fc04-4766-b3a8-8dfa6b955c69", "name": "network-vif-deleted", "tag": "dd6f231e-21c6-4584-9de0-b38b8d78838d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:01.178380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f50c762e-3e74-44a2-b288-7c3487a8ef8e req-4fc50584-c5f9-4b99-9309-7bbcecf4949f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:01.180932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f50c762e-3e74-44a2-b288-7c3487a8ef8e req-4fc50584-c5f9-4b99-9309-7bbcecf4949f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:01.183049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f50c762e-3e74-44a2-b288-7c3487a8ef8e req-4fc50584-c5f9-4b99-9309-7bbcecf4949f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:01.261431 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f50c762e-3e74-44a2-b288-7c3487a8ef8e req-4fc50584-c5f9-4b99-9309-7bbcecf4949f service nova] Creating event network-vif-deleted:dd6f231e-21c6-4584-9de0-b38b8d78838d for instance b764f391-fc04-4766-b3a8-8dfa6b955c69 on n-h1-master-1 Oct 24 08:55:01.285609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f50c762e-3e74-44a2-b288-7c3487a8ef8e req-4fc50584-c5f9-4b99-9309-7bbcecf4949f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134030 Oct 24 08:55:01.292565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:01.314580 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 475/922] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:01.318282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-91d1e454-550a-46f5-9440-c515e4cf4f27 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.328314 Oct 24 08:55:01.320163 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 448/923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:59 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:01.360859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:01.361829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:01.385788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:01.391358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:01.394290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:01.395365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:01.398776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:01.399534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.075366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:02.076375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:02.102038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.105266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.109657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.110794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.111785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.112620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.287663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.294212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.295983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.296621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lazy-loading 'fault' on Instance uuid b764f391-fc04-4766-b3a8-8dfa6b955c69 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:02.312692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.342467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.344365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.378219 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4e425ca-aee1-4d9d-8958-4c26912c3639 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 1.012729 Oct 24 08:55:02.395364 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 476/924] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:01 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:02.426857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:02.430197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:02.453706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.454799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.458538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.460292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.461001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.470489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.518913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec89a12c88145e4b34615836b7a690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25289f0047040a393894b2eec720066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.539265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7106735c-11f0-41b5-a152-fc65306f3d75 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 200 len: 1306 microversion: 2.1 time: 0.464065 Oct 24 08:55:02.542564 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 449/925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:02 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 1306 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:03.413562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:03.414243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:03.440067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.440563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.441038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.459891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.462057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.462498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.473685 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:03.527466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:03.551018 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71dd14dd-70c7-4d95-a259-46d0d1948fd3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.154129 Oct 24 08:55:03.551636 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 477/926] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:02 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:03.588752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:03.589482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] [instance: b764f391-fc04-4766-b3a8-8dfa6b955c69] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:03.614726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.615529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.616288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.617176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.617812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.618580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.657397 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] HTTP exception thrown: Instance b764f391-fc04-4766-b3a8-8dfa6b955c69 could not be found. Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Request method failure captured: Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 HTTP/1.1 Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlK8PjlU2uIq4B-cCB49xxgHSsJMkh4b0Vq1xtIOlt3EtF8CJihZ8G2QDfXVTH4oHWo2wlia6gvzq8NscGq1uzGk-FRZksRguI-AinsdwaHUA_cOO2CTTNTpKuuuRhYWoFW4J_Ov8tSdxZPyxc5EPt2ZbfoazEfvCJeShRtRc2PpDaU Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c25289f0047040a393894b2eec720066 Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-InstanceActionsTestJSON-1965711305 Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:55:03.663339 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c25289f0047040a393894b2eec720066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c25289f0047040a393894b2eec720066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c25289f0047040a393894b2eec720066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c25289f0047040a393894b2eec720066"}]}] Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-InstanceActionsTestJSON-1965711305 Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c25289f0047040a393894b2eec720066 Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1965711305 Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-InstanceActionsTestJSON-1965711305-project Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: aec89a12c88145e4b34615836b7a690b Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-InstanceActionsTestJSON-1965711305-project Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b764f391-fc04-4766-b3a8-8dfa6b955c69 could not be found. Oct 24 08:55:03.664947 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b764f391-fc04-4766-b3a8-8dfa6b955c69'} Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b764f391-fc04-4766-b3a8-8dfa6b955c69 could not be found. Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:03.665917 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b764f391-fc04-4766-b3a8-8dfa6b955c69 could not be found. Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b764f391-fc04-4766-b3a8-8dfa6b955c69 could not be found. Oct 24 08:55:03.667672 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:03.671764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] Returning 404 to user: Instance b764f391-fc04-4766-b3a8-8dfa6b955c69 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:03.673835 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df208284-2547-4d67-979f-ffa8501e9503 tempest-InstanceActionsTestJSON-1965711305 tempest-InstanceActionsTestJSON-1965711305-project] 10.222.0.25 "GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69" status: 404 len: 111 microversion: 2.1 time: 0.106328 Oct 24 08:55:03.681869 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 478/927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:03 2022] GET /compute/v2.1/servers/b764f391-fc04-4766-b3a8-8dfa6b955c69 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:04.112007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:04.123962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:04.125868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:04.153092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a4dd887d-3bd7-45fc-a00b-59913d5252f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.743379 Oct 24 08:55:04.153838 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 450/928] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:03 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:04.279041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1734310427", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "50ce0676-de1a-4c1e-8b5e-2aa8413c2173"}], "security_groups": [{"name": "tempest-securitygroup--689155362"}], "key_name": "tempest-keypair-2094986771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:04.584111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:04.585381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:04.604445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:04.624725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:04.625406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:04.626192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:04.626675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:04.627113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:05.334398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.346170 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7646f027-275c-46fe-9068-4575d07def3d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.768276 Oct 24 08:55:05.348321 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 451/929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:04 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:05.365644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:05.375844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:05.398670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:05.407960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:05.409841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:05.410869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:05.414347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:05.415023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:05.726167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.743028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.744919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.760569 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4278cbfc-d20a-4bac-a0f2-93abced73d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.404872 Oct 24 08:55:05.768534 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 452/930] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:05 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:06.326509 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:06.376190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:06.377155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:06.395631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:06.396598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:06.397528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:06.398470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:06.406730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:06.407525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:06.932776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:06.947009 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86af281f-6e5a-4f54-82cf-c5ee165cf3da tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.575718 Oct 24 08:55:06.967547 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 453/931] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:06 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:06.973527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:06.975285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:06.987720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:06.989053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:06.989761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:06.990730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:06.991404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:06.992223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.188598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:07.212026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:07.213824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:07.224875 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb9ee6f2-43ab-4583-b890-6d168deb0aa2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.255692 Oct 24 08:55:07.225746 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 454/932] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:06 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:07.974775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:07.975610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:07.998927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:08.002170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:08.002931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:08.003961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:08.005946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:08.007426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:08.671406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:08.684491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dff2f7cc-0c07-45fe-97f9-a41ee1e2c3bf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.713498 Oct 24 08:55:08.703741 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 455/933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:07 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:08.717869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:08.725010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:08.755935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:08.762142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:08.765125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:08.766271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:08.774451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:08.775679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:09.007300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:09.037138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:09.052094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:09.085780 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e0d4d9f-1197-4cfa-999f-8b6de64910ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.380175 Oct 24 08:55:09.101674 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 456/934] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:08 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:09.106701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:09.107205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:09.126200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:09.127031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:09.127710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:09.128481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:09.128954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:09.129423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:09.200363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:55:09.511052 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c034cc21-0af1-4ec3-8c4b-4bda05bf1ca0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 204 len: 0 microversion: 2.1 time: 0.407350 Oct 24 08:55:09.519609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 457/935] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:09 2022] DELETE /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:55:09.528186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:09.537365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:09.554727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:09.575743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:09.576219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:09.577582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:09.578055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:09.578482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:10.305742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:10.314332 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a5098ff-3558-40b6-ac06-03e81d8f7088 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1712 microversion: 2.1 time: 0.790282 Oct 24 08:55:10.314916 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 458/936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:09 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1712 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:10.345370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:10.346375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:10.373014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:10.393672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:10.398728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:10.399693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:10.400481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:10.402669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:10.879330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:10.896259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d50f9d7c-0eb8-40c9-b317-d0a24480a164 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.563714 Oct 24 08:55:10.909473 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 459/937] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:10 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:10.917504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:10.918239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:10.938565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:10.939075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:10.939521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:10.940246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:10.940715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:10.941151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.099666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:12.115028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:12.123876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:12.153449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5aa8e8d9-b2a0-4c18-92ec-0f71f542c428 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 1.247317 Oct 24 08:55:12.160674 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 460/938] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:10 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:12.177249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:12.191817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:12.207715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:12.208532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:12.209249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.210207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:12.216717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:12.217432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.802231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] validate_networks() for [('50ce0676-de1a-4c1e-8b5e-2aa8413c2173', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:55:13.634522 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=33 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:13.662530 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:13.714202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:13.750173 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac6371fd-0349-47df-8066-62ec3f6141f0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1712 microversion: 2.1 time: 1.582182 Oct 24 08:55:13.756057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 461/939] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:12 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1712 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:13.792190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:13.795922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:13.818568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:13.819565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:13.822973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:13.824207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:13.832733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:13.834909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.870190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:14.899551 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c273e77-6481-4b4d-ae22-6d54787d5e48 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.139610 Oct 24 08:55:14.914020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:55:14.914020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:55:14.914020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:55:14.914020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:55:14.914780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:55:14.915817 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 462/940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:13 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:14.920973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:14.926162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:14.943904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.945119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.945774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.946693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.949329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.949944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.965084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.965615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.966820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.967609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.971610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.972369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:15.033591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:55:15.041360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for user cc0be0ed857d4c96b26724144e20d766 and project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:55:15.066665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:55:15.071652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:55:15.172571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.195697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.199910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.212360 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c70bef64-bcdd-4877-b509-f6cbfd93e764 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 10.937239 Oct 24 08:55:15.218837 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 479/941] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:55:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 10944 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 08:55:15.244835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:15.252646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:15.256173 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69e656d3-3a34-483f-b8cb-825af5aaaf08 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1537 microversion: 2.91 time: 0.330509 Oct 24 08:55:15.260164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 463/942] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:14 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1537 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:15.269610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-050d2a1e-2208-41c5-b7fb-cbec9c3a3a9d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:15.270701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-050d2a1e-2208-41c5-b7fb-cbec9c3a3a9d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:15.281401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:15.282183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:15.282651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:15.283455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:15.284061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:15.284342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:15.600620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4099c569c4fe489fa349ee29e6974713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2c394d0ceb40f298afa7355102bfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.618169 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec140972-2440-419e-9665-87c90453f766 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 200 len: 1644 microversion: 2.1 time: 0.378754 Oct 24 08:55:15.619328 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 480/943] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:15 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 1644 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:15.635922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2d76a0f3-d229-4a32-8f8e-965e2e8e23f7 req-16db569c-aea8-4489-9cf0-0abc46d3a23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b851cf-83c2-40f9-abe5-66ac8aaf6099", "name": "network-vif-deleted", "tag": "30c0ac12-d466-4cba-a338-56de8f6d09ee"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:15.663009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2d76a0f3-d229-4a32-8f8e-965e2e8e23f7 req-16db569c-aea8-4489-9cf0-0abc46d3a23e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:15.664808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2d76a0f3-d229-4a32-8f8e-965e2e8e23f7 req-16db569c-aea8-4489-9cf0-0abc46d3a23e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:15.665631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2d76a0f3-d229-4a32-8f8e-965e2e8e23f7 req-16db569c-aea8-4489-9cf0-0abc46d3a23e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:15.695437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050d2a1e-2208-41c5-b7fb-cbec9c3a3a9d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.708289 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2d76a0f3-d229-4a32-8f8e-965e2e8e23f7 req-16db569c-aea8-4489-9cf0-0abc46d3a23e service nova] Creating event network-vif-deleted:30c0ac12-d466-4cba-a338-56de8f6d09ee for instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 on n-h1-master-1 Oct 24 08:55:15.723427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050d2a1e-2208-41c5-b7fb-cbec9c3a3a9d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.725481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050d2a1e-2208-41c5-b7fb-cbec9c3a3a9d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.727311 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-050d2a1e-2208-41c5-b7fb-cbec9c3a3a9d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1286 microversion: 2.25 time: 0.465769 Oct 24 08:55:15.730080 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 464/944] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:15 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1286 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:15.732450 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2d76a0f3-d229-4a32-8f8e-965e2e8e23f7 req-16db569c-aea8-4489-9cf0-0abc46d3a23e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106114 Oct 24 08:55:15.735374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 481/945] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:15.925152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:15.925762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:15.959671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:15.960187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:15.960631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:15.980084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:15.989436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:15.989999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.454826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.481571 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-008b2952-c0f2-4150-af4d-c49d6ccbce01 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.561286 Oct 24 08:55:16.482200 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 465/946] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:15 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:16.526523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:16.527579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:16.570658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.571452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.572193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.573191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.573951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.575349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.647941 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:16.657370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1332796123", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "54bbed7a-ce70-4cce-8f6a-1d193fc138f2"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:16.813118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.828410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.829919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.857912 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-66f964b0-3f32-49b0-b977-d9fa5c332f34 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1540 microversion: 2.91 time: 0.370162 Oct 24 08:55:16.861038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] validate_networks() for [('54bbed7a-ce70-4cce-8f6a-1d193fc138f2', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:55:16.884996 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 466/947] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:16 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1540 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:16.904152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:16.905385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:16.943916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.950570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.952847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.970590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.974696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.978017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.044333 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 HTTP/1.1 Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:17.049559 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:17.051067 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c8b851cf-83c2-40f9-abe5-66ac8aaf6099'} Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:17.051871 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:17.053685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.062093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:17.068175 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-edc8df84-ee1f-41a7-9447-d6f7074d9dac tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 404 len: 111 microversion: 2.1 time: 0.177943 Oct 24 08:55:17.069216 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 467/948] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:16 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:17.082377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.084833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.103936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.110901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.112274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.113467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.114175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.114783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.439696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.449260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.466454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.468588 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-611e482c-1821-439a-b60b-b666c7ed2653 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1290 microversion: 2.25 time: 0.397515 Oct 24 08:55:17.469063 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 468/949] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:17 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1290 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:17.484210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:17.502657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.512380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.513012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.520923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.523040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.527009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.527700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.668282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=126919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 08:55:17.839536 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c2cd0aef-59b2-4379-bbce-6ccc413c4185 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action" status: 202 len: 0 microversion: 2.91 time: 0.367537 Oct 24 08:55:17.841521 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 469/950] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:55:17 2022] POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:55:17.847721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.848574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.857605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.858870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.859777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.860771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.861557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.862087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.892947 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b HTTP/1.1 Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:17.898728 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:17.900433 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '267d3905-ae46-421f-bafd-76dfad07ef6b'} Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:17.901477 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:17.903801 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:17.905834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:17.905834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b99be58-2882-4687-ac0e-c434e2e9d831 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 404 len: 111 microversion: 2.1 time: 0.059558 Oct 24 08:55:17.907600 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 470/951] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:17 2022] DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:17.912929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.915956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.924812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.927698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.928267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.929282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.932104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.932905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.219914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.243580 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ce50970-a46b-4beb-8b1c-58d50e0d53e5 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.331667 Oct 24 08:55:18.244487 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 471/952] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:17 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:18.254248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:18.259513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:18.265203 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:18.281355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.281838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.282277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.283010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.283477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.283911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.416507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.431697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.440018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.452448 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d251cd7-96a5-47f6-819a-b19e23170d92 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1488 microversion: 2.91 time: 0.206580 Oct 24 08:55:18.474324 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 472/953] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:18 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1488 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:18.500059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:18.543171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:18.550781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.551784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.552404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.553323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.553926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.554536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.570854 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b HTTP/1.1 Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:18.572823 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:18.574474 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '267d3905-ae46-421f-bafd-76dfad07ef6b'} Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:18.575402 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:18.576775 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:18.579014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:18.580624 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f42c8858-9c4b-416f-a543-3f2c1c1aa76f tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 404 len: 111 microversion: 2.1 time: 0.104285 Oct 24 08:55:18.581763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 473/954] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:18 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:18.587112 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:18.587977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:18.596329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.597062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.597699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.598584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.599179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.600960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.831647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.846164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.855469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.858752 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d95e7525-08ee-416c-a0b8-0799462d39dc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1344 microversion: 2.25 time: 0.275547 Oct 24 08:55:18.859349 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 474/955] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:18 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1344 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:18.892476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb8ab6c6-822d-49af-a043-bba76e318054 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '.version_select at 0x7f8dab11e430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:18.953183 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb8ab6c6-822d-49af-a043-bba76e318054 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822886237" status: 202 len: 0 microversion: 2.1 time: 0.092731 Oct 24 08:55:18.959986 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 475/956] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 08:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822886237 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:55:19.272205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:19.272844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:19.281695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.282181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.282615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.283325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.283776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.284193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.633812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:55:19.634832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:55:19.635478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:55:19.636036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:55:19.636594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:55:19.655936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.660227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.662887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.664181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.666943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.668527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.715214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Getting quotas for project 6e21cf10d74849ad9f86efee0a5bd4df. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:55:19.726438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Getting quotas for user bea1fba85548404ca535fc5889752511 and project 6e21cf10d74849ad9f86efee0a5bd4df. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:55:19.768291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:55:19.773535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:55:19.893679 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21eb74e4-9053-4a66-b36d-2106053aed48 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.605993 Oct 24 08:55:19.901252 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 482/957] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:55:19.906337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:19.921753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:19.943373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.943871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.944304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.945010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.945502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.949109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.531653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.550301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc065fdb-6c8f-4477-a9b8-cd73518de325 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.281906 Oct 24 08:55:20.563589 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 476/958] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:19 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:20.573037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:20.584682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:20.612030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.612549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.612990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.621366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.621897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.622344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.805901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.816777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.821241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.836609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a9775b8-e2a6-4965-a6db-1db0ea9e2209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1488 microversion: 2.91 time: 0.932584 Oct 24 08:55:20.858856 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 483/959] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:19 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1488 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:20.868847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:20.869519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:20.883173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.883948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.884389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.885110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.885605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.886396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.156938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.167553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-49cb8d04-28c4-4752-b030-662af79d4184 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1220 microversion: 2.1 time: 0.307386 Oct 24 08:55:21.171569 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 484/960] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:20 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1220 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:21.331891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.352094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.356711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.364781 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dfe95d24-6ce3-4029-983a-66cf4db1f159 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1344 microversion: 2.25 time: 0.798929 Oct 24 08:55:21.365691 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 477/961] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:20 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1344 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:21.487372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-edf41920-2587-4c51-9dfb-2cbb85ca8272 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Action: 'create', calling method: .version_select at 0x7f8dab04a0d0>, body: {"keypair": {"name": "tempest-keypair-777841712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnsXxeOk3rgFDP7lLjI7InoHVnmGqLwsG+fK6B2CGdSCF8Da8hN0DHCYJ0QxWufyfIrIZ5+A6vniHXoMmyasdP3BqafZP5g7beY/tlgNLPoJVRyKfA/UVkiwHedd/ZHww=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:21.542058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-edf41920-2587-4c51-9dfb-2cbb85ca8272 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Getting quotas for project 178ccdbda089491a92f2c97d4437433c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:55:21.580300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:21.581575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:21.595097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-edf41920-2587-4c51-9dfb-2cbb85ca8272 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Getting quotas for user 83d393f7341e402a80a50b822b3f0f94 and project 178ccdbda089491a92f2c97d4437433c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:55:21.617693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.618191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.622668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.625178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.625794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.628673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.684633 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-edf41920-2587-4c51-9dfb-2cbb85ca8272 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.511864 Oct 24 08:55:21.687672 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 485/962] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:55:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:21.886487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:21.887279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:21.901628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.904260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.904821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.907851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.908364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.908781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.124786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.145822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.148202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.162012 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e03d1fd-f262-4ed8-9e4f-a9e6b9ac5f30 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.280728 Oct 24 08:55:22.183710 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 486/963] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:21 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:22.211739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:22.212619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:22.220575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.221486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.222163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.223125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.225286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.226160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.485524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.494426 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-581d0092-e3e2-4d9f-aed8-09e09482aebc tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1276 microversion: 2.1 time: 0.300117 Oct 24 08:55:22.509861 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 487/964] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:22 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:22.522630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:22.525679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:22.544581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.545868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.546500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.547392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.548015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.548604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.010642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.027074 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60b5b58a-ab69-4fca-bb0a-530b8e320976 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.452731 Oct 24 08:55:23.041495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 478/965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:21 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:23.079756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d5d2c95-5493-42e6-ba16-701fabb33f14 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.127236 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d5d2c95-5493-42e6-ba16-701fabb33f14 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1099244565" status: 202 len: 0 microversion: 2.1 time: 0.050763 Oct 24 08:55:23.129037 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 479/966] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 08:55:23 2022] DELETE /compute/v2.1/flavors/1099244565 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:55:23.155717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5036132f-9f77-4161-90f3-f678c2ece412 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.181245 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5036132f-9f77-4161-90f3-f678c2ece412 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.047376 Oct 24 08:55:23.182637 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 480/967] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:23.190263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.202496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.205944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.215545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.221584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.225787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a881127b-d9e0-49d9-a06a-12b557b9382b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.713396 Oct 24 08:55:23.230459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.231389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.235018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.236838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.237599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.238608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.244122 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 488/968] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:22 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:23.262265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d95206d6-477e-4792-8e77-913b8de1ba6d tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.289405 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d95206d6-477e-4792-8e77-913b8de1ba6d tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/730286020" status: 202 len: 0 microversion: 2.1 time: 0.043207 Oct 24 08:55:23.291494 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 489/969] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 08:55:23 2022] DELETE /compute/v2.1/flavors/730286020 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:55:23.303915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37aae3f1-647e-4285-81d0-6a964da4ba58 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.331859 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37aae3f1-647e-4285-81d0-6a964da4ba58 tempest-ServersWithSpecificFlavorTestJSON-668537215 tempest-ServersWithSpecificFlavorTestJSON-668537215-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034890 Oct 24 08:55:23.347334 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 490/970] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:23.357953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.358775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.366583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.368044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.368722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.369651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.370280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.370715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.387002 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 HTTP/1.1 Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:55:23.389633 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: exception: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.391256 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c8b851cf-83c2-40f9-abe5-66ac8aaf6099'} Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:23.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.394073 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.395601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:23.395601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86fa4b43-4f01-4cb0-8c0e-98b4d42ae9e3 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 404 len: 111 microversion: 2.1 time: 0.038274 Oct 24 08:55:23.395601 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 491/971] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:23 2022] DELETE /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:23.399870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.400495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: c8b851cf-83c2-40f9-abe5-66ac8aaf6099] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.408911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.409453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.410122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.411175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.411903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.412494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.435421 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 HTTP/1.1 Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:55:23.440449 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: exception: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.442097 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c8b851cf-83c2-40f9-abe5-66ac8aaf6099'} Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:23.443000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. Oct 24 08:55:23.444408 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.449473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance c8b851cf-83c2-40f9-abe5-66ac8aaf6099 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:23.450564 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f3ee3bb-89fa-494b-b0e1-59bee9227dea tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099" status: 404 len: 111 microversion: 2.1 time: 0.054717 Oct 24 08:55:23.462933 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 492/972] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/servers/c8b851cf-83c2-40f9-abe5-66ac8aaf6099 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:23.474103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.476828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.494231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.497560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.498003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.500925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.501549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.502171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.536998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.538920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.547444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b HTTP/1.1 Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:55:23.548990 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.550631 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '267d3905-ae46-421f-bafd-76dfad07ef6b'} Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:23.551525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.552955 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.558420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:23.561200 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4fdfc48d-aa54-4786-94fb-94da5683bacd tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 404 len: 111 microversion: 2.1 time: 0.097033 Oct 24 08:55:23.562337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.566883 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 493/973] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:23 2022] DELETE /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:23.573779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.574384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.579435 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1fc6648-83d3-4777-86d2-4eb283e8e7a2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.383543 Oct 24 08:55:23.580272 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 481/974] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:55:23.599292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.603497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.605227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] [instance: 267d3905-ae46-421f-bafd-76dfad07ef6b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.606562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.610868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.611794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.615263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.616350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.627288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.629599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.630386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.631918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.636328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.637543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.672971 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] HTTP exception thrown: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Request method failure captured: Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b HTTP/1.1 Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlI97CA86nHg_xKn9Ues6_1SPdFLZn6I2bwkWBNeKfh4wOje9k35z8OdYVpniFIulR1zX3zzWUvOpIc2yZN76aq7KmRZbdAuWJ6Jits61Z715HBTkWKBZ-b3_GYUdVtFwyfG34f1x-xKGUoHus-obKTZcj7p1F-PX3AK6MuXlVs5tOU Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:23.679329 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d2c394d0ceb40f298afa7355102bfd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d2c394d0ceb40f298afa7355102bfd5"}]}] Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8d2c394d0ceb40f298afa7355102bfd5 Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957 Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4099c569c4fe489fa349ee29e6974713 Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889072957-project Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.680904 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '267d3905-ae46-421f-bafd-76dfad07ef6b'} Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:23.681922 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. Oct 24 08:55:23.683344 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.684515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] Returning 404 to user: Instance 267d3905-ae46-421f-bafd-76dfad07ef6b could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:23.687265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a6576e2-5595-4213-88d6-1723bcc1c3c0 tempest-ServersWithSpecificFlavorTestJSON-889072957 tempest-ServersWithSpecificFlavorTestJSON-889072957-project] 10.222.0.25 "GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b" status: 404 len: 111 microversion: 2.1 time: 0.099128 Oct 24 08:55:23.691310 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 482/975] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/servers/267d3905-ae46-421f-bafd-76dfad07ef6b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:23.927383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.935964 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eba85bb8-c0d8-4ef9-8039-444eb33c7940 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1274 microversion: 2.1 time: 0.367360 Oct 24 08:55:23.938651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 494/976] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:24.054735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:24.055947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:24.070281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.070871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.072896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:24.073767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.074156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.080891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:24.268520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:24.269315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:24.285825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.289051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.293147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:24.295749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.296955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.300006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:24.515744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:24.531734 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5169c9e2-36d7-4954-8ef3-df2fd754abd0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.478677 Oct 24 08:55:24.533155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 483/977] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:24 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:24.565936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4b85307b-7ca7-4cc3-8308-79747cce577a req-83fbdda2-e1fd-47c8-806d-20fde2ebef23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a0887e-b5c7-47d7-ad5b-72297f386d40", "name": "network-vif-unplugged", "status": "completed", "tag": "cdcac286-03e9-4041-84b1-896d805de241"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:24.612689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4b85307b-7ca7-4cc3-8308-79747cce577a req-83fbdda2-e1fd-47c8-806d-20fde2ebef23 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.613173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4b85307b-7ca7-4cc3-8308-79747cce577a req-83fbdda2-e1fd-47c8-806d-20fde2ebef23 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.624084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4b85307b-7ca7-4cc3-8308-79747cce577a req-83fbdda2-e1fd-47c8-806d-20fde2ebef23 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:24.673225 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4b85307b-7ca7-4cc3-8308-79747cce577a req-83fbdda2-e1fd-47c8-806d-20fde2ebef23 service nova] Creating event network-vif-unplugged:cdcac286-03e9-4041-84b1-896d805de241 for instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 on n-h1-master-1 Oct 24 08:55:24.681732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4b85307b-7ca7-4cc3-8308-79747cce577a req-83fbdda2-e1fd-47c8-806d-20fde2ebef23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143893 Oct 24 08:55:24.682999 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 484/978] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:24.691949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:24.692965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:24.710239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.714179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.715653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:24.717953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.719243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:24.719927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:25.085280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.114808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.121704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.140003 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d44e2b4c-43e4-4c55-8558-38e3069e7d4d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.451310 Oct 24 08:55:25.142112 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 485/979] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:24 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:25.154911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:25.166985 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:25.195408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:25.199316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:25.202138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:25.204743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:25.211045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:25.214578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:25.540812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.563004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.563371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.569078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.571177 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16b88592-ee95-42af-b73d-c3844a7a724c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 1.306715 Oct 24 08:55:25.572937 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bcdd2573-cac7-4f95-91d4-bdc6b666d212 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 0.423331 Oct 24 08:55:25.573744 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 495/980] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:24 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:25.575010 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 486/981] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:25 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:25.620244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:25.622136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:25.638638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:25.639140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:25.639584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:25.646621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:25.647549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:25.648356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.171248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:26.172902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:26.176216 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:26.181087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.181983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.193191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.194410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.195151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.195806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.816838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.829321 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c80d098-0f96-43bd-84a8-d750bcbdc194 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.253789 Oct 24 08:55:26.830581 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 496/982] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:25 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:26.836802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:26.837949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:26.849952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.851144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.852132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.853619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.854560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.855375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.947051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.950497 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:26.964976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.967461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.994979 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47bc376b-fd79-4f47-9591-4f8701bf0a13 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.828154 Oct 24 08:55:27.000041 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 487/983] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:26 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:27.009973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:27.015186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:27.035712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.036705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.037403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.038368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.040519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.041229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.991066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.010039 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65d5be2f-ec7e-410f-a645-a1e84017ff32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 1.008541 Oct 24 08:55:28.011008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 488/984] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:27 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:28.018568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4161e5cc-60cb-4193-934d-b72324212667 req-480689e5-94cd-4483-978b-05326e71683c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792bb51b-253c-4fdb-ac1e-99e18bd2fce7", "tag": "a424feab-3312-458c-9dd4-f47480184a8f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:28.045320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4161e5cc-60cb-4193-934d-b72324212667 req-480689e5-94cd-4483-978b-05326e71683c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.046084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4161e5cc-60cb-4193-934d-b72324212667 req-480689e5-94cd-4483-978b-05326e71683c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.048553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4161e5cc-60cb-4193-934d-b72324212667 req-480689e5-94cd-4483-978b-05326e71683c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.079808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4161e5cc-60cb-4193-934d-b72324212667 req-480689e5-94cd-4483-978b-05326e71683c service nova] Creating event network-changed:a424feab-3312-458c-9dd4-f47480184a8f for instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 on n-h2-master-1 Oct 24 08:55:28.094092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.103146 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4161e5cc-60cb-4193-934d-b72324212667 req-480689e5-94cd-4483-978b-05326e71683c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090573 Oct 24 08:55:28.112515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 489/985] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:28.113689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.115427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.121567 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53be6a2d-e48f-4726-ad0b-783e427f05c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 1.288222 Oct 24 08:55:28.134449 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 497/986] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:26 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:28.147154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e430f11f-afd1-4257-8f97-10407a7e823c req-11974dae-ef02-40ea-b562-690cf8baa323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56a0887e-b5c7-47d7-ad5b-72297f386d40", "tag": "cdcac286-03e9-4041-84b1-896d805de241"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:28.164818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:28.165563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:28.178748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e430f11f-afd1-4257-8f97-10407a7e823c req-11974dae-ef02-40ea-b562-690cf8baa323 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.182428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.183186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e430f11f-afd1-4257-8f97-10407a7e823c req-11974dae-ef02-40ea-b562-690cf8baa323 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.183937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.184943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e430f11f-afd1-4257-8f97-10407a7e823c req-11974dae-ef02-40ea-b562-690cf8baa323 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.195407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.196501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.197130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.197758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.228777 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e430f11f-afd1-4257-8f97-10407a7e823c req-11974dae-ef02-40ea-b562-690cf8baa323 service nova] Creating event network-changed:cdcac286-03e9-4041-84b1-896d805de241 for instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 on n-h1-master-1 Oct 24 08:55:28.248345 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e430f11f-afd1-4257-8f97-10407a7e823c req-11974dae-ef02-40ea-b562-690cf8baa323 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131675 Oct 24 08:55:28.259558 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 490/987] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:28.299916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:28.305370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:28.347464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.349411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.350966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.353748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.355079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.359630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.756312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.770418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.775613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.799311 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f60115fb-3ae8-4baf-bffc-281f89b391ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.533841 Oct 24 08:55:28.802378 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 491/988] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:28 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:29.037954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:29.040274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:29.063074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:29.063921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:29.064671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:29.074120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:29.074925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:29.078064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:29.109022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:29.122351 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f26e3279-9a94-459a-8010-51b9488364af tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.985511 Oct 24 08:55:29.144005 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 498/989] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:28 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:29.155499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:29.160515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:29.189182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:29.190594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:29.192854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:29.197905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:29.198973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:29.200378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:29.691782 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:29.738145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:29.749812 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc3f432e-3f8d-4af7-aaf9-724ac88bc607 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 0.715028 Oct 24 08:55:29.765587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 492/990] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:29 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:29.838991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:29.839789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:29.848417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:29.849220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:29.850672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:29.851786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:29.852466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:29.853103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:29.993247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.006527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.007963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.008891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.018000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.020283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-306c0980-a4fb-4df8-b642-5ee5a4b5a3aa tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.185558 Oct 24 08:55:30.026863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.028656 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8b8982b-11f2-43de-9ff8-67b3b12a033b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.879606 Oct 24 08:55:30.029491 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 499/991] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:29 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:30.039023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 493/992] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:29 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:55:30.153413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:30.155438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:30.163787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.164529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.165239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:30.166136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.166749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.167333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:30.314221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0ea8193e-099b-4d5d-a620-3b286005ca64 req-54ff6175-311d-430e-958b-fdce7ba99173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6127cb-4f9c-4c21-8c3a-77f9647118b6", "tag": "ffbc072d-35c8-4f50-a633-0eda6e30404a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:30.323713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0ea8193e-099b-4d5d-a620-3b286005ca64 req-54ff6175-311d-430e-958b-fdce7ba99173 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.324426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0ea8193e-099b-4d5d-a620-3b286005ca64 req-54ff6175-311d-430e-958b-fdce7ba99173 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.325346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0ea8193e-099b-4d5d-a620-3b286005ca64 req-54ff6175-311d-430e-958b-fdce7ba99173 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:30.337964 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0ea8193e-099b-4d5d-a620-3b286005ca64 req-54ff6175-311d-430e-958b-fdce7ba99173 service nova] Creating event network-changed:ffbc072d-35c8-4f50-a633-0eda6e30404a for instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 on n-h1-master-1 Oct 24 08:55:30.343808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0ea8193e-099b-4d5d-a620-3b286005ca64 req-54ff6175-311d-430e-958b-fdce7ba99173 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033228 Oct 24 08:55:30.344439 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 494/993] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:55:30.778514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:30.779919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:30.797419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.799898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.801918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:30.804276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.807671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.808206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.086929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.104462 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8aed0f68-a1a0-47e3-ab3e-3ee8612f24f1 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.956908 Oct 24 08:55:31.116632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 500/994] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:30 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:31.123113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:31.129713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:31.154973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:31.155643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:31.157870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.162312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:31.162987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:31.163718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.485084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.516453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3a3666f-7750-4315-8470-a769609218df tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 0.742167 Oct 24 08:55:31.551384 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 495/995] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:30 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:31.570561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:31.574937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:31.599069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:31.601389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:31.602674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.604229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:31.610855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:31.612559 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:31.612762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.789403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.811504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.818596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.839478 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe7a996f-420e-48b7-b7ef-3144d90ce841 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.284254 Oct 24 08:55:31.847462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 496/996] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:31 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:32.063376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:32.077891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:32.082048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:32.088531 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84469200-29ae-472e-8786-44907e34e8ec tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.968496 Oct 24 08:55:32.091265 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 501/997] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:31 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:32.144636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:32.146283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:32.167487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:32.170365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:32.171926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:32.172944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:32.174571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:32.176138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:32.365496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1406055312", "imageRef": "b22f1eac-91c3-498a-99b2-50aeef85141f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3f327fd0-ae57-432e-968f-e46be4f8dc82"}], "security_groups": [{"name": "tempest-securitygroup--244864590"}], "key_name": "tempest-keypair-777841712", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:32.752135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] validate_networks() for [('3f327fd0-ae57-432e-968f-e46be4f8dc82', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:55:34.190412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:34.215472 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19409c29-d9fc-4bf3-95e9-bcc2524baf37 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 2.072759 Oct 24 08:55:34.218996 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 497/998] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:32 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:34.239888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:34.242600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:34.270753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.271347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.271816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.272609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.273071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.283549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.345267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:55:34.346508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:55:34.347466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:55:34.348248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:55:34.349508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:55:34.388278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.391967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.393031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.395408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.396698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.398379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.453110 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:34.473650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Getting quotas for project 178ccdbda089491a92f2c97d4437433c. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:55:34.506289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Getting quotas for user 83d393f7341e402a80a50b822b3f0f94 and project 178ccdbda089491a92f2c97d4437433c. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:55:34.546712 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:55:34.562154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b22f1eac-91c3-498a-99b2-50aeef85141f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:55:34.714951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b4d8db4-2e40-4d0f-96ca-e5c30ed89d95 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.355790 Oct 24 08:55:34.718633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 502/999] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:55:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:55:34.733135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:34.734210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:34.746371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.747165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.748382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.749591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.751014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.751739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.780917 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:34.990588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.018017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.019484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.051437 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d229ba19-aae0-40ca-92d1-55803346f9bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.331407 Oct 24 08:55:35.077428 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 503/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:34 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:35.100320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:35.101982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:35.119998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:35.124008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:35.128832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:35.129867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:35.130456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:35.131603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:35.284950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.306269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1dafc76-d665-4809-911a-769b2eb4b3a0 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 1.084440 Oct 24 08:55:35.315720 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 498/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:34 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:35.340095 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ae00146-e3e4-4f28-b15b-cc70a606567c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:35.346738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ae00146-e3e4-4f28-b15b-cc70a606567c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:35.574676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1ae00146-e3e4-4f28-b15b-cc70a606567c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.589541 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ae00146-e3e4-4f28-b15b-cc70a606567c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1245 microversion: 2.1 time: 0.270855 Oct 24 08:55:35.596024 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 499/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:35 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1245 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:35.612146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:35.614186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:35.634970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:35.637910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:35.640088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:35.641318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:35.642254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:35.646434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.568136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.585979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.594512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.596111 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73fee257-c665-4860-ade1-c3c9a5149655 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 1.513067 Oct 24 08:55:36.597380 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 504/1003] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:35 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:36.604822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:36.605839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:36.615388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:36.617672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:36.618454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.619448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:36.620142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:36.620807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.718357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.731664 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-444e931b-5fe7-43ed-9220-2e6c61c892ea tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.134260 Oct 24 08:55:36.738975 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 500/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:35 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:36.761943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:36.766123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:36.812537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:36.813543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:36.815830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.817736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:36.821091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:36.821884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.854089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.876451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.878827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.896478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7bf25b93-3b54-4ae1-b341-cf72e33a6712 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.297688 Oct 24 08:55:36.897642 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 505/1005] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:36 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:37.196565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-757451299", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:37.327153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:55:37.715355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:37.785938 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dfd275ad-f284-4a81-b5f7-cab31e587844 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 1.040091 Oct 24 08:55:37.788631 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 501/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:36 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:37.824495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:37.824495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:37.859550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:37.861882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:37.862452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:37.865509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:37.866128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:37.867195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.336896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:38.355344 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63c3f3ed-5eab-4b89-b3a5-2d4d592121c9 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1305 microversion: 2.1 time: 0.562164 Oct 24 08:55:38.355991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 502/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:37 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1305 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:38.382482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:38.383135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:38.428699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.429204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.429679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.430402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.430865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.444377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.784674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:38.797288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:38.802836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:38.808265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61088ee8-7b2b-4339-98ad-15f4644d863c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.442250 Oct 24 08:55:38.813700 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 503/1008] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:38 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:38.818497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:38.819111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:38.837596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.838960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.840904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.843122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.843812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.845775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.899765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:55:38.900889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:55:38.901611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:55:38.902237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:55:38.902884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:55:38.929000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.933891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.935731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.940029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.942093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.946381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.996449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:55:39.010389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:55:39.043511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:55:39.049888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:55:39.158164 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72c6797b-7374-49c3-b7a4-2e32549dec6c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258986 Oct 24 08:55:39.159628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 506/1009] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:55:39.164405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:39.165232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:39.172458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:39.188699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:39.190152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:39.191161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:39.191877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:39.193688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:39.406334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.424071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.427300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.439630 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41f56646-297e-4406-b893-6de41279cd2c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.278768 Oct 24 08:55:39.446260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 507/1010] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:39 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:39.463581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:39.464930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:39.484484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:39.485975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:39.487554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:39.489119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:39.490905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:39.491947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:39.773501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.789958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-508e2cc1-09d6-4966-bd6a-9eede377e34b tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 0.341964 Oct 24 08:55:39.806046 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 508/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:39 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:39.815014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0860dc7c-27cd-4d3e-9282-7ddd1356ef13 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:39.817079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0860dc7c-27cd-4d3e-9282-7ddd1356ef13 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:39.896404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.911934 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5c4cee8-11e2-4e07-8bad-700e6968f092 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.096870 Oct 24 08:55:39.912525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 504/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:38 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:39.922504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:39.923426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:39.947525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:39.948268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:39.948929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:39.951211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:39.961419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:39.961971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:39.963703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0860dc7c-27cd-4d3e-9282-7ddd1356ef13 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.990736 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0860dc7c-27cd-4d3e-9282-7ddd1356ef13 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1214 microversion: 2.1 time: 0.178566 Oct 24 08:55:39.992699 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 509/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:39 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:40.008283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:40.012595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:40.032562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.035982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.036659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.042025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.042766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.044632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.242659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.252290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67f884c2-59e0-479d-8cef-2fd28a89ec50 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1303 microversion: 2.1 time: 0.338199 Oct 24 08:55:40.268005 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 505/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:39 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1303 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:40.471748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:40.472930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:40.485463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.489359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.491594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.493780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.496255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.496939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.553622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.571782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.579116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.584515 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b33b2bb-53ae-4f1f-bb7e-04574d8fc5cd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.588133 Oct 24 08:55:40.594003 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 510/1015] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:39 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:40.817577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:40.818544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:40.836748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.837770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.840862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.850511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.851996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.852802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.416269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.427157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.434657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.444333 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0df453c8-21bd-4912-af02-750065bc2080 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.976917 Oct 24 08:55:41.446636 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 506/1016] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:40 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:55:41.452119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:41.453179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:41.459640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.460439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.461094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.462038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.462892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.463531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.559427 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:41.718605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.748974 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9c417ae-38c0-4e16-8c35-f71829fdfe32 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 0.936191 Oct 24 08:55:41.773323 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 511/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:40 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:41.802991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:41.804968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:41.828457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.830726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.832665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.837982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.839448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.840304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.079239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.090694 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6809c5d7-e5d0-4e4e-9c9d-686188d7cd35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1274 microversion: 2.1 time: 0.326340 Oct 24 08:55:42.109796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 512/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:41 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1274 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:42.116303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:42.117233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:42.130912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.131404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.142082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.143122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.143772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.147625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.391672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.406835 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-553fd69f-d5ae-494f-bcc9-e16ae316e10f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.299883 Oct 24 08:55:42.407487 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 513/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:42 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:42.426044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:42.427027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:42.436065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.436574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.437184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.437955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.438575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.439226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.466913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.488805 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a2b1d08-7dea-4fe6-95b1-ce368d1065bc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.040715 Oct 24 08:55:42.493448 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 507/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:41 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:42.513126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-90e43c3e-d531-4f11-8bf7-48ee4537e02b req-8ade6f6b-8516-49db-bc12-baaadb8bc560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6127cb-4f9c-4c21-8c3a-77f9647118b6", "name": "network-vif-plugged", "status": "completed", "tag": "ffbc072d-35c8-4f50-a633-0eda6e30404a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:42.554729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-90e43c3e-d531-4f11-8bf7-48ee4537e02b req-8ade6f6b-8516-49db-bc12-baaadb8bc560 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.563609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-90e43c3e-d531-4f11-8bf7-48ee4537e02b req-8ade6f6b-8516-49db-bc12-baaadb8bc560 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.564583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-90e43c3e-d531-4f11-8bf7-48ee4537e02b req-8ade6f6b-8516-49db-bc12-baaadb8bc560 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.592343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-90e43c3e-d531-4f11-8bf7-48ee4537e02b req-8ade6f6b-8516-49db-bc12-baaadb8bc560 service nova] Creating event network-vif-plugged:ffbc072d-35c8-4f50-a633-0eda6e30404a for instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 on n-h1-master-1 Oct 24 08:55:42.599713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-90e43c3e-d531-4f11-8bf7-48ee4537e02b req-8ade6f6b-8516-49db-bc12-baaadb8bc560 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103708 Oct 24 08:55:42.601186 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 508/1021] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:42.614024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:42.617212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:42.633572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.634519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.635188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.637949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.649251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.657205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.921500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.944532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.946540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.947968 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a32991c3-0064-4dfe-8b4b-2ba01a3185e8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.539548 Oct 24 08:55:42.949099 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 514/1022] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:42 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:42.954036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:42.954937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:42.968013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.973007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.973749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.975095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.978974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.979721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.079442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.092252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.099307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.110823 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:43.113499 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b27b063-b190-403d-b817-1f3aabebfc45 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.508959 Oct 24 08:55:43.129891 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 509/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:42 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:43.150977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:43.151752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:43.172796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.173400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.173776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.174448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.174900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.175321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.508423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.535286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9193ccc3-2f65-48d2-8363-cd4f836022c5 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1316 microversion: 2.1 time: 0.584803 Oct 24 08:55:43.556325 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 515/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:42 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:43.570344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:43.578936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:43.605459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.605975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.606419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.610441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.610932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.611388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.625958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.637730 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a92b5e6d-28e1-45c8-9822-d1ff8b748d2a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1272 microversion: 2.1 time: 0.506140 Oct 24 08:55:43.649861 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 510/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:43 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1272 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:43.661191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:43.670711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:43.683083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.683777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.687319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.689652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.696487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.697437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.200747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:44.211540 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a127cd28-3148-4f9c-9107-f537e6422a93 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.651360 Oct 24 08:55:44.212154 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 516/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:43 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:44.220927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:44.226123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:44.240817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.243509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.245395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.248310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.267348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.268786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.329047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:44.350915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c93ec7f-76be-4d5d-911a-2aafb200846e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.698840 Oct 24 08:55:44.351514 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 511/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:43 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:44.374019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:44.375153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:44.388632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.392270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.392979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.393973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.397553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.398212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.629902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:44.654209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:44.656239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:44.737802 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d73dfe5b-266a-4ce8-a349-2aabbaf7159c tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.380935 Oct 24 08:55:44.743150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 512/1028] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:44 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:44.783605 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:44.789593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:44.817009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.819669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.821949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.829958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.834075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.836739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.299230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.313250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.321855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.323044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2865cc9-901d-4562-bfdb-477f776e2407 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 1.108443 Oct 24 08:55:45.326678 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 517/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:44 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:45.349675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:45.350893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:45.367306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.368486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.370268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.372608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.373284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.375504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.504511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.539871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a68d9cd-3d50-473b-8b4f-7ad00c9bb6db tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1504 microversion: 2.1 time: 0.792457 Oct 24 08:55:45.570491 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 513/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:44 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1504 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:45.588145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.599427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f4617522-f9b5-4e41-8237-c404289d8c5b req-7bab6630-632a-4f37-be8b-4e4d97745029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792bb51b-253c-4fdb-ac1e-99e18bd2fce7", "name": "network-vif-plugged", "status": "completed", "tag": "a424feab-3312-458c-9dd4-f47480184a8f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:45.600896 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b46f6188-b9fb-4365-9503-9d8241561174 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1272 microversion: 2.1 time: 0.271504 Oct 24 08:55:45.615887 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 518/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:45 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:45.615887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:45.615887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:45.634591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.635097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.635543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.636262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.636721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.637145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.640990 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:45.656175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4617522-f9b5-4e41-8237-c404289d8c5b req-7bab6630-632a-4f37-be8b-4e4d97745029 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.656648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4617522-f9b5-4e41-8237-c404289d8c5b req-7bab6630-632a-4f37-be8b-4e4d97745029 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.657091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4617522-f9b5-4e41-8237-c404289d8c5b req-7bab6630-632a-4f37-be8b-4e4d97745029 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.730564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f4617522-f9b5-4e41-8237-c404289d8c5b req-7bab6630-632a-4f37-be8b-4e4d97745029 service nova] Creating event network-vif-plugged:a424feab-3312-458c-9dd4-f47480184a8f for instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 on n-h2-master-1 Oct 24 08:55:45.784263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f4617522-f9b5-4e41-8237-c404289d8c5b req-7bab6630-632a-4f37-be8b-4e4d97745029 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201840 Oct 24 08:55:45.788609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 514/1032] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:45.831234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:45.837072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:45.874416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.874928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.875376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.881518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:45.881775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:45.886667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:46.192978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:46.204719 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4f1096e-fa6f-449c-805b-5cc5e8f2d43c tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.600788 Oct 24 08:55:46.212909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 519/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:45 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:46.227303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:46.228049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:46.241036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:46.242246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:46.243679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:46.249712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:46.250215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:46.250661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:46.308559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:55:46.396662 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:46.500550 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd780c72-0c39-46f6-8e26-b893d02ff29d tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 204 len: 0 microversion: 2.1 time: 0.285697 Oct 24 08:55:46.501379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 520/1034] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:46 2022] DELETE /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:55:46.516468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:46.519004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:46.535781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:46.536264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:46.536711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:46.537616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:46.538078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:46.538509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:47.014086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.027054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.028663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.056032 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08e68931-6c5a-4bfc-84d6-4f69f65ef2c2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1533 microversion: 2.91 time: 0.549024 Oct 24 08:55:47.073414 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 521/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:46 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1533 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:47.082095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:47.082095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:47.115537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:47.124656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:47.127213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:47.130154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:47.131371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:47.137321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:47.646466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.691342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.701716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.707169 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a6a0021-8f42-40d0-9a51-f4cbeb48ff8f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.645185 Oct 24 08:55:47.727736 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 522/1036] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:47 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:47.727736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:47.733511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:47.764651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:47.778670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:47.780028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:47.780477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:47.782316 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dd5c2dd5-1958-4312-9ae1-eab77f4b509a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 1.989670 Oct 24 08:55:47.782924 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 515/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:45 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:47.783452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:47.785810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:47.786734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:47.803519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:47.805280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:47.826952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:47.827688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:47.829565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:47.832070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:47.832857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:47.833891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:48.939885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:48.952671 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de99cecb-6830-45d8-a565-7482daccaf81 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1510 microversion: 2.1 time: 1.237175 Oct 24 08:55:48.953316 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 523/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:47 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1510 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:48.983671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-88fe61d0-2fa0-4a6d-9d0a-22a4a81aa704 req-56498f82-a5cf-45a6-b60b-92c6ff143b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6352e97a-d784-43f0-b94e-cee5d7e9a084", "tag": "ec159437-cd78-406e-9391-5a30935d0b65"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:49.007076 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:49.010107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-88fe61d0-2fa0-4a6d-9d0a-22a4a81aa704 req-56498f82-a5cf-45a6-b60b-92c6ff143b6b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.010827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-88fe61d0-2fa0-4a6d-9d0a-22a4a81aa704 req-56498f82-a5cf-45a6-b60b-92c6ff143b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.011414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-88fe61d0-2fa0-4a6d-9d0a-22a4a81aa704 req-56498f82-a5cf-45a6-b60b-92c6ff143b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.047324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-88fe61d0-2fa0-4a6d-9d0a-22a4a81aa704 req-56498f82-a5cf-45a6-b60b-92c6ff143b6b service nova] Creating event network-changed:ec159437-cd78-406e-9391-5a30935d0b65 for instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 on n-h2-master-1 Oct 24 08:55:49.053882 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-88fe61d0-2fa0-4a6d-9d0a-22a4a81aa704 req-56498f82-a5cf-45a6-b60b-92c6ff143b6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084991 Oct 24 08:55:49.056622 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 524/1039] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:49.070080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:49.070788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:49.089541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.090328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.091575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.096343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.097007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.097480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.252706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lazy-loading 'services' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:49.289577 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-feb68a5a-e19b-4741-996e-6de62a9a371e tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1938 microversion: 2.91 time: 0.231412 Oct 24 08:55:49.290181 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 525/1040] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:49 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1938 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:49.331416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:49.332042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:49.348862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.349379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.349819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.350518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.350973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.351392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.535473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:49.557586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c511640-d039-4d19-9f00-b3fa3c6ebdcb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 1.769192 Oct 24 08:55:49.560409 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 516/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:47 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:49.578062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:49.580917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:49.600561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.601068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.611943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.614740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:49.617056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:49.618924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:49.968980 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:50.209737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:50.234629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6fdc30f5-1c74-43d5-b09a-815b70b73d92 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.927007 Oct 24 08:55:50.255685 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 526/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:49 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:50.273372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:50.273372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:50.282281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:50.282853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:50.283234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:50.284043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:50.284496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:50.284922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:50.368525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:50.415366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:50.426542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:50.435346 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0057421a-ff00-487a-9975-0c6edb0dd87a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1411 microversion: 2.25 time: 0.870823 Oct 24 08:55:50.437225 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 517/1043] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:49 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1411 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:50.461716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:50.464352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:50.494386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:50.496250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:50.496708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:50.499022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:50.500125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:50.500572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:50.610247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lazy-loading 'flavor' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:50.961564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:50.987388 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e829bee5-4981-447c-b43d-c52f99c36f77 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.726042 Oct 24 08:55:51.006835 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 527/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:50 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:51.031918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:51.036997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:51.075969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:51.082442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:51.088395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:51.089534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:51.093615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:51.094001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:51.400646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db871cb3-6efa-4322-a05a-4f7547d7a5ab tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action" status: 202 len: 0 microversion: 2.91 time: 0.957290 Oct 24 08:55:51.404621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 518/1045] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:55:50 2022] POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:55:51.430136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:51.431579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:51.461838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:51.464364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:51.464829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:51.465762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:51.473907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:51.473907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:51.691837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea1fba85548404ca535fc5889752511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21cf10d74849ad9f86efee0a5bd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:51.708858 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e62ab632-fe21-446e-8ae5-8a614d476c98 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 200 len: 1468 microversion: 2.1 time: 0.699523 Oct 24 08:55:51.710093 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 528/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:51 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 1468 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:51.718584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:51.719491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:51.753821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:51.762272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:51.763707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:51.764583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:51.765041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:51.765500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:51.964584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:51.978320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd2b0042-d7e7-4ed6-84f4-e67382bb6692 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.568213 Oct 24 08:55:51.979364 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 519/1047] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:51 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:51.985487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:51.995683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:52.016977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.017817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.018503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.023725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.024475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.025133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.068963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.079175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa361e11-7c23-4c03-abe2-951897947f42 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.367427 Oct 24 08:55:52.079798 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 529/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:51 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:52.093533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:52.106901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:52.118893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.119590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.120210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.121463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.122125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.123054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.435561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.446316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.447779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.454495 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47400614-2fdf-42a2-947d-fd359a15f8c3 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.473792 Oct 24 08:55:52.455390 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 520/1049] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:51 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:52.461499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3ed84d8c-1ece-48fb-a501-4e1ce9a16e63 req-1e561209-cc53-48f8-b3c9-1a5faf0d287e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6127cb-4f9c-4c21-8c3a-77f9647118b6", "name": "network-vif-deleted", "tag": "ffbc072d-35c8-4f50-a633-0eda6e30404a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:52.473243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3ed84d8c-1ece-48fb-a501-4e1ce9a16e63 req-1e561209-cc53-48f8-b3c9-1a5faf0d287e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.474114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3ed84d8c-1ece-48fb-a501-4e1ce9a16e63 req-1e561209-cc53-48f8-b3c9-1a5faf0d287e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.474555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3ed84d8c-1ece-48fb-a501-4e1ce9a16e63 req-1e561209-cc53-48f8-b3c9-1a5faf0d287e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.487658 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3ed84d8c-1ece-48fb-a501-4e1ce9a16e63 req-1e561209-cc53-48f8-b3c9-1a5faf0d287e service nova] Creating event network-vif-deleted:ffbc072d-35c8-4f50-a633-0eda6e30404a for instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 on n-h1-master-1 Oct 24 08:55:52.500906 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3ed84d8c-1ece-48fb-a501-4e1ce9a16e63 req-1e561209-cc53-48f8-b3c9-1a5faf0d287e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044056 Oct 24 08:55:52.507043 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 521/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:52.514982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:52.517177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:52.524485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.525772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.526554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.527486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.528676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.529475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.558421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.566929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.568359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:52.569555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1038fa5a-aa98-4c4f-a541-24eb78686612 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1606 microversion: 2.25 time: 0.483824 Oct 24 08:55:52.574147 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 530/1051] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:52 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1606 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:52.608268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:52.610095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:52.632983 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:52.641521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.643814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.645550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.648716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.653990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.656636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.845275 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc7f45dc-d826-4f48-a985-770bcf735090 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.247866 Oct 24 08:55:52.845969 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 531/1052] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 08:55:52 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:55:52.853915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:52.856326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:52.874641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.875153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.875598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.876325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.876784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.877208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.918803 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 HTTP/1.1 Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:55:52.923553 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.924951 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0d6127cb-4f9c-4c21-8c3a-77f9647118b6'} Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:52.925766 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.927047 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.929852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:52.931224 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c3a3d1e5-116a-4d47-952f-38dcc0e466e3 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 404 len: 111 microversion: 2.1 time: 0.081425 Oct 24 08:55:52.932215 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 532/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:52 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:52.942880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1280493860", "metadata": {"image_type": "test"}}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:52.947771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:52.955345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.956218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.958006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.960380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:52.961198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:52.961817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:52.981954 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6/action HTTP/1.1 Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 112 Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:55:52.985180 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1280493860", "metadata": {"image_type": "test"}}} Oct 24 08:55:52.986800 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0d6127cb-4f9c-4c21-8c3a-77f9647118b6', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1280493860', 'metadata': {'image_type': 'test'}}}} Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:52.987721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:52.989261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:52.990937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:52.990937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:52.990937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:52.990937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:52.990937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:55:52.996326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:52.999176 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0aa84277-c2a1-44f4-9fd9-7a0daa541c25 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "POST /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6/action" status: 404 len: 111 microversion: 2.1 time: 0.060861 Oct 24 08:55:53.000228 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 533/1054] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Oct 24 08:55:52 2022] POST /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:55:53.114198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1474515411", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "c18dc6e1-521c-409e-ae7d-3512fe14036e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:53.187171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] validate_networks() for [('c18dc6e1-521c-409e-ae7d-3512fe14036e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:55:53.267389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:53.282704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6d1c74a-23e5-4553-b787-5a8769398282 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1716 microversion: 2.1 time: 0.773265 Oct 24 08:55:53.293329 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 522/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:52 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1716 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:53.302596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:53.303222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:53.318512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:53.320005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:53.320619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:53.322182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:53.323653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:53.324359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:53.663283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:53.671820 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ad27692-bf40-4282-b5f2-c06fe9735446 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.379996 Oct 24 08:55:53.672598 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 523/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:53 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:53.694684 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa3c4886-4c57-4ff7-88bc-cee6c8a256a4 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1600474316", "metadata": {"image_type": "test"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:53.702441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa3c4886-4c57-4ff7-88bc-cee6c8a256a4 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Failed to fetch instance by id tempest-invalid-537291620 {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 08:55:53.703405 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-fa3c4886-4c57-4ff7-88bc-cee6c8a256a4 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance tempest-invalid-537291620 could not be found. Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa3c4886-4c57-4ff7-88bc-cee6c8a256a4 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/tempest-invalid-537291620/action HTTP/1.1 Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 112 Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:53.708111 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1600474316", "metadata": {"image_type": "test"}}} Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:53.709778 n-d-master-1 devstack@n-api.service[126919]: exception: Instance tempest-invalid-537291620 could not be found. Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'tempest-invalid-537291620', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1600474316', 'metadata': {'image_type': 'test'}}}} Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-537291620 could not be found. Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:53.710878 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-537291620 could not be found. Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-537291620 could not be found. Oct 24 08:55:53.712889 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:53.716257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa3c4886-4c57-4ff7-88bc-cee6c8a256a4 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance tempest-invalid-537291620 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:53.717320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa3c4886-4c57-4ff7-88bc-cee6c8a256a4 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-537291620/action" status: 404 len: 100 microversion: 2.1 time: 0.043980 Oct 24 08:55:53.718100 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 524/1057] 10.222.0.25 () {60 vars in 1246 bytes} [Mon Oct 24 08:55:53 2022] POST /compute/v2.1/servers/tempest-invalid-537291620/action => generated 100 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:53.723256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:53.723875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:53.732932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:53.733468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:53.733909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:53.734626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:53.735094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:53.736064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:53.739274 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:54.042886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:54.063333 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bef8da4-d3d2-4ea5-90bc-27ee96157979 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.333051 Oct 24 08:55:54.065112 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 525/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:53 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:54.072047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:54.072675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:54.079640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.080386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.081007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.082449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.083067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.083645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.199613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:54.210271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:54.212669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:54.221213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d06a9678-50dc-424e-b1a2-694b94e21b05 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.154102 Oct 24 08:55:54.222550 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 526/1059] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:54 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:54.227948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24d51ef6-f4ff-410c-a06b-890a8ea62e16 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-617127754"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:54.230919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24d51ef6-f4ff-410c-a06b-890a8ea62e16 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 08:55:54.232507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-24d51ef6-f4ff-410c-a06b-890a8ea62e16 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24d51ef6-f4ff-410c-a06b-890a8ea62e16 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 56 Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:54.234583 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: {"createImage": {"name": "tempest-test-snap-617127754"}} Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:54.235929 n-d-master-1 devstack@n-api.service[126919]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-617127754'}}} Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:54.236731 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.237969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.240778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24d51ef6-f4ff-410c-a06b-890a8ea62e16 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:54.241904 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24d51ef6-f4ff-410c-a06b-890a8ea62e16 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018055 Oct 24 08:55:54.248628 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 527/1060] 10.222.0.25 () {60 vars in 1275 bytes} [Mon Oct 24 08:55:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:54.254026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c9c4703-dad8-43e6-b54a-60c9bcf69868 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-786126066"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:54.258145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c9c4703-dad8-43e6-b54a-60c9bcf69868 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 08:55:54.258908 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7c9c4703-dad8-43e6-b54a-60c9bcf69868 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c9c4703-dad8-43e6-b54a-60c9bcf69868 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 56 Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:54.260744 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: {"createImage": {"name": "tempest-test-snap-786126066"}} Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:54.262315 n-d-master-1 devstack@n-api.service[126919]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-786126066'}}} Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:54.264048 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 08:55:54.266935 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.269819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c9c4703-dad8-43e6-b54a-60c9bcf69868 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:54.272426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c9c4703-dad8-43e6-b54a-60c9bcf69868 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020212 Oct 24 08:55:54.273513 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 528/1061] 10.222.0.25 () {60 vars in 1281 bytes} [Mon Oct 24 08:55:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:54.284700 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:54.285280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:54.296168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.297034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.297701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.298675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.299333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.300116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.318741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 HTTP/1.1 Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:54.320964 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.322430 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '0d6127cb-4f9c-4c21-8c3a-77f9647118b6'} Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:54.323176 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.324782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.330658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:54.332258 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84473cc3-8c12-4b5f-8503-8ff41aef8542 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 404 len: 111 microversion: 2.1 time: 0.051614 Oct 24 08:55:54.337640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 529/1062] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:54 2022] DELETE /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:55:54.343297 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:54.343918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:54.350842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.351334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.351770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.353196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.353716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.354141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.625006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:54.633789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37ff6f53-aeea-45fa-857d-b9fef6c0a8b9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1706 microversion: 2.1 time: 0.295101 Oct 24 08:55:54.634751 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 530/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:54 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1706 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:54.658224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:54.659380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] [instance: 0d6127cb-4f9c-4c21-8c3a-77f9647118b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:54.696105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.698053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.698789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.699788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.701057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.701857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.718401 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] HTTP exception thrown: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Request method failure captured: Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 HTTP/1.1 Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlLz0m3kJSKpRxfWDs2j7G58plVG7AgyIIqieNmYRqGks5mE8vUG2ioUFfaIElSmRvv5cDtMGvE5RWLvFnCdcwhLXWK7iW9giwabe0WxNISSiZt-2n5ppddenDoyNb0oAM4I3BySIsgsEUKGSFpIB6lsJ-W27KBjCmBubGrap2YcSqI Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:55:54.719845 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21cf10d74849ad9f86efee0a5bd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21cf10d74849ad9f86efee0a5bd4df"}]}] Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 6e21cf10d74849ad9f86efee0a5bd4df Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-527085739 Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: bea1fba85548404ca535fc5889752511 Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesNegativeTestJSON-527085739-project Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.721364 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '0d6127cb-4f9c-4c21-8c3a-77f9647118b6'} Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:54.726479 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. Oct 24 08:55:54.727938 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:55:54.729313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] Returning 404 to user: Instance 0d6127cb-4f9c-4c21-8c3a-77f9647118b6 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:54.729313 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dfd4a9a7-36b5-4bb9-b945-1d679fd8e847 tempest-ImagesNegativeTestJSON-527085739 tempest-ImagesNegativeTestJSON-527085739-project] 10.222.0.25 "GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6" status: 404 len: 111 microversion: 2.1 time: 0.085320 Oct 24 08:55:54.729313 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 531/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:54 2022] GET /compute/v2.1/servers/0d6127cb-4f9c-4c21-8c3a-77f9647118b6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:54.729313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-03802c32-8d62-4ab0-be36-b1dbf0e0a711 req-d12fcfe6-e115-4877-941e-2b809b595129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92f3cc7-ce7c-493d-85cf-72e7a8fc702a", "tag": "4cada68f-2e38-449f-9a4f-a55582221bf1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:54.737278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-03802c32-8d62-4ab0-be36-b1dbf0e0a711 req-d12fcfe6-e115-4877-941e-2b809b595129 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.737805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-03802c32-8d62-4ab0-be36-b1dbf0e0a711 req-d12fcfe6-e115-4877-941e-2b809b595129 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.738237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-03802c32-8d62-4ab0-be36-b1dbf0e0a711 req-d12fcfe6-e115-4877-941e-2b809b595129 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.754279 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-03802c32-8d62-4ab0-be36-b1dbf0e0a711 req-d12fcfe6-e115-4877-941e-2b809b595129 service nova] Creating event network-changed:4cada68f-2e38-449f-9a4f-a55582221bf1 for instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a on n-h1-master-1 Oct 24 08:55:54.759591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-03802c32-8d62-4ab0-be36-b1dbf0e0a711 req-d12fcfe6-e115-4877-941e-2b809b595129 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 Oct 24 08:55:54.760490 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 532/1065] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:54.766407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1d7764c-f98e-46ea-b517-0fe5a57baded tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '.version_select at 0x7f8dab088160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:54.769909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1d7764c-f98e-46ea-b517-0fe5a57baded tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.770395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1d7764c-f98e-46ea-b517-0fe5a57baded tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.770831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1d7764c-f98e-46ea-b517-0fe5a57baded tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.787536 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1d7764c-f98e-46ea-b517-0fe5a57baded tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1934 microversion: 2.1 time: 0.025839 Oct 24 08:55:54.788714 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 533/1066] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:55:54 2022] GET /compute/v2.1/os-migrations => generated 1934 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:54.795142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:54.796097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:54.804281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.805240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.805850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:54.806788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:54.807394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:54.807970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.163238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:55:55.163853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:55:55.164101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:55:55.164699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:55:55.165356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:55:55.178394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.178878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.180226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.180970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.181621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.182747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.212311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Getting quotas for project 946a17ccefa7499e8e6753cda6710cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:55:55.221214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Getting quotas for user 549b0b8da68647e3b968e80ab7e48022 and project 946a17ccefa7499e8e6753cda6710cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:55:55.236248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:55:55.240305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:55:55.282971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:55.300858 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d398655-c6a6-428e-9d72-49a1c0741f38 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.510861 Oct 24 08:55:55.301718 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 534/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:54 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:55.311719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:55.312713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:55.319369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.320206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.320876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.321832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.322503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.323165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.326580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f2f4b78-a2f2-4d63-b651-3add1eacc240 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.323274 Oct 24 08:55:55.329099 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 534/1068] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:55:55.348574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:55.349204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:55.355711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.356493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.357106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.358307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.358925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.359517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.710275 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bada4f4-f44e-4932-898a-a66a9a07f07a tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1857 microversion: 2.1 time: 0.407238 Oct 24 08:55:55.711105 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 535/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:55 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1857 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:55.736628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:55.737570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:55.745521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.746598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.747255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.748128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:55.748743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:55.749375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:55.931358 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:55.941692 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2743fed2-c15f-4cf2-b0f4-688efe82d669 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.610960 Oct 24 08:55:55.942482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 535/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:55 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:55.947151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ef3df54-72cf-43e9-99dc-c8f916ff83be tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:55.951126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ef3df54-72cf-43e9-99dc-c8f916ff83be tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:56.023973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:56.037960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:56.043889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:56.063417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0fc3df5f-239e-4136-82a1-2bcceb3552b8 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.335290 Oct 24 08:55:56.068136 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 536/1071] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:55 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:56.091912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:56.092910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:56.113611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ef3df54-72cf-43e9-99dc-c8f916ff83be tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:56.117488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:56.119586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:56.120055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:56.120799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:56.124474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ef3df54-72cf-43e9-99dc-c8f916ff83be tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1225 microversion: 2.1 time: 0.180820 Oct 24 08:55:56.124612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:56.124954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:56.129475 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 536/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:55 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:56.340559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:56.341145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:56.368626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:56.369136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:56.371669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:56.374898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:56.375429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:56.375881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:56.915194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:56.931332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ff2c562-a117-4057-830d-29dc5c3f882d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.598548 Oct 24 08:55:56.935987 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 537/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:56 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:56.945758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-119a6bbb-3aac-4bb3-af18-432d2ac1d331 req-8e718c35-215d-4670-b881-33e43b6abae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792bb51b-253c-4fdb-ac1e-99e18bd2fce7", "tag": "a424feab-3312-458c-9dd4-f47480184a8f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:56.984995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-119a6bbb-3aac-4bb3-af18-432d2ac1d331 req-8e718c35-215d-4670-b881-33e43b6abae6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:56.988060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-119a6bbb-3aac-4bb3-af18-432d2ac1d331 req-8e718c35-215d-4670-b881-33e43b6abae6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:56.988854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-119a6bbb-3aac-4bb3-af18-432d2ac1d331 req-8e718c35-215d-4670-b881-33e43b6abae6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.020391 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-119a6bbb-3aac-4bb3-af18-432d2ac1d331 req-8e718c35-215d-4670-b881-33e43b6abae6 service nova] Creating event network-changed:a424feab-3312-458c-9dd4-f47480184a8f for instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 on n-h2-master-1 Oct 24 08:55:57.034027 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-119a6bbb-3aac-4bb3-af18-432d2ac1d331 req-8e718c35-215d-4670-b881-33e43b6abae6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094968 Oct 24 08:55:57.038697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 538/1074] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:57.047392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:57.047963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:57.056356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.057271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.058007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.059146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.060577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.061880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.416513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:57.426930 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8aab10a-830d-4061-ab25-41e967543416 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.386219 Oct 24 08:55:57.427519 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 539/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:57 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:57.437796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:57.438647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:57.453039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.455402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.456059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.456956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.457790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.458734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.586843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:57.588713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1fd6f1e2-0558-445a-a41b-f579e9f94c86 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1857 microversion: 2.1 time: 1.514599 Oct 24 08:55:57.591248 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:57.605319 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 537/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:56 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1857 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:57.605544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:57.605544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:57.609924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:57.610828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:57.623488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd617bed-ea9e-4b20-9d73-02d02dc3e5e7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.193037 Oct 24 08:55:57.626823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.629451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.630676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.633687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.634453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.636071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 540/1077] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:57 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:57.636818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.786723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:57.787879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:57.802306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.803463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.820663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.821766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.823618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.824248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.900665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:57.910230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-45fb3d04-1cf1-4246-bff4-e0cdb093e6cb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1277 microversion: 2.1 time: 0.315760 Oct 24 08:55:57.915235 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 538/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:57 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1277 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:57.961343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:57.962068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:57.974478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.979519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.982273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:57.983719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:57.985820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:57.987846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.050745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lazy-loading 'services' on Instance uuid 56a0887e-b5c7-47d7-ad5b-72297f386d40 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:58.370175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-46478f04-9db9-49da-a999-51dc9154f4fc tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments/f2d7d094-9745-4c83-9014-68582971f6d0" status: 202 len: 0 microversion: 2.1 time: 0.586621 Oct 24 08:55:58.380540 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 541/1079] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 08:55:57 2022] DELETE /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments/f2d7d094-9745-4c83-9014-68582971f6d0 => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:55:58.394597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:58.406248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:58.428815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.432028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.433234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.434040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.438194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.440516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.539944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43cda5d0-d12b-4d66-be67-ca62f94f07a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153250 Oct 24 08:55:58.548368 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 542/1080] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:55:58 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:58.565068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:58.566551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:58.582855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.583363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.583809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.584531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.584991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.586037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.708538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:58.718030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63a8d2ca-3d51-443a-ab8a-117c1f119acd tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.760748 Oct 24 08:55:58.729796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 539/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:57 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:55:58.741070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:58.742042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:58.748986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.749829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.750443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.751353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.751983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.753249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:58.887853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:58.911375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:58.913809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:58.940330 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fedb190e-fcd8-4864-ad60-41bd1a7ca7a0 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.209012 Oct 24 08:55:58.959371 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 540/1082] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:58 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:58.969800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a16300ac-c691-4caf-afe7-8bb1b21f7327 req-a5570653-8947-44fd-a738-3daa51823ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6352e97a-d784-43f0-b94e-cee5d7e9a084", "name": "network-vif-plugged", "status": "completed", "tag": "ec159437-cd78-406e-9391-5a30935d0b65"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:58.988105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a16300ac-c691-4caf-afe7-8bb1b21f7327 req-a5570653-8947-44fd-a738-3daa51823ac1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:58.988926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a16300ac-c691-4caf-afe7-8bb1b21f7327 req-a5570653-8947-44fd-a738-3daa51823ac1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:58.989564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a16300ac-c691-4caf-afe7-8bb1b21f7327 req-a5570653-8947-44fd-a738-3daa51823ac1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.007461 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a16300ac-c691-4caf-afe7-8bb1b21f7327 req-a5570653-8947-44fd-a738-3daa51823ac1 service nova] Creating event network-vif-plugged:ec159437-cd78-406e-9391-5a30935d0b65 for instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 on n-h2-master-1 Oct 24 08:55:59.014896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a16300ac-c691-4caf-afe7-8bb1b21f7327 req-a5570653-8947-44fd-a738-3daa51823ac1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053793 Oct 24 08:55:59.016307 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 541/1083] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:59.038740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:59.040219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:59.052991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.053821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.055417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.056377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.057001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.057774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.236929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:59.247057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d5918a7-9452-4b25-a76a-7c0f4796af54 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1283 microversion: 2.1 time: 0.229198 Oct 24 08:55:59.249223 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 542/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:59 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1283 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:59.265876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:59.276462 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b6fb758-3c80-4275-864c-ec9c255911ca tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.723464 Oct 24 08:55:59.285612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 543/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:58 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:59.554072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:59.556668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:59.570142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.574512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.576610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.578368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.580018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.580879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.653941 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d3af18f-6e90-4d1f-afa3-16f6183bf0ab tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103163 Oct 24 08:55:59.655887 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 543/1086] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:55:59 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:59.746361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:59.747705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:59.756955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.761936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.767495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.768494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.769886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.770506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.977843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:59.979099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:59.989214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.991163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.991813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:59.993508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:59.995300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:59.996217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.192515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:00.205274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:00.211815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:00.230388 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f23e4486-8719-4cfb-97d8-dbb500d98156 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.251765 Oct 24 08:56:00.251212 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 544/1087] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:59 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:00.281564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:00.282577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:00.286095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:00.294294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:00.295291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:00.296072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.297060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:00.297837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:00.298310 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a0757a87-5bd3-460d-8417-fafecf0e249d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.555942 Oct 24 08:56:00.298739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.298897 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 544/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:59 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:00.323828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:00.336523 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:00.356969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:00.357496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:00.362376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.363438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:00.365243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:00.366157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.615299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:00.626644 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-199f5862-e326-40d7-b074-7192eee8fd56 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.355892 Oct 24 08:56:00.647215 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 545/1089] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:00 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:00.666342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:00.668541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:00.690012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:00.690555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:00.691588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.693462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:00.694964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:00.695852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:00.791249 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71a8578d-af76-41e1-878f-83571d17c5ac tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128508 Oct 24 08:56:00.792550 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 546/1090] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:00 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:00.999516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:01.030031 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d3aee4c-5d5c-4dc2-a2c9-c2dd056d3cfa tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1370 microversion: 2.1 time: 0.712306 Oct 24 08:56:01.061682 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 545/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:00 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1370 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:01.141452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8e01791d-14f9-4463-b002-bf2d7d637036 req-95057955-8e2b-4a72-b088-b26985c602f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92f3cc7-ce7c-493d-85cf-72e7a8fc702a", "name": "network-vif-plugged", "status": "completed", "tag": "4cada68f-2e38-449f-9a4f-a55582221bf1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:01.162090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8e01791d-14f9-4463-b002-bf2d7d637036 req-95057955-8e2b-4a72-b088-b26985c602f9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.173516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8e01791d-14f9-4463-b002-bf2d7d637036 req-95057955-8e2b-4a72-b088-b26985c602f9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.181982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8e01791d-14f9-4463-b002-bf2d7d637036 req-95057955-8e2b-4a72-b088-b26985c602f9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:01.212159 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:01.221630 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8e01791d-14f9-4463-b002-bf2d7d637036 req-95057955-8e2b-4a72-b088-b26985c602f9 service nova] Creating event network-vif-plugged:4cada68f-2e38-449f-9a4f-a55582221bf1 for instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a on n-h1-master-1 Oct 24 08:56:01.232658 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8e01791d-14f9-4463-b002-bf2d7d637036 req-95057955-8e2b-4a72-b088-b26985c602f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097300 Oct 24 08:56:01.235025 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 547/1092] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:01.263327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:01.264330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:01.273509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.274318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.281645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:01.282829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.283793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.284466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:01.326047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:01.326928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:01.347226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.351244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.351833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:01.352684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.353959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.357238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:01.644499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:01.656297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:01.657749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:01.688040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86e69785-1a90-4c7c-ae43-8ffb2e913209 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.427604 Oct 24 08:56:01.689039 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 546/1093] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:01 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:01.700566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:01.718363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:01.734511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.735004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.735435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:01.736139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:01.739838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:01.740996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.085211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:02.097616 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e1be52e-5697-4cfb-9e8f-987a70f91e50 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.407746 Oct 24 08:56:02.098613 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 547/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:01 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:02.109236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:02.119366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:02.138033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.138526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.138960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.139656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.140110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.152577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.238363 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-094cdf5c-6155-44a9-a00c-1dbe899eb4d8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138282 Oct 24 08:56:02.239262 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 548/1095] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:02 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:02.245127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:02.250353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:02.267643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.268359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.268988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.269967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.270633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.271273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.483369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:02.499819 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aab11c7a-e156-4507-8e38-4f30c132c030 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 1.178417 Oct 24 08:56:02.500798 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 548/1096] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:01 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:02.603760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:02.612309 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99f45f28-1d92-4577-ab21-34bac0bca651 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1556 microversion: 2.1 time: 0.371798 Oct 24 08:56:02.615617 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 549/1097] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:02 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1556 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:02.708004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a432d572-4cab-447e-a51b-027b08775319 req-c120281f-eb04-4cc6-8c0f-dca8a2e4cdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbceef75-e380-4bfd-b277-a0a27f07a417", "tag": "6d4a8cf3-1b18-4da7-9d37-f93567b05e11"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:02.727237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a432d572-4cab-447e-a51b-027b08775319 req-c120281f-eb04-4cc6-8c0f-dca8a2e4cdc4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.727723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a432d572-4cab-447e-a51b-027b08775319 req-c120281f-eb04-4cc6-8c0f-dca8a2e4cdc4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.728156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a432d572-4cab-447e-a51b-027b08775319 req-c120281f-eb04-4cc6-8c0f-dca8a2e4cdc4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.745285 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a432d572-4cab-447e-a51b-027b08775319 req-c120281f-eb04-4cc6-8c0f-dca8a2e4cdc4 service nova] Creating event network-changed:6d4a8cf3-1b18-4da7-9d37-f93567b05e11 for instance cbceef75-e380-4bfd-b277-a0a27f07a417 on n-h1-master-1 Oct 24 08:56:02.750430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9aab2f0-1cfe-4f9b-9891-c7c15c474c68 tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-196514481", "id": 1862937475, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:02.752848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a432d572-4cab-447e-a51b-027b08775319 req-c120281f-eb04-4cc6-8c0f-dca8a2e4cdc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250654 Oct 24 08:56:02.753751 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 549/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:02.765681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:02.766548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:02.773803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.774523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.775146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.776000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.776603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.777177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.806225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9aab2f0-1cfe-4f9b-9891-c7c15c474c68 tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.187944 Oct 24 08:56:02.818949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 550/1099] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:56:02 2022] POST /compute/v2.1/flavors => generated 470 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:56:02.827111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:02.827653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:02.834784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.835251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.835689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.836457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:02.837268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:02.837741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:02.921118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:02.933678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:02.935233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:02.942379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fedb1717-26e7-4cc2-bd04-19b53e231bfe tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.121836 Oct 24 08:56:02.943960 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 551/1100] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:02 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:02.951188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58d24d47-6bf2-40eb-a133-ddc91cec7ac2 tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:02.955465 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6b4495c-134d-4c4f-a378-5d77f8de9373 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198853 Oct 24 08:56:02.967756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 550/1101] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:56:02 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:03.126473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:03.138767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:03.152422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.153977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.154699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:03.154849 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58d24d47-6bf2-40eb-a133-ddc91cec7ac2 tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1862937475/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.209211 Oct 24 08:56:03.155851 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 552/1102] 10.222.0.25 () {62 vars in 1265 bytes} [Mon Oct 24 08:56:02 2022] POST /compute/v2.1/flavors/1862937475/os-extra_specs => generated 62 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:03.156496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.157044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.157788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:03.176143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4b68045-28ea-4480-bab9-fc6bb4307f44 tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:03.199385 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4b68045-28ea-4480-bab9-fc6bb4307f44 tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1862937475" status: 202 len: 0 microversion: 2.86 time: 0.033707 Oct 24 08:56:03.201714 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 553/1103] 10.222.0.25 () {60 vars in 1202 bytes} [Mon Oct 24 08:56:03 2022] DELETE /compute/v2.1/flavors/1862937475 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:56:03.210823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-822e8fdd-63cd-49c5-bb01-c11b50d090ae tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:03.240338 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-822e8fdd-63cd-49c5-bb01-c11b50d090ae tempest-FlavorMetadataValidation-310725281 tempest-FlavorMetadataValidation-310725281-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.034355 Oct 24 08:56:03.241726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 554/1104] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 08:56:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:03.268676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:03.271532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:03.279501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.280330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.281104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:03.286183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.287409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.288561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:03.404687 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90c2d890-ddcd-4369-b365-1c6626b89a8a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141180 Oct 24 08:56:03.409648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 555/1105] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:03 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:03.523832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:03.524872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:03.541112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.543077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.543765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:03.546388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.548950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.550504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:03.750866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:03.766213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-209c5edb-11f0-4735-a426-ac952b32f7bb tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.644454 Oct 24 08:56:03.766768 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 551/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:03 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:03.899657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:03.923880 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-68f32640-a752-479d-be02-3eb9049d4ecf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1314 microversion: 2.1 time: 0.404532 Oct 24 08:56:03.939551 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 556/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:03 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:03.975665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:03.976294 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:03.994524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:03.998273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:03.999067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.002194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.003037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.003994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.177707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:04.198013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:04.200091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:04.207642 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f09af57-36ef-482b-92fe-d33a36744272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.237126 Oct 24 08:56:04.208875 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 552/1108] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:03 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:04.419390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:04.422654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:04.431620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.432541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.433207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.434255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.434790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.435285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.472928 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1cb87520-8903-45ea-a2dc-8fa057847c7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058892 Oct 24 08:56:04.473566 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 557/1109] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:04 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:04.788083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:04.789581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:04.797044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.797911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.798588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.799376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.800058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.800681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.958405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:04.960070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:04.991580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.994967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.995502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:04.996565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:04.997044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:04.997517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.092539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:05.110418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1dbdcf8f-57c8-41cf-8375-b86e0969b54e tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.325619 Oct 24 08:56:05.111849 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 553/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:04 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:05.197033 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:05.236572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:05.238554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:05.250504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.261103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.264716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.266816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.268829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.269966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.453679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:05.468802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:05.471593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:05.482068 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-756e751a-35f3-445e-ab24-4c9171074f90 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1500 microversion: 2.1 time: 0.532980 Oct 24 08:56:05.482316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:05.485456 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 558/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:04 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1500 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:05.495051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a95dcb6-f734-4e02-a68d-89ceb6ee0208 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.262762 Oct 24 08:56:05.524030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 554/1112] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:05 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:05.537466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:05.546803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:05.570779 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:05.575448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.576518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.578787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.579821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.581509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.582524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.649603 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cd674fe-e710-48b8-9a5d-a90517c8fbee tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123281 Oct 24 08:56:05.650845 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 555/1113] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:05 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:05.659407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:05.660250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:05.667810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.669359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.670021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.670944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.671607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.672230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.706546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:56:05.900307 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f28d484-adb2-4725-8bf8-26927e293033 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 204 len: 0 microversion: 2.1 time: 0.247774 Oct 24 08:56:05.903953 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 556/1114] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:05 2022] DELETE /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:56:05.920888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:05.921858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:05.932353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.933384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.934971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:05.936271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:05.937082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:05.937763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.005268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-df6a49c1-74f5-4f31-b2e4-1fd469f0932c req-0ff6fb59-6b9f-4807-8d72-1990b4274d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6352e97a-d784-43f0-b94e-cee5d7e9a084", "tag": "ec159437-cd78-406e-9391-5a30935d0b65"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:06.042639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-df6a49c1-74f5-4f31-b2e4-1fd469f0932c req-0ff6fb59-6b9f-4807-8d72-1990b4274d1d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.044537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-df6a49c1-74f5-4f31-b2e4-1fd469f0932c req-0ff6fb59-6b9f-4807-8d72-1990b4274d1d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.045446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-df6a49c1-74f5-4f31-b2e4-1fd469f0932c req-0ff6fb59-6b9f-4807-8d72-1990b4274d1d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.084358 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-df6a49c1-74f5-4f31-b2e4-1fd469f0932c req-0ff6fb59-6b9f-4807-8d72-1990b4274d1d service nova] Creating event network-changed:ec159437-cd78-406e-9391-5a30935d0b65 for instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 on n-h2-master-1 Oct 24 08:56:06.097151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-df6a49c1-74f5-4f31-b2e4-1fd469f0932c req-0ff6fb59-6b9f-4807-8d72-1990b4274d1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.608775 Oct 24 08:56:06.099406 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 559/1115] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:06.136047 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:06.141425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:06.142663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:06.163539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.164054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.166332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.167420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.167903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.171753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.180735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:06.195677 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68f5133c-ecab-4369-8282-8edb99ab9977 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1506 microversion: 2.1 time: 0.285473 Oct 24 08:56:06.210959 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 557/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:05 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:06.526539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:06.534231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:06.535131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:06.535843 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-83dd2743-b0e7-435e-a4f8-4a895909d12a tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.400621 Oct 24 08:56:06.549338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.549338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.549338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.549338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.549874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.549874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.550633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 560/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:06 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:06.663240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:06.665565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:06.665848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:06.678797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:06.680290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:06.682775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.683753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.690607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.692412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:06.694083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:06.697344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:06.698097 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4894817-121c-4a44-9b06-de5b1f895d29 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.171245 Oct 24 08:56:06.698759 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 558/1118] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:06 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:06.759997 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:06.784443 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6077a122-b5cd-44de-ab67-597c4c53a1a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126038 Oct 24 08:56:06.786255 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 561/1119] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:06 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:56:07.220423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:07.222265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:07.230406 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:07.232998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:07.235168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:07.235965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:07.236903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:07.237837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:07.238496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:07.624925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68505e31-811e-46c9-8d4f-c5d55f441a66 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8dab04e0d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx69jTcJZ0NqXdWrMt4aq/Ky8l8bP95JUYnyZX+ajK/sFnkNwdWBbL4viXuoS52JZ7IPDzjJre7rhLIbB/Etni9fj9FIMa8DOMyJnZKPfg5o2y5+yyA7L+i9YRVNLPliw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68505e31-811e-46c9-8d4f-c5d55f441a66 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 257 Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:56:07.631013 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:56:07.632547 n-d-master-1 devstack@n-api.service[126919]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx69jTcJZ0NqXdWrMt4aq/Ky8l8bP95JUYnyZX+ajK/sFnkNwdWBbL4viXuoS52JZ7IPDzjJre7rhLIbB/Etni9fj9FIMa8DOMyJnZKPfg5o2y5+yyA7L+i9YRVNLPliw=="}} Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx69jTcJZ0NqXdWrMt4aq/Ky8l8bP95JUYnyZX+ajK/sFnkNwdWBbL4viXuoS52JZ7IPDzjJre7rhLIbB/Etni9fj9FIMa8DOMyJnZKPfg5o2y5+yyA7L+i9YRVNLPliw=='}}} Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.633266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:07.634428 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:56:07.636370 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:56:07.638883 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 08:56:07.638883 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.638883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68505e31-811e-46c9-8d4f-c5d55f441a66 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:07.638883 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68505e31-811e-46c9-8d4f-c5d55f441a66 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.458232 Oct 24 08:56:07.639809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 559/1120] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:07 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:07.646015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:07.646755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:07.654422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:07.654937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:07.655371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:07.656159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:07.656610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:07.657214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:07.677829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:07.690221 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4278bf6c-3a59-4971-8c9d-9b6424d91f43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1506 microversion: 2.1 time: 0.473802 Oct 24 08:56:07.690815 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 562/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:07 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:07.702734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8daaf07310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-386041574", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:07.807386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:07.818492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for user 9056e70b4e694aa7b487cc9e66c57e76 and project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:07.824966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:07.835130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-030a3902-e9cb-45c3-815e-bc7c6cb86fbf tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.193897 Oct 24 08:56:07.836127 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 560/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:07 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:07.841492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:07.842403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:07.854962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:07.857906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:07.859311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:07.861231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:07.862766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:07.863373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:07.880685 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 2166 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-386041574", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:56:07.908169 n-d-master-1 devstack@n-api.service[126920]: exception: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-386041574', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:07.910446 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c77321d4-5902-4315-b018-ac4e7dca485b tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.213679 Oct 24 08:56:07.914486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 563/1123] 10.222.0.25 () {60 vars in 1160 bytes} [Mon Oct 24 08:56:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:07.923543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d5d08d2-e749-44bc-a140-f4f1f402f5ab tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8daae8c040>, body: {"keypair": {"name": "tempest-keypair-1418530305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuYNZaBRUQCp24R9aYVsZQwpUSAJ0Y4Z87iiUq+yJtlcgM1weBnVsBGeWmvyY+wMwnEtjtEupP9uiXC4rcBiiS86eUGLXDBcO9KiMoXnno/PHlJMYD3aRtvX/ChTfyTeQ=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:07.972009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3d5d08d2-e749-44bc-a140-f4f1f402f5ab tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:07.988795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3d5d08d2-e749-44bc-a140-f4f1f402f5ab tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for user 9056e70b4e694aa7b487cc9e66c57e76 and project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:07.997266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:08.009389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:08.018331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:08.027674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a52f6953-68e4-4861-ab26-3ab52f5ed132 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1560 microversion: 2.91 time: 0.190441 Oct 24 08:56:08.029005 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 561/1124] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:07 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:08.053363 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d5d08d2-e749-44bc-a140-f4f1f402f5ab tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133843 Oct 24 08:56:08.053826 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 564/1125] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:08.072888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8dab04e8b0>, body: {"keypair": {"name": "tempest-keypair-1418530305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgr6FqSV7rhzjbu5TY5v+YVvxeCjtIkfFh44oXJmcs+FXyfS4uI9Wg4L8DxEvOZKMxB5JV5SrnU//D1cg5adBodfH+G65ZEZhARu1bjfrUq5tL5wfTtg1T8nRwuPd8Dag=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:08.114762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:08.136188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for user 9056e70b4e694aa7b487cc9e66c57e76 and project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:08.177888 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] HTTP exception thrown: Key pair 'tempest-keypair-1418530305' already exists. Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 273 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: {"keypair": {"name": "tempest-keypair-1418530305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgr6FqSV7rhzjbu5TY5v+YVvxeCjtIkfFh44oXJmcs+FXyfS4uI9Wg4L8DxEvOZKMxB5JV5SrnU//D1cg5adBodfH+G65ZEZhARu1bjfrUq5tL5wfTtg1T8nRwuPd8Dag=="}} Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: exception: Key pair 'tempest-keypair-1418530305' already exists. Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1418530305', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgr6FqSV7rhzjbu5TY5v+YVvxeCjtIkfFh44oXJmcs+FXyfS4uI9Wg4L8DxEvOZKMxB5JV5SrnU//D1cg5adBodfH+G65ZEZhARu1bjfrUq5tL5wfTtg1T8nRwuPd8Dag=='}}} Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result.read() Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '9056e70b4e694aa7b487cc9e66c57e76-tempest-keypair-1418530305' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 24 08:56:08.186425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi session.flush() Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result.read() Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 08:56:08.190190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '9056e70b4e694aa7b487cc9e66c57e76-tempest-keypair-1418530305' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 24, 8, 56, 8, 161979), 'updated_at': None, 'name': 'tempest-keypair-1418530305', 'user_id': '9056e70b4e694aa7b487cc9e66c57e76', 'fingerprint': 'a2:29:48:0f:55:66:96:07:2e:50:26:2b:f7:f6:5a:2a', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgr6FqSV7rhzjbu5TY5v+YVvxeCjtIkfFh44oXJmcs+FXyfS4uI9Wg4L8DxEvOZKMxB5JV5SrnU//D1cg5adBodfH+G65ZEZhARu1bjfrUq5tL5wfTtg1T8nRwuPd8Dag==', 'type': 'ssh'}] Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi keypair.create() Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._create() Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1418530305' already exists. Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 24 08:56:08.194532 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1418530305' already exists. Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1418530305' already exists. Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 409 to user: Key pair 'tempest-keypair-1418530305' already exists. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc6e46f9-2564-4767-9d8f-88cba265c0fd tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.121450 Oct 24 08:56:08.199987 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 562/1126] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:08 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:56:08.210393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d3b58ed-7a1e-41df-9c24-8c6bdd0e21b1 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Calling method '.version_select at 0x7f8daae8c280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:08.229958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-503c262c-9eb8-4a93-99b6-875117444c2e req-80d4f2c1-dff4-4cda-9510-7f7c34c937db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92f3cc7-ce7c-493d-85cf-72e7a8fc702a", "name": "network-vif-deleted", "tag": "4cada68f-2e38-449f-9a4f-a55582221bf1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:08.245380 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d3b58ed-7a1e-41df-9c24-8c6bdd0e21b1 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418530305" status: 202 len: 0 microversion: 2.1 time: 0.039069 Oct 24 08:56:08.246467 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 565/1127] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 08:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418530305 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:08.261811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93a932f4-c156-405f-90b0-c735dcebcab1 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8dab120820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/LR3v8sSvLOROcwUMwdp7FZlOoKgLfuu1QVO02z9gs2rfZqMbW0OLxYnMrTNewIpGR4Edgu3aPl8Ku7cBSXC68HPu+/otUAJV08lo803x0BMXqgjiAIZy5+OS5Cz3juQ=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:08.266635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-503c262c-9eb8-4a93-99b6-875117444c2e req-80d4f2c1-dff4-4cda-9510-7f7c34c937db service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:08.267125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-503c262c-9eb8-4a93-99b6-875117444c2e req-80d4f2c1-dff4-4cda-9510-7f7c34c937db service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93a932f4-c156-405f-90b0-c735dcebcab1 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 247 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/LR3v8sSvLOROcwUMwdp7FZlOoKgLfuu1QVO02z9gs2rfZqMbW0OLxYnMrTNewIpGR4Edgu3aPl8Ku7cBSXC68HPu+/otUAJV08lo803x0BMXqgjiAIZy5+OS5Cz3juQ=="}} Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/LR3v8sSvLOROcwUMwdp7FZlOoKgLfuu1QVO02z9gs2rfZqMbW0OLxYnMrTNewIpGR4Edgu3aPl8Ku7cBSXC68HPu+/otUAJV08lo803x0BMXqgjiAIZy5+OS5Cz3juQ=='}}} Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '' Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:56:08.273126 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93a932f4-c156-405f-90b0-c735dcebcab1 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93a932f4-c156-405f-90b0-c735dcebcab1 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019456 Oct 24 08:56:08.280157 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 566/1128] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:08 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:08.282843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-503c262c-9eb8-4a93-99b6-875117444c2e req-80d4f2c1-dff4-4cda-9510-7f7c34c937db service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:08.295389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8daae8f700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2028634312", "public_key": " "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:08.297540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-503c262c-9eb8-4a93-99b6-875117444c2e req-80d4f2c1-dff4-4cda-9510-7f7c34c937db service nova] Creating event network-vif-deleted:4cada68f-2e38-449f-9a4f-a55582221bf1 for instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a on n-h1-master-1 Oct 24 08:56:08.315373 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-503c262c-9eb8-4a93-99b6-875117444c2e req-80d4f2c1-dff4-4cda-9510-7f7c34c937db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093504 Oct 24 08:56:08.338058 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 563/1129] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:08.377507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:08.387953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for user 9056e70b4e694aa7b487cc9e66c57e76 and project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:08.411369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 95 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2028634312", "public_key": " "}} Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: exception: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2028634312', 'public_key': ' '}}} Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.416437 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.421464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:08.424363 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8a3236d-12b4-422d-ac82-4d538a08151e tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.139538 Oct 24 08:56:08.424363 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 567/1130] 10.222.0.25 () {60 vars in 1158 bytes} [Mon Oct 24 08:56:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:08.435988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a06d1043-539d-4bfd-8504-a9832e8bc3b9 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8dab0873a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8jtMi/drsQ6kCDpqlSGG7avHoXL3YjDTcvxkuYt2WEF/kmqnHIfSr3X+C/nWTsv9np0VFiifcWInJRk4VaRQyA8/3FHtIQa1uleTVS/27n/fHLx9BHz0muB3E3uoRrDQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a06d1043-539d-4bfd-8504-a9832e8bc3b9 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 507 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8jtMi/drsQ6kCDpqlSGG7avHoXL3YjDTcvxkuYt2WEF/kmqnHIfSr3X+C/nWTsv9np0VFiifcWInJRk4VaRQyA8/3FHtIQa1uleTVS/27n/fHLx9BHz0muB3E3uoRrDQ=="}} Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8jtMi/drsQ6kCDpqlSGG7avHoXL3YjDTcvxkuYt2WEF/kmqnHIfSr3X+C/nWTsv9np0VFiifcWInJRk4VaRQyA8/3FHtIQa1uleTVS/27n/fHLx9BHz0muB3E3uoRrDQ=='}}} Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 24 08:56:08.443780 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 08:56:08.447633 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.453482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a06d1043-539d-4bfd-8504-a9832e8bc3b9 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:08.459047 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a06d1043-539d-4bfd-8504-a9832e8bc3b9 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.027910 Oct 24 08:56:08.459831 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 564/1131] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:08 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:08.471181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Action: 'create', calling method: .version_select at 0x7f8daae8cdc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-575158658", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:08.492380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:08.498546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Getting quotas for user 9056e70b4e694aa7b487cc9e66c57e76 and project ed3cdf857fdd4948a1135c2fe4cb3c7c. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:08.537017 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 117 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-575158658", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: exception: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-575158658', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 24 08:56:08.539903 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.543983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:08.551711 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd162faf-29b6-4b6f-839e-ce9d408db9c8 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.077907 Oct 24 08:56:08.551711 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 568/1132] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:08.555657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2560ffd0-7546-44d3-a1c4-805272c3af72 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Calling method '.version_select at 0x7f8dab04ec10>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:08.576762 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-2560ffd0-7546-44d3-a1c4-805272c3af72 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2085547477 not found for user 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2560ffd0-7546-44d3-a1c4-805272c3af72 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Request method failure captured: Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2085547477 HTTP/1.1 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMnSYN9eVu1B-p3pbfrtKSMghWljs3RmLSQ44mhXBuF62xDn3QHHEo5TsKkPJF1E3WWQK1FIkrBA6Kr6ijp-5QOQ3s18PJUnVq_bWw77zaH4EhSp7ByCpm2YYSEEji-Q94a_0fO-AbZGvrShPZP8gRPeddjKEzlbKzvTBxiLT_1d2w Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed3cdf857fdd4948a1135c2fe4cb3c7c"}]}] Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ed3cdf857fdd4948a1135c2fe4cb3c7c Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-347688045 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-KeyPairsNegativeTestJSON-347688045-project Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: exception: Keypair tempest-keypair-non-existent-2085547477 not found for user 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'tempest-keypair-non-existent-2085547477'} Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2085547477 not found for user 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.578618 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2085547477 not found for user 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2085547477 not found for user 9056e70b4e694aa7b487cc9e66c57e76 Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2560ffd0-7546-44d3-a1c4-805272c3af72 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2085547477 not found for user 9056e70b4e694aa7b487cc9e66c57e76 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2560ffd0-7546-44d3-a1c4-805272c3af72 tempest-KeyPairsNegativeTestJSON-347688045 tempest-KeyPairsNegativeTestJSON-347688045-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2085547477" status: 404 len: 145 microversion: 2.1 time: 0.029370 Oct 24 08:56:08.587284 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 565/1133] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2085547477 => generated 145 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:08.715405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:08.716085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:08.723120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:08.723396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:08.724510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:08.725750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:08.726378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:08.727439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:08.765569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:08.766148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:08.766709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:08.767159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lazy-loading 'fault' on Instance uuid b92f3cc7-ce7c-493d-85cf-72e7a8fc702a {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:56:08.817955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:08.828043 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc2e2dc8-9653-42e6-a29d-d4230b79298f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 200 len: 1304 microversion: 2.1 time: 0.117609 Oct 24 08:56:08.829212 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 569/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:08 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:08.865798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:08.867367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:08.878579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:08.879356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:08.879778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:08.881174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:08.883575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:08.884083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.073326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:09.074860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:09.086593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.087822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.088473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.089538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.092005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.092680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.099936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:09.127642 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79f6b7ac-bdcd-4145-b740-1586b491bdee tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.267874 Oct 24 08:56:09.130575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 566/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:08 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:09.219844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:09.229849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:09.232380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:09.239584 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99873b00-9390-460b-93ca-e54657298ae5 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.184753 Oct 24 08:56:09.240427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 570/1136] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:09 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:09.505451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Calling method '.version_select at 0x7f8dab93f940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:09.508319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.509415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.510211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.529214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.529969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.530560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.544544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.545195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.545808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.554054 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9706cacb-37e4-4da2-9bb7-68b7849458a2 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.281120 Oct 24 08:56:09.560958 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 567/1137] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:56:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:09.568352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Calling method '.version_select at 0x7f8daae8c550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:09.570275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.570854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.571359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.592160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.593211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.593677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.630022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.630511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.630940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.638077 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f1d9cac-f41d-47b3-9a77-a438d1965bb8 tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers" status: 200 len: 512 microversion: 2.1 time: 0.075185 Oct 24 08:56:09.649350 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 571/1138] 10.222.0.25 () {58 vars in 1212 bytes} [Mon Oct 24 08:56:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers => generated 512 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:09.650792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Calling method '.version_select at 0x7f8dab0bdf70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:09.652607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.653082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.653536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.673526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.674016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.674460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.677706 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:09.687963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.688829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.689833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.697888 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5317fb1-2991-4a4f-a119-472952d7168d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050524 Oct 24 08:56:09.705194 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 568/1139] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:56:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:09.709880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Calling method '.version_select at 0x7f8dab1200d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:09.711807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.712300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.712763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.732227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.732864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.733365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.741339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae1c31e2-dce3-4675-b6dd-430c75246b4d tempest-HypervisorAdminUnderV252Test-1569332521 tempest-HypervisorAdminUnderV252Test-1569332521-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.035176 Oct 24 08:56:09.742056 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 572/1140] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 08:56:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 104 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:09.854058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:09.859801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:09.868087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.868817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.869358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.870453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:09.874630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:09.875405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:09.901462 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a HTTP/1.1 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b92f3cc7-ce7c-493d-85cf-72e7a8fc702a'} Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:09.904645 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 08:56:09.909898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:09.912359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:09.915369 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86bc4dc2-b891-485c-9b95-71c4ba252a4c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 404 len: 111 microversion: 2.1 time: 0.066128 Oct 24 08:56:09.916993 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 569/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:09 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:10.157202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:10.158266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:10.173917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.179279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.184941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.187181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.188608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.192147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.235887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1938434951", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:10.467980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:10.479478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f9a6c16-8077-4302-836f-ba87618f51c9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.325893 Oct 24 08:56:10.481611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 573/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:10 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:10.486980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:10.487929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:10.502128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.503244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.504175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.506145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.506849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.508114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.594766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:10.607478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:10.609242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:10.619124 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-136f4cfb-3adf-4f76-b446-931a4d287665 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.135503 Oct 24 08:56:10.620396 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 574/1143] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:10 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:10.626077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1348342e-aec7-45a6-acd1-efb75092f7ff req-4785612b-090e-49ed-9db8-86edd111c6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbceef75-e380-4bfd-b277-a0a27f07a417", "name": "network-vif-plugged", "status": "completed", "tag": "6d4a8cf3-1b18-4da7-9d37-f93567b05e11"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:10.639667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1348342e-aec7-45a6-acd1-efb75092f7ff req-4785612b-090e-49ed-9db8-86edd111c6d6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.640509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1348342e-aec7-45a6-acd1-efb75092f7ff req-4785612b-090e-49ed-9db8-86edd111c6d6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.641129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1348342e-aec7-45a6-acd1-efb75092f7ff req-4785612b-090e-49ed-9db8-86edd111c6d6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.659620 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1348342e-aec7-45a6-acd1-efb75092f7ff req-4785612b-090e-49ed-9db8-86edd111c6d6 service nova] Creating event network-vif-plugged:6d4a8cf3-1b18-4da7-9d37-f93567b05e11 for instance cbceef75-e380-4bfd-b277-a0a27f07a417 on n-h1-master-1 Oct 24 08:56:10.665724 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1348342e-aec7-45a6-acd1-efb75092f7ff req-4785612b-090e-49ed-9db8-86edd111c6d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042776 Oct 24 08:56:10.666898 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 575/1144] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:11.508294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:11.508855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:11.521648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:11.522223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:11.522670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:11.523395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:11.523846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:11.524273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:11.813350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:11.826807 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b57c19ec-0ac7-44e4-8fec-e721143ad254 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1325 microversion: 2.1 time: 0.323459 Oct 24 08:56:11.830144 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 576/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:11 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:11.836521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:11.837488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:11.845724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:11.846516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:11.847445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:11.848643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:11.849265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:11.850039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:11.961227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:11.996230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:12.004542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:12.019403 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47f259c8-68d3-4eea-8c0e-7a12386f6947 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.187100 Oct 24 08:56:12.024560 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 577/1146] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:11 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:12.860285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:12.861710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:12.879968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:12.881791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:12.883357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:12.885524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:12.887613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:12.889717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.372112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:13.389776 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d03e1e4-92ed-4402-9b07-bd20c0ba2eaa tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1522 microversion: 2.1 time: 0.541446 Oct 24 08:56:13.415318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 578/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:12 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:13.434047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:13.435018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:13.444667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:13.445796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:13.446468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.447576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:13.448258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:13.448990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.685068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:13.698092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:13.702265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:13.720144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ed42116-6824-4f02-9d1e-738eae8828da tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.301936 Oct 24 08:56:13.720737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 579/1148] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:13 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:13.773420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:13.776395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:13.790283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:13.792133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:13.794697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.796095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:13.796744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:13.799933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.857496 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] HTTP exception thrown: Instance is not a member of specified network Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Request method failure captured: Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417/ips/invalid HTTP/1.1 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMYv_4r1RJeflDGdrBufF_14eXc9ZD-DWwNV7kwdMUfzmCE2dGkPscAzCjT4rcBoeeoxalZCk0boe4MZXCmdj1YJaunHXn6VKJEnB6nTIzHduV3k_LTk2-QHbt7whLbN0HcKJ3DGcMxN8fbV9PoKa1UfiCS7B1oQOuDSZdzxDn6QQQ Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 946a17ccefa7499e8e6753cda6710cf8 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/946a17ccefa7499e8e6753cda6710cf8"}]}] Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 946a17ccefa7499e8e6753cda6710cf8 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerAddressesNegativeTestJSON-844583473-project Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 549b0b8da68647e3b968e80ab7e48022 Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-844583473-project Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: exception: Instance is not a member of specified network Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: action_args: {'server_id': 'cbceef75-e380-4bfd-b277-a0a27f07a417', 'id': 'invalid'} Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 24 08:56:13.865386 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.869918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:13.869918 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3c51fcf-2e7d-4125-9ff0-259a940511b6 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.124345 Oct 24 08:56:13.869918 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 580/1149] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:13 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417/ips/invalid => generated 91 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:56:13.882501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a93df541-a591-4e47-9988-4a764e976703 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:13.883052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a93df541-a591-4e47-9988-4a764e976703 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Failed to fetch instance by id 999 {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 08:56:13.883566 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a93df541-a591-4e47-9988-4a764e976703 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] HTTP exception thrown: Instance 999 could not be found. Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a93df541-a591-4e47-9988-4a764e976703 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Request method failure captured: Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMYv_4r1RJeflDGdrBufF_14eXc9ZD-DWwNV7kwdMUfzmCE2dGkPscAzCjT4rcBoeeoxalZCk0boe4MZXCmdj1YJaunHXn6VKJEnB6nTIzHduV3k_LTk2-QHbt7whLbN0HcKJ3DGcMxN8fbV9PoKa1UfiCS7B1oQOuDSZdzxDn6QQQ Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 946a17ccefa7499e8e6753cda6710cf8 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/946a17ccefa7499e8e6753cda6710cf8"}]}] Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 946a17ccefa7499e8e6753cda6710cf8 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerAddressesNegativeTestJSON-844583473-project Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 549b0b8da68647e3b968e80ab7e48022 Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-844583473-project Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 999 could not be found. Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: action_args: {'server_id': '999'} Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 24 08:56:13.886157 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:13.890769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a93df541-a591-4e47-9988-4a764e976703 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:13.890769 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a93df541-a591-4e47-9988-4a764e976703 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.014307 Oct 24 08:56:13.893630 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 581/1150] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:56:13 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:56:13.902840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:13.903729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:13.913744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:13.914852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:13.915533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.916624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:13.917316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:13.918726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:13.989844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:56:14.222404 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6334a6ba-afbc-43f4-9071-d78e33ff3fd9 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 204 len: 0 microversion: 2.1 time: 0.325180 Oct 24 08:56:14.224759 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 582/1151] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:13 2022] DELETE /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:56:14.246588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:14.248502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:14.277448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:14.279895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:14.285061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:14.288526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:14.291340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:14.294566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:14.773461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:14.802317 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55082e51-4e38-40da-8424-71246b6547fc tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1528 microversion: 2.1 time: 0.563177 Oct 24 08:56:14.818747 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 583/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:14 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1528 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:14.825000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:14.825420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:14.843611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:14.844110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:14.844599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:14.845427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:14.845889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:14.846322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:14.852214 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:15.059787 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:15.070972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:15.079098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:15.095501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5dbea20e-4f88-433a-afba-1d2a2c810d8f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.275525 Oct 24 08:56:15.096872 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 584/1153] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:14 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:15.436279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eb53750-73fe-4777-835a-faf7362d4cb7 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:15.438333 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3eb53750-73fe-4777-835a-faf7362d4cb7 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eb53750-73fe-4777-835a-faf7362d4cb7 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin] Request method failure captured: Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMvcyZPXPxYQFxnDWV6OuAWAzYFeKas5TCBYInFFKLwwQutQfoEERSXjN2ItGx9VwlLLUFuX507xkwLgsxKjqzxu3NBRMlKulqWoAtDY7cBYzkoPq-mxpF9Buh15by8Jj13VBcbaPgTi7kKVT3EPBHsMxaqgeeiQw_5-Up7gfYcnE8 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8e042f14a0c049f1af2f0f26a1da58ec Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8e042f14a0c049f1af2f0f26a1da58ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8e042f14a0c049f1af2f0f26a1da58ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8e042f14a0c049f1af2f0f26a1da58ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8e042f14a0c049f1af2f0f26a1da58ec"}]}] Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8e042f14a0c049f1af2f0f26a1da58ec Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 1f06078de46f417d8c865dde7597b374 Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid timestamp for date invalid_time Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'invalid_time'} Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:15.454324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:15.459284 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 24 08:56:15.459284 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.461072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eb53750-73fe-4777-835a-faf7362d4cb7 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:15.462426 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3eb53750-73fe-4777-835a-faf7362d4cb7 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909 tempest-InstanceUsageAuditLogNegativeTestJSON-454911909-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.228168 Oct 24 08:56:15.463488 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 585/1154] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:15.656153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-379a8b7b-0441-4aab-8830-0e22e73258aa tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:15.659568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-379a8b7b-0441-4aab-8830-0e22e73258aa tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3e32a18dd54a4f1fa2a7d5bb064497f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69703cd88a84f07af0facdb7202c9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-379a8b7b-0441-4aab-8830-0e22e73258aa tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Request method failure captured: Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMt88Z4uefF7uUb_jZ1WqhoHXUw4bfEy12CWe7qq1H4MUmh5SSvT3kuCSFMtFJ1r1ijnJ0QM5lX6q-EjZFY2zFu7ofed3Rkw6SprvJmku3GO_dgzips4NXHi8r3DvuLC0ybk2I8lJ67PpifCsKXGi5-tcJYbEPS2Fhv5zkwobzx8qs Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a69703cd88a84f07af0facdb7202c9e5 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a69703cd88a84f07af0facdb7202c9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a69703cd88a84f07af0facdb7202c9e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a69703cd88a84f07af0facdb7202c9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a69703cd88a84f07af0facdb7202c9e5"}]}] Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a69703cd88a84f07af0facdb7202c9e5 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3e32a18dd54a4f1fa2a7d5bb064497f8 Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.661249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-379a8b7b-0441-4aab-8830-0e22e73258aa tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-379a8b7b-0441-4aab-8830-0e22e73258aa tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.195249 Oct 24 08:56:15.665724 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 586/1155] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 08:56:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 197 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:56:15.690855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12d9ce35-d0bc-47c2-a8a5-9d26a3195721 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:15.691243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12d9ce35-d0bc-47c2-a8a5-9d26a3195721 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3e32a18dd54a4f1fa2a7d5bb064497f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69703cd88a84f07af0facdb7202c9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12d9ce35-d0bc-47c2-a8a5-9d26a3195721 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Request method failure captured: Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24%2008:56:15 HTTP/1.1 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMt88Z4uefF7uUb_jZ1WqhoHXUw4bfEy12CWe7qq1H4MUmh5SSvT3kuCSFMtFJ1r1ijnJ0QM5lX6q-EjZFY2zFu7ofed3Rkw6SprvJmku3GO_dgzips4NXHi8r3DvuLC0ybk2I8lJ67PpifCsKXGi5-tcJYbEPS2Fhv5zkwobzx8qs Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a69703cd88a84f07af0facdb7202c9e5 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a69703cd88a84f07af0facdb7202c9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a69703cd88a84f07af0facdb7202c9e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a69703cd88a84f07af0facdb7202c9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a69703cd88a84f07af0facdb7202c9e5"}]}] Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a69703cd88a84f07af0facdb7202c9e5 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 3e32a18dd54a4f1fa2a7d5bb064497f8 Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '2022-10-24 08:56:15'} Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.696265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12d9ce35-d0bc-47c2-a8a5-9d26a3195721 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12d9ce35-d0bc-47c2-a8a5-9d26a3195721 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830 tempest-InstanceUsageAuditLogNegativeTestJSON-1290997830-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24 08:56:15" status: 403 len: 128 microversion: 2.1 time: 0.028408 Oct 24 08:56:15.706947 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 587/1156] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 08:56:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24%2008%3A56%3A15 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:56:15.834244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:15.834900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:15.854816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:15.855322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:15.855803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:15.856547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:15.857018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:15.857496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:17.033073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549b0b8da68647e3b968e80ab7e48022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946a17ccefa7499e8e6753cda6710cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:17.048211 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72743eff-0098-4ca0-94ec-224eb22b1ac4 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 200 len: 1528 microversion: 2.1 time: 1.227336 Oct 24 08:56:17.053339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 588/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:15 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 1528 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:17.073462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:17.081454 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:17.106056 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:17.112408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:17.119342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:17.126001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:17.127184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:17.127788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:17.132484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:17.363568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:17.390914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:17.392833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:17.399412 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5636b2ba-f1e9-4c8b-b12a-466b5fd8c175 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.344338 Oct 24 08:56:17.400448 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 589/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:17 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:17.406514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3ab5d614-0a6b-4e4a-bfd7-4562a82b0219 req-2cf3b25c-27ab-4972-9d86-7da7568bf01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbceef75-e380-4bfd-b277-a0a27f07a417", "name": "network-vif-deleted", "tag": "6d4a8cf3-1b18-4da7-9d37-f93567b05e11"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:17.419101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ab5d614-0a6b-4e4a-bfd7-4562a82b0219 req-2cf3b25c-27ab-4972-9d86-7da7568bf01c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:17.419997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ab5d614-0a6b-4e4a-bfd7-4562a82b0219 req-2cf3b25c-27ab-4972-9d86-7da7568bf01c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:17.420666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ab5d614-0a6b-4e4a-bfd7-4562a82b0219 req-2cf3b25c-27ab-4972-9d86-7da7568bf01c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:17.434712 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3ab5d614-0a6b-4e4a-bfd7-4562a82b0219 req-2cf3b25c-27ab-4972-9d86-7da7568bf01c service nova] Creating event network-vif-deleted:6d4a8cf3-1b18-4da7-9d37-f93567b05e11 for instance cbceef75-e380-4bfd-b277-a0a27f07a417 on n-h1-master-1 Oct 24 08:56:17.443149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3ab5d614-0a6b-4e4a-bfd7-4562a82b0219 req-2cf3b25c-27ab-4972-9d86-7da7568bf01c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041351 Oct 24 08:56:17.444464 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 590/1159] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:18.076620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:18.077483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] [instance: cbceef75-e380-4bfd-b277-a0a27f07a417] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:18.092102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:18.095854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:18.097856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:18.100822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:18.102124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:18.106452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:18.128309 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] HTTP exception thrown: Instance cbceef75-e380-4bfd-b277-a0a27f07a417 could not be found. Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Request method failure captured: Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 HTTP/1.1 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMYv_4r1RJeflDGdrBufF_14eXc9ZD-DWwNV7kwdMUfzmCE2dGkPscAzCjT4rcBoeeoxalZCk0boe4MZXCmdj1YJaunHXn6VKJEnB6nTIzHduV3k_LTk2-QHbt7whLbN0HcKJ3DGcMxN8fbV9PoKa1UfiCS7B1oQOuDSZdzxDn6QQQ Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 946a17ccefa7499e8e6753cda6710cf8 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/946a17ccefa7499e8e6753cda6710cf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/946a17ccefa7499e8e6753cda6710cf8"}]}] Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 946a17ccefa7499e8e6753cda6710cf8 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-844583473 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerAddressesNegativeTestJSON-844583473-project Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 549b0b8da68647e3b968e80ab7e48022 Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-844583473-project Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: exception: Instance cbceef75-e380-4bfd-b277-a0a27f07a417 could not be found. Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'cbceef75-e380-4bfd-b277-a0a27f07a417'} Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbceef75-e380-4bfd-b277-a0a27f07a417 could not be found. Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbceef75-e380-4bfd-b277-a0a27f07a417 could not be found. Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:18.130265 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbceef75-e380-4bfd-b277-a0a27f07a417 could not be found. Oct 24 08:56:18.135449 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:18.137548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] Returning 404 to user: Instance cbceef75-e380-4bfd-b277-a0a27f07a417 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:18.138605 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1748126-4f07-463d-8839-b8abd536c532 tempest-ServerAddressesNegativeTestJSON-844583473 tempest-ServerAddressesNegativeTestJSON-844583473-project] 10.222.0.25 "GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417" status: 404 len: 111 microversion: 2.1 time: 0.067726 Oct 24 08:56:18.150793 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:18.157442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 591/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:18 2022] GET /compute/v2.1/servers/cbceef75-e380-4bfd-b277-a0a27f07a417 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:56:18.433870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:18.434563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:18.451850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:18.452930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:18.453615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:18.456628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:18.457539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:18.458406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:18.509888 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:18.718497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:18.733824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:18.735374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:18.759000 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bb85c9b6-2724-4021-bb85-c664806f728b tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.332397 Oct 24 08:56:18.759600 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 592/1161] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:18 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:19.795735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:19.797850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:19.833428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:19.833943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:19.837137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:19.841626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:19.842125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:19.845090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:19.881584 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=5 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:20.243030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:20.264430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:20.276941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:20.294452 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f557ec3-0463-45c8-b7fb-a5311193ebc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.503973 Oct 24 08:56:20.294994 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:20.301622 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 593/1162] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:19 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:21.332992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:21.343396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:21.385959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:21.398479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:21.399259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:21.400794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:21.401628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:21.402474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:21.576172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:21.596492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:21.602204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:21.618694 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7029ce06-f435-4caf-9fdf-726b356d60ea tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.293029 Oct 24 08:56:21.623160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 594/1163] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:21 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:22.654929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:22.655863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:22.668268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:22.668779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:22.669231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:22.670841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:22.671324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:22.671784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:22.955437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:22.972409 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:22.978303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:22.993328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09f5d43d-d1f7-4454-a886-0ac346e30bcf tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.340331 Oct 24 08:56:22.996929 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 595/1164] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:22 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:24.291745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4363cd83-9f6d-4b63-bf39-edc96976fbbb tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8dab005040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-18308671", "description": "tempest-description-1325463993"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:24.819142 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4363cd83-9f6d-4b63-bf39-edc96976fbbb tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.350137 Oct 24 08:56:24.820057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 596/1165] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:23 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:24.934831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:24.940985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:24.942790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:24.945046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:24.948018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:24.949914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:24.950709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.004190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2fe99e4-3661-498a-a767-11fd43ba9989 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.182874 Oct 24 08:56:25.006166 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 597/1166] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:56:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:25.018843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:25.022983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:25.037043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.041878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.042459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.043541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.046579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.048306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.680865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:25.735309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:25.737749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:25.767198 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-27e05b57-6d7e-425d-ab61-72c12a49ea82 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.758743 Oct 24 08:56:25.770008 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 598/1167] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:25 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:25.806473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d0870ba-bb84-4ee0-8638-44ad28956a55 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8dab005280>, body: {"security_group_rule": {"parent_group_id": "04421967-a8f2-4329-9c09-1d61ceead282", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:26.538486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d0870ba-bb84-4ee0-8638-44ad28956a55 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.764622 Oct 24 08:56:26.539228 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 599/1168] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 08:56:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:26.556858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:26.565110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:26.565985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:26.566677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:26.571926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:26.572801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:26.574687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:26.606866 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b479b5ea-56ae-4c06-b67b-2a7458316c1c tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053647 Oct 24 08:56:26.607913 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 600/1169] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 08:56:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:26.624681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60fbf6c4-f564-4006-9b94-e02a44cd8723 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daae41040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1780179686", "description": "tempest-description-1983772372"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:27.111777 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60fbf6c4-f564-4006-9b94-e02a44cd8723 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.492473 Oct 24 08:56:27.112513 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 601/1170] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:27.127553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:27.132032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:27.133527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:27.134469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:27.136117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:27.137238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:27.137962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:27.169903 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e57305ae-dbc6-406c-90a3-7c12bc975be5 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.046025 Oct 24 08:56:27.170870 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 602/1171] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:56:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:27.186429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:27.187385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:27.195304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:27.196549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:27.197467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:27.199223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:27.200234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:27.200859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:27.319885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:27.347984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:27.352210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:27.360569 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-328d1919-f8f7-4ba4-9338-f04e7df67dc4 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.179251 Oct 24 08:56:27.362246 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 603/1172] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:27 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:27.368382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d9badfd-696b-42dc-bca7-87880b7fd2e4 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daae5e8b0>, body: {"security_group_rule": {"parent_group_id": "00a4fa90-d691-4e5a-a3dd-e8b750e1b6e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:27.857039 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d9badfd-696b-42dc-bca7-87880b7fd2e4 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.493220 Oct 24 08:56:27.857975 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 604/1173] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 08:56:27 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:27.872753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:27.877608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:27.878099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:27.878551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:27.879305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:27.879774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:27.880203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:27.940386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2312c31e-1a02-4504-b76b-1895d89ed874 tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.081290 Oct 24 08:56:27.941985 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 605/1174] 10.222.0.25 () {58 vars in 1194 bytes} [Mon Oct 24 08:56:27 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:56:27.947799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd946024-22c8-4129-a802-cecc9508cd02 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daae5b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-746055355", "description": "tempest-description-1196910451"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:28.392004 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd946024-22c8-4129-a802-cecc9508cd02 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.448020 Oct 24 08:56:28.403206 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 606/1175] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:28.408797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:28.414618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:28.415408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:28.416048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:28.417014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:28.418211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:28.418917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:28.460321 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bec9b8cd-d6d0-4679-88c5-65af4b2e08ad tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.055568 Oct 24 08:56:28.461470 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 607/1176] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:56:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:28.467941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:28.470119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:28.483273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:28.483782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:28.484228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:28.485024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:28.485920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:28.486360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:28.601128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:28.613839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:28.615887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:28.626140 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa6a530c-f840-4037-b55c-a67763537528 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.163140 Oct 24 08:56:28.627476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 608/1177] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:28 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:28.645790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f3640d2-2f41-4219-ac2e-500f219443c0 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daae5eca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-766333570", "description": "tempest-description-2029636096"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:28.964768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f3640d2-2f41-4219-ac2e-500f219443c0 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.334114 Oct 24 08:56:28.964768 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 609/1178] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:28.981965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:28.986011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:28.986523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:28.986975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:28.987797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:28.988265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:28.988696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:29.064543 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-036f3f02-1226-49db-8e0b-e6a43414fb5d tempest-ServicesAdminNegativeTestJSON-1097150802 tempest-ServicesAdminNegativeTestJSON-1097150802-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.097342 Oct 24 08:56:29.075824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 610/1179] 10.222.0.25 () {58 vars in 1198 bytes} [Mon Oct 24 08:56:28 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:56:29.080584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5a6224f6-b8fb-4735-9c8d-5508b11a0477 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8dab476280>, body: {"security_group_rule": {"parent_group_id": "7a244194-6a21-4539-b2a7-b6d72f3acf5a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a4ab4c1f-4c12-4cf5-9921-ee5a859f3396"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:29.749891 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5a6224f6-b8fb-4735-9c8d-5508b11a0477 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.673196 Oct 24 08:56:29.750624 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 611/1180] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 08:56:29 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:30.212242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7200b2b3-9337-44b7-81fe-46265eed5ae7 tempest-ServicesAdminNegativeTestJSON-553485237 tempest-ServicesAdminNegativeTestJSON-553485237-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:30.229043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7200b2b3-9337-44b7-81fe-46265eed5ae7 tempest-ServicesAdminNegativeTestJSON-553485237 tempest-ServicesAdminNegativeTestJSON-553485237-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f378809e7d6e41ef862b7d5c12286f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cbcc43399d48b984b47037806c396a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7200b2b3-9337-44b7-81fe-46265eed5ae7 tempest-ServicesAdminNegativeTestJSON-553485237 tempest-ServicesAdminNegativeTestJSON-553485237-project] Request method failure captured: Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlM1bzigUDjMyHxe2t4MiFlkpajHt5WVyD9irqn6XHwLH3wqrLNn4pMcyERM14eXqZHModpCi2fBNQz9iKBIESUbwyn3Ck1ab48zHeuc1uqcvpf81Lxu25pP8r7hhv9ii8h33CjGb_nawz8SRtv7FrvpAs4UeT3kxwN57oXaVi0BjVs Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b9cbcc43399d48b984b47037806c396a Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-553485237 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9cbcc43399d48b984b47037806c396a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9cbcc43399d48b984b47037806c396a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9cbcc43399d48b984b47037806c396a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9cbcc43399d48b984b47037806c396a"}]}] Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-553485237 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b9cbcc43399d48b984b47037806c396a Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-553485237 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServicesAdminNegativeTestJSON-553485237-project Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f378809e7d6e41ef862b7d5c12286f57 Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-553485237-project Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 08:56:30.249859 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7200b2b3-9337-44b7-81fe-46265eed5ae7 tempest-ServicesAdminNegativeTestJSON-553485237 tempest-ServicesAdminNegativeTestJSON-553485237-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7200b2b3-9337-44b7-81fe-46265eed5ae7 tempest-ServicesAdminNegativeTestJSON-553485237 tempest-ServicesAdminNegativeTestJSON-553485237-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.500154 Oct 24 08:56:30.254720 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 612/1181] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:56:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 501 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:30.271185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:30.276871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:30.294490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:30.296897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:30.299644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:30.302070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:30.302955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:30.306421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:30.398934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:30.496593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:30.514484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:30.520458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:30.541817 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e165638-9595-43b7-8a11-aff52ec117ff tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.288211 Oct 24 08:56:30.542926 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 613/1182] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:30 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:30.562395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c5dca9ed-4fa6-437a-9f96-8bde3e978768 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daae69c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1937229889", "description": "tempest-description-774948937"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:30.904963 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c5dca9ed-4fa6-437a-9f96-8bde3e978768 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.356395 Oct 24 08:56:30.906811 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 614/1183] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:30.920461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab27acf3-f789-42ff-b45b-51de8389543c tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daadf58b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1080195757", "description": "tempest-description-1063539504"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:31.259705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab27acf3-f789-42ff-b45b-51de8389543c tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.343671 Oct 24 08:56:31.260386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 615/1184] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:31.273848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7fe988a-dc57-4873-81ef-3e1a20980c33 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daae66040>, body: {"security_group_rule": {"parent_group_id": "a498feca-17a8-4593-be67-76d9f51de76e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c9d3bf49-b38c-4aef-b4db-65e9883961d3"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:31.732679 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7fe988a-dc57-4873-81ef-3e1a20980c33 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.462723 Oct 24 08:56:31.734236 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 616/1185] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 08:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:56:31.749508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:31.761729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:31.778651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:31.779652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:31.780670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:31.781765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:31.782547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:31.783764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:31.937474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:31.951142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:31.952991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:31.959431 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6285341d-0ac5-472b-bef3-0ef1ddf0a566 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1555 microversion: 2.91 time: 0.215841 Oct 24 08:56:31.960062 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 617/1186] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:31 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:31.980478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:31.981715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:31.989743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:31.990471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:31.991476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:31.992464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:31.993041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:31.993796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:32.117577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:32.118401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:32.118688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:32.119173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:32.120129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:32.148959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:32.151423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:32.152147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:32.158228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:32.158789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:32.159588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:32.213217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:32.217438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:56:32.220204 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:32.232962 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1989c25b-e904-463f-b406-24ce0a787417 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 2344 microversion: 2.25 time: 0.271412 Oct 24 08:56:32.233939 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 618/1187] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:31 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 2344 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:32.239083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a119b7b5-f789-42f2-a7fe-7650a0cda2ca tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8dab0e6280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:32.252152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:32.255694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:32.342557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-755c6d24-86d0-4620-b57d-7ca554379e9b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 22.111856 Oct 24 08:56:32.343472 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 570/1188] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 22113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:56:32.356405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:32.365569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:32.366715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:32.367674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:32.371530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:32.372561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:32.373366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:32.456077 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99b2bc88-cf81-4cdc-973c-7c3bb4d4e865 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.107963 Oct 24 08:56:32.457348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 571/1189] 10.222.0.25 () {60 vars in 1217 bytes} [Mon Oct 24 08:56:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:56:32.462980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49747635-5caf-4655-ad50-31d999fc0200 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:32.464630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49747635-5caf-4655-ad50-31d999fc0200 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:32.595685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49747635-5caf-4655-ad50-31d999fc0200 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:32.614370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49747635-5caf-4655-ad50-31d999fc0200 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1215 microversion: 2.1 time: 0.155383 Oct 24 08:56:32.615369 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 572/1190] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:32 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:32.999973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:33.001075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:33.018903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:33.019794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:33.020589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:33.021774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:33.022546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:33.023257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:33.241853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:33.284897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:33.290447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:33.317055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d0fe32f-d506-4455-bc6d-71af12250d38 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1537 microversion: 2.91 time: 0.324495 Oct 24 08:56:33.319298 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 573/1191] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:32 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:33.653987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:33.654666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:33.669820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:33.671133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:33.672816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:33.676849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:33.677413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:33.679885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:33.689840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a119b7b5-f789-42f2-a7fe-7650a0cda2ca tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c9d3bf49-b38c-4aef-b4db-65e9883961d3" status: 202 len: 0 microversion: 2.1 time: 1.453896 Oct 24 08:56:33.690824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 619/1192] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:32 2022] DELETE /compute/v2.1/os-security-groups/c9d3bf49-b38c-4aef-b4db-65e9883961d3 => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:33.714269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-789879d7-f1f2-4c58-8dec-2329b5eac862 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaef1550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:33.843488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-789879d7-f1f2-4c58-8dec-2329b5eac862 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/a498feca-17a8-4593-be67-76d9f51de76e" status: 200 len: 247 microversion: 2.1 time: 0.147874 Oct 24 08:56:33.844714 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 620/1193] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 08:56:33 2022] GET /compute/v2.1/os-security-groups/a498feca-17a8-4593-be67-76d9f51de76e => generated 247 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:56:33.869144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-339d269d-7b3a-4aa6-9b63-c87736f5c5eb tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8dab1208b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-429403807", "description": "tempest-description-1815554567"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:33.985625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:34.004538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b42e7426-dee6-4218-adf3-0acf75827a28 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1211 microversion: 2.1 time: 0.355288 Oct 24 08:56:34.005618 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 574/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:33 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1211 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:34.350764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:34.352164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:34.385534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:34.388059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:34.388814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:34.390379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:34.392522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:34.395414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:34.612711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:34.635756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:34.641504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:34.664612 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cd8952e-5a10-4118-a55a-5d05fed185e2 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1537 microversion: 2.91 time: 0.319422 Oct 24 08:56:34.676735 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 575/1195] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:34 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:35.049928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:35.050843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:35.076963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:35.081962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:35.087037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:35.094660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:35.098010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:35.098857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:35.274169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:35.282981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17b540da-b455-46e8-83dd-1aedfd727b62 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1273 microversion: 2.1 time: 0.238670 Oct 24 08:56:35.283559 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 576/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:35 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:35.526332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-339d269d-7b3a-4aa6-9b63-c87736f5c5eb tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.660956 Oct 24 08:56:35.527607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 621/1197] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 08:56:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:35.543767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-548e7057-e54b-463c-a246-6db8b8b01095 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8dab0d0700>, body: {"security_group_rule": {"parent_group_id": "601ae464-4e08-4b57-a7b2-7048bd4cf38e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:35.710928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:35.711750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:35.762685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:35.765984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:35.769514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:35.774292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:35.778240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:35.778995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.059596 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-548e7057-e54b-463c-a246-6db8b8b01095 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.521564 Oct 24 08:56:36.061604 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 577/1198] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 08:56:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:36.079533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a59e9722-c7ef-4636-b00f-3517779abf01 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Action: 'create', calling method: .version_select at 0x7f8daaf75e50>, body: {"security_group_rule": {"parent_group_id": "601ae464-4e08-4b57-a7b2-7048bd4cf38e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:36.102751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.106876 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:36.112706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.119493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.135613 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-757cccc6-f91f-458d-b160-94da6024f6fc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1540 microversion: 2.91 time: 0.428438 Oct 24 08:56:36.136677 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 622/1199] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:35 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1540 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:36.176505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:36.179704 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:36.189255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:36.190987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:36.196998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.198742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:36.200508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:36.201066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.330274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=126920) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 08:56:36.409953 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a59e9722-c7ef-4636-b00f-3517779abf01 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.338110 Oct 24 08:56:36.410627 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 578/1200] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 08:56:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:36.423519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:36.424164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:36.434058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:36.434761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:36.435490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.436752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:36.438095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:36.438702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.519041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72e0e965-aa14-401c-9fe9-29d5032d3de6 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action" status: 202 len: 0 microversion: 2.91 time: 0.343875 Oct 24 08:56:36.521248 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 623/1201] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:56:36 2022] POST /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:56:36.546195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e0efc880-a73d-434d-a1d3-0218823d157e tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8dab0cfee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:36.586642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.598482 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eab3aef2-41b8-42cf-95c3-401b0222857a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1273 microversion: 2.1 time: 0.185851 Oct 24 08:56:36.599083 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 579/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:36 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:36.611908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:36.612527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:36.624567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:36.625065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:36.630822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.632613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:36.633121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:36.633587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:36.697804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e0efc880-a73d-434d-a1d3-0218823d157e tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/601ae464-4e08-4b57-a7b2-7048bd4cf38e" status: 200 len: 664 microversion: 2.1 time: 0.174971 Oct 24 08:56:36.698497 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 624/1203] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 08:56:36 2022] GET /compute/v2.1/os-security-groups/601ae464-4e08-4b57-a7b2-7048bd4cf38e => generated 664 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:36.712493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2b12441-cf23-42a5-aad0-2d794328b5be tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daae66a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:36.783144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.796874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.806017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:36.824926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f003580e-de60-470a-bc63-c23f60924246 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1488 microversion: 2.91 time: 0.220697 Oct 24 08:56:36.828016 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 580/1204] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:36 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1488 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:36.993732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ec90f04-b8ca-4773-8fc0-9904f7b033c7", "device": "/dev/xvdb"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:37.010651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:37.032655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:37.033570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:37.034151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:37.035038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:37.035631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:37.036166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:37.723839 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f628ba2-f139-4001-afb9-cc9222f8f2da tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "POST /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.728697 Oct 24 08:56:37.727250 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 581/1205] 10.222.0.25 () {62 vars in 1364 bytes} [Mon Oct 24 08:56:36 2022] POST /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:56:37.741121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:37.742096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:37.751721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:37.752841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:37.754433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:37.755159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:37.755900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:37.756512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:37.922430 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2b12441-cf23-42a5-aad0-2d794328b5be tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/bae8c2ea-6481-4107-a7aa-8fcc84c1968a" status: 202 len: 0 microversion: 2.1 time: 1.213671 Oct 24 08:56:37.923781 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 625/1206] 10.222.0.25 () {58 vars in 1287 bytes} [Mon Oct 24 08:56:36 2022] DELETE /compute/v2.1/os-security-group-rules/bae8c2ea-6481-4107-a7aa-8fcc84c1968a => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:37.929629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:37.930528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:37.951132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:37.951992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:37.952676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:37.953708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:37.960861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:37.961903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:38.095326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:38.116574 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c00b685a-62c9-4bc7-8b7c-3684f1ed6cdf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.381423 Oct 24 08:56:38.130493 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 582/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:37 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:38.195921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:38.205349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:38.213627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:38.226116 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9aa1971c-8e0c-472c-b646-60c2e804da56 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.300722 Oct 24 08:56:38.241326 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 626/1208] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:37 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:38.241326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06a6ad72-5f4e-4c6b-b46c-2000d10b74e2 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daadf5b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:38.342203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-978043472", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:38.430959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:38.873558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:38.874238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:38.874713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:38.875234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:38.875754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:38.898206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:38.898802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:38.899362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:38.906367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:38.907035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:38.907591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:38.962738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Getting quotas for project f6376cfd719142a58ac589d96c89f6e4. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:38.974216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Getting quotas for user aff5064287e54352b298041c4b0c37ec and project f6376cfd719142a58ac589d96c89f6e4. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:39.002774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:39.006867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:39.008302 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:39.076194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-da25ef7b-5616-42ac-80a4-2eda3088e801 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941460 Oct 24 08:56:39.076997 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 583/1209] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:56:39.090272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4bebd1e6-c11c-4331-8889-338b27133fed tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:39.090963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4bebd1e6-c11c-4331-8889-338b27133fed tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:39.190876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4bebd1e6-c11c-4331-8889-338b27133fed tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:39.198212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4bebd1e6-c11c-4331-8889-338b27133fed tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1213 microversion: 2.1 time: 0.112766 Oct 24 08:56:39.212866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 584/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:39 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:39.220407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:39.221011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:39.232630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:39.234062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:39.239171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:39.239598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:39.240075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:39.240506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:39.506503 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06a6ad72-5f4e-4c6b-b46c-2000d10b74e2 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/601ae464-4e08-4b57-a7b2-7048bd4cf38e" status: 202 len: 0 microversion: 2.1 time: 1.277046 Oct 24 08:56:39.507384 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 627/1211] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:38 2022] DELETE /compute/v2.1/os-security-groups/601ae464-4e08-4b57-a7b2-7048bd4cf38e => generated 0 bytes in 1280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:39.514870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:39.515758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:39.537397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:39.538346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:39.539329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:39.540327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:39.542835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:39.543554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:39.579478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:39.590690 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60a00844-6130-44ea-9e5d-481a4c971a16 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.375572 Oct 24 08:56:39.607508 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 585/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:39 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:39.616916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaf45ca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:39.644661 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:56:39.645256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Neutron security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 08:56:39.645889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] HTTP exception thrown: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.645889 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Request method failure captured: Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/c9d3bf49-b38c-4aef-b4db-65e9883961d3 HTTP/1.1 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlM3X6sJdX7Qqo3PWWwjt5Z-a-T9tVoTVoQO-QTFqjtk0FZf7o3I9BMBOpY4vkQ3IFpjC3soOjf1N_9R-5MU8g4aRXchtbu--xulcA7tlHntoNn2UajRMMDznrzdlYmCF7kxreONg77fL0KvimZPuWWugzP1AZ4lK8q9StPxTviFxaQ Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 71e2648d2b6748339745098a79d87f56 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1253245803 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71e2648d2b6748339745098a79d87f56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71e2648d2b6748339745098a79d87f56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71e2648d2b6748339745098a79d87f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71e2648d2b6748339745098a79d87f56"}]}] Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1253245803 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 71e2648d2b6748339745098a79d87f56 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1253245803 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupRulesTestJSON-1253245803-project Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c1f9da09bd824bd79c6adb316f1fd41b Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1253245803-project Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: exception: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c9d3bf49-b38c-4aef-b4db-65e9883961d3'} Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:56:39.648582 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Returning 404 to user: Security group c9d3bf49-b38c-4aef-b4db-65e9883961d3 does not exist Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4cffc487-306d-4a5c-a539-40151ca5e098'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8cc98e62-07ec-44a4-837f-d98c315435c6 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c9d3bf49-b38c-4aef-b4db-65e9883961d3" status: 404 len: 194 microversion: 2.1 time: 0.041417 Oct 24 08:56:39.652685 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 586/1213] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:39 2022] DELETE /compute/v2.1/os-security-groups/c9d3bf49-b38c-4aef-b4db-65e9883961d3 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:39.659031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59876d85-d3a0-4d7e-9591-54cf949ec93a tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaf39e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:39.932449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:39.934812 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59876d85-d3a0-4d7e-9591-54cf949ec93a tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a498feca-17a8-4593-be67-76d9f51de76e" status: 202 len: 0 microversion: 2.1 time: 0.279962 Oct 24 08:56:39.936441 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 587/1214] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:39 2022] DELETE /compute/v2.1/os-security-groups/a498feca-17a8-4593-be67-76d9f51de76e => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:56:39.947051 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:39.948227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b43e5d7a-72f3-4516-9d8b-1672df5c2d0c tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaf451f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:39.967189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:39.980921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0bd938c4-8efc-4fb9-9e69-d2d0373f0e63 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.471454 Oct 24 08:56:39.989988 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 628/1215] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:39 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:40.224339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23bdbd29-3c05-4af6-be55-cc768d71c292 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:40.224958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-23bdbd29-3c05-4af6-be55-cc768d71c292 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:40.460881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-23bdbd29-3c05-4af6-be55-cc768d71c292 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:40.469797 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23bdbd29-3c05-4af6-be55-cc768d71c292 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1213 microversion: 2.1 time: 0.248692 Oct 24 08:56:40.489995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 629/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:40 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1213 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:40.621932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:40.625520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:40.632938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:40.633176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:40.633671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:40.634399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:40.641178 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b43e5d7a-72f3-4516-9d8b-1672df5c2d0c tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a4ab4c1f-4c12-4cf5-9921-ee5a859f3396" status: 202 len: 0 microversion: 2.1 time: 0.698887 Oct 24 08:56:40.643565 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 588/1217] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:39 2022] DELETE /compute/v2.1/os-security-groups/a4ab4c1f-4c12-4cf5-9921-ee5a859f3396 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:56:40.652427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:40.652876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:40.654272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4bdbd606-25cc-4fbb-9775-83a16c6838ac tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaf34820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:41.390658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.416932 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c0618c2e-49ef-4afa-a4bc-eb87a088a907 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.802585 Oct 24 08:56:41.418956 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 630/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:40 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:41.430957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:41.436287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:41.451539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.452352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.453000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.465719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.466576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.471361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.691969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.702153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.721575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.732686 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-adf9067b-0b9c-453d-a75a-abde862b6272 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.310340 Oct 24 08:56:41.740777 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 631/1219] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:41 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:41.759840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:41.762117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:41.773249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.777087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.777771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.786625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.787333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.788016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:42.164554 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4bdbd606-25cc-4fbb-9775-83a16c6838ac tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7a244194-6a21-4539-b2a7-b6d72f3acf5a" status: 202 len: 0 microversion: 2.1 time: 1.516030 Oct 24 08:56:42.166462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 589/1220] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:40 2022] DELETE /compute/v2.1/os-security-groups/7a244194-6a21-4539-b2a7-b6d72f3acf5a => generated 0 bytes in 1519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:42.171743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7faa923e-9cb6-433c-8b5a-5418460ebf2e req-43a968dc-df58-4357-b548-33ab6d46259e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087182c5-5ac3-4775-861b-db31388889b5", "tag": "50709261-6d9b-48d0-9eaf-d22e0bcf2380"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:42.212752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7faa923e-9cb6-433c-8b5a-5418460ebf2e req-43a968dc-df58-4357-b548-33ab6d46259e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:42.218003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7faa923e-9cb6-433c-8b5a-5418460ebf2e req-43a968dc-df58-4357-b548-33ab6d46259e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:42.218679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7faa923e-9cb6-433c-8b5a-5418460ebf2e req-43a968dc-df58-4357-b548-33ab6d46259e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:42.267915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7faa923e-9cb6-433c-8b5a-5418460ebf2e req-43a968dc-df58-4357-b548-33ab6d46259e service nova] Creating event network-changed:50709261-6d9b-48d0-9eaf-d22e0bcf2380 for instance 087182c5-5ac3-4775-861b-db31388889b5 on n-h1-master-1 Oct 24 08:56:42.276655 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7faa923e-9cb6-433c-8b5a-5418460ebf2e req-43a968dc-df58-4357-b548-33ab6d46259e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107841 Oct 24 08:56:42.285914 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 590/1221] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:42.301089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08f15807-c2c4-4e84-a946-5749cc610973 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaf39940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:42.310797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:42.323278 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09ba1d6f-e1aa-4662-9cab-d5999e227b55 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1265 microversion: 2.1 time: 0.578480 Oct 24 08:56:42.324579 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 632/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:41 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1265 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:42.450008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:42.450679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:42.453179 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:42.463461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:42.468276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:42.468829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:42.469634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:42.474695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:42.475301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.013647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:43.036744 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1ab3ba2-0a62-4d0d-a051-cbca4933a59d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.586074 Oct 24 08:56:43.040036 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 633/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:42 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:43.058317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:43.059534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:43.080234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.083607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.086554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.087884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.091790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.092795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.498274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:43.518078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:43.525607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:43.558427 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b6fd9f7-f66f-4ae2-9a2c-74bb8fd7a9f6 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.516590 Oct 24 08:56:43.569604 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 634/1224] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:43 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:43.588014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:43.591271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:43.606785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08f15807-c2c4-4e84-a946-5749cc610973 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/00a4fa90-d691-4e5a-a3dd-e8b750e1b6e6" status: 202 len: 0 microversion: 2.1 time: 1.319309 Oct 24 08:56:43.608444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 591/1225] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:42 2022] DELETE /compute/v2.1/os-security-groups/00a4fa90-d691-4e5a-a3dd-e8b750e1b6e6 => generated 0 bytes in 1322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:43.617433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7667c9df-be6b-47a9-9c31-db1ccb634429 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] Calling method '.version_select at 0x7f8daaf394c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:43.617647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.618937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.619580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.624133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.626905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.629097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.875682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:43.890251 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-66459fb1-22f2-4369-aae3-50ce744056af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1271 microversion: 2.1 time: 0.319056 Oct 24 08:56:43.890857 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 635/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:43 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:44.068727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:44.069411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:44.082485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.082983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.090234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.091025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.095764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.097216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.373880 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7667c9df-be6b-47a9-9c31-db1ccb634429 tempest-SecurityGroupRulesTestJSON-1253245803 tempest-SecurityGroupRulesTestJSON-1253245803-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/04421967-a8f2-4329-9c09-1d61ceead282" status: 202 len: 0 microversion: 2.1 time: 0.760797 Oct 24 08:56:44.374725 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 592/1227] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 08:56:43 2022] DELETE /compute/v2.1/os-security-groups/04421967-a8f2-4329-9c09-1d61ceead282 => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:56:44.598301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:44.599756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:44.631193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.634798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.636404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.640629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.642844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.644745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.974190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:44.992955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.002766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.016086 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46bd131c-1106-41db-99bc-6613753e8d66 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.425094 Oct 24 08:56:45.027499 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 593/1228] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:44 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:45.072202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:45.073163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:45.088448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.089218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.095887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.097340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.098081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.100287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.562872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.574239 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-defc13e6-2681-49de-ab9c-a169e72c3449 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1271 microversion: 2.1 time: 0.522566 Oct 24 08:56:45.581970 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 594/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:45 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1271 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:45.962991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1246524136", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a1e84f6c-6a1f-4a59-a284-a0213f1972ff"}], "block_device_mapping_v2": [{"uuid": "2f3f7011-dab4-43b1-afce-836427317e68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:46.219826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:46.228532 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d746f6e-0dd4-42ae-b2be-b9ee3d720184 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 2.164611 Oct 24 08:56:46.237590 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 636/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:44 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:46.255827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:46.256444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:46.306634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.307137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.307678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.308409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.308870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.309316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.334544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] validate_networks() for [('a1e84f6c-6a1f-4a59-a284-a0213f1972ff', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:46.623444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:46.643694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:46.645995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:46.660935 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9244f04c-f641-4314-b299-e88a272a56ae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.421381 Oct 24 08:56:46.670921 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 637/1231] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:46 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:46.683624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3d516b5-2fd5-423d-bf6e-a26d4d16306e"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:46.688468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:46.713483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.716667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.717207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.718242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.721812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.722361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:47.179321 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0edf9d6c-cf2e-458d-bf7e-75149c949fcf tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "POST /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504706 Oct 24 08:56:47.182028 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 638/1232] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 08:56:46 2022] POST /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:47.199301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:47.202868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:47.253775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:47.273891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:47.278247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:47.281948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:47.286436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:47.287370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:47.735925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:47.755154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-017e5dac-de77-42e7-a770-5f4b824d0d9e tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1271 microversion: 2.1 time: 0.571140 Oct 24 08:56:47.768306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 639/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:47 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1271 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:47.781499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:47.782398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:47.831156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:47.831659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:47.832183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:47.856916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:47.858935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:47.860060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.920437 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:49.197730 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=16 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:49.552344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:49.553270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:49.553529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:49.554539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:49.555169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:49.571562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.572063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.572566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.574452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.577877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.578336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.633107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:49.643753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:49.650752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Getting quotas for user b43a269fe8b746b88c38db6b9e9bfa12 and project bdb9aeb0656347798749c2b8e4434c56. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:49.657595 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:49.661547 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e4d2138-67d9-44df-a2e2-e8b5fbeb26df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 1.891106 Oct 24 08:56:49.662276 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 640/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:47 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:49.675047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:49.675893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:49.700028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.701160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.702223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.715348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.716485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.717417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:50.191522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:50.205276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:50.209339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:50.227644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8037b18f-7ff2-499f-8a81-8adb066bfaa7 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.557049 Oct 24 08:56:50.231723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 641/1235] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:49 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:50.245442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:50.254595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:50.294205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:50.294205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:50.294205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:50.294205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:50.294205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:50.294205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:50.469077 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:51.111499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:51.114284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f3f7011-dab4-43b1-afce-836427317e68',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:51.253691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:51.274836 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01726f4d-a5cf-4560-8901-a04ec334cda9 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 1.039530 Oct 24 08:56:51.279082 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 642/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:50 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:51.289107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:51.296303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:51.315057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:51.319089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:51.320570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:51.325257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:51.326474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:51.327434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:51.372501 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d32713ab-3792-4996-902b-cd5cbdc05274 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.413958 Oct 24 08:56:51.375513 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 595/1237] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:56:51.474990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-729788685", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:51.599787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] validate_networks() for [('f125655b-1594-4cfb-9de7-d70d5cecfa9c', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:51.885115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:51.902459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15d70df6-3faa-4665-afde-479aa232d897 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.621980 Oct 24 08:56:51.905400 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 643/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:51 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:51.917999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:51.922963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:51.937993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:51.939172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:51.940204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:51.941399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:51.942160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:51.942848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:52.138323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:52.156969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:52.167758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:52.195821 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e85ac6f-e45f-4053-a917-1934b6dd21e9 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.284440 Oct 24 08:56:52.197337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 644/1239] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:51 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:52.203091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f330c523-e123-4ffd-86a5-66e1ecba560f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:52.204057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f330c523-e123-4ffd-86a5-66e1ecba560f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:52.304823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f330c523-e123-4ffd-86a5-66e1ecba560f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:52.312710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f330c523-e123-4ffd-86a5-66e1ecba560f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1053 microversion: 2.1 time: 0.113376 Oct 24 08:56:52.317747 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 645/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:52 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1053 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:52.331913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:52.332554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:52.343507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:52.344030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:52.344496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:52.345260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:52.345737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:52.346224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:52.642024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:52.658098 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72a176a5-447f-46d9-b13d-ff31a6521bfd tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.331695 Oct 24 08:56:52.673469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 646/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:52 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:52.940826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:52.941641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:52.975776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:52.980857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:52.981339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:52.987461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:52.989569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:52.991638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.475726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:53.486022 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2431c945-d780-49ad-b9f7-6cb94b566ec8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.557216 Oct 24 08:56:53.515613 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 647/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:52 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:53.548387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:53.549006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:53.573359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.582085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.582547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.583299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.589563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.590068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.767239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:53.781740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:53.785986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:53.815879 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-280d6cb9-71e8-49fc-af34-4eff791b4fae tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.298791 Oct 24 08:56:53.820421 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 648/1243] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:53 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:53.835082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:53.835802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:53.836464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:53.836965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:53.837901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:53.838350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:53.845745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:53.871226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.873466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.874158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.876498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.878285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.880212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.883207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.883717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.884162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.897428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.898041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.900629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.979731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:54.015008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for user 7e709503bbff4c239491b0f109673264 and project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:54.045057 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:54.109591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:54.123807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:54.306168 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-790355cc-0b10-4a42-8005-ba606bd15e60 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.925746 Oct 24 08:56:54.315825 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 596/1244] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:56:54.320741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:54.327850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:54.344888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:54.347769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:54.348443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:54.350237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:54.354794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:54.355922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:54.364639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:54.386651 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd235846-d57c-4d74-a260-d9e8273faa83 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1159 microversion: 2.1 time: 0.561488 Oct 24 08:56:54.388408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 649/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:53 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1159 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:54.413569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1f9abe6e-78b9-4fff-9558-9488fb664879 req-229b8858-33c3-428e-85a7-5d09f3a35379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3310d8a3-e620-4d6c-ac7f-c3f9c05b5390", "tag": "23bd1c5e-0ece-44c9-9a17-5aca2cc39f74"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:54.465572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1f9abe6e-78b9-4fff-9558-9488fb664879 req-229b8858-33c3-428e-85a7-5d09f3a35379 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:54.466444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1f9abe6e-78b9-4fff-9558-9488fb664879 req-229b8858-33c3-428e-85a7-5d09f3a35379 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:54.467551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1f9abe6e-78b9-4fff-9558-9488fb664879 req-229b8858-33c3-428e-85a7-5d09f3a35379 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:54.530648 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1f9abe6e-78b9-4fff-9558-9488fb664879 req-229b8858-33c3-428e-85a7-5d09f3a35379 service nova] Creating event network-changed:23bd1c5e-0ece-44c9-9a17-5aca2cc39f74 for instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 on n-h1-master-1 Oct 24 08:56:54.566318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1f9abe6e-78b9-4fff-9558-9488fb664879 req-229b8858-33c3-428e-85a7-5d09f3a35379 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176424 Oct 24 08:56:54.571514 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 650/1246] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:54.590568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a407da3-c66c-40c1-9344-7e8b6fc2180c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:54.591691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a407da3-c66c-40c1-9344-7e8b6fc2180c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:54.898989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a407da3-c66c-40c1-9344-7e8b6fc2180c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:54.915952 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a407da3-c66c-40c1-9344-7e8b6fc2180c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1221 microversion: 2.1 time: 0.335428 Oct 24 08:56:54.932028 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 651/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:54 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1221 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:54.966177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:54.976317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:55.006355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.008337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.017277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.018155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.021059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.024421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.218264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:55.237338 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fbc4bb7-9949-4fda-8cdc-6850d98f5f7a tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.915903 Oct 24 08:56:55.238272 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 597/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:54 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:55.274895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:55.274895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:55.300795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.305067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.305701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.306702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.307898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.317536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.489930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:55.511642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:55.513762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:55.521500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ee1507c-b8e0-4121-b965-f324f4b030db tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.265149 Oct 24 08:56:55.526432 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 598/1249] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:55 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:55.540941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1956354318", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:55.641420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] validate_networks() for [('f125655b-1594-4cfb-9de7-d70d5cecfa9c', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:56.309058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:56.334202 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-790e1b99-9f14-4eb8-9d85-abbe7ce43795 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 1.380541 Oct 24 08:56:56.338972 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 652/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:54 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:56.357894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:56.358846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:56.407306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.407869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.408328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.414731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.418082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.421111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.578187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:56.594135 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d3fcf4f-3455-4efc-b22a-e544f4a44299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1169 microversion: 2.1 time: 0.252360 Oct 24 08:56:56.594736 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 653/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:56 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1169 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:56.710921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:56.711346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:56.711803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:56.712211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:56.712625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:56.719155 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-dd11b7a3-3668-40ac-9c49-3cd8e515daab req-b09ffade-2b9b-4120-a7e4-4692f5616d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087182c5-5ac3-4775-861b-db31388889b5", "name": "network-vif-plugged", "status": "completed", "tag": "50709261-6d9b-48d0-9eaf-d22e0bcf2380"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:56.724362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.724857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.725528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.726458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.727102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.727762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.735898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd11b7a3-3668-40ac-9c49-3cd8e515daab req-b09ffade-2b9b-4120-a7e4-4692f5616d8d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.736384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd11b7a3-3668-40ac-9c49-3cd8e515daab req-b09ffade-2b9b-4120-a7e4-4692f5616d8d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.736813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd11b7a3-3668-40ac-9c49-3cd8e515daab req-b09ffade-2b9b-4120-a7e4-4692f5616d8d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.741878 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:56.757096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:56.758654 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-dd11b7a3-3668-40ac-9c49-3cd8e515daab req-b09ffade-2b9b-4120-a7e4-4692f5616d8d service nova] Creating event network-vif-plugged:50709261-6d9b-48d0-9eaf-d22e0bcf2380 for instance 087182c5-5ac3-4775-861b-db31388889b5 on n-h1-master-1 Oct 24 08:56:56.764586 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-dd11b7a3-3668-40ac-9c49-3cd8e515daab req-b09ffade-2b9b-4120-a7e4-4692f5616d8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168478 Oct 24 08:56:56.765427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 654/1252] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:56.770039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for user 7e709503bbff4c239491b0f109673264 and project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:56.774953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:56.775974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:56.785468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.787696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:56.790958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:56.799561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.801335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.803017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.804216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.804893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.858480 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92ef8644-98fd-4d6b-aca6-da4a8de1e60b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.330125 Oct 24 08:56:56.859201 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 599/1253] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:56:56.868070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:56.869641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:56.884084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.884632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.886031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.886998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:56.887640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:56.888313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:56.986224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:56.996798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:56.998299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:57.005470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1b890c5-7402-4a6e-89d9-592e92feeb3f tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.144994 Oct 24 08:56:57.022663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 600/1254] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:56 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:57.034005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ea83a6a-668e-43db-80b6-4c0821ecaa64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:57.034862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ea83a6a-668e-43db-80b6-4c0821ecaa64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:57.094057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ea83a6a-668e-43db-80b6-4c0821ecaa64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:57.103027 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ea83a6a-668e-43db-80b6-4c0821ecaa64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1222 microversion: 2.1 time: 0.079119 Oct 24 08:56:57.104034 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 601/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:57 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:57.364389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:57.365189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:57.376871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:57.377794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:57.378468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:57.379477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:57.380618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:57.381362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:57.737752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:57.750857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4999f5a-6e1e-44b5-be1a-9971232b1231 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.390361 Oct 24 08:56:57.755084 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 602/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:57 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:57.779004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:57.780006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:57.814332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:57.815305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:57.816722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:57.818498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:57.825642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:57.826512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:57.916670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:57.926185 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e02fd3a4-ca32-47f7-b9fe-6cda8f51dd60 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 1.158500 Oct 24 08:56:57.930352 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 655/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:56 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:58.040422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:58.041329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:58.063525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.064354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.064952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.066182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.066810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.067422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.196960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:58.210407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:58.215990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:58.227415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:58.230803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-edf81508-42aa-4877-87b7-10c53e9b1466 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1169 microversion: 2.1 time: 0.470314 Oct 24 08:56:58.234378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c5ede7a-3d92-42e4-bdc3-51da71034314 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.199590 Oct 24 08:56:58.237244 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 656/1258] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:58 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:58.246152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:58.253475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:58.271907 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 603/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:57 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1169 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:58.274170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.274858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.275482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.276406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.277037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.279590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.485176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:58.497373 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed49c090-af89-40bb-836d-d4a8eea18b34 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1218 microversion: 2.1 time: 0.255591 Oct 24 08:56:58.499559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 657/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:58 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:58.783444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:58.784069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:58.796977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.801478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.802232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.803148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.803661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.804294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.952002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:58.952616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:58.969663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.970757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.971571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.972864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.973836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.974626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.047832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.062818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e4e7dd2-40ec-4472-9185-219c85d66323 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.281749 Oct 24 08:56:59.064919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 604/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:58 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:59.266729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:59.267343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:59.281729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.285102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.285604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.286354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.290617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.293011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.444028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.455403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.456852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.467595 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1d28eca-06cb-4c42-b9b3-c34e6f34cb43 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.204680 Oct 24 08:56:59.468843 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 605/1262] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:59 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:59.478405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:59.479639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:59.517560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.518053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.518493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.519285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.519711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.520127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.574509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.585827 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50d9a7af-a3f6-4d22-a8b1-557e23ff43c7 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.637405 Oct 24 08:56:59.586854 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 658/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:58 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:59.592414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:59.595246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:59.604410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.605646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.606169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.612307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.613023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.614278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.836932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.860538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3c393f5-00eb-4e24-8b25-db71773c0e43 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1211 microversion: 2.1 time: 0.388058 Oct 24 08:56:59.862540 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 606/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:59 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1211 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:59.894450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.910923 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91c9b746-df8a-4409-9b40-59d7be82e5ea tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1274 microversion: 2.1 time: 0.322572 Oct 24 08:56:59.911525 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 659/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:59 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:00.095255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:00.096289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:00.127780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.128299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.134385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.135231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.135720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.136160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.502249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:00.502872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:00.516652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.530130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.530962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.533661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.534368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.535074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.582251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:00.600121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df5567d6-e77b-4453-be88-c5f11d2ce8df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1315 microversion: 2.1 time: 0.509740 Oct 24 08:57:00.600785 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 607/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:00 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:00.624209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:00.625088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:00.631994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.632702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.633286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.634158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.634766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.635426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.756418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:00.766919 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:00.769795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:00.771233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:00.793173 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ab88115-4c35-4387-bbfc-4c4324c3a3bc tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1546 microversion: 2.91 time: 0.294765 Oct 24 08:57:00.801909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 660/1267] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:00 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:00.880662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:00.890022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:00.890932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:00.891237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d2367e4-736d-4c25-9faf-af997ebdb632 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.270929 Oct 24 08:57:00.907992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 608/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:00 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:00.908555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.909053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.909587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.910461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.911071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.912193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.938994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:00.939719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:00.953617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.955964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.956587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.957524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.960214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.962684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:01.118909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:01.137973 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9ad2dcb-10c7-4ad3-a270-442ea8cfa86d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1282 microversion: 2.1 time: 0.199446 Oct 24 08:57:01.152515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 609/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:00 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:01.628688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:01.629842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:01.644771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:01.645701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:01.647924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:01.648969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:01.649738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:01.650364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:01.859370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:01.871370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-781934d3-85d3-4fe4-968f-e2a10729c9b0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1501 microversion: 2.1 time: 0.245338 Oct 24 08:57:01.873789 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 610/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:01 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:01.891745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:01.893110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:01.900961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:01.901499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:01.901943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:01.902642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:01.903265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:01.903853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.013002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.042184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.047031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.064986 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30263358-4dec-44c7-b52f-4e179873721a tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1533 microversion: 2.91 time: 0.189748 Oct 24 08:57:02.082956 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 611/1271] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:01 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1533 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:02.101261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:02.101907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:02.117960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.118460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.118902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.123395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.125503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.128418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.295577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.309322 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-328e95f9-e814-4e3d-88a8-d46e0f125ca3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1211 microversion: 2.1 time: 1.424880 Oct 24 08:57:02.311096 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 661/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:00 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1211 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:02.317089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:02.324577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:02.337732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.340518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.341598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.342820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.346643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.347370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.376773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.386310 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-031a9ff3-3313-411e-93d6-6c47f77db9af tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.301562 Oct 24 08:57:02.400703 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 612/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:02 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:02.409248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:02.410473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:02.418134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.418832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.419430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.420687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.421343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.421927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.534092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.546742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15739a80-5463-4ae9-b4f4-063f5b8270f3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1280 microversion: 2.1 time: 0.144635 Oct 24 08:57:02.548065 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 613/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:02 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1280 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:02.563448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] Lazy-loading 'services' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:02.568322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cfd31c46-05fd-42c8-9d09-deb56b124b71 req-e4ea4ca6-40db-4ebb-b39b-d52ce4423a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3310d8a3-e620-4d6c-ac7f-c3f9c05b5390", "name": "network-vif-plugged", "status": "completed", "tag": "23bd1c5e-0ece-44c9-9a17-5aca2cc39f74"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:02.583986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cfd31c46-05fd-42c8-9d09-deb56b124b71 req-e4ea4ca6-40db-4ebb-b39b-d52ce4423a43 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.585963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cfd31c46-05fd-42c8-9d09-deb56b124b71 req-e4ea4ca6-40db-4ebb-b39b-d52ce4423a43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.587231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cfd31c46-05fd-42c8-9d09-deb56b124b71 req-e4ea4ca6-40db-4ebb-b39b-d52ce4423a43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.601636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c46a34d-5e5f-441f-bdc6-e166e1c51805 tempest-UnshelveToHostMultiNodesTest-1878457268 tempest-UnshelveToHostMultiNodesTest-1878457268-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1938 microversion: 2.91 time: 0.288935 Oct 24 08:57:02.602246 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 662/1275] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:02 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1938 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:02.614323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cfd31c46-05fd-42c8-9d09-deb56b124b71 req-e4ea4ca6-40db-4ebb-b39b-d52ce4423a43 service nova] Creating event network-vif-plugged:23bd1c5e-0ece-44c9-9a17-5aca2cc39f74 for instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 on n-h1-master-1 Oct 24 08:57:02.621685 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cfd31c46-05fd-42c8-9d09-deb56b124b71 req-e4ea4ca6-40db-4ebb-b39b-d52ce4423a43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063914 Oct 24 08:57:02.621685 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 614/1276] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:02.655764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:02.656295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:02.662940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.663511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.664107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.665384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.666027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.667585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.708897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:57:02.814119 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d3f7657-a7ae-4599-9894-8f5e537d5c80 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 204 len: 0 microversion: 2.91 time: 0.162302 Oct 24 08:57:02.818965 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 663/1277] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 08:57:02 2022] DELETE /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:57:02.824359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:02.825059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:02.836680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.837594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.838993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.897955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.902320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.902493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-db6fcdfd-7968-45fb-882a-15066447ef94 req-5695da64-1553-4889-8177-b63677074563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb", "tag": "3ed9cd08-1f32-4430-8985-9dca63b3af99"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:02.903198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.926604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-db6fcdfd-7968-45fb-882a-15066447ef94 req-5695da64-1553-4889-8177-b63677074563 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.927091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-db6fcdfd-7968-45fb-882a-15066447ef94 req-5695da64-1553-4889-8177-b63677074563 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.927521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-db6fcdfd-7968-45fb-882a-15066447ef94 req-5695da64-1553-4889-8177-b63677074563 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.942070 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-db6fcdfd-7968-45fb-882a-15066447ef94 req-5695da64-1553-4889-8177-b63677074563 service nova] Creating event network-changed:3ed9cd08-1f32-4430-8985-9dca63b3af99 for instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb on n-h2-master-1 Oct 24 08:57:02.948868 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-db6fcdfd-7968-45fb-882a-15066447ef94 req-5695da64-1553-4889-8177-b63677074563 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070868 Oct 24 08:57:02.950189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 664/1278] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:03.046556 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:03.071069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:03.073162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:03.082655 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-207e616c-be34-4dfd-819e-4467e7f2c396 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.262570 Oct 24 08:57:03.102735 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 615/1279] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:02 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:03.343399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:03.348260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:03.362765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:03.363676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:03.364305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:03.366562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:03.367271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:03.368435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:03.415780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:03.416475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:03.424847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:03.426830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:03.427433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:03.434420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:03.434917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:03.435355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:03.701958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:03.714452 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f075ad3-9ee3-4e10-a088-cf3b3c1579c8 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.302260 Oct 24 08:57:03.731412 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 616/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:03 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:03.738654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:03.739717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:03.749243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:03.750443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:03.751125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:03.752059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:03.752540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:03.753031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:03.764969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:03.775386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16b0a279-757a-4540-8ca1-4ee0dfbf3352 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1211 microversion: 2.1 time: 0.441810 Oct 24 08:57:03.777370 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 665/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:03 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1211 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:04.080180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:04.088740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5cffe6f-d258-47aa-9b5a-a36344b2fb06 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.355335 Oct 24 08:57:04.093568 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 617/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:03 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:04.115425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:04.116133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:04.131159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.131900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.132347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.133049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.133528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.134003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.319209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:04.333204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:04.334777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:04.374212 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca4c382d-0577-45c1-8b4e-2868f6c9fc3d tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1539 microversion: 2.91 time: 0.242375 Oct 24 08:57:04.376890 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 666/1283] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:04 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:04.740169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:04.740866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:04.751404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.751911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.752355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.753071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.753566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.753993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.776913 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:04.803072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:04.803799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:04.817831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.818369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.820911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.821951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.823612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.825196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.908748 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:05.121712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.135984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3b5dd055-83b0-4ac1-9aa2-bc801a8db6c0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1313 microversion: 2.1 time: 0.399879 Oct 24 08:57:05.137827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 618/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:04 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:05.183232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.187305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:05.188788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:05.194655 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50aee632-7a2b-4311-a7db-101dc319da8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1211 microversion: 2.1 time: 0.395586 Oct 24 08:57:05.201014 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 667/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:04 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1211 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:05.206844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.207399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.207845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.211613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.215031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.215522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.306027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:05.307489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:05.315741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.316523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.317159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.318513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.319339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.319963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.572956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.587600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cfad9b5-b558-4ae7-88be-a3b5be22eff3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.422843 Oct 24 08:57:05.589698 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 619/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:05 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:05.601891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:05.604170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:05.622993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.623500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.624813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.628886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.629558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.629999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.804848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.806858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.808032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.810653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lazy-loading 'fault' on Instance uuid 0e9b551c-4640-4fc0-9d70-96752ce6304e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:05.895489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.909603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.911133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fa08ec12fa74ec3af765850e8bbc609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fe645c49214c7d84b9081e3f481de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.923787 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7fd38bd1-2e22-4f5b-b1f9-40788ad21931 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 200 len: 1544 microversion: 2.91 time: 0.331809 Oct 24 08:57:05.925595 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 620/1287] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:05 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 1544 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:06.164794 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:06.166982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:06.178622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.179365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.183569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.184690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.185350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.185959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.187062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:06.228516 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-472c21c4-d2fd-434c-9c49-457515ec0532 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 2422 microversion: 2.25 time: 0.926681 Oct 24 08:57:06.233493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 668/1288] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:05 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 2422 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:06.265444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:06.271796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:06.291569 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:06.295648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.298512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.302501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.303532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.304186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.304628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.514025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:06.522172 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b46b1779-94d4-49ea-9640-dd8500f32ea0 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1463 microversion: 2.1 time: 0.362024 Oct 24 08:57:06.522754 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 621/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:06 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1463 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:06.553969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:06.556645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:06.563142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.563736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.564264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.565048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.565607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.566172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.597355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'flavor' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:06.611450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Going to try to live migrate instance to n-h1-master-1 {{(pid=126919) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:57:06.742380 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:07.104131 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=20 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:07.219831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:07.234160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b689779-0047-4a88-9d84-e5a956eb3e4b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1211 microversion: 2.1 time: 0.996169 Oct 24 08:57:07.246143 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 669/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:06 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1211 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:07.599364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Calling method '.version_select at 0x7f8daadf5af0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:07.630800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.631287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.631947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:07.674084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.674856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.676063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:07.752237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec93f75e-7be5-45df-951a-be292c577f42 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/f6376cfd719142a58ac589d96c89f6e4?start=2022-10-23T08%3A57%3A06.538396&end=2022-10-25T08%3A57%3A06.538396" status: 200 len: 693 microversion: 2.1 time: 0.511631 Oct 24 08:57:07.769507 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 670/1291] 10.222.0.25 () {58 vars in 1412 bytes} [Mon Oct 24 08:57:07 2022] GET /compute/v2.1/os-simple-tenant-usage/f6376cfd719142a58ac589d96c89f6e4?start=2022-10-23T08%3A57%3A06.538396&end=2022-10-25T08%3A57%3A06.538396 => generated 693 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:07.776063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:07.776733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:07.784798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.785575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.786183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:07.787091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.787701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.788290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.288288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:08.297829 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aabd0d3f-4dc6-4d52-ba37-d0ab23d61179 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.525956 Oct 24 08:57:08.313398 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 671/1292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:07 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:08.318636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:08.319297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] [instance: 0e9b551c-4640-4fc0-9d70-96752ce6304e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:08.326230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.326850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.327380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.328444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.329287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.330046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.346921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] HTTP exception thrown: Instance 0e9b551c-4640-4fc0-9d70-96752ce6304e could not be found. Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Request method failure captured: Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e HTTP/1.1 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlKjeyftAN1GlKr1ZxmXobcSm-0s3v0ysVA6lFCCVUwlY-DU8zvho7ZYQsFz4OOFcBSUPQ3pEpyKsDM-o8jD8w2iKhgIO0zs4uSQ0ID29M0lHrVbisFa9BZI9IQTQ81SUFQbrTGVG1tW-qjACU6zTYeySKtxkge1_F7QVQelGILBL0s Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.91 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 22fe645c49214c7d84b9081e3f481de9 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-470240227 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/22fe645c49214c7d84b9081e3f481de9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_22fe645c49214c7d84b9081e3f481de9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/22fe645c49214c7d84b9081e3f481de9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/22fe645c49214c7d84b9081e3f481de9"}]}] Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-470240227 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 22fe645c49214c7d84b9081e3f481de9 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-470240227 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-UnshelveToHostMultiNodesTest-470240227-project Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9fa08ec12fa74ec3af765850e8bbc609 Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-470240227-project Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0e9b551c-4640-4fc0-9d70-96752ce6304e could not be found. Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0e9b551c-4640-4fc0-9d70-96752ce6304e'} Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9b551c-4640-4fc0-9d70-96752ce6304e could not be found. Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9b551c-4640-4fc0-9d70-96752ce6304e could not be found. Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:08.348953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9b551c-4640-4fc0-9d70-96752ce6304e could not be found. Oct 24 08:57:08.353601 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:08.356998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] Returning 404 to user: Instance 0e9b551c-4640-4fc0-9d70-96752ce6304e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:08.358158 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ffae7b36-77ca-4eab-af48-ff7f9278e850 tempest-UnshelveToHostMultiNodesTest-470240227 tempest-UnshelveToHostMultiNodesTest-470240227-project] 10.222.0.25 "GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e" status: 404 len: 111 microversion: 2.91 time: 0.043385 Oct 24 08:57:08.359096 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 672/1293] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:08 2022] GET /compute/v2.1/servers/0e9b551c-4640-4fc0-9d70-96752ce6304e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:57:08.372870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b9c406f-b40b-4e43-af2c-31334a854e2b"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:08.375329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:08.393237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.394384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.395376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.397668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.398164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.398603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.584791 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8817e790-475b-44bd-acc8-c9ae510689e8 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/action" status: 202 len: 0 microversion: 2.25 time: 2.036406 Oct 24 08:57:08.589481 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 622/1294] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:57:06 2022] POST /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/action => generated 0 bytes in 2042 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:57:08.600774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ef126508-b66f-4fb7-a378-35fd9d37e1da req-673800e9-cb20-45d8-8062-2cb88673ccdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2e62742-ceeb-4336-bf67-b6ae657b4852", "tag": "97452f9d-c71f-4d41-bcc9-56b11baf935a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:08.625545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ef126508-b66f-4fb7-a378-35fd9d37e1da req-673800e9-cb20-45d8-8062-2cb88673ccdf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.627962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ef126508-b66f-4fb7-a378-35fd9d37e1da req-673800e9-cb20-45d8-8062-2cb88673ccdf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.628647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ef126508-b66f-4fb7-a378-35fd9d37e1da req-673800e9-cb20-45d8-8062-2cb88673ccdf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.648083 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ef126508-b66f-4fb7-a378-35fd9d37e1da req-673800e9-cb20-45d8-8062-2cb88673ccdf service nova] Creating event network-changed:97452f9d-c71f-4d41-bcc9-56b11baf935a for instance c2e62742-ceeb-4336-bf67-b6ae657b4852 on n-h2-master-1 Oct 24 08:57:08.661322 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ef126508-b66f-4fb7-a378-35fd9d37e1da req-673800e9-cb20-45d8-8062-2cb88673ccdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066373 Oct 24 08:57:08.662712 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 623/1295] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:08.668033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '.version_select at 0x7f8daaeff040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:08.679519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.679996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.680605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.705386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.706248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.706896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.735898 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2430c865-c98a-4d51-a7f4-49e6cebcc766 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/f6376cfd719142a58ac589d96c89f6e4?start=2022-10-23T08%3A57%3A06.538396&end=2022-10-25T08%3A57%3A06.538396" status: 200 len: 694 microversion: 2.1 time: 0.071730 Oct 24 08:57:08.737609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 624/1296] 10.222.0.25 () {58 vars in 1412 bytes} [Mon Oct 24 08:57:08 2022] GET /compute/v2.1/os-simple-tenant-usage/f6376cfd719142a58ac589d96c89f6e4?start=2022-10-23T08%3A57%3A06.538396&end=2022-10-25T08%3A57%3A06.538396 => generated 694 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:08.742496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:08.743567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:08.753257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.754393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.755096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.755950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.756561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.757314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.892839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02522f44-0406-40ae-9fcb-5165312f9eb7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532058 Oct 24 08:57:08.894280 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 673/1297] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 08:57:08 2022] POST /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:08.913470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:08.916035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:08.924634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.925527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.926196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.927110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.927760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.928375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.039532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.049354 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dd235e91-1586-4e5c-8449-96f7dedfa88b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.310288 Oct 24 08:57:09.050419 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 625/1298] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:08 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:09.066778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Calling method '.version_select at 0x7f8daaf45670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:09.078300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.079053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.079664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.100756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.101249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.101743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.163667 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a18bb375-ca98-49e4-a099-64c4d24f94b9 tempest-TenantUsagesTestJSON-319941474 tempest-TenantUsagesTestJSON-319941474-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T08%3A57%3A06.538396&end=2022-10-25T08%3A57%3A06.538396&detailed=1" status: 200 len: 15333 microversion: 2.1 time: 0.111703 Oct 24 08:57:09.164887 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 626/1299] 10.222.0.25 () {58 vars in 1335 bytes} [Mon Oct 24 08:57:09 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T08%3A57%3A06.538396&end=2022-10-25T08%3A57%3A06.538396&detailed=1 => generated 15333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:57:09.195798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:09.197345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:09.205199 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:09.207161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.207907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.208545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.209484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.210137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.210766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.242922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:57:09.397240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb0bc4cf-f0d1-4975-ae0a-ad6362fe35b3 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 204 len: 0 microversion: 2.1 time: 0.205209 Oct 24 08:57:09.402162 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 627/1300] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:57:09 2022] DELETE /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:57:09.423025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:09.424368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:09.452223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.453095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.456026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.458026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.458756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.461974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.480398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.498221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.500629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.502320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c6b3f33-f24f-483b-9c32-ba9a9bcb6e5a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.606483 Oct 24 08:57:09.505165 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 674/1301] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:08 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:09.518557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:09.519742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:09.536290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.541098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.542960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.544933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.554254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.556264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.749142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.762969 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d37b5314-0d5d-4dd7-82e3-d7948d5dd028 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.357505 Oct 24 08:57:09.764336 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 628/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:09 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:09.821878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.826444 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:09.831472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96a68ccc-e572-4787-bb2e-7b9230633b77 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1469 microversion: 2.1 time: 0.324923 Oct 24 08:57:09.838168 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 675/1303] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:09 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:09.920374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:09.928228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:09.943275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.943931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.944632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.948469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.949106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.949921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.001674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9857de96-4572-43fb-ae7e-acfc2ca78cac tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084784 Oct 24 08:57:10.008107 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 629/1304] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:57:09 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:10.014059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.016023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.030176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.030684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.031154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.031842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.043168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.043869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.079027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.079925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.091289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.091994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.092779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.094396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.095032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.095647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.223711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lazy-loading 'services' on Instance uuid 6352e97a-d784-43f0-b94e-cee5d7e9a084 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:10.360724 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7dac3d31-3353-44bb-8a1e-7159fd5c4b5b tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments/d3d516b5-2fd5-423d-bf6e-a26d4d16306e" status: 202 len: 0 microversion: 2.1 time: 0.350938 Oct 24 08:57:10.361531 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 676/1305] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 08:57:10 2022] DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments/d3d516b5-2fd5-423d-bf6e-a26d4d16306e => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:57:10.495910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:10.511918 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d040c210-ec3a-41b5-97c7-54610a0cf8f2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.443462 Oct 24 08:57:10.527126 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 630/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:10 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:10.533543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.534885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.551409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.559101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.559812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.562869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.563593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.568140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.730994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c9f31fea-776e-4629-bb42-649b9b210bb9 req-5c6507bb-0ce3-471c-8e41-108527d040ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add07d56-c8d6-4722-8f2f-8feae52e0d8c", "tag": "0ed081e0-c576-45fb-a26f-6dccbf7ffa72"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:10.777781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c9f31fea-776e-4629-bb42-649b9b210bb9 req-5c6507bb-0ce3-471c-8e41-108527d040ae service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.781140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c9f31fea-776e-4629-bb42-649b9b210bb9 req-5c6507bb-0ce3-471c-8e41-108527d040ae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.782770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c9f31fea-776e-4629-bb42-649b9b210bb9 req-5c6507bb-0ce3-471c-8e41-108527d040ae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.830388 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c9f31fea-776e-4629-bb42-649b9b210bb9 req-5c6507bb-0ce3-471c-8e41-108527d040ae service nova] Creating event network-changed:0ed081e0-c576-45fb-a26f-6dccbf7ffa72 for instance add07d56-c8d6-4722-8f2f-8feae52e0d8c on n-h1-master-1 Oct 24 08:57:10.844903 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c9f31fea-776e-4629-bb42-649b9b210bb9 req-5c6507bb-0ce3-471c-8e41-108527d040ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123079 Oct 24 08:57:10.846635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 631/1307] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:10.862386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.865810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.882186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.882689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.883135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.884974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.886433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.886910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.024342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:11.033754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:11.038818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:11.040037 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb19fa58-dba3-4c4a-8444-a6e962972cb1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.511206 Oct 24 08:57:11.040610 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 677/1308] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:10 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:11.064638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:11.065277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:11.083120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:11.083639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:11.084084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.084807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:11.085274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:11.085735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.290285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:11.307992 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4310563-4e01-46b7-ac26-99655554768d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.455861 Oct 24 08:57:11.340108 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 632/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:10 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:11.541791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:11.542494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:11.551397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:11.552191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:11.552791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.553716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:11.554333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:11.554920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.581112 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:12.010426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:12.026502 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d224a2b7-90a9-45c6-b10c-472499587a22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.488717 Oct 24 08:57:12.036527 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 633/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:11 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:12.072449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:12.073584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:12.084827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.085746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.086354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.088580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.090788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.091494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.142932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:12.154293 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f135e28-f44c-4c5c-b107-f00598c54f24 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1469 microversion: 2.1 time: 1.101980 Oct 24 08:57:12.158180 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 678/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:11 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1469 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:12.343533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:12.346543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:12.374696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.375513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.378082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.379154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.381705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.383276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.081566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:13.108271 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96773ea3-2d1d-404c-bdef-deb9ae7f606a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.775948 Oct 24 08:57:13.133723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 679/1312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:12 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:13.148880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:13.149587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:13.189348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.189868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.192310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.193677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.194168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.194601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.317778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:13.332155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:13.353091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:13.358521 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aedfdb82-c7f3-45af-8d6f-a04dee0affe3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 1.291645 Oct 24 08:57:13.359196 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 634/1313] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:12 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:13.373560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-243bb246-83d5-4ffc-98ed-da68cf154507 req-945cc66b-219b-4108-9876-5796bf385b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3310d8a3-e620-4d6c-ac7f-c3f9c05b5390", "name": "network-vif-deleted", "tag": "23bd1c5e-0ece-44c9-9a17-5aca2cc39f74"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:13.423652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-243bb246-83d5-4ffc-98ed-da68cf154507 req-945cc66b-219b-4108-9876-5796bf385b51 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.428983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-243bb246-83d5-4ffc-98ed-da68cf154507 req-945cc66b-219b-4108-9876-5796bf385b51 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.429820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-243bb246-83d5-4ffc-98ed-da68cf154507 req-945cc66b-219b-4108-9876-5796bf385b51 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.458668 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-243bb246-83d5-4ffc-98ed-da68cf154507 req-945cc66b-219b-4108-9876-5796bf385b51 service nova] Creating event network-vif-deleted:23bd1c5e-0ece-44c9-9a17-5aca2cc39f74 for instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 on n-h1-master-1 Oct 24 08:57:13.474142 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-243bb246-83d5-4ffc-98ed-da68cf154507 req-945cc66b-219b-4108-9876-5796bf385b51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105088 Oct 24 08:57:13.475466 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 635/1314] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:13.492817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:13.494097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:13.503067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.503833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.504500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.505472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.506168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.506811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.559852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.566228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.567045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.568546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lazy-loading 'fault' on Instance uuid 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:13.636453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:13.647798 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20beb7df-49da-4cae-b2ec-74c87964b978 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.512893 Oct 24 08:57:13.648388 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 680/1315] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:13 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:13.888082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff5064287e54352b298041c4b0c37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6376cfd719142a58ac589d96c89f6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:13.907434 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6abb8f8-f8f6-46eb-a11e-8206b48659f4 tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 200 len: 1303 microversion: 2.1 time: 0.425159 Oct 24 08:57:13.908099 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 636/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:13 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 1303 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:13.948263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Action: 'update', calling method: .version_select at 0x7f8daae00af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:13.953447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.956003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.957362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.972735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:13.973235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:13.978422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:13.994235 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] HTTP exception thrown: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Request method failure captured: Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3 HTTP/1.1 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 56 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNph4xZIerUUjygAi4VrBtRWIToPdnPCtyYBKL32FI-G5EeA9akD5LvipZNVbOSLYxnsG7GlLrUb1uIPGa2BWX2Nyo_zNH_ZjmKNffF09g4tAjWx5M3iUghstn25-PsOUbQWI2cJx80WukNsEtQM4ZRNeloNzmRNTzyDyoB2R4KSzE Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6a46c38ffdcb48d89245d502d7851231 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a46c38ffdcb48d89245d502d7851231"}]}] Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6a46c38ffdcb48d89245d502d7851231 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: fbf03b170727417487ae0ad514c639ef Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: exception: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8f7941de-a008-4fdb-bd9e-cc09b807cad3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:57:13.996571 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.001000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Returning 404 to user: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:14.002029 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f20ef926-c3ed-4198-afff-b23b63a74c3e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3" status: 404 len: 110 microversion: 2.53 time: 0.347272 Oct 24 08:57:14.006834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 681/1317] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Oct 24 08:57:13 2022] PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3 => generated 110 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:57:14.014601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Action: 'update', calling method: .version_select at 0x7f8daaf45ca0>, body: {"status": "disabled"} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:14.018880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.019597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.020263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.039650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.042325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.043931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.062963 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] HTTP exception thrown: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Request method failure captured: Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: request: PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3 HTTP/1.1 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 22 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlNph4xZIerUUjygAi4VrBtRWIToPdnPCtyYBKL32FI-G5EeA9akD5LvipZNVbOSLYxnsG7GlLrUb1uIPGa2BWX2Nyo_zNH_ZjmKNffF09g4tAjWx5M3iUghstn25-PsOUbQWI2cJx80WukNsEtQM4ZRNeloNzmRNTzyDyoB2R4KSzE Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 6a46c38ffdcb48d89245d502d7851231 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a46c38ffdcb48d89245d502d7851231"}]}] Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 6a46c38ffdcb48d89245d502d7851231 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: fbf03b170727417487ae0ad514c639ef Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: {"status": "disabled"} Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: exception: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '8f7941de-a008-4fdb-bd9e-cc09b807cad3', 'body': {'status': 'disabled'}} Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:57:14.065560 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.071496 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.073641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Returning 404 to user: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:14.078638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1dc04e72-13a6-4da0-8e21-a2d8af7a831a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3" status: 404 len: 110 microversion: 2.53 time: 0.070345 Oct 24 08:57:14.079723 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 637/1318] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Oct 24 08:57:14 2022] PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 08:57:14.089069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Action: 'update', calling method: .version_select at 0x7f8daad968b0>, body: {"status": "enabled"} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:14.093452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.094147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.095614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.116705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.117777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.118692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.130227 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] HTTP exception thrown: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Request method failure captured: Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3 HTTP/1.1 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 21 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNph4xZIerUUjygAi4VrBtRWIToPdnPCtyYBKL32FI-G5EeA9akD5LvipZNVbOSLYxnsG7GlLrUb1uIPGa2BWX2Nyo_zNH_ZjmKNffF09g4tAjWx5M3iUghstn25-PsOUbQWI2cJx80WukNsEtQM4ZRNeloNzmRNTzyDyoB2R4KSzE Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6a46c38ffdcb48d89245d502d7851231 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a46c38ffdcb48d89245d502d7851231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a46c38ffdcb48d89245d502d7851231"}]}] Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6a46c38ffdcb48d89245d502d7851231 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886 Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: fbf03b170727417487ae0ad514c639ef Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: {"status": "enabled"} Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: exception: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8f7941de-a008-4fdb-bd9e-cc09b807cad3', 'body': {'status': 'enabled'}} Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:57:14.132354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. Oct 24 08:57:14.138585 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.141213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Returning 404 to user: Service 8f7941de-a008-4fdb-bd9e-cc09b807cad3 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:14.147734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.150359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:14.155800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c143b4e-3bfc-4dda-bbfa-6c2c3fc92579 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3" status: 404 len: 110 microversion: 2.53 time: 0.070891 Oct 24 08:57:14.156903 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 682/1319] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Oct 24 08:57:14 2022] PUT /compute/v2.1/os-services/8f7941de-a008-4fdb-bd9e-cc09b807cad3 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:57:14.170891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.178226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.179339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.180339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.183626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.184139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.184299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.184574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.185535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.185745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.186204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.186748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.187357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.257602 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-75c0b487-70f2-4baf-8146-03813e2699e4 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.090609 Oct 24 08:57:14.268389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 683/1320] 10.222.0.25 () {60 vars in 1178 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:14.278868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.290353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.292162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.294161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.295313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.295798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.304017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.369250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5683b367-5e02-465f-aee8-26cfdc01087e tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.099296 Oct 24 08:57:14.378293 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 684/1321] 10.222.0.25 () {60 vars in 1211 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:14.386314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.389995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.390760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.391577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.392724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.394084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.394964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.426288 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99d438f1-bb06-4b14-94c1-cd7fbb9c4329 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044481 Oct 24 08:57:14.427567 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 685/1322] 10.222.0.25 () {60 vars in 1178 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:14.433344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.434209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:14.443722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.444331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.444849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.445666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.446351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.446853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.513536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:14.528523 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d42d8e5-81f3-408f-95bb-db060e328883 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.391730 Oct 24 08:57:14.529851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 638/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:14.536233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.540688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.541492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.542165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.543393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.544061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.544840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.574174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78f6ddbd-aa73-425c-95e3-89e4041a115a tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.042996 Oct 24 08:57:14.575510 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 639/1324] 10.222.0.25 () {60 vars in 1235 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:14.589523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.597334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.601093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.601833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.603926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.604409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.604849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.675816 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9f05a48b-f304-4c01-b633-adaca1d0ac70 tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.091973 Oct 24 08:57:14.676449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 640/1325] 10.222.0.25 () {60 vars in 1178 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:14.697803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.698491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:14.715415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.716139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.718511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.720146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.722136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.722595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.732677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:14.742018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:14.743471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:14.744716 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c5b1c30-9f64-4692-8d02-e460befadfc1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.315928 Oct 24 08:57:14.763621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 686/1326] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:14.770064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:14.775305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.783097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.783872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.787852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.788567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.790522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.840814 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb21ac3e-4349-4444-982d-f39b5808bf8c tempest-ServicesAdminNegativeV253TestJSON-1412842886 tempest-ServicesAdminNegativeV253TestJSON-1412842886-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.075870 Oct 24 08:57:14.849675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 687/1327] 10.222.0.25 () {60 vars in 1239 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:15.051287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1b6f04e-8534-48cd-a755-4f17263588ec tempest-ServicesAdminNegativeV253TestJSON-741827840 tempest-ServicesAdminNegativeV253TestJSON-741827840-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:15.064140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1b6f04e-8534-48cd-a755-4f17263588ec tempest-ServicesAdminNegativeV253TestJSON-741827840 tempest-ServicesAdminNegativeV253TestJSON-741827840-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a59f9fcc21c44410af62e5833b0d70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bf2fd195bba468095d4cb1501e9922f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1b6f04e-8534-48cd-a755-4f17263588ec tempest-ServicesAdminNegativeV253TestJSON-741827840 tempest-ServicesAdminNegativeV253TestJSON-741827840-project] Request method failure captured: Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNo3ZvfTigSUr5NaSzTqYk9Vjm2UtDh24mDgmBIorWpDtFO3CaU7HoaIzYPAEEK8DyDeeAuc7IcOtcAm-9fZaueMuwi60qw2gfbkM8mRAQlpWi886jOSSsHYb7VBvIBxHLaW23IN1TCR_KIY7J9mQWEqcBfpwI_JG3pRuEL_PXZE28 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5bf2fd195bba468095d4cb1501e9922f Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-741827840 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5bf2fd195bba468095d4cb1501e9922f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5bf2fd195bba468095d4cb1501e9922f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5bf2fd195bba468095d4cb1501e9922f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5bf2fd195bba468095d4cb1501e9922f"}]}] Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-741827840 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5bf2fd195bba468095d4cb1501e9922f Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-741827840 Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServicesAdminNegativeV253TestJSON-741827840-project Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a59f9fcc21c44410af62e5833b0d70ff Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-741827840-project Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 08:57:15.065884 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1b6f04e-8534-48cd-a755-4f17263588ec tempest-ServicesAdminNegativeV253TestJSON-741827840 tempest-ServicesAdminNegativeV253TestJSON-741827840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1b6f04e-8534-48cd-a755-4f17263588ec tempest-ServicesAdminNegativeV253TestJSON-741827840 tempest-ServicesAdminNegativeV253TestJSON-741827840-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.207353 Oct 24 08:57:15.070924 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 688/1328] 10.222.0.25 () {60 vars in 1178 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 209 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:57:15.074556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:15.074714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] [instance: 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:15.082287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.082789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.083232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.083949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.084414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.084840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.122763 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] HTTP exception thrown: Instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 could not be found. Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Request method failure captured: Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 HTTP/1.1 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNDa98m0Mj7MN9ePfkuBpRXjDc3ydmh6Bvev4ZAWjHX5jbL7nUOUhcMupBWyXVwOmnfGbroG_f_3txhisc0EDCrVx4KMrsxF_ILc1WoUhf82n4SS_ZBC43IWz08d6vM05NCOmSjpyXvP7Bk_remRVeCOC06rvEzQpvXCqlEalvqKSw Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f6376cfd719142a58ac589d96c89f6e4 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TenantUsagesTestJSON-360318489 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6376cfd719142a58ac589d96c89f6e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6376cfd719142a58ac589d96c89f6e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6376cfd719142a58ac589d96c89f6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6376cfd719142a58ac589d96c89f6e4"}]}] Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TenantUsagesTestJSON-360318489 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f6376cfd719142a58ac589d96c89f6e4 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TenantUsagesTestJSON-360318489 Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TenantUsagesTestJSON-360318489-project Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: aff5064287e54352b298041c4b0c37ec Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TenantUsagesTestJSON-360318489-project Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 could not be found. Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '3310d8a3-e620-4d6c-ac7f-c3f9c05b5390'} Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 could not be found. Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 could not be found. Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:15.125052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 could not be found. Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] Returning 404 to user: Instance 3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05034467-66dc-4eb6-804b-80207031672f tempest-TenantUsagesTestJSON-360318489 tempest-TenantUsagesTestJSON-360318489-project] 10.222.0.25 "GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390" status: 404 len: 111 microversion: 2.1 time: 0.057338 Oct 24 08:57:15.132201 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 689/1329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:15 2022] GET /compute/v2.1/servers/3310d8a3-e620-4d6c-ac7f-c3f9c05b5390 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:15.140538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d5d62c5c-2723-4bbd-8358-3517277229d3 req-9a0f1f06-b49c-49e4-b812-3dd0c2208318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e62742-ceeb-4336-bf67-b6ae657b4852", "name": "network-vif-plugged", "status": "completed", "tag": "97452f9d-c71f-4d41-bcc9-56b11baf935a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:15.169974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d5d62c5c-2723-4bbd-8358-3517277229d3 req-9a0f1f06-b49c-49e4-b812-3dd0c2208318 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.170651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d5d62c5c-2723-4bbd-8358-3517277229d3 req-9a0f1f06-b49c-49e4-b812-3dd0c2208318 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.170889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d5d62c5c-2723-4bbd-8358-3517277229d3 req-9a0f1f06-b49c-49e4-b812-3dd0c2208318 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.195680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d5d62c5c-2723-4bbd-8358-3517277229d3 req-9a0f1f06-b49c-49e4-b812-3dd0c2208318 service nova] Creating event network-vif-plugged:97452f9d-c71f-4d41-bcc9-56b11baf935a for instance c2e62742-ceeb-4336-bf67-b6ae657b4852 on n-h2-master-1 Oct 24 08:57:15.203907 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d5d62c5c-2723-4bbd-8358-3517277229d3 req-9a0f1f06-b49c-49e4-b812-3dd0c2208318 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075135 Oct 24 08:57:15.205199 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 690/1330] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:15.556206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:15.558734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:15.570195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.571049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.571693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.574547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.575028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.577629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.626707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:15.634621 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0e32d8b-fb95-4072-817a-fb78ed62544a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.957074 Oct 24 08:57:15.652815 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 641/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:14 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:15.791873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:15.792595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:15.804998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.805530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.805965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.806747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:15.807142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:15.807558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:15.950887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:15.962544 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73c98611-76ca-4307-a0c1-f067036403f0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.410477 Oct 24 08:57:15.966858 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 691/1332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:15 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:16.019131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:16.033801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:16.039410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:16.040806 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3088b55c-eccc-4bc3-a6d8-d1f6f9e05953 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.254117 Oct 24 08:57:16.043609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 642/1333] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:15 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:16.270483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba5a134e-13c1-4619-994b-ed99d00d434d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Action: 'create', calling method: .version_select at 0x7f8daad72dc0>, body: {"keypair": {"name": "tempest-keypair-1332625018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGjDIorC5Tv67g0fJV8i1RVk/9pI4uLMuJnIG/5lzZayq69MBZ5M4JkRXK2rujDEbAaNwtPKV5B1sHaRRrHanqkfjXDFznkXdAXtRJapCPYZmwg9y0RXRrUe0gkk4i+UA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:16.319854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ba5a134e-13c1-4619-994b-ed99d00d434d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Getting quotas for project 01d49a667f134a8283ea56977bc33572. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:16.342231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ba5a134e-13c1-4619-994b-ed99d00d434d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Getting quotas for user b9785b058f4849e28c1fe25af094bef5 and project 01d49a667f134a8283ea56977bc33572. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:16.393023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba5a134e-13c1-4619-994b-ed99d00d434d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401844 Oct 24 08:57:16.394938 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 692/1334] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:57:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:16.658528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:16.659699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:16.674476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:16.679809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:16.680876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:16.683849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:16.687221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:16.689519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:17.000124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:17.001068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:17.022065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:17.022990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:17.023664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:17.028090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:17.028871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:17.029598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:17.047953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:17.061042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-57f6222d-f575-4168-97be-2fd70f6e6da7 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.407416 Oct 24 08:57:17.065162 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 643/1335] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:16 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:17.088516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:17.089885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:17.097010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:17.097749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:17.098422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:17.099407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:17.100071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:17.100726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:17.316952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:17.331316 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-faa5bef2-0651-47d2-b091-97142117c039 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.335578 Oct 24 08:57:17.332401 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 693/1336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:16 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:17.361425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-938eb04e-735b-4c93-adc1-063f98a550e1 req-339f1741-218c-4057-9629-42c250576635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add07d56-c8d6-4722-8f2f-8feae52e0d8c", "name": "network-vif-plugged", "status": "completed", "tag": "0ed081e0-c576-45fb-a26f-6dccbf7ffa72"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:17.382293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938eb04e-735b-4c93-adc1-063f98a550e1 req-339f1741-218c-4057-9629-42c250576635 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:17.383818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938eb04e-735b-4c93-adc1-063f98a550e1 req-339f1741-218c-4057-9629-42c250576635 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:17.395663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938eb04e-735b-4c93-adc1-063f98a550e1 req-339f1741-218c-4057-9629-42c250576635 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:17.433487 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-938eb04e-735b-4c93-adc1-063f98a550e1 req-339f1741-218c-4057-9629-42c250576635 service nova] Creating event network-vif-plugged:0ed081e0-c576-45fb-a26f-6dccbf7ffa72 for instance add07d56-c8d6-4722-8f2f-8feae52e0d8c on n-h1-master-1 Oct 24 08:57:17.453505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-938eb04e-735b-4c93-adc1-063f98a550e1 req-339f1741-218c-4057-9629-42c250576635 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117614 Oct 24 08:57:17.456621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 694/1337] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:17.586941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:17.620849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:17.629579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:17.633142 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53516183-5a3c-4dd1-ba65-91c7bcc12948 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.550128 Oct 24 08:57:17.657211 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 644/1338] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:17 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:18.089114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:18.089920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:18.098846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:18.104590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:18.105362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:18.106341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:18.107412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:18.110722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:18.377318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:18.377990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:18.412374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:18.413434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:18.414658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:18.416728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:18.417785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:18.418384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:18.419085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:18.445531 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bdcfd805-13fd-4b30-8fd1-42b0ae22ce82 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.361029 Oct 24 08:57:18.449120 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 695/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:18 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:18.680201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:18.681517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:18.690239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:18.694098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:18.695981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:18.698054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:18.703848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:18.705792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:19.070325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:19.086352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:19.089542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:19.091232 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ba982f4-076f-4cf5-b4e3-acb373ffcddd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.415380 Oct 24 08:57:19.093861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:19.114395 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 696/1340] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:18 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:19.130584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98916e61-86f5-4cd7-a9c4-41386550c934 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1322 microversion: 2.1 time: 0.779145 Oct 24 08:57:19.131960 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 645/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:18 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1322 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:19.471924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:19.479288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0a007492-744a-4256-99bb-7a02206370b1 req-419e0a53-49f4-43a4-aa17-051b105edd9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb", "name": "network-vif-plugged", "status": "completed", "tag": "3ed9cd08-1f32-4430-8985-9dca63b3af99"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:19.480177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:19.506226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:19.508795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:19.511811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0a007492-744a-4256-99bb-7a02206370b1 req-419e0a53-49f4-43a4-aa17-051b105edd9d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:19.512439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:19.513272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:19.513875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:19.514542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:19.515612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0a007492-744a-4256-99bb-7a02206370b1 req-419e0a53-49f4-43a4-aa17-051b105edd9d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:19.520208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0a007492-744a-4256-99bb-7a02206370b1 req-419e0a53-49f4-43a4-aa17-051b105edd9d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:19.542772 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0a007492-744a-4256-99bb-7a02206370b1 req-419e0a53-49f4-43a4-aa17-051b105edd9d service nova] Creating event network-vif-plugged:3ed9cd08-1f32-4430-8985-9dca63b3af99 for instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb on n-h2-master-1 Oct 24 08:57:19.556911 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0a007492-744a-4256-99bb-7a02206370b1 req-419e0a53-49f4-43a4-aa17-051b105edd9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082330 Oct 24 08:57:19.558992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 646/1342] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:57:19.905527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1030961187", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "58a1914c-bd52-4879-80e3-7184624c7b5c"}], "security_groups": [{"name": "tempest-securitygroup--593183267"}], "key_name": "tempest-keypair-1332625018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:19.958552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:19.968537 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-266e1b2b-eb2d-4521-8759-01aef5da1a7b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1199 microversion: 2.1 time: 0.501053 Oct 24 08:57:19.969030 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 697/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:19 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1199 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:20.128283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:20.129023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:20.142459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.143286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.144085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.145120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.145772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.146491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.191641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] validate_networks() for [('58a1914c-bd52-4879-80e3-7184624c7b5c', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:57:20.383242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:20.411107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:20.414440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:20.416810 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-acefff15-4b83-4379-8217-eac2bf6c3f19 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.298868 Oct 24 08:57:20.417871 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 698/1344] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:20 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:20.435362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:20.436212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:20.444101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.445280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.446690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.447772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.448411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.449276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.727401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:20.731322 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:20.738394 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1738987e-526b-4844-aa98-4aa347b9b83b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1514 microversion: 2.1 time: 0.318992 Oct 24 08:57:20.753979 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 699/1345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:20 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:20.765266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:20.767922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:20.774312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.775663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.776295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.777190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.777967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.778559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.806778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'flavor' on Instance uuid add07d56-c8d6-4722-8f2f-8feae52e0d8c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:20.902250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3be4dbc9-c10f-4c86-bbba-fd903eaeb110 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action" status: 200 len: 32 microversion: 2.1 time: 0.142770 Oct 24 08:57:20.903075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 700/1346] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:57:20 2022] POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 08:57:20.914986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:20.915928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:20.924806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.925705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.926620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.928283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:20.928975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:20.929660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:20.961873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Getting quotas for project 01d49a667f134a8283ea56977bc33572. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:20.992516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Getting quotas for user b9785b058f4849e28c1fe25af094bef5 and project 01d49a667f134a8283ea56977bc33572. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:21.041424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:57:21.042146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:57:21.042923 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:57:21.043588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:57:21.044204 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:57:21.065260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:21.066029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:21.066636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:21.067545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:21.068168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:21.068889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:21.114159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Getting quotas for project 01d49a667f134a8283ea56977bc33572. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:21.131137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Getting quotas for user b9785b058f4849e28c1fe25af094bef5 and project 01d49a667f134a8283ea56977bc33572. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:21.159239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:57:21.162200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:57:21.270156 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c050eac8-1171-41d1-a9ae-ce9471e4b27d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.372038 Oct 24 08:57:21.274461 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 647/1347] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:57:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:57:21.279427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:21.288343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:21.295344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:21.295836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:21.296267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:21.297060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:21.299949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:21.300570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:21.389156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:21.406873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a509922-1f04-4184-941b-56922c46b3df tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.496868 Oct 24 08:57:21.408406 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 701/1348] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:20 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:21.416962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-812c875c-24b9-42dc-af67-55f09b7b3821 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:21.418410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-812c875c-24b9-42dc-af67-55f09b7b3821 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:21.545016 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-812c875c-24b9-42dc-af67-55f09b7b3821 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:21.557357 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-812c875c-24b9-42dc-af67-55f09b7b3821 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1270 microversion: 2.1 time: 0.146128 Oct 24 08:57:21.557987 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 702/1349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:21 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:21.570779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:21.573645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:21.592782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:21.593310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:21.593912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:21.595913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:21.596719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:21.600189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:21.771705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:21.781430 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bd74ce7-8741-4014-9d90-4e32c8423fba tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1380 microversion: 2.1 time: 0.505564 Oct 24 08:57:21.782019 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 648/1350] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:21 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1380 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:22.094788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:22.105567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:22.122096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:22.126277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-624853a7-12b8-4e23-9cd8-01a840aa209a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.566209 Oct 24 08:57:22.146250 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 703/1351] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:21 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:22.162862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:22.173024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:22.174366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:22.193553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:22.195338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.198861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.199572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.202253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.203006 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.222052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.263554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.264723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.266517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.273118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.275103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.279429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.370215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2cb244a-818d-4a8d-a9d4-65a96e5fe217 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.213515 Oct 24 08:57:22.378523 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 704/1352] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:57:22 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments => generated 25 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:57:22.441808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:22.444756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:22.466858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.469557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.471764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.474915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.475841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.477928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.669446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-164a4bb6-f81c-4f4b-af54-e5cb4f132ffb tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1531 microversion: 2.1 time: 0.866873 Oct 24 08:57:22.689659 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 649/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:21 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1531 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:22.700988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:22.702777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:22.718240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.719940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.720511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.722033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.724676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.725450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.999583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:23.016772 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-892b8b4b-aded-4043-8f6c-f5e4142e44fb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1266 microversion: 2.1 time: 0.318996 Oct 24 08:57:23.018060 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 650/1354] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:22 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:23.022778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:23.026010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:23.036547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.046039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.046702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.047680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.048390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.048970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.151708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:23.168566 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47c6a394-e255-434e-8043-e6fc9bf69a9a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.735417 Oct 24 08:57:23.169484 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 705/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:22 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:23.176856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:23.177615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:23.202156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.202675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.203112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.203825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.204282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.204708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.736742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:23.773652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:23.777799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:23.782141 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-88c3fb36-412c-4ca2-b274-2461f11f5c65 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.611488 Oct 24 08:57:23.783549 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 706/1356] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:23 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:23.831482 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de8ffd3a-0d06-4498-8575-e8a12e063b95 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1531 microversion: 2.1 time: 0.812025 Oct 24 08:57:23.832218 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 651/1357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:23 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1531 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:23.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:23.866156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.866651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.867091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.867818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.871217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.871672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.945810 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-edbbec02-eb61-4f7b-ae0a-eec71e5acdae tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091117 Oct 24 08:57:23.951278 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 707/1358] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 08:57:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:23.964984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:23.968292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:23.982877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.984923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.985704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:23.986140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:23.986599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:23.987022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:24.037721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lazy-loading 'flavor' on Instance uuid bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:24.046787 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:24.047584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:24.058976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:24.064848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:24.067481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:24.068823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:24.073382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:24.082010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:24.131481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Going to try to live migrate instance to n-h1-master-1 {{(pid=126919) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:57:24.260610 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:24.293594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:24.307548 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e6d64786-43fb-4baf-b65d-66b42fe7df3d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1328 microversion: 2.1 time: 0.260135 Oct 24 08:57:24.308210 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 708/1359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:24 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1328 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:24.326903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:24.327795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:24.343866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:24.344185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:24.344825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:24.345809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:24.346777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:24.349560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.347686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:25.361450 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ecbee61a-b30f-4392-955c-81416e0a8515 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 1.050947 Oct 24 08:57:25.362392 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 709/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:24 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:25.378574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:25.379288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:25.393907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.394570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.395022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.399991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.400623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.401075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.738263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:25.749333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:25.761617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:25.769624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5caa95a6-b5ce-443a-8d15-82cc3b41a7c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.400546 Oct 24 08:57:25.794496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 710/1361] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:25 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:25.807675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:25.814352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:25.836197 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:25.848203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.854032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.856395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.866369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.870338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.876274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:26.241938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:26.273668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02ad5623-d563-4e64-add2-22f5561a5eec tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1328 microversion: 2.1 time: 0.474787 Oct 24 08:57:26.277381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 711/1362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:25 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:26.304590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:26.314700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:26.375471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:26.376362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:26.383802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:26.386945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:26.389816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:26.390582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:26.482888 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15d2e282-d2fc-4679-b780-77c19ee72bf2 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202310 Oct 24 08:57:26.483523 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 712/1363] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:57:26 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084/os-volume_attachments => generated 25 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:57:26.494014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:26.495139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:26.512520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:26.513177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:26.513639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:26.514351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:26.514810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:26.516029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:27.266197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:27.302042 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5beecece-d870-469a-8acb-5320f99c6b41 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.811431 Oct 24 08:57:27.308084 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 713/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:26 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:27.334377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:27.335737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:27.361163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:27.362396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:27.363517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:27.365119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:27.375706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:27.376724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:27.515300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:57:27.647581 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:27.744227 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e6f4177-f311-4169-be47-9681145e276d tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 204 len: 0 microversion: 2.1 time: 0.433440 Oct 24 08:57:27.744835 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 714/1365] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:57:27 2022] DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:57:27.753384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:27.754132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:27.761330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:27.761809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:27.762251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:27.762965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:27.763421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:27.763858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.019651 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ae8df30-0f8d-4494-a4f6-9e8b1eeac22b tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb/action" status: 202 len: 0 microversion: 2.1 time: 4.058528 Oct 24 08:57:28.029152 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 652/1366] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:57:23 2022] POST /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb/action => generated 0 bytes in 4070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:57:28.046768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:28.050234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:28.072329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.074568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.075749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.078035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.079627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.087818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.113602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.128648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.133057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.136710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ec1ffb0-7672-4118-87d3-e95514d0654f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.386054 Oct 24 08:57:28.138607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 715/1367] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:27 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:28.154372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:28.155200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:28.183693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.184215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.184662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.186773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.187359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.187798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.505951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.515146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d501cc2-46fb-41a5-a061-be423a16410e tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1681 microversion: 2.1 time: 0.373712 Oct 24 08:57:28.516174 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 716/1368] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:28 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:28.521353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:28.522056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:28.529842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.530514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.531068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.531895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.532471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.533012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.637610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.650895 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e936793d-e2c5-4499-9981-c4e482ba3858 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.617092 Oct 24 08:57:28.669984 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 653/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:28 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:28.678670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:28.679543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:28.686319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.687088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.687809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.688817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.689477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.690075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.811255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.824439 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-540554b5-c144-4c4e-b6c7-4a311a34e0a6 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.306862 Oct 24 08:57:28.825047 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 717/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:28 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:29.181973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:29.183048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:29.195901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:29.198061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:29.198707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:29.202320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:29.203197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:29.206008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:29.238516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:29.253517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-377dd212-9595-46b6-847f-6b0bfb4d0827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.581996 Oct 24 08:57:29.254411 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 654/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:28 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:29.508457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:29.525236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:29.539255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:29.543276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07df3bc4-2624-43f7-9396-583cc39bce44 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.366111 Oct 24 08:57:29.543672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:29.543888 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 718/1372] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:29 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:29.544298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:29.557797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:29.558324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:29.558743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:29.569854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:29.570643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:29.571299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:29.684137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:29.684760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:29.692806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:29.693281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:29.693741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:29.694457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:29.694914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:29.695341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.203234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:30.213337 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03b32f3a-60af-4794-95af-5faff563a018 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.533024 Oct 24 08:57:30.220240 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 719/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:29 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:30.226671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:30.227560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:30.244458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:30.251935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:30.254349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.258710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:30.259514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:30.261839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.414984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:30.433730 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1598ee1c-b1db-4c0b-9849-60ea89f20e2a tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1681 microversion: 2.1 time: 0.893483 Oct 24 08:57:30.457376 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 655/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:29 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1681 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:30.477595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:30.480248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:30.490145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:30.490867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:30.491510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.492485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:30.493139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:30.494478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.944398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:30.958903 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-675d6f98-6856-4ea9-a6f5-b8089c50e250 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.498819 Oct 24 08:57:30.964919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 656/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:30 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:30.980602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:30.985485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:31.000310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:31.007750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.008243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.011775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-49316d16-ec5f-4aa6-b9ca-deb45fe65193 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.788503 Oct 24 08:57:31.012594 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 720/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:30 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:31.015036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.017485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.018693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.020057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.099513 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:31.154417 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:31.171605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-80ee3eec-137a-4864-88f9-e94887ccf030 req-760d1813-2f97-4032-9509-61b3c8343b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ef4985-b1ff-4177-9373-d6dc8794e3d6", "tag": "1137817f-88a5-46ed-b4ed-57072602e3b4"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:31.189464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80ee3eec-137a-4864-88f9-e94887ccf030 req-760d1813-2f97-4032-9509-61b3c8343b6b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.189937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80ee3eec-137a-4864-88f9-e94887ccf030 req-760d1813-2f97-4032-9509-61b3c8343b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.190483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80ee3eec-137a-4864-88f9-e94887ccf030 req-760d1813-2f97-4032-9509-61b3c8343b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.215551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-80ee3eec-137a-4864-88f9-e94887ccf030 req-760d1813-2f97-4032-9509-61b3c8343b6b service nova] Creating event network-changed:1137817f-88a5-46ed-b4ed-57072602e3b4 for instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 on n-h1-master-1 Oct 24 08:57:31.231671 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-80ee3eec-137a-4864-88f9-e94887ccf030 req-760d1813-2f97-4032-9509-61b3c8343b6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063676 Oct 24 08:57:31.233225 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 721/1377] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:31.248599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:31.251550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:31.268623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.273948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.275177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.276013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.276503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.276951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.551304 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:32.048184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:32.065378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d17145c9-e49e-4fa5-9240-e434acb68c0a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.823190 Oct 24 08:57:32.070663 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 722/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:31 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:32.112569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:32.120931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:32.129774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:32.146208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.151482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.159682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.163150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.163615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.166064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.171155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:32.172783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:32.174253 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98cf1f3e-a746-48c6-b67d-816f01dfaf55 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 1.208042 Oct 24 08:57:32.187822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 657/1379] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:30 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:32.220898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:32.223288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:32.258591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.260121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.260649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.266461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.269534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.270110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.634196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:32.656173 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b0e1614-d0b1-4e25-99d0-b9aaa52ed3f6 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1681 microversion: 2.1 time: 0.584322 Oct 24 08:57:32.679199 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 723/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:32 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1681 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:32.692481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:32.694465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:32.712106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.712854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.716181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.717407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.719757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.724232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.432505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:57:33.484355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:33.504957 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-054faa63-601c-4237-a895-362ff04a6b3b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 1.323645 Oct 24 08:57:33.506766 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 658/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:32 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:33.519024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:33.519652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:33.539148 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:33.544008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.546340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.547975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.551367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.554335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.555145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.622846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7b400bc-3da2-4a93-91fe-801131694f55 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 204 len: 0 microversion: 2.1 time: 0.940771 Oct 24 08:57:33.624625 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 724/1382] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:57:32 2022] DELETE /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:57:33.808327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9087d6a-2a50-405d-b055-6844027dc1e4 tempest-FloatingIPDetailsNegativeTestJSON-266771910 tempest-FloatingIPDetailsNegativeTestJSON-266771910-project] Calling method '.version_select at 0x7f8daadaaaf0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:33.865269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:33.884543 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:33.885327 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc20e46e-b9d0-4635-b1f4-f5d1f7221c63 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.375308 Oct 24 08:57:33.885942 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 659/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:33 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:33.894191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:33.894817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:33.910822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.911326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.911773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.912491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.912955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.913966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.944912 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-b9087d6a-2a50-405d-b055-6844027dc1e4 tempest-FloatingIPDetailsNegativeTestJSON-266771910 tempest-FloatingIPDetailsNegativeTestJSON-266771910-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b could not be found", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:57:33.945715 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b9087d6a-2a50-405d-b055-6844027dc1e4 tempest-FloatingIPDetailsNegativeTestJSON-266771910 tempest-FloatingIPDetailsNegativeTestJSON-266771910-project] HTTP exception thrown: Floating IP not found for ID d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9087d6a-2a50-405d-b055-6844027dc1e4 tempest-FloatingIPDetailsNegativeTestJSON-266771910 tempest-FloatingIPDetailsNegativeTestJSON-266771910-project] Request method failure captured: Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-floating-ips/d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b HTTP/1.1 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlN82ZCbKJ3WiIsnQZEm_bO2tYqHdVGcHvYsJzk1HXBEcuSn_qE6OatcMsghQKiFIq-Gdzw19wT9mgkObz3Ju1auuByr0EgZfZ0YypcU0pSYgF4VlJbqIkTKyJG3-FuockYNW-lzktiLqC_VxUPH86xD6Kw3hEENou2cquPAFWY7RCc Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b444615dfc8f436db3a7310a43ca6622 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-266771910 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b444615dfc8f436db3a7310a43ca6622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b444615dfc8f436db3a7310a43ca6622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b444615dfc8f436db3a7310a43ca6622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b444615dfc8f436db3a7310a43ca6622"}]}] Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-266771910 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b444615dfc8f436db3a7310a43ca6622 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-266771910 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-266771910-project Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b3795b2dee9a4ef29f6f218c4a251876 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-266771910-project Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP not found for ID d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'd41d897a-8913-4dcc-a3d4-7ab1f2c5f21b'} Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b could not be found Oct 24 08:57:33.948052 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f88f66b6-0bde-428d-9597-14f426a2feff'] Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b. Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9087d6a-2a50-405d-b055-6844027dc1e4 tempest-FloatingIPDetailsNegativeTestJSON-266771910 tempest-FloatingIPDetailsNegativeTestJSON-266771910-project] Returning 404 to user: Floating IP not found for ID d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:33.954434 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9087d6a-2a50-405d-b055-6844027dc1e4 tempest-FloatingIPDetailsNegativeTestJSON-266771910 tempest-FloatingIPDetailsNegativeTestJSON-266771910-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b" status: 404 len: 111 microversion: 2.1 time: 0.325975 Oct 24 08:57:33.958724 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 725/1384] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:57:33 2022] GET /compute/v2.1/os-floating-ips/d41d897a-8913-4dcc-a3d4-7ab1f2c5f21b => generated 111 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:33.970925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:33.972096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:33.992580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.993373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.993948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.994815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.995786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.999572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.227948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.242235 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0cf3a4c2-54bc-45a9-a1cc-6d289013009a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.355193 Oct 24 08:57:34.243501 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 660/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:33 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:34.252777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4f308ca2-148e-4c9e-a4d3-ff826f192e7a req-0a4b5c88-5e3d-49bc-883d-42dd9dac3ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6352e97a-d784-43f0-b94e-cee5d7e9a084", "name": "network-vif-deleted", "tag": "ec159437-cd78-406e-9391-5a30935d0b65"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:34.282807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4f308ca2-148e-4c9e-a4d3-ff826f192e7a req-0a4b5c88-5e3d-49bc-883d-42dd9dac3ed0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.284356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4f308ca2-148e-4c9e-a4d3-ff826f192e7a req-0a4b5c88-5e3d-49bc-883d-42dd9dac3ed0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.287009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4f308ca2-148e-4c9e-a4d3-ff826f192e7a req-0a4b5c88-5e3d-49bc-883d-42dd9dac3ed0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.323527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4f308ca2-148e-4c9e-a4d3-ff826f192e7a req-0a4b5c88-5e3d-49bc-883d-42dd9dac3ed0 service nova] Creating event network-vif-deleted:ec159437-cd78-406e-9391-5a30935d0b65 for instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 on n-h2-master-1 Oct 24 08:57:34.354000 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4f308ca2-148e-4c9e-a4d3-ff826f192e7a req-0a4b5c88-5e3d-49bc-883d-42dd9dac3ed0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108824 Oct 24 08:57:34.354641 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 661/1386] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:34.362960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:34.364794 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:34.381534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.382282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.382900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.383952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.384577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.385459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.389885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.407775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.412055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.417289 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-27e18826-0a9e-42cb-b306-e15fe286ea6e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.459167 Oct 24 08:57:34.440478 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 726/1387] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:33 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:34.448259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:34.452421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:34.465832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.471101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.472514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.473498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.474137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.474735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.525165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.527501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.528142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.528772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lazy-loading 'fault' on Instance uuid 6352e97a-d784-43f0-b94e-cee5d7e9a084 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:34.587562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d393f7341e402a80a50b822b3f0f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178ccdbda089491a92f2c97d4437433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.607793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96928ba9-d7fa-46bd-ad05-f9616ea08e78 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 200 len: 1331 microversion: 2.1 time: 0.170138 Oct 24 08:57:34.610360 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 727/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:34 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 1331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:34.615643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:34.616475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:34.624661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.625526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.626289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.627276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.627851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.629127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.738122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.747517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ff2e3e68-5184-43e1-9c5e-3cc2a741b7d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1553 microversion: 2.1 time: 0.390317 Oct 24 08:57:34.761910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 662/1389] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:34 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1553 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:34.924111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:34.924948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:34.934654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.935169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.935624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.936330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.939506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.940222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.944431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.957112 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e71e3c0-944a-44f8-aa1b-b8748614e203 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.345047 Oct 24 08:57:34.961344 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 728/1390] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:34 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:35.268536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:35.269164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:35.282838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.283358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.283812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.284537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.285016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.285481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.359912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:35.382677 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05848d2d-0eb9-4db1-95b9-2c941c0bf168 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.462406 Oct 24 08:57:35.384362 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 663/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:34 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:35.453671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:35.454282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:35.460604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.461092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.461555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.462835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.463468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.463880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.591882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:35.609995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e945ee4-5393-4c83-bfa4-09324613be1d tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.345558 Oct 24 08:57:35.610816 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 729/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:35 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:35.635232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:35.636258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:35.651887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.657006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.657628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.660330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.660663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.661079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.683543 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] HTTP exception thrown: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Request method failure captured: Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 HTTP/1.1 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlK6HUvLthaGtQ7o2nJdXUj3tOuCsSVHkT3z9uzsefdg6bOQ4Xwi-b3YNX_KAXwC0ioi0UMQPmnl5S-gn_qzWOO5kH_5reZcJo2N0hRAjSY7PHlWp5IDRlbEkHPqwF33Zz7LVX9IfxFwLzxXLS0sFgAIY64aYK53BIE4ENHHRWTzh0I Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 178ccdbda089491a92f2c97d4437433c Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/178ccdbda089491a92f2c97d4437433c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_178ccdbda089491a92f2c97d4437433c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/178ccdbda089491a92f2c97d4437433c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/178ccdbda089491a92f2c97d4437433c"}]}] Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 178ccdbda089491a92f2c97d4437433c Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachSCSIVolumeTestJSON-1431982080-project Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 83d393f7341e402a80a50b822b3f0f94 Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1431982080-project Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6352e97a-d784-43f0-b94e-cee5d7e9a084'} Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:35.691463 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:35.697312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:35.700140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Returning 404 to user: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:35.705755 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c29a57f9-a9b2-43b2-9767-2aec025db20f tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 404 len: 111 microversion: 2.1 time: 0.075282 Oct 24 08:57:35.707611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 730/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:35 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:57:35.717860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-565ef012-e53e-4ee6-ae24-59c5e1195893 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '.version_select at 0x7f8daadd9820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:35.753671 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-565ef012-e53e-4ee6-ae24-59c5e1195893 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777841712" status: 202 len: 0 microversion: 2.1 time: 0.041868 Oct 24 08:57:35.758656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 731/1394] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 08:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777841712 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:57:35.775779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:35.777233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:35.800089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.801869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.803113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.807002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:35.814902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:35.816610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:35.856750 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:35.978547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:35.996286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:36.001909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:36.004053 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1a6a130-4533-4b1d-aed7-422b540c130c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.554295 Oct 24 08:57:36.007482 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 664/1395] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:35 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:57:36.018788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:36.020423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:36.039858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:36.044489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:36.045401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:36.047341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:36.050103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:36.050829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:36.396565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:36.420710 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77c3d830-a35d-4528-bb41-bee6e45d91bf tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.411784 Oct 24 08:57:36.421320 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 665/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:36 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:36.426228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:36.427164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:36.434599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:36.435328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:36.436145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:36.437014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:36.437651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:36.438228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:36.502099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:36.518219 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00eb7ac9-d68a-4d37-abda-df8d25b2d202 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1553 microversion: 2.1 time: 0.749440 Oct 24 08:57:36.519986 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 732/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:35 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1553 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:36.638338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:36.639500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:36.655752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:36.656289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:36.656724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:36.657471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:36.657932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:36.658354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.070521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:37.084597 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-36876f13-1dbd-470b-8d3f-8ccedd23455c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.451369 Oct 24 08:57:37.085547 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 733/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:36 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:37.101193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:37.102131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:37.116936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.119760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.120659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.121610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.127975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.128737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.129235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:37.141040 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1812b6d4-4714-4973-8db8-fc455f97227f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.718457 Oct 24 08:57:37.158392 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 666/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:36 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:37.367042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-78af52bb-5f54-4799-bfb5-95e8847a5f98 req-37ebca58-ee0a-4c57-9d4f-f4974b512748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087182c5-5ac3-4775-861b-db31388889b5", "name": "network-vif-deleted", "tag": "50709261-6d9b-48d0-9eaf-d22e0bcf2380"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:37.381823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78af52bb-5f54-4799-bfb5-95e8847a5f98 req-37ebca58-ee0a-4c57-9d4f-f4974b512748 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.390086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78af52bb-5f54-4799-bfb5-95e8847a5f98 req-37ebca58-ee0a-4c57-9d4f-f4974b512748 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.392013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78af52bb-5f54-4799-bfb5-95e8847a5f98 req-37ebca58-ee0a-4c57-9d4f-f4974b512748 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.409036 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-78af52bb-5f54-4799-bfb5-95e8847a5f98 req-37ebca58-ee0a-4c57-9d4f-f4974b512748 service nova] Creating event network-vif-deleted:50709261-6d9b-48d0-9eaf-d22e0bcf2380 for instance 087182c5-5ac3-4775-861b-db31388889b5 on n-h1-master-1 Oct 24 08:57:37.419987 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-78af52bb-5f54-4799-bfb5-95e8847a5f98 req-37ebca58-ee0a-4c57-9d4f-f4974b512748 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061053 Oct 24 08:57:37.423339 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 667/1400] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:37.448788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:37.449867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:37.462766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.463294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.463750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.465976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.466462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.466905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.630493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:37.651347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:37.653439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:37.654793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a15aec4-9914-4a2b-a2fe-60fe11cb6997 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.567972 Oct 24 08:57:37.661341 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 734/1401] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:37 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:37.665217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:37.665965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:37.681426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.682107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.682659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.683485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:37.686709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:37.687693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:37.844998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:37.865836 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14404672-3332-4ee3-872a-17c328dbbb13 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.413449 Oct 24 08:57:37.877319 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 668/1402] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:37 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:38.086203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:38.108561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:38.109478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:38.120746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:38.121240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:38.129427 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0db6555e-5572-4318-b0db-93e17071e2be tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1346 microversion: 2.1 time: 0.472297 Oct 24 08:57:38.131901 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 735/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:37 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1346 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:38.133430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:38.134366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:38.134857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:38.135303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:38.174763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:38.174763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:38.192863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:38.193408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:38.196410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:38.197640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:38.201327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:38.203783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:38.659350 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:38.664074 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:38.702633 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7caa3931-3ac3-4f53-91be-df06ee095c76 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.597863 Oct 24 08:57:38.703245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 669/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:38 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:38.728828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:38.729575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:38.741270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:38.745589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:38.746120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:38.746901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:38.747363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:38.749914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:39.345467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:39.377037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:39.378862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:39.380175 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ccd642cc-3531-4ef4-910c-daa83b6acf66 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.675859 Oct 24 08:57:39.409393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 670/1405] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:38 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:39.410165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:39.423706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:39.450912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:39.450912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:39.454250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:39.455431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:39.456260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:39.460219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:39.842615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:39.875184 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6330a86-ace1-47a7-9544-f0eaae734911 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 1.707091 Oct 24 08:57:39.880508 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 736/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:38 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:39.893955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:39.895584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:39.919024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:39.929664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:39.931414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:39.931756 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-619a0808-d4d3-4c55-bf5a-d1a1a40d8ad8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.534562 Oct 24 08:57:39.932376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:39.933826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:39.934621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:39.935323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:39.938766 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 671/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:39 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:39.955035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:39.955648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:39.970796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:39.971662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:39.972296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:39.991058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:39.991899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:39.995804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:40.585621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:40.599078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8956cc1f-cb5d-41ea-a0e4-b8f9beba7c76 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1346 microversion: 2.1 time: 0.716426 Oct 24 08:57:40.599713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 737/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:39 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1346 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:40.618904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:40.619506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:40.647286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:40.655163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:40.655672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:40.656114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:40.659554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:40.660261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:40.660985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:40.679002 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-551d9cdb-eb00-4e64-9875-935b8fca1b7c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.738997 Oct 24 08:57:40.680087 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 672/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:39 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:40.911789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:40.912499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:40.937072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:40.938972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:40.939484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:40.941600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:40.943944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:40.945760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:41.186702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:41.197549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:41.203718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:41.209214 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d48c3116-e7e2-4278-bfc3-3a6148e1f5d3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.607944 Oct 24 08:57:41.212958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 738/1410] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:40 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:41.224441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:41.227624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:41.239233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:41.240801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:41.246266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:41.247422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:41.248148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:41.248850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:41.390669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:41.399121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb2f2ef7-b48b-46c5-aaab-bbbf8e616492 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.491810 Oct 24 08:57:41.416179 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 673/1411] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:40 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:57:41.543001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:41.553982 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d949e461-e96f-46eb-92bb-b78334681160 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.339582 Oct 24 08:57:41.559305 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 739/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:41 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:41.636797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:41.637870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:41.660906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:41.662134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:41.662966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:41.663983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:41.665400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:41.668844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:41.705204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:41.709655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:41.718683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:41.723225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:41.724593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:41.725546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:41.726687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:41.728498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.123388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:42.131839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac33f7ee-f646-433a-acfa-4b17f700b3c8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.430843 Oct 24 08:57:42.145427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 740/1413] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:41 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:42.211463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:42.223891 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65559e4a-0d8c-4dc3-bd28-fbf40cd37ac4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1346 microversion: 2.1 time: 0.599223 Oct 24 08:57:42.224484 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 674/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:41 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1346 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:42.240683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:42.241314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:42.254253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.259864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.260209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.261230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.261922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.262565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.422442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:42.425670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:42.454187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.454896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.458001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.459555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.460200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.460800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.546137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:42.561990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:42.568142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:42.570075 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcc57cbc-5648-48ce-9ed4-75aa35298bab tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.333671 Oct 24 08:57:42.570589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 741/1415] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:42 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:42.585994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:42.587136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:42.607247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.607753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.608368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.609283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.609761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.610326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.804218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:42.821617 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d465199-56c2-4ff3-a12d-cf61e35490fd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.397586 Oct 24 08:57:42.822952 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 675/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:42 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:42.828886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-27bc486d-e6fb-4e6b-8af0-cc4f005faa99 req-969f5d59-b134-4c10-8a65-35b93d6c855a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792bb51b-253c-4fdb-ac1e-99e18bd2fce7", "name": "network-vif-unplugged", "status": "completed", "tag": "a424feab-3312-458c-9dd4-f47480184a8f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:42.847832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-27bc486d-e6fb-4e6b-8af0-cc4f005faa99 req-969f5d59-b134-4c10-8a65-35b93d6c855a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:42.848329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-27bc486d-e6fb-4e6b-8af0-cc4f005faa99 req-969f5d59-b134-4c10-8a65-35b93d6c855a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:42.848770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-27bc486d-e6fb-4e6b-8af0-cc4f005faa99 req-969f5d59-b134-4c10-8a65-35b93d6c855a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:42.871645 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-27bc486d-e6fb-4e6b-8af0-cc4f005faa99 req-969f5d59-b134-4c10-8a65-35b93d6c855a service nova] Creating event network-vif-unplugged:a424feab-3312-458c-9dd4-f47480184a8f for instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 on n-h2-master-1 Oct 24 08:57:42.879790 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-27bc486d-e6fb-4e6b-8af0-cc4f005faa99 req-969f5d59-b134-4c10-8a65-35b93d6c855a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055379 Oct 24 08:57:42.881141 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 676/1417] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:43.160977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:43.161987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:43.169767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.170776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.171386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:43.172368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.173164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.173870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:43.176375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:43.185813 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e38a0d2-0969-401c-822d-445f5553c06e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.603557 Oct 24 08:57:43.188306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 742/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:42 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:43.221139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-895bf15f-5fde-4799-8230-a2683598c646 req-25743ab2-1b64-481f-9083-104b0979f97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ef4985-b1ff-4177-9373-d6dc8794e3d6", "name": "network-vif-plugged", "status": "completed", "tag": "1137817f-88a5-46ed-b4ed-57072602e3b4"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:43.245947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-895bf15f-5fde-4799-8230-a2683598c646 req-25743ab2-1b64-481f-9083-104b0979f97e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.250997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-895bf15f-5fde-4799-8230-a2683598c646 req-25743ab2-1b64-481f-9083-104b0979f97e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.262403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-895bf15f-5fde-4799-8230-a2683598c646 req-25743ab2-1b64-481f-9083-104b0979f97e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:43.289635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-895bf15f-5fde-4799-8230-a2683598c646 req-25743ab2-1b64-481f-9083-104b0979f97e service nova] Creating event network-vif-plugged:1137817f-88a5-46ed-b4ed-57072602e3b4 for instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 on n-h1-master-1 Oct 24 08:57:43.303268 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-895bf15f-5fde-4799-8230-a2683598c646 req-25743ab2-1b64-481f-9083-104b0979f97e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086040 Oct 24 08:57:43.304273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 743/1419] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:43.320111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:43.325078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:43.340042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.350138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.350591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:43.352086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.352874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.353532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:43.619262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:43.639143 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ddf8efe-c180-4603-887c-1e97216880af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1346 microversion: 2.1 time: 0.333572 Oct 24 08:57:43.653757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 744/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:43 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1346 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:43.660408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:43.661433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:43.681343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.682186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.682856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:43.683830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:43.684781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:43.685580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.164053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:44.197791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:44.200057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:44.201692 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b223f2cb-5a23-4659-b95a-dd7cfa8a6136 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.546442 Oct 24 08:57:44.217495 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 745/1421] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:43 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:44.243033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:44.244949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:44.253174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.254627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.256209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.257426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.258216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.271189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.419122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:44.452021 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0783400e-7b7e-42c8-af7b-34fc843201fa tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 1.291660 Oct 24 08:57:44.453012 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 677/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:43 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:44.479325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:44.485058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:44.502613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.503117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.503557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.504316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.509749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.510483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.739449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:44.754058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-675fdf75-42cc-4659-a8f0-d002d2e4ebbf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.511726 Oct 24 08:57:44.756149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 746/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:44 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:44.784708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:44.787282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:44.813687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.816164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.816848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.818173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.818901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.822117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:44.876512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:44.893237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-adc46e68-4951-443b-8508-8c95271c45de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.437802 Oct 24 08:57:44.896960 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 678/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:44 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:44.936157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-086821d8-4fd4-42ee-b5ca-a810324f3a2d req-be4fde05-130d-4dc5-9dc7-5fe997d9650b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792bb51b-253c-4fdb-ac1e-99e18bd2fce7", "tag": "a424feab-3312-458c-9dd4-f47480184a8f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:44.990514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-086821d8-4fd4-42ee-b5ca-a810324f3a2d req-be4fde05-130d-4dc5-9dc7-5fe997d9650b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:44.991138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-086821d8-4fd4-42ee-b5ca-a810324f3a2d req-be4fde05-130d-4dc5-9dc7-5fe997d9650b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:44.992127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-086821d8-4fd4-42ee-b5ca-a810324f3a2d req-be4fde05-130d-4dc5-9dc7-5fe997d9650b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:45.009592 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-086821d8-4fd4-42ee-b5ca-a810324f3a2d req-be4fde05-130d-4dc5-9dc7-5fe997d9650b service nova] Creating event network-changed:a424feab-3312-458c-9dd4-f47480184a8f for instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 on n-h2-master-1 Oct 24 08:57:45.035684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-086821d8-4fd4-42ee-b5ca-a810324f3a2d req-be4fde05-130d-4dc5-9dc7-5fe997d9650b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131651 Oct 24 08:57:45.036816 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 679/1425] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:45.058050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:45.068205 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67877975-7de3-4310-8659-48fbf366a537 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1346 microversion: 2.1 time: 0.306310 Oct 24 08:57:45.097015 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 747/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:44 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1346 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:45.244225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:45.247672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:45.263811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:45.264221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:45.268381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:45.270790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:45.272663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:45.273408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:45.479982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:45.480605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:45.493745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:45.494889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:45.496432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:45.498742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:45.501031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:45.501522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.023411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.033178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.045454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.048804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.051559 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b82b58c6-1bc7-4f75-8bae-47ce8d996f50 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.819806 Oct 24 08:57:46.058442 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 680/1427] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:45 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:46.062362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-349cf16b-124c-48a5-bdb1-f026778d9a6c tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1395 microversion: 2.1 time: 0.586617 Oct 24 08:57:46.066723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:46.070189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:46.078978 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 748/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:45 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1395 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:46.092475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:46.094737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:46.095243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:46.095691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.095897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:46.096419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:46.096881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:46.098784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.111589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:46.112578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:46.113271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.114294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:46.115030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:46.115697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.397543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.410720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4501e3f3-2623-48cf-9131-75f2b1aaca05 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.346003 Oct 24 08:57:46.412638 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 681/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:46 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:46.426400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:46.427368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:46.443179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:46.443179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:46.447685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.448841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:46.452672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:46.453208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:46.644352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.663026 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-033f202a-02f8-4c0b-b7cd-5567ace20442 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1346 microversion: 2.1 time: 0.248470 Oct 24 08:57:46.663583 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 682/1430] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:46 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1346 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:46.771713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:46.775919 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:46.785278 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e120435e-7c4e-4c28-8c44-5e85ea805a2f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.705025 Oct 24 08:57:46.789031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 749/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:46 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:47.078354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:47.078993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:47.094886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:47.095491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:47.106366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.106901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.107384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.108115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.108878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.109324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.116857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.120737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.121491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.124081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.124838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.125934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.587755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:47.621933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:47.627442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:47.628914 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e19cf246-ba84-47bc-8918-0f653632646c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.555155 Oct 24 08:57:47.629533 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 683/1432] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:47 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:47.644261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:47.652868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:47.674354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:47.684153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e1c649e-cab9-4077-b024-f769a159a8ca tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1576 microversion: 2.1 time: 0.593389 Oct 24 08:57:47.713391 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 750/1433] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:47 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1576 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:47.722609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.724692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.731001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:47.731893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.732808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.734052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:47.734409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.735025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.762446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.769880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.771913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.773567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.781250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.783301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.904022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:47.904523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:47.904962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:47.905443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lazy-loading 'fault' on Instance uuid 087182c5-5ac3-4775-861b-db31388889b5 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:48.282896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:48.296629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:48.365152 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d160918-18e8-4703-84da-fb9948a25163 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 200 len: 1305 microversion: 2.1 time: 0.650298 Oct 24 08:57:48.372918 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 751/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:47 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 1305 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:48.382552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:48.383989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:48.393615 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee5631f6-ad28-4ff4-8120-1bcb702f3e0c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.740741 Oct 24 08:57:48.409391 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 684/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:47 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:48.409645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:48.409645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:48.409645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:48.415624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:48.416389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:48.419887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:48.425142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:48.427983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:48.445182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:48.446376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:48.446848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:48.447622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:48.448099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:48.453630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:48.718688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:48.728223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9badb446-ccd2-47d2-9020-633e8d2e7ada tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.316859 Oct 24 08:57:48.747145 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 685/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:48 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:48.761208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:48.763139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:48.786201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:48.786960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:48.789903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:48.790880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:48.793679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:48.795758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:48.856664 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a0af48b-a1ae-4f81-a793-e68e5734098a tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.479163 Oct 24 08:57:48.865663 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 752/1437] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:57:48 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6/os-interface => generated 284 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:49.037435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:49.050407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:49.052407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:49.060427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad10a45a-76e8-47a2-a8c9-440c2992a82b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.305396 Oct 24 08:57:49.061086 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 686/1438] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:48 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:49.265791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd9cf8ab-277f-4e70-9ff5-43ebeb8117fb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Action: 'create', calling method: .version_select at 0x7f8daae00790>, body: {"keypair": {"name": "tempest-keypair-912060532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiCnsRx93IXb/LxgJjkree+rGGn1WlYk8J9PRVh2eKW9AaFHQ5SEndZTui++lwcuX79dgY5q6dcVY8FXm2Qyk828u3gEI+Qrz51wjpTjCbvNyH+RBDU9m2mG6iVxuiO3A=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:49.279234 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:49.292690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-bd9cf8ab-277f-4e70-9ff5-43ebeb8117fb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Getting quotas for project c229d0d4780449dd9b751ffb8b1b734d. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:49.299600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-bd9cf8ab-277f-4e70-9ff5-43ebeb8117fb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Getting quotas for user 9f3fa66a009149e8b5cec58e4b24a788 and project c229d0d4780449dd9b751ffb8b1b734d. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:49.333127 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd9cf8ab-277f-4e70-9ff5-43ebeb8117fb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.360160 Oct 24 08:57:49.334733 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 753/1439] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:57:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:57:49.397079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:49.398019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:49.413945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.414457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.415465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.419399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.419973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.421750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.428020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:49.428901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:49.446577 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.449656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.450177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.453158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 HTTP/1.1 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '087182c5-5ac3-4775-861b-db31388889b5'} Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:49.454513 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.459390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.459881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.459991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:49.460085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.460085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.462342 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-40ffd75c-6738-43ff-a7f0-08a8d4536260 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 404 len: 111 microversion: 2.1 time: 0.067863 Oct 24 08:57:49.466291 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 687/1440] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:49 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:49.736754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:49.740117 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:49.760028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.760904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.761714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.762684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.764021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.775957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.797828 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5/os-volume_attachments HTTP/1.1 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '087182c5-5ac3-4775-861b-db31388889b5'} Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:49.814994 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 08:57:49.819790 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:49.830585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:49.832570 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3306e64b-e0f6-4b39-9c3d-88e5689e90ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103806 Oct 24 08:57:49.835331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 688/1441] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:57:49 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5/os-volume_attachments => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:49.850643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:49.851286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:49.885958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.888923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.889461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.892386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:49.892883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:49.893369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:49.919262 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:50.266714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:50.267615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:50.294506 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56366121-8248-4cb2-944d-f923d3323d23 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.870176 Oct 24 08:57:50.298089 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c0e4630-679a-4b6c-a7fa-6d83bca9de05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 0.451191 Oct 24 08:57:50.313697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 754/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:49 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:50.314476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 689/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:49 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:50.320056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-939292079", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:50.321562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:50.322303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:50.330166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:50.330670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:50.331115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:50.334984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:50.335492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:50.337487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:50.383466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:57:50.785574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:50.804425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:50.806195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:50.807430 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-371d0af9-49d9-4a51-86c8-04b2d0283c6a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.489965 Oct 24 08:57:50.813712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 755/1444] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:50 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:51.085133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:57:51.085795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:57:51.087146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:57:51.087789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:57:51.088715 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:57:51.112703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:51.113800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:51.115273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:51.116590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:51.119181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:51.121255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:51.172524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:51.181838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:51.207045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:57:51.213972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:57:51.293357 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f94e8410-c122-4c9b-97cf-db524533ab92 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977433 Oct 24 08:57:51.294453 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 690/1445] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:57:51.307781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79667537-3fba-43f2-bed4-1b01c3239d35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:51.308737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79667537-3fba-43f2-bed4-1b01c3239d35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:51.345725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:51.351717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:51.402634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:51.404775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:51.407556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:51.412013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:51.413970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:51.417878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:51.512810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-79667537-3fba-43f2-bed4-1b01c3239d35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:51.542180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79667537-3fba-43f2-bed4-1b01c3239d35 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba" status: 200 len: 1214 microversion: 2.1 time: 0.223236 Oct 24 08:57:51.544081 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 756/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:51 2022] GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:51.577759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:51.578445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:51.612159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:51.612971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:51.615332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:51.616717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:51.619458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:51.621476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:51.860264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:51.880347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e7fbffe6-8126-49f5-8f18-0c5bc0ed9e00 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.565183 Oct 24 08:57:51.882488 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 691/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:51 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:51.896309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c55d9149-1e2e-474f-9d05-e1384bc4208c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:51.898233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c55d9149-1e2e-474f-9d05-e1384bc4208c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:51.948476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c55d9149-1e2e-474f-9d05-e1384bc4208c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:57:52.517663 n-d-master-1 devstack@n-api.service[126919]: INFO nova.scheduler.client.report [None req-c55d9149-1e2e-474f-9d05-e1384bc4208c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Deleted allocations for instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba Oct 24 08:57:52.551936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c55d9149-1e2e-474f-9d05-e1384bc4208c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba" status: 204 len: 0 microversion: 2.1 time: 0.665452 Oct 24 08:57:52.554972 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 692/1448] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:57:51 2022] DELETE /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:57:52.571697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:52.572643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:52.594030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.595617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.596342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.598972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.600510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.603558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.804715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:52.818555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e2060d4a-a9b0-4d9a-a2b7-e04eac80c9fe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 1.265718 Oct 24 08:57:52.822737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 757/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:51 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:52.834408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:52.837194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:52.856892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.858089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.858981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.861109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.864071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.864815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.882868 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] HTTP exception thrown: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Request method failure captured: Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 HTTP/1.1 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlK6HUvLthaGtQ7o2nJdXUj3tOuCsSVHkT3z9uzsefdg6bOQ4Xwi-b3YNX_KAXwC0ioi0UMQPmnl5S-gn_qzWOO5kH_5reZcJo2N0hRAjSY7PHlWp5IDRlbEkHPqwF33Zz7LVX9IfxFwLzxXLS0sFgAIY64aYK53BIE4ENHHRWTzh0I Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 178ccdbda089491a92f2c97d4437433c Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/178ccdbda089491a92f2c97d4437433c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_178ccdbda089491a92f2c97d4437433c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/178ccdbda089491a92f2c97d4437433c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/178ccdbda089491a92f2c97d4437433c"}]}] Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 178ccdbda089491a92f2c97d4437433c Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachSCSIVolumeTestJSON-1431982080-project Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 83d393f7341e402a80a50b822b3f0f94 Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1431982080-project Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6352e97a-d784-43f0-b94e-cee5d7e9a084'} Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:52.885617 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:52.891606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.894243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Returning 404 to user: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:52.895498 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3bdc871-2656-4f0c-9099-413d96bdb9ce tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 404 len: 111 microversion: 2.1 time: 0.071465 Oct 24 08:57:52.904362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 758/1450] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:57:52 2022] DELETE /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:52.910857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:52.911736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:52.919305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.920097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.920928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.922145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.922970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.923665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.940911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba HTTP/1.1 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '486f96da-5dc9-432d-8f06-da45c8f4c1ba'} Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:52.942925 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 08:57:52.950206 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:52.954569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:52.955726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9811c281-f846-41d4-885c-c4b3671360ac tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba" status: 404 len: 111 microversion: 2.1 time: 0.049754 Oct 24 08:57:52.956493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 759/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:52 2022] GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:52.964229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:52.965111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] [instance: 6352e97a-d784-43f0-b94e-cee5d7e9a084] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:52.987157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.993021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.993981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:52.995462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:52.997371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:52.999185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:53.034447 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] HTTP exception thrown: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Request method failure captured: Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 HTTP/1.1 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlK6HUvLthaGtQ7o2nJdXUj3tOuCsSVHkT3z9uzsefdg6bOQ4Xwi-b3YNX_KAXwC0ioi0UMQPmnl5S-gn_qzWOO5kH_5reZcJo2N0hRAjSY7PHlWp5IDRlbEkHPqwF33Zz7LVX9IfxFwLzxXLS0sFgAIY64aYK53BIE4ENHHRWTzh0I Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 178ccdbda089491a92f2c97d4437433c Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/178ccdbda089491a92f2c97d4437433c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_178ccdbda089491a92f2c97d4437433c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/178ccdbda089491a92f2c97d4437433c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/178ccdbda089491a92f2c97d4437433c"}]}] Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 178ccdbda089491a92f2c97d4437433c Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1431982080 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachSCSIVolumeTestJSON-1431982080-project Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 83d393f7341e402a80a50b822b3f0f94 Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1431982080-project Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6352e97a-d784-43f0-b94e-cee5d7e9a084'} Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:53.038634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. Oct 24 08:57:53.043320 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:57:53.044938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] Returning 404 to user: Instance 6352e97a-d784-43f0-b94e-cee5d7e9a084 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:53.046156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55e90bde-eefa-4612-922e-59a0d0855dd1 tempest-AttachSCSIVolumeTestJSON-1431982080 tempest-AttachSCSIVolumeTestJSON-1431982080-project] 10.222.0.25 "GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084" status: 404 len: 111 microversion: 2.1 time: 0.088496 Oct 24 08:57:53.047158 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 760/1452] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:52 2022] GET /compute/v2.1/servers/6352e97a-d784-43f0-b94e-cee5d7e9a084 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:53.056270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:53.057146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:53.066940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:53.069994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:53.072423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:53.073447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:53.076029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:53.076840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:53.118927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:53.133975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:53.139149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:53.140531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d49a40c-a47a-434a-b6ec-abeb7c2f2f02 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.581882 Oct 24 08:57:53.151012 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 693/1453] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:52 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:53.156076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-780654226", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:53.250450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:57:54.644164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:54.658218 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f854de7-5960-4a4d-bc67-5d670dddd4cd tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 1.605280 Oct 24 08:57:54.677315 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 761/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:53 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:54.680520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:54.684798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:54.700687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:54.701191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:54.701673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:54.706801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:54.708685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:54.709182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.027483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:57:55.028571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:57:55.029278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:57:55.030287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:57:55.030935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:57:55.035338 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:55.064218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.071308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.072025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.073261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.074015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.074694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.112455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:55.125029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:55.179233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:57:55.184478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:57:55.289259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5003683-ee97-4655-95b2-a74d720dc562 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.136945 Oct 24 08:57:55.298633 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 694/1455] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:57:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:57:55.303820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:55.304447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:55.312942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.313745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.313989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.314677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.315140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.316837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.795104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:55.803365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ace37eee-e313-4dec-bca6-27f4ff5d3bc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1520 microversion: 2.1 time: 1.138632 Oct 24 08:57:55.813713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 762/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:54 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1520 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:55.833084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:55.835135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:55.835985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:55.839720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:55.841157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:55.843465 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-205eec72-5035-4389-afd3-3200bde12a4a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.543736 Oct 24 08:57:55.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.861575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.862685 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 695/1457] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:55 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:55.868825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c7b7b202-fa75-4108-9c4a-75b02d43bd3c req-d41de75c-ec9c-4934-b4c7-5d861e0ae12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ef4985-b1ff-4177-9373-d6dc8794e3d6", "tag": "1137817f-88a5-46ed-b4ed-57072602e3b4"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:55.881976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7b7b202-fa75-4108-9c4a-75b02d43bd3c req-d41de75c-ec9c-4934-b4c7-5d861e0ae12f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:55.882855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7b7b202-fa75-4108-9c4a-75b02d43bd3c req-d41de75c-ec9c-4934-b4c7-5d861e0ae12f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:55.883560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7b7b202-fa75-4108-9c4a-75b02d43bd3c req-d41de75c-ec9c-4934-b4c7-5d861e0ae12f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:55.896937 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c7b7b202-fa75-4108-9c4a-75b02d43bd3c req-d41de75c-ec9c-4934-b4c7-5d861e0ae12f service nova] Creating event network-changed:1137817f-88a5-46ed-b4ed-57072602e3b4 for instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 on n-h1-master-1 Oct 24 08:57:55.904761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c7b7b202-fa75-4108-9c4a-75b02d43bd3c req-d41de75c-ec9c-4934-b4c7-5d861e0ae12f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040451 Oct 24 08:57:55.905993 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 696/1458] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:55.911491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d60ec030-60b9-44fc-9666-ae6664fc97a0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:55.912681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d60ec030-60b9-44fc-9666-ae6664fc97a0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:56.117551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d60ec030-60b9-44fc-9666-ae6664fc97a0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:56.132491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d60ec030-60b9-44fc-9666-ae6664fc97a0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1214 microversion: 2.1 time: 0.222461 Oct 24 08:57:56.134850 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 697/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:55 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:56.147708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:56.149914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:56.173424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:56.178107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:56.178681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:56.179545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:56.180144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:56.186118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:56.642425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:56.654246 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c936c00e-c174-4e00-ad71-5fc685a31c58 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1576 microversion: 2.1 time: 0.827247 Oct 24 08:57:56.667211 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 763/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:55 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1576 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:56.674567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1049030971", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "1d9215cf-bd29-455b-8560-a233aa62ca29"}], "security_groups": [{"name": "tempest-securitygroup--1295833369"}], "key_name": "tempest-keypair-912060532", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:57.044952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] validate_networks() for [('1d9215cf-bd29-455b-8560-a233aa62ca29', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:57:57.153670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:57.162713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d31c238b-dae1-45d1-8011-b7344a11329c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 1.026074 Oct 24 08:57:57.173561 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 698/1461] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:56 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:57.178560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:57.179178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:57.197717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:57.198587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:57.199253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:57.200195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:57.200891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:57.201588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:57.696305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:57.705861 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87fb5af8-7627-4aab-b045-4eae11c1f36f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1500 microversion: 2.1 time: 0.530995 Oct 24 08:57:57.718440 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 699/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:57 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1500 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:57.730173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:57.741672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:57.750842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:57.758718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:57.759476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:57.760449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:57.761079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:57.761881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:58.138209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:58.156796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:58.159843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:58.161859 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e367169-796e-4f36-81f6-a44cf9ee1184 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.441828 Oct 24 08:57:58.199178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 700/1463] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:57 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:57:58.210184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:58.214714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:58.221818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:58.223059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:58.223756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:58.224727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:58.225561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:58.226268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:58.453436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:58.482269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83e8914d-f2b7-4a44-8c5c-49e3ed07c00e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1272 microversion: 2.1 time: 0.281376 Oct 24 08:57:58.483298 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 701/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:58 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:58.528156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:58.528759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:58.538496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:58.545746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:58.546497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:58.552304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:58.553587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:58.554246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:58.906655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:58.930933 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02304638-2ec2-41df-bb24-9fea91a46b53 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1514 microversion: 2.1 time: 0.414602 Oct 24 08:57:58.946023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 702/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:58 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:58.958921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:58.959941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:58.968067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:58.968902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:58.969638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:58.970583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:58.971276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:58.971907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.238794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:57:59.240048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:57:59.240669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:57:59.241161 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:57:59.241721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:57:59.260686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.261203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.261661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.262772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.265863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.269753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.315614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Getting quotas for project c229d0d4780449dd9b751ffb8b1b734d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:59.323324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Getting quotas for user 9f3fa66a009149e8b5cec58e4b24a788 and project c229d0d4780449dd9b751ffb8b1b734d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:59.332102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:59.343818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b1fcdce-8fd2-453e-b90d-c26559cd7ce4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.394430 Oct 24 08:57:59.344452 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 703/1466] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:58 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:59.352637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:57:59.353697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-779271b4-6128-490a-90b9-dca4541b9be8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:59.356143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:57:59.359804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-779271b4-6128-490a-90b9-dca4541b9be8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: f27b600f-2702-4c16-b51a-b8f3f5ce76fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:59.379846 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-779271b4-6128-490a-90b9-dca4541b9be8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Instance f27b600f-2702-4c16-b51a-b8f3f5ce76fc could not be found. Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-779271b4-6128-490a-90b9-dca4541b9be8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/f27b600f-2702-4c16-b51a-b8f3f5ce76fc/action HTTP/1.1 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 14 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: {"rescue": {}} Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f27b600f-2702-4c16-b51a-b8f3f5ce76fc could not be found. Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f27b600f-2702-4c16-b51a-b8f3f5ce76fc', 'body': {'rescue': {}}} Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27b600f-2702-4c16-b51a-b8f3f5ce76fc could not be found. Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27b600f-2702-4c16-b51a-b8f3f5ce76fc could not be found. Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:59.387061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27b600f-2702-4c16-b51a-b8f3f5ce76fc could not be found. Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-779271b4-6128-490a-90b9-dca4541b9be8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 404 to user: Instance f27b600f-2702-4c16-b51a-b8f3f5ce76fc could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-779271b4-6128-490a-90b9-dca4541b9be8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/f27b600f-2702-4c16-b51a-b8f3f5ce76fc/action" status: 404 len: 111 microversion: 2.1 time: 0.043220 Oct 24 08:57:59.394882 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 704/1467] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:57:59 2022] POST /compute/v2.1/servers/f27b600f-2702-4c16-b51a-b8f3f5ce76fc/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:59.397735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:59.397735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:59.417471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.418044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.418730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.419941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.420705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.421371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.452326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b6c2960-2e55-420e-92cd-2356123e2bc8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.783649 Oct 24 08:57:59.453391 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 764/1468] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:57:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:57:59.463697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:59.464547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:59.478962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.479961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.497740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.498595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.499079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.499566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.651046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f64f647-8cf3-4767-a4f6-9a5b6a153593 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action" status: 202 len: 0 microversion: 2.1 time: 0.191451 Oct 24 08:57:59.651644 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 765/1469] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:57:59 2022] POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:57:59.661561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c50c18f-8176-44fa-80bb-654faa2000ce tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:59.662625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c50c18f-8176-44fa-80bb-654faa2000ce tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:59.783791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c50c18f-8176-44fa-80bb-654faa2000ce tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:59.792032 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c50c18f-8176-44fa-80bb-654faa2000ce tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1241 microversion: 2.1 time: 0.137698 Oct 24 08:57:59.795753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 766/1470] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:59 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:59.806522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:59.807384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:59.823499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.824114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.824646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:59.825514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:59.829005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:59.829631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:00.007030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:00.020267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9720e55-86e8-4773-82f9-b6a5082221d1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1272 microversion: 2.1 time: 0.223200 Oct 24 08:58:00.021119 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 767/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:59 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:00.026948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:00.038630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:00.054165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:00.055188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:00.055882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:00.056848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:00.068288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:00.073339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:00.905688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:00.918729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c51f93e-0930-491a-b07a-3f6b0098a6c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1499 microversion: 2.1 time: 0.896197 Oct 24 08:58:00.920240 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 768/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:00 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1499 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:00.928596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:00.932808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:00.954004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:00.954810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:00.957156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:00.958105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:00.958741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:00.959333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.128421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:01.143924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:01.156517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:01.159199 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb7b22cd-7563-49ba-8df8-de731c60cfca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 1.768969 Oct 24 08:58:01.159796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 705/1473] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:57:59 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:01.177208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:01.187992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:01.211709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.212693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.213439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.214483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.215110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.216225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.290480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:01.303382 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16e74783-440b-4f53-bba2-87467837b001 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.379983 Oct 24 08:58:01.304001 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 769/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:00 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:01.331851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:01.344593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:01.355345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.356038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.356652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.358670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.359563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.360760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.408434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'flavor' on Instance uuid c2e62742-ceeb-4336-bf67-b6ae657b4852 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:01.417778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:01.428265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43f2c119-a539-4ea5-bce3-a604818da310 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1293 microversion: 2.1 time: 0.266093 Oct 24 08:58:01.429618 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 706/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:01 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1293 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:01.439481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:01.440195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:01.452491 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Cannot 'rescue' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state paused Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action HTTP/1.1 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 14 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: {"rescue": {}} Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'rescue' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state paused Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c2e62742-ceeb-4336-bf67-b6ae657b4852', 'body': {'rescue': {}}} Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 in vm_state paused. Cannot rescue while the instance is in this state. Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state paused Oct 24 08:58:01.454467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state paused Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 409 to user: Cannot 'rescue' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state paused {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:01.459611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dc9cb5d-799c-4054-9ec6-0b8be8f1a827 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action" status: 409 len: 144 microversion: 2.1 time: 0.151646 Oct 24 08:58:01.461469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 770/1476] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:01 2022] POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action => generated 144 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:58:01.464895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.466767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:01.467331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:01.473978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.474477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.474916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.475791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.476659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.477600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.478641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.479640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.480771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.481397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.481954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.515403 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:01.717072 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff45be49-7b18-4c1e-9605-086a3a1b7cd0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action" status: 202 len: 0 microversion: 2.1 time: 0.254301 Oct 24 08:58:01.729681 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 771/1477] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:01 2022] POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:01.760786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:01.763724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:01.790039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.790543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.790988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:01.798628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:01.799232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:01.799681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.143823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.175340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bbb4c39-2342-4568-876b-8dead046c60d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.743537 Oct 24 08:58:02.176756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 707/1478] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:01 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:02.185803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:02.192361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:02.202309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:02.203148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:02.204367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.205363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:02.206043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:02.206728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.314887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.328511 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5832f129-9b47-469e-8789-106aa2c1ce64 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1506 microversion: 2.1 time: 0.595323 Oct 24 08:58:02.343945 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 772/1479] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:01 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:02.353661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:02.355299 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:02.363568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:02.365249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:02.368508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.369705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:02.370690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:02.371364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.543653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.554102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.562142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.563659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d694458e-ca43-474c-96f8-2fc48310d9db tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1813 microversion: 2.25 time: 0.382104 Oct 24 08:58:02.568008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 708/1480] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:02 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1813 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:58:02.575933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:02.576549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:02.593764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:02.594286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:02.594787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.595521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:02.595974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:02.596399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:02.847404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.862954 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6e70e3f-b8dc-42cc-8367-4311b88e9aef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.517716 Oct 24 08:58:02.884886 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 773/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:02 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:02.957240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:02.985542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3dc82aba-b7f5-415e-af41-747e076e4e2a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1299 microversion: 2.1 time: 0.416078 Oct 24 08:58:02.987803 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 709/1482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:02 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1299 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:03.012318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2014251430", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "62c56d9c-5126-43a0-b067-60873881adab"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:03.099990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] validate_networks() for [('62c56d9c-5126-43a0-b067-60873881adab', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:58:03.200993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:03.201733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:03.220876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:03.221395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:03.222180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:03.223188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:03.223842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:03.224304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:03.653703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:03.683726 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:03.694102 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf42c79f-24ba-4faa-9af8-d02525d2c42a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.496076 Oct 24 08:58:03.720299 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 710/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:03 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:03.734158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e2af3dcd-d891-49b2-8a57-0f643ce51102 req-1849b418-395f-406b-9068-4e24b45dfe52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad171800-a972-4956-8c16-df04c6ef8f13", "tag": "a47ae400-76b3-44a4-8984-28b92de0c869"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:03.758321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e2af3dcd-d891-49b2-8a57-0f643ce51102 req-1849b418-395f-406b-9068-4e24b45dfe52 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:03.760840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e2af3dcd-d891-49b2-8a57-0f643ce51102 req-1849b418-395f-406b-9068-4e24b45dfe52 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:03.761566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e2af3dcd-d891-49b2-8a57-0f643ce51102 req-1849b418-395f-406b-9068-4e24b45dfe52 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:03.779045 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e2af3dcd-d891-49b2-8a57-0f643ce51102 req-1849b418-395f-406b-9068-4e24b45dfe52 service nova] Creating event network-changed:a47ae400-76b3-44a4-8984-28b92de0c869 for instance ad171800-a972-4956-8c16-df04c6ef8f13 on n-h2-master-1 Oct 24 08:58:03.794402 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e2af3dcd-d891-49b2-8a57-0f643ce51102 req-1849b418-395f-406b-9068-4e24b45dfe52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071532 Oct 24 08:58:03.796033 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 711/1484] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:03.816622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:03.818944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:03.829364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:03.830502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:03.831219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:03.850232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:03.852887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:03.853834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.281426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:04.297584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3ddf152-eb47-4c5e-8ac7-a4a6ab901db8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1514 microversion: 2.1 time: 0.499593 Oct 24 08:58:04.298294 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 712/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:03 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1514 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:04.308193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:04.309104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:04.319016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.325250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.327033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.329475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.330612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.331405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.480267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:58:04.488754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:58:04.488754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:58:04.488754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:58:04.488754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:58:04.509553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.514073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.515201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.516044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.516524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.520013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.578932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:58:04.595091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for user ca932e5866274fc78b04689811e72746 and project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:58:04.631010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:58:04.640917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:58:04.756910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:04.769065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:04.776766 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5857b867-0bd8-43c8-8f14-31e6e5b1ad11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890048 Oct 24 08:58:04.777559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:04.779947 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1481bb0-7a0e-4136-bcc4-4c2edfd26d8e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1803 microversion: 2.25 time: 0.480477 Oct 24 08:58:04.782901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 713/1486] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:04 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1803 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:04.790108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 774/1487] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:58:04.796686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:04.796904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:04.798641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:04.804120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:04.822194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.822856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.823038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.823510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.824177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.824427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.824981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.825815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.828640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.829687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.830514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.834137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:05.091779 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:05.521705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:05.532752 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08868a68-a1d0-4c99-8853-34ae286b0d79 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.741057 Oct 24 08:58:05.542808 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 775/1488] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:04 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:05.581333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:05.581333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:05.584443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:05.585802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:05.586047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:05.586777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:05.594690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:05.595166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:05.830152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:05.844782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1356a90-3294-4249-8c88-2e4e5fe2b811 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 1.060414 Oct 24 08:58:05.848410 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 714/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:04 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:05.857254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a811e01-ecaa-4714-9226-dcb409c9b1fa tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:05.860621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a811e01-ecaa-4714-9226-dcb409c9b1fa tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:05.964373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a811e01-ecaa-4714-9226-dcb409c9b1fa tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:05.977431 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a811e01-ecaa-4714-9226-dcb409c9b1fa tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1208 microversion: 2.1 time: 0.124968 Oct 24 08:58:05.978621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 715/1490] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:05 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1208 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:05.990439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b62bc88f-dc9d-467c-9522-c6f9dc7622ae tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '.version_select at 0x7f8daae60550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:05.998059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b62bc88f-dc9d-467c-9522-c6f9dc7622ae tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.000342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b62bc88f-dc9d-467c-9522-c6f9dc7622ae tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.001010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b62bc88f-dc9d-467c-9522-c6f9dc7622ae tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.043246 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b62bc88f-dc9d-467c-9522-c6f9dc7622ae tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3202 microversion: 2.25 time: 0.061677 Oct 24 08:58:06.046431 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 716/1491] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Oct 24 08:58:05 2022] GET /compute/v2.1/os-migrations => generated 3202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:06.062561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:06.063386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:06.074166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.074661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.075100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.075805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.076270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.076699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.389709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:06.404099 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5fa75830-7533-4f5f-93bc-7409435dbc4e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.851254 Oct 24 08:58:06.405414 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 776/1492] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:05 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:06.570646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:06.571309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:06.613021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.615730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.616778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.622478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.623397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.625183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.849011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:06.874849 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0e8e033-7e5b-4883-9816-abfac361c154 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 2422 microversion: 2.25 time: 0.816205 Oct 24 08:58:06.901466 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 717/1493] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:06 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 2422 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:06.908859 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:06.909526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:06.919015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.919518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.919940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.920646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.921098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.921551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.947007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:06.970640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-81c0c48e-664f-4e6a-92b8-434671329692 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.406308 Oct 24 08:58:06.971840 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 777/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:06 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:06.977566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:06.978396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:06.986867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.987361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.987996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:06.988883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:06.989629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:06.991158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.226550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:07.229855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:07.242193 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d4a9ab0-300f-4ee5-adcf-d9c062c5231a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.335974 Oct 24 08:58:07.244357 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 718/1495] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:06 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:07.255300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:07.258434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:07.280539 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62c18fb2-a25d-46e2-96e6-f260471e6331 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 2422 microversion: 2.25 time: 0.305281 Oct 24 08:58:07.280767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.281558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.281911 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 778/1496] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:06 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 2422 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:07.285926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.287157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.287795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.288411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.294666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b7f0139b-edcd-48f1-b31c-ff80b60494ce req-612f3f9b-7025-4352-a550-07974860f491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffca5715-95e0-4499-a802-9b5e37649ce6", "tag": "2a5d8582-20a9-4c8a-8a1b-ba8c036c2079"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:07.313474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7f0139b-edcd-48f1-b31c-ff80b60494ce req-612f3f9b-7025-4352-a550-07974860f491 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.313976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7f0139b-edcd-48f1-b31c-ff80b60494ce req-612f3f9b-7025-4352-a550-07974860f491 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.314408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7f0139b-edcd-48f1-b31c-ff80b60494ce req-612f3f9b-7025-4352-a550-07974860f491 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.353768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b7f0139b-edcd-48f1-b31c-ff80b60494ce req-612f3f9b-7025-4352-a550-07974860f491 service nova] Creating event network-changed:2a5d8582-20a9-4c8a-8a1b-ba8c036c2079 for instance ffca5715-95e0-4499-a802-9b5e37649ce6 on n-h2-master-1 Oct 24 08:58:07.359967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b7f0139b-edcd-48f1-b31c-ff80b60494ce req-612f3f9b-7025-4352-a550-07974860f491 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076753 Oct 24 08:58:07.360896 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 779/1497] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:07.381867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:07.385113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:07.398971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.403404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.403864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.406146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.406792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.408847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.459935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'flavor' on Instance uuid c2e62742-ceeb-4336-bf67-b6ae657b4852 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:07.484518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:07.493936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-efa3ddc3-aa0b-4503-9058-57a67abe81c8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1260 microversion: 2.1 time: 0.247454 Oct 24 08:58:07.501271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 719/1498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:07 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:07.523526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:07.524205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:07.542035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.542851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.543473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.544424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.547157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.549026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.678039 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e6456f1-4c80-428d-a9b9-16533adb4006 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action" status: 200 len: 32 microversion: 2.1 time: 0.300464 Oct 24 08:58:07.681807 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 780/1499] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:07 2022] POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:58:07.710211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:07.714532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:07.718543 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:07.729726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.730494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.731284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.732290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.732991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.733640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.872506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lazy-loading 'services' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:07.999932 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-158042c6-d6d1-4a5f-a1b8-6e98ac84ec0a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments/4ec90f04-b8ca-4773-8fc0-9904f7b033c7" status: 202 len: 0 microversion: 2.25 time: 0.301507 Oct 24 08:58:08.000796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 781/1500] 10.222.0.25 () {60 vars in 1457 bytes} [Mon Oct 24 08:58:07 2022] DELETE /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments/4ec90f04-b8ca-4773-8fc0-9904f7b033c7 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:08.015544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:08.026950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:08.043995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.045385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.045840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.050792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.051288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.051730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.153690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:08.161896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8876e9a5-12bd-42bc-98e5-4fc2fa0a8842 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.659106 Oct 24 08:58:08.167579 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 720/1501] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:07 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:08.178994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:08.185149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:08.217272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.218095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.219486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.220673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.221488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.222070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.433385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:08.442518 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-322b144d-8d4d-45ad-874f-ca5b69473233 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.439948 Oct 24 08:58:08.443823 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 782/1502] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:08 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:08.465009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:08.467824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:08.474648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.475390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.476008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.477543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.478197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.478799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.537441 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97f69ac5-9a90-42fc-8829-253aebbe9e3a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091712 Oct 24 08:58:08.544290 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 783/1503] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:08 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:08.548073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:08.548775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:08.556477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.557021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.558310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.561364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.561967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.562560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.689579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:08.710257 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c9d377a-d71e-414c-97b2-b4fc01b89d76 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.541212 Oct 24 08:58:08.712700 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 721/1504] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:08 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:08.739397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:08.741270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:08.760148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.760969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.761675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.764040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:08.765501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:08.766453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:08.970269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:08.986447 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9d3d84e-dac9-49b8-abdd-0f0ac04e11c0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.439950 Oct 24 08:58:08.990130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 784/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:08 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:09.047008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:09.060900 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-40b6d7fb-cda0-4343-9447-8f9747db52e5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1266 microversion: 2.1 time: 0.345630 Oct 24 08:58:09.076490 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 722/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:08 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:09.190703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:09.191768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:09.198390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.198884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.199322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.200221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.200855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.201286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.205641 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:09.365697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:09.376015 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed929208-ed75-4fac-ad68-61be36f95352 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.189243 Oct 24 08:58:09.376628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 785/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:09 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:09.466564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:09.467778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:09.475240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.475739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.476184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.477701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.478166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.478599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.552398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:09.555210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:09.562281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.562779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.563219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.563940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.564404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.564824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.597443 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-14d1491a-65d5-40e2-9f02-d243299d16b8 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049047 Oct 24 08:58:09.598032 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 786/1508] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:09 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 08:58:09.741258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:09.742880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:09.750525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.751204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.751740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.752542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:09.753557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:09.754088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:09.902868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:09.903437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:09.912770 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1520a18-a1e3-4dc8-8acc-cebd68218dfd tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.178948 Oct 24 08:58:09.933008 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 787/1509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:09 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:09.966276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4f7bbff6-8ad8-40d9-af6b-53f9c35f2d03 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.503921 Oct 24 08:58:09.981387 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 723/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:09 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:10.015021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:10.015808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:10.033354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.036742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.038392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.039676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.042293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.043340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.085007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:10.085772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:10.105056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.105895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.106518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.110818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.111539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.112148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.531391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:10.541228 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4253aaf8-7e5a-46af-bab6-4a490f477764 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.530863 Oct 24 08:58:10.545146 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 788/1511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:10 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:10.551180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:10.560093 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:10.579797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.580575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.581230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.581887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:10.582670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.583562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.584169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.591223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f642fb4-0503-4c9d-9cef-d46513067d74 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.510860 Oct 24 08:58:10.595921 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 724/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:10 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:10.611707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:10.615867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:10.629945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.630433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.630865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.631963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.633139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.633867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.675806 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e71fc1d-df3f-4a9a-8f3a-3f3283181aaf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068268 Oct 24 08:58:10.676714 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 725/1513] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:10 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:10.810449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:10.824340 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-609bd924-627b-451b-9b00-c0574d0ab157 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.272605 Oct 24 08:58:10.825021 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 789/1514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:10 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:10.943883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:10.945404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:10.955401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.956129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.957261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.958535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:10.959191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:10.960227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:10.999238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:10.999895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:11.018990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.022503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.022983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.023767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.024234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.024659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.168240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:11.176641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-768f8ff2-da95-4fa9-8d32-33d863856a1f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.184415 Oct 24 08:58:11.179756 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 790/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:10 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:11.184615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1e0daac6-03e3-40ec-9ce6-3ac9ac572726 req-37d45d1b-6fe3-4339-8f3c-3978c1c05f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad171800-a972-4956-8c16-df04c6ef8f13", "name": "network-vif-plugged", "status": "completed", "tag": "a47ae400-76b3-44a4-8984-28b92de0c869"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:11.196825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e0daac6-03e3-40ec-9ce6-3ac9ac572726 req-37d45d1b-6fe3-4339-8f3c-3978c1c05f86 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.197641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e0daac6-03e3-40ec-9ce6-3ac9ac572726 req-37d45d1b-6fe3-4339-8f3c-3978c1c05f86 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.198260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e0daac6-03e3-40ec-9ce6-3ac9ac572726 req-37d45d1b-6fe3-4339-8f3c-3978c1c05f86 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.211624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1e0daac6-03e3-40ec-9ce6-3ac9ac572726 req-37d45d1b-6fe3-4339-8f3c-3978c1c05f86 service nova] Creating event network-vif-plugged:a47ae400-76b3-44a4-8984-28b92de0c869 for instance ad171800-a972-4956-8c16-df04c6ef8f13 on n-h2-master-1 Oct 24 08:58:11.220237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1e0daac6-03e3-40ec-9ce6-3ac9ac572726 req-37d45d1b-6fe3-4339-8f3c-3978c1c05f86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039065 Oct 24 08:58:11.221713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 791/1516] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:11.337509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:11.347949 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6530244e-ff1f-4f55-8d32-8f243bcabd58 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.413123 Oct 24 08:58:11.371753 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 726/1517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:10 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:11.569446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:11.571089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:11.578023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.578766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.579455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.580639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.581973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.582700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.619072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:11.620879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:11.645674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.646582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.647228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.648716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.649373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.649972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.748493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:11.759334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8cd602e8-7391-42a2-bc4a-469a2d3fcea0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.194343 Oct 24 08:58:11.760546 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 792/1518] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:11 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:11.779930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:11.782938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:11.791933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.793045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.793863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.794758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.795405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.796355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.885641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-174e2c7c-76ad-4ade-8234-5501b77cb1d1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119637 Oct 24 08:58:11.886318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 793/1519] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:11 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:11.891148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:11.891757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:11.930228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.931566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.932180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.933089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.933736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.935136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.985278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:11.993616 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28dae78e-a515-42d7-a4e4-bcaeabfd7a01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.378339 Oct 24 08:58:11.997139 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 727/1520] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:11 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:12.121811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-93da6ce8-d59e-400e-b5e2-690f048128cf req-9d0d81c5-cf10-4b5e-af36-577f2a73f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7", "tag": "5e25c21f-a445-4e66-af2e-c8872d507e65"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:12.150058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-93da6ce8-d59e-400e-b5e2-690f048128cf req-9d0d81c5-cf10-4b5e-af36-577f2a73f1cf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.153061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-93da6ce8-d59e-400e-b5e2-690f048128cf req-9d0d81c5-cf10-4b5e-af36-577f2a73f1cf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.153925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-93da6ce8-d59e-400e-b5e2-690f048128cf req-9d0d81c5-cf10-4b5e-af36-577f2a73f1cf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.171675 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-93da6ce8-d59e-400e-b5e2-690f048128cf req-9d0d81c5-cf10-4b5e-af36-577f2a73f1cf service nova] Creating event network-changed:5e25c21f-a445-4e66-af2e-c8872d507e65 for instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 on n-h1-master-1 Oct 24 08:58:12.177684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-93da6ce8-d59e-400e-b5e2-690f048128cf req-9d0d81c5-cf10-4b5e-af36-577f2a73f1cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061357 Oct 24 08:58:12.179192 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 728/1521] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:12.203677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:12.204918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:12.222846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.223350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.228395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.229231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.229796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.231140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.275426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:12.285020 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d094a32c-5133-45a1-bd74-40b748ec90a8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1314 microversion: 2.1 time: 0.397460 Oct 24 08:58:12.303766 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 794/1522] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:11 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:12.379945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:12.380566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:12.394884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.395386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.395824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.396534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.396986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.397435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.571928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:12.581247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-935fba5f-995f-4f81-a1de-bc3e14627799 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.384418 Oct 24 08:58:12.587855 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 729/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:12 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:12.784270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:12.784932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:12.798449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.798951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.801229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.802007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.802479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.802915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.832971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:12.852933 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a329310-2921-420b-ad00-b6dbc21054e4 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.477523 Oct 24 08:58:12.853851 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:12.874937 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 795/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:12 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:12.901490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:12.907268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:12.923031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.928071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.944211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:12.946040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:12.948639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:12.949272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.007110 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d00dbdf-a81e-4e85-b567-9bd62d5a2506 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112736 Oct 24 08:58:13.013246 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 796/1525] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:12 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:13.026765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:13.027837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:13.034270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.035108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.035827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.039802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:13.049367 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1039309-89e2-40bf-850c-e204d3ab828e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.269131 Oct 24 08:58:13.050527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.051290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.051996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.061802 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 730/1526] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:12 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:13.283620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:13.295577 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc121262-29df-47a7-a943-1ed2a2aff4bc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.276130 Oct 24 08:58:13.296353 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 797/1527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:13 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:13.317632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:13.318457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:13.325513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.327594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.328212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.329111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.330236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.330835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.588807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:13.604878 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-655943af-dc38-4fe4-ad5a-48ea56bf2ef5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1500 microversion: 2.1 time: 0.293857 Oct 24 08:58:13.606137 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 731/1528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:13 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1500 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:13.612433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:13.613578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:13.624110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.625071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.625941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.633582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:13.634383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:13.635228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.635747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.636186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.659279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.667284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.667775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.668659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.669116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.669563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.772132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e159a496-d67e-4f3a-b632-296cd8c16d89 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13/action" status: 202 len: 0 microversion: 2.1 time: 0.143657 Oct 24 08:58:13.777964 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 732/1529] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:13 2022] POST /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:13.790187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:13.791032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:13.810958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.811589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.818696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.819592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.820811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.821261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.930792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:13.939775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1465fece-04f3-4661-9b22-f740e4af0fe1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.331578 Oct 24 08:58:13.946033 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 798/1530] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:13 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:13.953822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:13.955108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:13.964161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.964953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.965726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:13.966634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:13.967396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:13.967992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.184860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:14.189977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:14.207447 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ace0e37-74e3-46e8-91b8-d2d08a7c5782 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1505 microversion: 2.1 time: 0.427757 Oct 24 08:58:14.208317 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91fba43e-9209-4384-bc55-be85a7071440 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.260901 Oct 24 08:58:14.209733 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 799/1531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:13 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:14.210441 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 733/1532] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:13 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:14.220986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:14.221605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:14.223404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:14.229010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:14.239719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.240490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.241104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.241797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.242447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.243887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.244776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.245016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.246130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.246781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.247369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.247957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.364353 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3359a0ce-afd6-458b-94a2-8785c3993dfc tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151979 Oct 24 08:58:14.364946 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 734/1533] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:14 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:14.393089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:14.394842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:14.407509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.412736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.413323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.414666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.415136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.415567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.541449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:14.549625 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc71e5d9-5542-4f20-bbca-5efb7352e661 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.335948 Oct 24 08:58:14.550212 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 800/1534] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:14 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:14.698919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:14.711704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f82d042-d193-4550-935b-b45523f9ef57 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.332269 Oct 24 08:58:14.712939 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 735/1535] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:14 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:14.964640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:14.964899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:14.967328 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:14.968167 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=20 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:14.981950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.982446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.982879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.983583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.984037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.984461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.187986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:15.206211 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a877d99-c499-42c0-b86a-49b4aa4bfffc tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.246536 Oct 24 08:58:15.218040 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 801/1536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:14 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:15.232826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.233508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.242653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.243033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.243743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.244623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.245901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.246533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.246996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.247430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.254693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.255471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.256439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.257663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.258579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.259264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.293357 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:15.451433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:15.459307 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-792cc8b2-0de7-4e9d-9ed4-2019e3e1c84f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.221048 Oct 24 08:58:15.474200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 802/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:15 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:15.480560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b7359c30-2c51-47a9-95ef-cba22da3459d req-1f1a22b7-1135-43c9-b5e1-e17aa05ff0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffca5715-95e0-4499-a802-9b5e37649ce6", "name": "network-vif-plugged", "status": "completed", "tag": "2a5d8582-20a9-4c8a-8a1b-ba8c036c2079"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:15.484114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:15.495799 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d0d8774f-2f55-42bf-8fc6-ce2aa33ae2a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1485 microversion: 2.1 time: 0.266603 Oct 24 08:58:15.495959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7359c30-2c51-47a9-95ef-cba22da3459d req-1f1a22b7-1135-43c9-b5e1-e17aa05ff0ff service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.496616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7359c30-2c51-47a9-95ef-cba22da3459d req-1f1a22b7-1135-43c9-b5e1-e17aa05ff0ff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.497595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7359c30-2c51-47a9-95ef-cba22da3459d req-1f1a22b7-1135-43c9-b5e1-e17aa05ff0ff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.502142 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 736/1538] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:15 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1485 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:15.518156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.520071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b7359c30-2c51-47a9-95ef-cba22da3459d req-1f1a22b7-1135-43c9-b5e1-e17aa05ff0ff service nova] Creating event network-vif-plugged:2a5d8582-20a9-4c8a-8a1b-ba8c036c2079 for instance ffca5715-95e0-4499-a802-9b5e37649ce6 on n-h2-master-1 Oct 24 08:58:15.521526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.525545 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:15.528822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b7359c30-2c51-47a9-95ef-cba22da3459d req-1f1a22b7-1135-43c9-b5e1-e17aa05ff0ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051666 Oct 24 08:58:15.530065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 803/1539] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:15.535855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.536573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.537894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.540483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.541218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.541878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.550442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.551597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.562494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.563261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.564571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.565640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.566894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.567509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.593761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a469c0a3-5dad-40b0-b665-ca518b875301 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089299 Oct 24 08:58:15.594431 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 737/1540] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:15 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:15.600121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.600782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.609705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.610053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.610855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.612172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.612794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.613405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.635591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:58:15.780657 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a8a9906-a7eb-4f79-9629-28d974c4ca69 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 204 len: 0 microversion: 2.1 time: 0.248342 Oct 24 08:58:15.781592 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 804/1541] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:58:15 2022] DELETE /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:15.790149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.790936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.794214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:15.801543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.802095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.802563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.803455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.803959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.804087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8641ac06-e193-40c7-af24-f0f5a5cf8779 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.208487 Oct 24 08:58:15.804449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.821268 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 738/1542] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:15 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:15.827146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:15.828160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:15.836546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.837454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.838206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.839173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:15.839986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:15.840668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:15.974204 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=18 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:16.010769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:16.019224 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed148761-8524-4c4c-9604-049e4f6c8e58 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.236396 Oct 24 08:58:16.020167 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 805/1543] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:15 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:16.041187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:16.049708 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25ef3d7a-90bd-41c0-942d-33ff3ec5e5de tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1491 microversion: 2.1 time: 0.226598 Oct 24 08:58:16.050248 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 739/1544] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:15 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1491 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:16.233227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:16.233874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:16.240628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.241117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.241579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.242466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.242929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.243353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.446854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:16.458113 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2782937d-566d-423c-b652-92cf555c681c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.230271 Oct 24 08:58:16.459578 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 806/1545] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:16 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:16.483850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:16.484474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:16.491675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.492539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.493146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.494053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.494674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.495536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.607196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:16.611652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:16.616010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.616496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.617496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.618196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.618643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.619063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.654569 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c28b123-7189-4eb7-9d08-93babde2be78 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051249 Oct 24 08:58:16.655587 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 807/1546] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:16 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:58:16.754635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:16.768737 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9b00c23-aa5a-4b6a-8120-f292a9fb05c7 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.288350 Oct 24 08:58:16.772271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 740/1547] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:16 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:16.826909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:16.827914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:16.836955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.837828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.838490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:16.839419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:16.840111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:16.840754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.015615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:17.024850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-39951d83-95f7-441f-a499-abab12692aa0 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.201732 Oct 24 08:58:17.026084 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 808/1548] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:16 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:17.046722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:17.047531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:17.054380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.055228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.055893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.057190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.057910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.058585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.073615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:17.075087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:17.088661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.090158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.092480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.093501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.095179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.097582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.273744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:17.283315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d921f532-56e9-49b6-bb52-a5cda45af2d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.241227 Oct 24 08:58:17.284222 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 741/1549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:17 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:17.301680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:17.310466 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6afadb0d-8476-4d0b-80d5-6164f57e68d2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1491 microversion: 2.1 time: 0.242256 Oct 24 08:58:17.311239 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 809/1550] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:17 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1491 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:17.482796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:17.483417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:17.489896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.490563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.490809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.492287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.492931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.493389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.667689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:17.670595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:17.677168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.677902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.678544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.682089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:17.689808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-be6c3a8f-1901-4a93-b83a-02505b068bcd tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.211125 Oct 24 08:58:17.690385 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 742/1551] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:17 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:17.694086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.695540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.696973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.742143 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f56751a-019c-4483-a7cd-3ef2ae9c0673 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.078830 Oct 24 08:58:17.743454 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 810/1552] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 08:58:17 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:17.796125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:17.797799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:17.810901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.811714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.812306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.813234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.813909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.814561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.993180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:18.002002 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1adb0771-8243-459e-ab97-47af6da433c6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1367 microversion: 2.1 time: 0.210921 Oct 24 08:58:18.002623 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 743/1553] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:17 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:18.050348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:18.052143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:18.073612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.074366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.074980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.076065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.076893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.077567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.309006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:18.309921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:18.327815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.328595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.328734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.329466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.329928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.330361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.403402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:18.411406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a30c479-d0ca-4b13-b3dd-3e4482167e5f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.367097 Oct 24 08:58:18.421130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 811/1554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:18 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:18.438549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:18.441644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:18.453402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.454891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.455534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.456543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.457224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.457838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.740417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:18.750684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de90d70a-88c6-4534-961c-7113b5ee6b60 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.448200 Oct 24 08:58:18.752426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 744/1555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:18 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:18.758994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:18.759929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:18.770289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.771390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.771964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.785839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.787503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.788092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.855282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:18.866030 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed630e2f-de35-4ecb-8ec5-b0fd398bc30e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 200 len: 1491 microversion: 2.1 time: 0.443383 Oct 24 08:58:18.867158 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 812/1556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:18 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 1491 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:18.888373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-74eee4f0-9e80-412e-889b-32a02b438880 req-a7a3e60b-c5d8-429c-9c46-b58d536f54a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7", "name": "network-vif-plugged", "status": "completed", "tag": "5e25c21f-a445-4e66-af2e-c8872d507e65"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:18.905236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74eee4f0-9e80-412e-889b-32a02b438880 req-a7a3e60b-c5d8-429c-9c46-b58d536f54a1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.905754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74eee4f0-9e80-412e-889b-32a02b438880 req-a7a3e60b-c5d8-429c-9c46-b58d536f54a1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.906193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74eee4f0-9e80-412e-889b-32a02b438880 req-a7a3e60b-c5d8-429c-9c46-b58d536f54a1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.941693 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-74eee4f0-9e80-412e-889b-32a02b438880 req-a7a3e60b-c5d8-429c-9c46-b58d536f54a1 service nova] Creating event network-vif-plugged:5e25c21f-a445-4e66-af2e-c8872d507e65 for instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 on n-h1-master-1 Oct 24 08:58:18.950881 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-74eee4f0-9e80-412e-889b-32a02b438880 req-a7a3e60b-c5d8-429c-9c46-b58d536f54a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066782 Oct 24 08:58:18.952086 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 813/1557] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:18.991156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8285d4d7-ee5f-4d58-beb9-781ff31ee486 req-619d674d-b1b3-472e-93c4-9a9035571642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad171800-a972-4956-8c16-df04c6ef8f13", "name": "network-vif-deleted", "tag": "a47ae400-76b3-44a4-8984-28b92de0c869"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:19.035835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8285d4d7-ee5f-4d58-beb9-781ff31ee486 req-619d674d-b1b3-472e-93c4-9a9035571642 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.040595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8285d4d7-ee5f-4d58-beb9-781ff31ee486 req-619d674d-b1b3-472e-93c4-9a9035571642 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.043590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8285d4d7-ee5f-4d58-beb9-781ff31ee486 req-619d674d-b1b3-472e-93c4-9a9035571642 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.068059 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8285d4d7-ee5f-4d58-beb9-781ff31ee486 req-619d674d-b1b3-472e-93c4-9a9035571642 service nova] Creating event network-vif-deleted:a47ae400-76b3-44a4-8984-28b92de0c869 for instance ad171800-a972-4956-8c16-df04c6ef8f13 on n-h2-master-1 Oct 24 08:58:19.102357 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8285d4d7-ee5f-4d58-beb9-781ff31ee486 req-619d674d-b1b3-472e-93c4-9a9035571642 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113099 Oct 24 08:58:19.104628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 814/1558] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:19.112809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:19.113033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:19.118291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:19.119729 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:19.130036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.130900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.131602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.132571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.133279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.133981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.135691 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6521f332-790c-4e26-a6a2-27d2235e6f2d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.381270 Oct 24 08:58:19.137585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 745/1559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:18 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:19.384198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:19.393340 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7667116-2087-4a37-ac51-1f5b2bf62922 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1558 microversion: 2.1 time: 0.287299 Oct 24 08:58:19.405830 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 815/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:19 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1558 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:19.424162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:19.424162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:19.430582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.431074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.431525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.432221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.432680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.433124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.444014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:19.444963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:19.455079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.461631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.462390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.463284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.464244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.464902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.530913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b33c5967-9a60-4239-a393-be2e9008bf44 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117493 Oct 24 08:58:19.532078 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 746/1561] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:58:19 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:19.781186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:19.782798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:19.791952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.793581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.798164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.799177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.800495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.802138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.168539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:20.178531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b5dc5b22-848c-4da5-bd48-22f689ed809c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1308 microversion: 2.1 time: 0.406301 Oct 24 08:58:20.184127 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 747/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:19 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:20.189249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:20.192148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:20.210292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:20.211716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:20.214285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.215317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:20.216825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:20.220075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.244170 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 HTTP/1.1 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ad171800-a972-4956-8c16-df04c6ef8f13'} Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:20.246687 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 08:58:20.251439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:20.253390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:20.254465 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7bd18ec5-2070-442e-8fa4-9f1d4cdbd7b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 404 len: 111 microversion: 2.1 time: 0.069106 Oct 24 08:58:20.255568 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 748/1563] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:20 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:58:20.274245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:20.277831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:20.301861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:20.307201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:20.308878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.310038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:20.313534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:20.314464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.380987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:20.393274 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7363dfd9-e58b-4df6-9f45-18808d119fd4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.950611 Oct 24 08:58:20.410009 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 816/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:19 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:20.489351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1685708337", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:20.585115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:58:20.747824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:20.757801 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02e19b68-cb04-49c0-96ef-b78531a420ac tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.500381 Oct 24 08:58:20.781232 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 749/1565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:20 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:21.160785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-10105a07-5ee2-49fe-9d4f-f7216cc8d770 req-9be44466-73d4-4d75-8d33-90c726e28276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffca5715-95e0-4499-a802-9b5e37649ce6", "tag": "2a5d8582-20a9-4c8a-8a1b-ba8c036c2079"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:21.181094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-10105a07-5ee2-49fe-9d4f-f7216cc8d770 req-9be44466-73d4-4d75-8d33-90c726e28276 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.181661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-10105a07-5ee2-49fe-9d4f-f7216cc8d770 req-9be44466-73d4-4d75-8d33-90c726e28276 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.182254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-10105a07-5ee2-49fe-9d4f-f7216cc8d770 req-9be44466-73d4-4d75-8d33-90c726e28276 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.203105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-10105a07-5ee2-49fe-9d4f-f7216cc8d770 req-9be44466-73d4-4d75-8d33-90c726e28276 service nova] Creating event network-changed:2a5d8582-20a9-4c8a-8a1b-ba8c036c2079 for instance ffca5715-95e0-4499-a802-9b5e37649ce6 on n-h2-master-1 Oct 24 08:58:21.220233 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-10105a07-5ee2-49fe-9d4f-f7216cc8d770 req-9be44466-73d4-4d75-8d33-90c726e28276 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062324 Oct 24 08:58:21.226710 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 750/1566] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:21.234980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:21.236313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:21.244545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.245694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.246663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.247753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.248995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.249672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.441563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:21.451294 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a57d9634-d3b4-4d4d-b988-2254133d01dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1488 microversion: 2.1 time: 0.222565 Oct 24 08:58:21.465388 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 751/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:21 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1488 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:21.470993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:21.471636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:21.483322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.484083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.484823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.486009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.486704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.487429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.523478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:58:21.524054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:58:21.524378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:58:21.524816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:58:21.525227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:58:21.539636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.544412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.545322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.546521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.547237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.547836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.602840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:58:21.609532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:58:21.633718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:58:21.636403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:58:21.686204 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:21.698286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ddb7a8b-af71-467f-8a04-f9ef283da0b8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.239005 Oct 24 08:58:21.699562 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 752/1568] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:21 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:21.720822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:21.721709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:21.733094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.735440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.736094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.738473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.743944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.744447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.761516 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eeca3cc8-2ead-4201-b93d-4ff6dddd4722 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272326 Oct 24 08:58:21.763036 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 817/1569] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:58:21.776952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f99bfa5-86d1-44ea-820b-e86f17a3ed5b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:21.781285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8f99bfa5-86d1-44ea-820b-e86f17a3ed5b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:21.897986 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2cd2584-82e2-4e46-8c08-d632c9e9a4fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7/action" status: 202 len: 0 microversion: 2.1 time: 0.195735 Oct 24 08:58:21.907450 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 753/1570] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:21 2022] POST /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:21.920600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:21.923400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:21.938900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.942468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.945439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.946257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.946803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.947245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.090885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f99bfa5-86d1-44ea-820b-e86f17a3ed5b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:22.110306 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f99bfa5-86d1-44ea-820b-e86f17a3ed5b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1215 microversion: 2.1 time: 0.337671 Oct 24 08:58:22.110306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 818/1571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:21 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1215 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:22.115143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:22.124266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:22.163849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:22.168226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:22.171218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.175509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:22.186730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:22.187808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.363122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:22.377369 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1ca3003-10e9-4119-b0a2-903ba5773a66 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.463969 Oct 24 08:58:22.417250 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 754/1572] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:21 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:22.712609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:22.724853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:22.728212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:22.735254 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7591d82-fe8d-40ee-af52-c90bf2db6e3b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1493 microversion: 2.1 time: 0.621658 Oct 24 08:58:22.744014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:22.744850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:22.745912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.747024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:22.747740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:22.748377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.759013 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 819/1573] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:22 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1493 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:23.068627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:23.096942 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5d4d3c6-6975-4beb-b23d-a26f0f7c3fcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.376589 Oct 24 08:58:23.100000 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 755/1574] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:22 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:23.138783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:23.139613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:23.147193 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:23.152165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.153266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.154211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.155734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.156837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.157552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.254936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:23.268381 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e164ca4e-8d12-4140-82be-6ee0173fc9e1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1267 microversion: 2.1 time: 0.132412 Oct 24 08:58:23.269464 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 820/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:23 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:23.391086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:23.401715 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:23.405901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Searching by: {'deleted': False, 'project_id': '01d49a667f134a8283ea56977bc33572'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 08:58:23.412105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:23.413077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:23.427314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.428375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.429512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.434645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.436322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.436960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.439103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.444733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.445993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.446988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.447623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.448223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.449527 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:23.599275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 08:58:23.703034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3468de0-fe88-4aca-a0d9-bade3b780d01 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.315625 Oct 24 08:58:23.703939 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 756/1576] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 08:58:23 2022] GET /compute/v2.1/servers => generated 334 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:23.718177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:23.724251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:23.725519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Searching by: {'deleted': False, 'project_id': '01d49a667f134a8283ea56977bc33572'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 08:58:23.731908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.732722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.733455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.734496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.735226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.735872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.765546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:23.775749 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efc4720a-e5d8-4b69-843a-6751016b47f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.367520 Oct 24 08:58:23.799108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 821/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:23 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:23.813182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:23.820441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:23.831204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.832281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.832951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.834332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.834873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.835886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.865327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 08:58:23.999934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:24.009003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.009820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.010385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.213581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a67736b-b15f-4d8a-a364-1ad0504280af tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.499099 Oct 24 08:58:24.215520 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 757/1578] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 08:58:23 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:24.220454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:24.221404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:24.230157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.230968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.231619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.232540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.233557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.234196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.330467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:24.344326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5960fb9b-da53-4174-9ad7-df3aa69f40e4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 200 len: 1473 microversion: 2.1 time: 0.539047 Oct 24 08:58:24.345448 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 822/1579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:23 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 1473 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:24.357859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b6f55ee0-c0a1-4706-aae4-76ea1e878cd9 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:24.377863 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b6f55ee0-c0a1-4706-aae4-76ea1e878cd9 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025825 Oct 24 08:58:24.378521 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 823/1580] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 08:58:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:24.393436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:24.395217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:24.404758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.405812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.406492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.407458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.408303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.409409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.457366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:24.471144 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5041c08a-cb3c-4841-92a2-403c589a6f8d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.253632 Oct 24 08:58:24.472389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 758/1581] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:24 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:24.479203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1342192119"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:24.487525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:24.496824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.498786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.500165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.501085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.501957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.502542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.760149 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3274e773-918b-4ea5-871a-e429750ca39b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7/action" status: 202 len: 0 microversion: 2.1 time: 0.285788 Oct 24 08:58:24.761342 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 759/1582] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:24 2022] POST /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 08:58:24.772201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0adb45b-cef4-4280-a5d6-ce1dc5941c03 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab93fb80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:24.837220 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0adb45b-cef4-4280-a5d6-ce1dc5941c03 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.069622 Oct 24 08:58:24.845206 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 760/1583] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:24 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:24.845206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:24.845206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:24.855862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.856364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.856810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.857631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.858092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.858522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.902457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:58:24.924711 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:24.943982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:24.953635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7dc7bd31-df22-497b-a3ff-39f0554a7eea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1273 microversion: 2.1 time: 0.571522 Oct 24 08:58:24.958484 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 824/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:24 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1273 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:24.971719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:24.976887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:25.003960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.006957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.008648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.010531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.012217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.013628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.094065 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b5460ed-1d10-4bda-a13f-5e86c8493631 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 204 len: 0 microversion: 2.1 time: 0.254360 Oct 24 08:58:25.097789 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 761/1585] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:58:24 2022] DELETE /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:25.104200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:25.105122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:25.114688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.115203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.115749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.120810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.121811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.122045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.331867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:25.344981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b56a85b-c883-4f3e-ad32-9c87060b60eb tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1701 microversion: 2.1 time: 0.245313 Oct 24 08:58:25.368726 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 762/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:25 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1701 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:25.386238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:25.396768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-787446a4-811a-47b1-8ba4-9bdc6e78a867 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.431767 Oct 24 08:58:25.414712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 825/1587] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:24 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:25.502785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:25.503706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:25.511365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.512023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.512704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.513455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.514113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.515140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.686489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:25.695985 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ed2a0ed-19b1-4b45-a859-2eefc0617910 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.197039 Oct 24 08:58:25.697403 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 763/1588] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:25 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:25.868835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d2aece5-1659-471e-817f-18ed54b5d941 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daad6b550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:25.981749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:25.982381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:25.998969 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d2aece5-1659-471e-817f-18ed54b5d941 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.149395 Oct 24 08:58:26.009730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.010184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.010631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.011356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.011819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.012253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.014295 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 826/1589] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:25 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:26.286067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:26.302909 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72c16898-a3f6-4aa5-b002-b8578bf294ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.328928 Oct 24 08:58:26.305809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 764/1590] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:25 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:26.408788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:26.409926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:26.420224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.421045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.421686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.422604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.423266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.423864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.425021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:26.426028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:26.447056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.449863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.454366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.455360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.457226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.458305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.756118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:26.767378 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0693c777-ec43-44f6-988d-4d1abb7ae941 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.346172 Oct 24 08:58:26.769504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 765/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:26 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:26.775664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:26.776814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:26.794938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.795766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.795919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.796569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.797023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.797480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:27.020693 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:27.030598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9280c5f-14e0-42c9-98d8-82670818b0e4 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.258556 Oct 24 08:58:27.031743 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 766/1592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:26 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:27.037360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0889ebc2-a7f3-4c1b-8f0b-7e49ed5b436d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab990f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:27.043048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:27.060636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7e94138-cb22-4972-86ea-2bdf231676d4 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1701 microversion: 2.1 time: 0.664401 Oct 24 08:58:27.071457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 827/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:26 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1701 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:27.096576 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0889ebc2-a7f3-4c1b-8f0b-7e49ed5b436d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.063500 Oct 24 08:58:27.097477 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 767/1594] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:27 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:27.329289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:27.330494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:27.345164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:27.346724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:27.347421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:27.349097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:27.349581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:27.350021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:27.539301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-73ad6798-1812-4211-8061-6b0b140cdd84 req-d4fb871a-28cb-435e-bb37-7b26c0137877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb", "name": "network-vif-unplugged", "status": "completed", "tag": "3ed9cd08-1f32-4430-8985-9dca63b3af99"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:27.559099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-73ad6798-1812-4211-8061-6b0b140cdd84 req-d4fb871a-28cb-435e-bb37-7b26c0137877 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:27.560081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-73ad6798-1812-4211-8061-6b0b140cdd84 req-d4fb871a-28cb-435e-bb37-7b26c0137877 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:27.561157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-73ad6798-1812-4211-8061-6b0b140cdd84 req-d4fb871a-28cb-435e-bb37-7b26c0137877 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:27.575631 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-73ad6798-1812-4211-8061-6b0b140cdd84 req-d4fb871a-28cb-435e-bb37-7b26c0137877 service nova] Creating event network-vif-unplugged:3ed9cd08-1f32-4430-8985-9dca63b3af99 for instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb on n-h2-master-1 Oct 24 08:58:27.582633 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-73ad6798-1812-4211-8061-6b0b140cdd84 req-d4fb871a-28cb-435e-bb37-7b26c0137877 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048533 Oct 24 08:58:27.583913 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 768/1595] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:27.747250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:27.758089 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d0faa19-91c6-407c-8d93-bf847e4ae0c8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.432122 Oct 24 08:58:27.760392 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 828/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:27 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:27.796773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:27.797534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:27.808253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:27.818594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:27.819369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:27.820850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:27.824632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:27.826865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.063359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:28.064172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:28.080773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.088794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.089276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.093817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.093817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.093817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.123141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:28.151218 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52f38432-0b00-4a34-b1fa-2306e57f3400 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.362173 Oct 24 08:58:28.158829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 769/1597] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:27 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:28.175990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:28.176609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:28.207165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.207669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.208109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.218424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.219190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.220033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.423459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:28.434503 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3bcab70f-2f62-4787-bb9a-2273bf4d97db tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1701 microversion: 2.1 time: 0.269137 Oct 24 08:58:28.435098 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 770/1598] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:28 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1701 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:28.447168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7411977-4d25-4435-a5d9-dccac35ec244 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab817f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:28.555365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7411977-4d25-4435-a5d9-dccac35ec244 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.118603 Oct 24 08:58:28.565472 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 771/1599] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:28 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:28.678980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:28.694859 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4b103be-5102-4b01-8967-aacbd6d12647 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.641245 Oct 24 08:58:28.698676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 829/1600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:28 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:28.784483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:28.785214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:28.794997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.795822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.796453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.798859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.800032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.801181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.942947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f7fd1c9c-4ded-4ada-88dc-fe720e8c9215 req-bb495b3f-8293-4f43-a686-4d5bb89b1614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b57e8e-048a-4bcb-b104-f6c0243aa58d", "tag": "710188f0-b072-4171-8ddd-37cec90dd9c1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:28.964704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f7fd1c9c-4ded-4ada-88dc-fe720e8c9215 req-bb495b3f-8293-4f43-a686-4d5bb89b1614 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:28.966032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f7fd1c9c-4ded-4ada-88dc-fe720e8c9215 req-bb495b3f-8293-4f43-a686-4d5bb89b1614 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:28.966758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f7fd1c9c-4ded-4ada-88dc-fe720e8c9215 req-bb495b3f-8293-4f43-a686-4d5bb89b1614 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:28.985049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f7fd1c9c-4ded-4ada-88dc-fe720e8c9215 req-bb495b3f-8293-4f43-a686-4d5bb89b1614 service nova] Creating event network-changed:710188f0-b072-4171-8ddd-37cec90dd9c1 for instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d on n-h2-master-1 Oct 24 08:58:29.002236 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f7fd1c9c-4ded-4ada-88dc-fe720e8c9215 req-bb495b3f-8293-4f43-a686-4d5bb89b1614 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065213 Oct 24 08:58:29.003773 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 830/1601] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:29.055659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:29.065546 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9219fde3-c9cd-4e70-bac7-cf605fe7133a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.285299 Oct 24 08:58:29.068205 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 772/1602] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:28 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:29.185753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:29.186489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:29.193925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.195111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.195550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.196609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.197070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.197526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.458649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:29.459272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:29.468653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.469147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.469616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.470333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.470791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.471222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.608545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:29.627320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0dde42f5-4f2a-4f76-b622-afe8d8103d58 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.446594 Oct 24 08:58:29.628559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 831/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:29 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:29.645258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb624433-9b29-496d-9f42-aba68b7198f7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0a25e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:29.664754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:29.689174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c7fc0ff-fbea-491f-8cce-e9ba33b67431 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1634 microversion: 2.1 time: 0.234984 Oct 24 08:58:29.710660 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 773/1604] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:29 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1634 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:29.726572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb624433-9b29-496d-9f42-aba68b7198f7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.096298 Oct 24 08:58:29.729205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3373cbe2-8440-464e-880a-14afc4f8b12d req-718c0fe8-d517-4f46-8b8c-bc564b8e2018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb", "tag": "3ed9cd08-1f32-4430-8985-9dca63b3af99"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:29.730092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 832/1605] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:29 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:29.748239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3373cbe2-8440-464e-880a-14afc4f8b12d req-718c0fe8-d517-4f46-8b8c-bc564b8e2018 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.748912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3373cbe2-8440-464e-880a-14afc4f8b12d req-718c0fe8-d517-4f46-8b8c-bc564b8e2018 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.749545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3373cbe2-8440-464e-880a-14afc4f8b12d req-718c0fe8-d517-4f46-8b8c-bc564b8e2018 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.765588 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3373cbe2-8440-464e-880a-14afc4f8b12d req-718c0fe8-d517-4f46-8b8c-bc564b8e2018 service nova] Creating event network-changed:3ed9cd08-1f32-4430-8985-9dca63b3af99 for instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb on n-h2-master-1 Oct 24 08:58:29.771516 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3373cbe2-8440-464e-880a-14afc4f8b12d req-718c0fe8-d517-4f46-8b8c-bc564b8e2018 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058635 Oct 24 08:58:29.772143 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 774/1606] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:29.777719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:29.778432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:29.786292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.787072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.787704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.789142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:29.789789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:29.790384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:29.950257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b925127b-a0e9-4a32-8465-7357fd60ed2c tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Action: 'create', calling method: .version_select at 0x7f8dab02ad30>, body: {"pool": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:30.151786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:30.163393 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-378947cd-7c5c-4394-9364-0cd49a6493b3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.389802 Oct 24 08:58:30.164264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 775/1607] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:29 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:30.171056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:30.175121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:30.183063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:30.183840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:30.184460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:30.185387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:30.186013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:30.186434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:30.498894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:30.518152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2775da8-445d-42e8-bfe2-9b9f31d5d6f0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.344626 Oct 24 08:58:30.522818 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 776/1608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:30 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:30.654503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:30.655034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:30.674139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:30.674780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:30.675061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:30.675781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:30.676262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:30.676707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:31.055056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:31.066627 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9639fa8a-2621-4798-89a6-803cd7344f47 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.415860 Oct 24 08:58:31.069343 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 777/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:30 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:31.108507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:31.110361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:31.124894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:31.126498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:31.126961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:31.130189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:31.130676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:31.131174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:31.273273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:31.274908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:31.277663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:31.279081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lazy-loading 'fault' on Instance uuid 61ef4985-b1ff-4177-9373-d6dc8794e3d6 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:31.368710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9785b058f4849e28c1fe25af094bef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d49a667f134a8283ea56977bc33572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:31.385222 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-51402ec2-465d-4905-b32c-732de7458ed0 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 200 len: 1360 microversion: 2.1 time: 0.290519 Oct 24 08:58:31.398262 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 778/1610] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:31 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 1360 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:31.407900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b153118-4189-45fe-9aaf-e596c5c032ab tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab5908b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:31.568455 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:32.097643 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:33.422349 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b925127b-a0e9-4a32-8465-7357fd60ed2c tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.690974 Oct 24 08:58:33.432155 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 833/1611] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 08:58:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:33.437988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-157a70c4-8b76-4352-a230-865900e450af req-29e6e44b-6349-4263-a72c-9caf7e4c0b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ef4985-b1ff-4177-9373-d6dc8794e3d6", "name": "network-vif-deleted", "tag": "1137817f-88a5-46ed-b4ed-57072602e3b4"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:33.460798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-157a70c4-8b76-4352-a230-865900e450af req-29e6e44b-6349-4263-a72c-9caf7e4c0b3c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:33.464006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-157a70c4-8b76-4352-a230-865900e450af req-29e6e44b-6349-4263-a72c-9caf7e4c0b3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:33.464660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-157a70c4-8b76-4352-a230-865900e450af req-29e6e44b-6349-4263-a72c-9caf7e4c0b3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.491423 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-157a70c4-8b76-4352-a230-865900e450af req-29e6e44b-6349-4263-a72c-9caf7e4c0b3c service nova] Creating event network-vif-deleted:1137817f-88a5-46ed-b4ed-57072602e3b4 for instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 on n-h1-master-1 Oct 24 08:58:33.502569 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-157a70c4-8b76-4352-a230-865900e450af req-29e6e44b-6349-4263-a72c-9caf7e4c0b3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068972 Oct 24 08:58:33.506399 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 834/1612] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:33.519339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:33.527531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:33.541910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:33.543337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:33.544948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.546577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:33.547894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:33.549194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.795418 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:33.846707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:33.857478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f109529e-6837-4b33-a55c-37f24e27630f tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.348084 Oct 24 08:58:33.858842 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 835/1613] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:33 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:33.885772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:33.886577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:33.893128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:33.893733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:33.894241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.895184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:33.896104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:33.896740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.992385 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:34.246987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:34.258386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed57cba5-389e-4b76-a395-3fa8f6b9de5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.378329 Oct 24 08:58:34.258827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 836/1614] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:33 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:34.278360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:34.278907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:34.293330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.293868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.296727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.297550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.298869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.299501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.646971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:34.659315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb88e43f-2a9c-4a23-a23c-b629c73929f6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.399117 Oct 24 08:58:34.660149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 837/1615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:34 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:34.689010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:34.689685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] [instance: 61ef4985-b1ff-4177-9373-d6dc8794e3d6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:34.705559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.707582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.710473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.711269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.711997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.712442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.803965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] HTTP exception thrown: Instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 could not be found. Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Request method failure captured: Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 HTTP/1.1 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNrOan-qVcWILFzqMUwcidraXMgiWN51pBP5GhbYujISCk-0_SiZQ4QNrA3lKXQmf_ADZ4Bk50037XZdAHfjILa9tz2beo82-lDc7LeUnEq7dpiml4XJcfxn3i7xJoRanVhc2YawFqSRp_suJHe_pJlSrmFHKPUupYlrp4cuRVxsBA Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 01d49a667f134a8283ea56977bc33572 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1245664127 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01d49a667f134a8283ea56977bc33572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01d49a667f134a8283ea56977bc33572"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01d49a667f134a8283ea56977bc33572"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01d49a667f134a8283ea56977bc33572"}]}] Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1245664127 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 01d49a667f134a8283ea56977bc33572 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1245664127 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1245664127-project Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b9785b058f4849e28c1fe25af094bef5 Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1245664127-project Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 could not be found. Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '61ef4985-b1ff-4177-9373-d6dc8794e3d6'} Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 could not be found. Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 could not be found. Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:34.805990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 could not be found. Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Returning 404 to user: Instance 61ef4985-b1ff-4177-9373-d6dc8794e3d6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5d49f32-2021-4a56-9f67-c5a1fe2053b6 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6" status: 404 len: 111 microversion: 2.1 time: 0.146367 Oct 24 08:58:34.811141 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 838/1616] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:34 2022] GET /compute/v2.1/servers/61ef4985-b1ff-4177-9373-d6dc8794e3d6 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:58:34.813584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-4915bf8e-c51a-4fb6-92ad-873aa4ee875f req-f59575f7-9ec1-4249-8f02-4848d2089288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7", "name": "network-vif-plugged", "status": "completed", "tag": "5e25c21f-a445-4e66-af2e-c8872d507e65"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:34.825784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4915bf8e-c51a-4fb6-92ad-873aa4ee875f req-f59575f7-9ec1-4249-8f02-4848d2089288 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.826274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4915bf8e-c51a-4fb6-92ad-873aa4ee875f req-f59575f7-9ec1-4249-8f02-4848d2089288 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.826707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4915bf8e-c51a-4fb6-92ad-873aa4ee875f req-f59575f7-9ec1-4249-8f02-4848d2089288 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.841505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-4915bf8e-c51a-4fb6-92ad-873aa4ee875f req-f59575f7-9ec1-4249-8f02-4848d2089288 service nova] Creating event network-vif-plugged:5e25c21f-a445-4e66-af2e-c8872d507e65 for instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 on n-h1-master-1 Oct 24 08:58:34.848065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-4915bf8e-c51a-4fb6-92ad-873aa4ee875f req-f59575f7-9ec1-4249-8f02-4848d2089288 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038083 Oct 24 08:58:34.848841 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 839/1617] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:34.858256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20974252-578e-4a0c-ac3f-b1d41d987944 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Calling method '.version_select at 0x7f8daad6b9d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:35.173180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20974252-578e-4a0c-ac3f-b1d41d987944 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/dab65b23-49d5-4bd8-a38c-85ad38f9f2f8" status: 200 len: 142 microversion: 2.1 time: 0.319969 Oct 24 08:58:35.175249 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 840/1618] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:58:34 2022] GET /compute/v2.1/os-floating-ips/dab65b23-49d5-4bd8-a38c-85ad38f9f2f8 => generated 142 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:35.181141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9adaff79-c3cc-41e6-b1e5-7933d9fb48d8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] Calling method '.version_select at 0x7f8daae00d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:35.239317 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9adaff79-c3cc-41e6-b1e5-7933d9fb48d8 tempest-ServersTestJSON-1245664127 tempest-ServersTestJSON-1245664127-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332625018" status: 202 len: 0 microversion: 2.1 time: 0.062697 Oct 24 08:58:35.243065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 841/1619] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 08:58:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332625018 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:35.261246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:35.262042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:35.275449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:35.279310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:35.285539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:35.286523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:35.287364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:35.288122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:35.587992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:35.599101 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c6d0f34-154c-46ea-b08c-1dbaccf30b7a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.354021 Oct 24 08:58:35.600476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 842/1620] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:35 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:35.606567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a115c044-cfd2-4d66-b6cc-a3ef0d472415 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Calling method '.version_select at 0x7f8daad6b940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:35.971152 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a115c044-cfd2-4d66-b6cc-a3ef0d472415 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.369337 Oct 24 08:58:35.979561 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 843/1621] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 08:58:35 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:35.986515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:35.987846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:36.009064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:36.009896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:36.012916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:36.013994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:36.015794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:36.016496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:36.353431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:36.368289 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47a66999-4984-4337-b886-8d78a6091e0c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.385481 Oct 24 08:58:36.381853 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 844/1622] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:35 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:36.395197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:36.398521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:36.413530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:36.416249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:36.417064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:36.419449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:36.422326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:36.423083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:36.869333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:36.881334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df5209ce-d401-4ad1-b91a-98de43b72df1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1500 microversion: 2.1 time: 0.491858 Oct 24 08:58:36.882425 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 845/1623] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:36 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1500 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:36.892301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-076c41f8-f83b-4870-8243-aa652919c0de tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Calling method '.version_select at 0x7f8daafba3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:37.169080 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b153118-4189-45fe-9aaf-e596c5c032ab tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 5.769602 Oct 24 08:58:37.182200 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 779/1624] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:31 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 5783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:37.191317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:37.200061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:37.207862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.216270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.220641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.230288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.240779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.245412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.582982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:37.590964 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:37.597763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9fb41930-a41f-48c9-b349-26c71279cf61 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.413478 Oct 24 08:58:37.598575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 780/1625] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:37 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:37.609018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f04bc85-d2ef-48f6-b947-20e2cd6a065c"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:37.615730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:37.638032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.641125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.641673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.642443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.642917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.644250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.700676 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Cannot 'attach_volume' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state rescued Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/os-volume_attachments HTTP/1.1 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 74 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "0f04bc85-d2ef-48f6-b947-20e2cd6a065c"}} Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'attach_volume' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state rescued Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'c2e62742-ceeb-4336-bf67-b6ae657b4852', 'body': {'volumeAttachment': {'volumeId': '0f04bc85-d2ef-48f6-b947-20e2cd6a065c'}}} Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 24 08:58:37.713026 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state rescued Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state rescued Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 409 to user: Cannot 'attach_volume' instance c2e62742-ceeb-4336-bf67-b6ae657b4852 while it is in vm_state rescued {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-930d73c1-33f1-4860-9e18-9be69678bb8b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.116532 Oct 24 08:58:37.719965 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 781/1626] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 08:58:37 2022] POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/os-volume_attachments => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:58:37.724717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:37.725961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:37.746781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.747206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.747652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.748638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.748851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.749358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:38.311658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:38.321931 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-103292d8-0bfe-485a-8593-5d6c32c11457 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.603850 Oct 24 08:58:38.342024 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 782/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:37 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:38.348543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:38.349406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:38.356514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.357001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.357515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:38.358284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.358922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.359521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:38.451930 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6473829c-52df-4e05-87b0-8801c8b638a9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action" status: 202 len: 0 microversion: 2.1 time: 0.108382 Oct 24 08:58:38.452977 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 783/1628] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:38 2022] POST /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:38.469994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-17e502cd-a8c9-4d5d-b912-9d0ee4ed220a req-275fd9dc-00de-4e76-ae24-5383d1793c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b57e8e-048a-4bcb-b104-f6c0243aa58d", "name": "network-vif-plugged", "status": "completed", "tag": "710188f0-b072-4171-8ddd-37cec90dd9c1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:38.499779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-17e502cd-a8c9-4d5d-b912-9d0ee4ed220a req-275fd9dc-00de-4e76-ae24-5383d1793c80 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.500273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-17e502cd-a8c9-4d5d-b912-9d0ee4ed220a req-275fd9dc-00de-4e76-ae24-5383d1793c80 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.500709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-17e502cd-a8c9-4d5d-b912-9d0ee4ed220a req-275fd9dc-00de-4e76-ae24-5383d1793c80 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:38.521128 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-17e502cd-a8c9-4d5d-b912-9d0ee4ed220a req-275fd9dc-00de-4e76-ae24-5383d1793c80 service nova] Creating event network-vif-plugged:710188f0-b072-4171-8ddd-37cec90dd9c1 for instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d on n-h2-master-1 Oct 24 08:58:38.528108 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-17e502cd-a8c9-4d5d-b912-9d0ee4ed220a req-275fd9dc-00de-4e76-ae24-5383d1793c80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073646 Oct 24 08:58:38.529018 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 784/1629] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:38.550274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dd8feb4a-ddb7-4192-8d8a-f21c3f367b0a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab115820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:38.629100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dd8feb4a-ddb7-4192-8d8a-f21c3f367b0a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.098407 Oct 24 08:58:38.630033 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 785/1630] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:38 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:38.640566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:38.641677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:38.649969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.650463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.650904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:38.651617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.652075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.652645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:39.091173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:39.104701 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-789e8911-354b-413b-b263-aafcdb1169ee tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1508 microversion: 2.1 time: 0.473032 Oct 24 08:58:39.105515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 786/1631] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:38 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:39.129584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:39.130200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:39.146514 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:39.149020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:39.149572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:39.150118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:39.150867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:39.151315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:39.151741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:39.531937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:39.546075 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cd6de78-7086-443e-80f0-6a5dfa6a431b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1390 microversion: 2.1 time: 0.420402 Oct 24 08:58:39.547380 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 787/1632] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:39 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1390 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:39.552544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:39.553494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:39.559904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:39.560610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:39.561205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:39.562990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:39.563686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:39.564282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:39.838614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:39.849119 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9967b993-2e1b-442d-a09f-9301fd643cb5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.300350 Oct 24 08:58:39.849756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 788/1633] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:39 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:39.867699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f979f78d-295f-4ab8-afd2-266885b76a17 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab138ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:39.933740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f979f78d-295f-4ab8-afd2-266885b76a17 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.082732 Oct 24 08:58:39.938726 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 789/1634] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:39 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:39.971188 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-076c41f8-f83b-4870-8243-aa652919c0de tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/dab65b23-49d5-4bd8-a38c-85ad38f9f2f8" status: 202 len: 0 microversion: 2.1 time: 3.087548 Oct 24 08:58:39.977682 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 846/1635] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:58:36 2022] DELETE /compute/v2.1/os-floating-ips/dab65b23-49d5-4bd8-a38c-85ad38f9f2f8 => generated 0 bytes in 3095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:39.988205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-da57ae54-d0f9-4203-aee5-4e07713ce906 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Action: 'create', calling method: .version_select at 0x7f8dab5b3a60>, body: {"pool": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:40.133430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:40.134115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:40.149474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.151716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.153634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.155305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.157960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.158656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.653410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:40.671343 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-068aacc6-6fff-45be-ac68-1a27217b8749 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1508 microversion: 2.1 time: 0.534963 Oct 24 08:58:40.672342 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 847/1636] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:40 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:40.679765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:40.683190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:40.702807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.703514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.704220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.705206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.706669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.708246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.738489 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:41.072510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:41.084087 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e492365-921c-4208-887a-00c64457d1a3 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1380 microversion: 2.1 time: 0.410918 Oct 24 08:58:41.100498 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 848/1637] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:40 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1380 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:41.120733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:41.132138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:41.139192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:41.140021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:41.140933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:41.141933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:41.147767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:41.148496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:41.559884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:41.571576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6055904-af9a-4366-90f9-408d92afcccb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1315 microversion: 2.1 time: 0.462887 Oct 24 08:58:41.575314 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 849/1638] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:41 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:41.580294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52c9de9b-c5d3-4ec3-aee4-b0cab6cdd386 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daafba160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:41.672186 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52c9de9b-c5d3-4ec3-aee4-b0cab6cdd386 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.095536 Oct 24 08:58:41.672772 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 850/1639] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:41 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:41.697737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-352f1287-09ce-4497-83e2-04ad6bbf6328 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '.version_select at 0x7f8dab0231f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:41.701600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-352f1287-09ce-4497-83e2-04ad6bbf6328 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:41.702106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-352f1287-09ce-4497-83e2-04ad6bbf6328 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:41.717921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-352f1287-09ce-4497-83e2-04ad6bbf6328 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:41.767065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-352f1287-09ce-4497-83e2-04ad6bbf6328 tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2702 microversion: 2.1 time: 0.092950 Oct 24 08:58:41.778250 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 851/1640] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 08:58:41 2022] GET /compute/v2.1/os-migrations => generated 2702 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:41.778250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:41.778250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:41.797354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:41.797863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:41.798308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:41.799022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:41.799476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:41.799903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:42.359232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:42.386396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-247dea3e-a8b4-4dc0-81a1-aaf43f9e8c1e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1508 microversion: 2.1 time: 0.617113 Oct 24 08:58:42.415458 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 852/1641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:41 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1508 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:42.422453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:42.427965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:42.447280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:42.452452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:42.454982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:42.460253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:42.461526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:42.464419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:42.483674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-da57ae54-d0f9-4203-aee5-4e07713ce906 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.505010 Oct 24 08:58:42.484312 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 790/1642] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 08:58:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:42.500761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3d2d566-f00e-4d76-8840-d533a8693845 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Calling method '.version_select at 0x7f8dab4f7790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:43.073782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8d453252-f59d-4254-90e8-331d5544d33d tempest-LiveMigrationTest-1814331793 tempest-LiveMigrationTest-1814331793-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1531 microversion: 2.1 time: 0.657008 Oct 24 08:58:43.076678 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 853/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:42 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1531 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:43.085236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:43.087575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:43.111273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.112912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.113617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.114559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.115215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.115895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.471814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:43.494321 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d9b6844a-88a1-4075-aaae-fc55fb809e85 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1501 microversion: 2.1 time: 0.413646 Oct 24 08:58:43.496132 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 854/1644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:43 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1501 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:43.519090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-430180aa-3cb3-4bd6-86ce-80a468cb44d8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf151f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:43.614421 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-430180aa-3cb3-4bd6-86ce-80a468cb44d8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.115199 Oct 24 08:58:43.626731 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 855/1645] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:43 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:43.639194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:43.642098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:43.650949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.651814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.655301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.656335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.657557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.672075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.728403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:58:43.891521 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0871a998-6dae-46da-a3ee-991d4c7c5fad tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 204 len: 0 microversion: 2.1 time: 0.261639 Oct 24 08:58:43.892550 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 856/1646] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:58:43 2022] DELETE /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:43.901940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:43.907026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:43.917491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.920026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.922384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.925239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.925895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.926413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:44.252467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:44.263901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4050f94a-3342-42f4-a6bd-51932491a8c4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1514 microversion: 2.1 time: 0.370213 Oct 24 08:58:44.264502 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 857/1647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:43 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:44.290955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:44.308065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:44.331955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:44.332461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:44.333027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:44.333797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:44.334230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:44.335443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:44.355149 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3d2d566-f00e-4d76-8840-d533a8693845 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8" status: 202 len: 0 microversion: 2.1 time: 1.861527 Oct 24 08:58:44.356823 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 791/1648] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:58:42 2022] DELETE /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 => generated 0 bytes in 1864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:44.362284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:44.364031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:44.394633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:44.395392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:44.396002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:44.398577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:44.400628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:44.403502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:44.424273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lazy-loading 'flavor' on Instance uuid a7b57e8e-048a-4bcb-b104-f6c0243aa58d {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:44.908885 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c34d6c82-b638-43a5-bb90-dc4e6a398fc6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d/action" status: 202 len: 0 microversion: 2.1 time: 0.626843 Oct 24 08:58:44.913834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 858/1649] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:58:44 2022] POST /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:44.932041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c7e01f6-6791-48c0-a174-750b22fc3245 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Calling method '.version_select at 0x7f8dab0230d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:44.988944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:44.997694 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-954c1a2e-efb9-4642-aa0d-e8bacb6b1893 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1386 microversion: 2.1 time: 0.639353 Oct 24 08:58:45.009799 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 792/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:44 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1386 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:45.015401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-966ee362-e216-4334-a4eb-a0edf1b47b32 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab817e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:45.099529 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-966ee362-e216-4334-a4eb-a0edf1b47b32 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.088296 Oct 24 08:58:45.101904 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 793/1651] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:45 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:45.109373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:45.112388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:45.119278 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-1c7e01f6-6791-48c0-a174-750b22fc3245 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 could not be found", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:58:45.121651 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1c7e01f6-6791-48c0-a174-750b22fc3245 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] HTTP exception thrown: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.126587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:45.127252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:45.127722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:45.128795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:45.129495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c7e01f6-6791-48c0-a174-750b22fc3245 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Request method failure captured: Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 HTTP/1.1 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlO1b32VW60i38hm8xwoGwjFslPFBWnK4usA03sAirwLwjDY0FoZwNcN11pUI3tRKHCPAdziKpszpbCBqmi8_v2EfNpkkfN6q1MskvlnXNhHdF5x2Q0oP2_pNip5mCMugURDi85NC945fptP51q1NZA3-ZKh6w_FOEdAl2hux1UaAg0 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 1b649fda281a461490da66bde72b3042 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsTestJSON-251637942 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b649fda281a461490da66bde72b3042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b649fda281a461490da66bde72b3042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b649fda281a461490da66bde72b3042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b649fda281a461490da66bde72b3042"}]}] Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsTestJSON-251637942 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 1b649fda281a461490da66bde72b3042 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsTestJSON-251637942 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsTestJSON-251637942-project Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 4a156abb1c2f486388806138cc370cc6 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsTestJSON-251637942-project Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0bdb422a-7cdd-4462-acfa-9ae471ce1ad8'} Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 could not be found Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e91d8355-61ed-496a-adce-d89cb0f24356'] Oct 24 08:58:45.129616 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8. Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c7e01f6-6791-48c0-a174-750b22fc3245 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Returning 404 to user: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c7e01f6-6791-48c0-a174-750b22fc3245 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8" status: 404 len: 111 microversion: 2.1 time: 0.218503 Oct 24 08:58:45.136366 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 859/1652] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 08:58:44 2022] GET /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:58:45.145884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:45.159481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41789a2c-0a58-49bc-842a-9698cf8e4769 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Calling method '.version_select at 0x7f8daadaa430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:45.413875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:45.423709 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-925b32b0-4811-4dba-9a19-0f2d9ada5ba2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.320560 Oct 24 08:58:45.436734 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 794/1653] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:45 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:45.444267 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-41789a2c-0a58-49bc-842a-9698cf8e4769 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 could not be found", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 08:58:45.445635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-41789a2c-0a58-49bc-842a-9698cf8e4769 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] HTTP exception thrown: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41789a2c-0a58-49bc-842a-9698cf8e4769 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Request method failure captured: Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 HTTP/1.1 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlO1b32VW60i38hm8xwoGwjFslPFBWnK4usA03sAirwLwjDY0FoZwNcN11pUI3tRKHCPAdziKpszpbCBqmi8_v2EfNpkkfN6q1MskvlnXNhHdF5x2Q0oP2_pNip5mCMugURDi85NC945fptP51q1NZA3-ZKh6w_FOEdAl2hux1UaAg0 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 1b649fda281a461490da66bde72b3042 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-FloatingIPsTestJSON-251637942 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b649fda281a461490da66bde72b3042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b649fda281a461490da66bde72b3042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b649fda281a461490da66bde72b3042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b649fda281a461490da66bde72b3042"}]}] Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-FloatingIPsTestJSON-251637942 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 1b649fda281a461490da66bde72b3042 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-FloatingIPsTestJSON-251637942 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-FloatingIPsTestJSON-251637942-project Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 4a156abb1c2f486388806138cc370cc6 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-FloatingIPsTestJSON-251637942-project Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: exception: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0bdb422a-7cdd-4462-acfa-9ae471ce1ad8'} Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 could not be found Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa5ca65b-a35c-49a2-9f54-2189d0cd5ebe'] Oct 24 08:58:45.448056 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8. Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 Oct 24 08:58:45.452629 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:58:45.456742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41789a2c-0a58-49bc-842a-9698cf8e4769 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] Returning 404 to user: Floating IP not found for ID 0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:45.458256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41789a2c-0a58-49bc-842a-9698cf8e4769 tempest-FloatingIPsTestJSON-251637942 tempest-FloatingIPsTestJSON-251637942-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8" status: 404 len: 111 microversion: 2.1 time: 0.316010 Oct 24 08:58:45.459006 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 860/1654] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 08:58:45 2022] DELETE /compute/v2.1/os-floating-ips/0bdb422a-7cdd-4462-acfa-9ae471ce1ad8 => generated 111 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:58:46.091928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:46.092558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:46.121074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7b2a8ae-078c-4125-8ebe-77655c769cf5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daae8fdc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:46.124358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:46.124903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:46.137714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:46.155144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:46.155779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:46.156233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:46.277789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7b2a8ae-078c-4125-8ebe-77655c769cf5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.163068 Oct 24 08:58:46.296575 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 861/1655] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:46 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:46.453403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:46.454214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:46.496791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:46.497608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:46.498231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:46.499136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:46.499929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:46.501418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:46.864662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:46.899517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2845aac8-08f9-4496-9e18-f46e7b1c3d22 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1386 microversion: 2.1 time: 0.811669 Oct 24 08:58:46.902973 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 795/1656] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:46 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1386 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:47.305038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba405a16-dd02-4fa4-a203-065ad4626123 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab3713a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:47.396847 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba405a16-dd02-4fa4-a203-065ad4626123 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.099297 Oct 24 08:58:47.405626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 796/1657] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:47 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:47.410782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1890813c-6b65-4f99-87e7-c7dd40ce5c0f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'create', calling method: .version_select at 0x7f8dab5bcee0>, body: {"keypair": {"name": "tempest-keypair-1130784208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKgke8YweojNBK0YlaJ5k65O+hbYOjwEz0PuhFcUSu+iOinszUXfrb6SPwhff+ERfwvBbFv094mF7u5lSXRmF9TWcc/6uV9IudjBM86oxH+9o5Vj09BvW1JlRiPj4HprA=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:47.466581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1890813c-6b65-4f99-87e7-c7dd40ce5c0f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:58:47.475722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1890813c-6b65-4f99-87e7-c7dd40ce5c0f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for user 7e709503bbff4c239491b0f109673264 and project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:58:47.529543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:47.538593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1890813c-6b65-4f99-87e7-c7dd40ce5c0f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130804 Oct 24 08:58:47.539757 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 797/1658] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:58:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:47.546404 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-320617fa-05c6-4ee0-8002-e00770eda436 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 1.098880 Oct 24 08:58:47.551712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 862/1659] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:46 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:47.926803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:47.928759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:47.940888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:47.942907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:47.946675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:47.948551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:47.950994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:47.951783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:48.144747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-294193b9-dc34-4155-bc3e-d425ff30a007 req-61de35e6-3f89-4e99-b30b-5e04e7efc6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb", "name": "network-vif-deleted", "tag": "3ed9cd08-1f32-4430-8985-9dca63b3af99"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:48.173230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-294193b9-dc34-4155-bc3e-d425ff30a007 req-61de35e6-3f89-4e99-b30b-5e04e7efc6af service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:48.175562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-294193b9-dc34-4155-bc3e-d425ff30a007 req-61de35e6-3f89-4e99-b30b-5e04e7efc6af service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:48.176015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-294193b9-dc34-4155-bc3e-d425ff30a007 req-61de35e6-3f89-4e99-b30b-5e04e7efc6af service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:48.215353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-294193b9-dc34-4155-bc3e-d425ff30a007 req-61de35e6-3f89-4e99-b30b-5e04e7efc6af service nova] Creating event network-vif-deleted:3ed9cd08-1f32-4430-8985-9dca63b3af99 for instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb on n-h1-master-1 Oct 24 08:58:48.222008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:48.224792 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-294193b9-dc34-4155-bc3e-d425ff30a007 req-61de35e6-3f89-4e99-b30b-5e04e7efc6af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086016 Oct 24 08:58:48.228674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 863/1660] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:48.238424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b299f40f-48dd-4ebd-b075-aac445232bcf tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1344 microversion: 2.1 time: 0.316212 Oct 24 08:58:48.261328 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 798/1661] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:47 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1344 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:48.419219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1afa4d7b-4609-475b-9b4d-ae0015721657 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab094940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:48.544754 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1afa4d7b-4609-475b-9b4d-ae0015721657 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.135682 Oct 24 08:58:48.546788 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 864/1662] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:48 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:48.583323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:48.584255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:48.608321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:48.617440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:48.619374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:48.623387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:48.623877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:48.632243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:49.269716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:49.270624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:49.288937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:49.292155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:49.292645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:49.298384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:49.298965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:49.299419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:49.567386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:49.587351 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57ba8389-8300-4b49-b2b3-312b913153a2 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.320536 Oct 24 08:58:49.591486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 865/1663] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:49 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:49.609042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3239c858-ffa1-4db8-b1bf-426dd7759ed9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab04a0d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:49.617006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:49.660810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e6bc907-b690-497c-8201-9e80e4588c54 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 1.082031 Oct 24 08:58:49.668263 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 799/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:48 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:49.713255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3239c858-ffa1-4db8-b1bf-426dd7759ed9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.119701 Oct 24 08:58:49.722148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 866/1665] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:49 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:50.124705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-944046707", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50ce0676-de1a-4c1e-8b5e-2aa8413c2173"}], "block_device_mapping_v2": [{"uuid": "aec89406-be8e-46e1-ab1c-8deca053880b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:50.287127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] validate_networks() for [('50ce0676-de1a-4c1e-8b5e-2aa8413c2173', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:58:50.616969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:50.618224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:50.647569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:50.648911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:50.649756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:50.650896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:50.652773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:50.654123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:50.781897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:50.796091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0adfac01-a326-42da-b373-1c95fd25692a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.184980 Oct 24 08:58:50.811364 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 867/1666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:50 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:50.820860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:50.821623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:50.829361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:50.830133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:50.831173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:50.832758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:50.833525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:50.834632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:51.146219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:51.158449 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fad9a58-767b-4888-979b-ca36fa6f61a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.344628 Oct 24 08:58:51.173333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 868/1667] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:50 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:51.173333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19292790-d21e-41fc-8708-f1dd994f05dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf15160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:51.242008 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19292790-d21e-41fc-8708-f1dd994f05dd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.081143 Oct 24 08:58:51.250562 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 869/1668] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:51 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:51.792510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:58:51.793939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:58:51.794587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:58:51.795182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:58:51.796535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:58:51.827756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:51.828270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:51.828714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:51.829529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:51.829994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:51.830427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:51.831502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:51.833049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:51.853537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:51.855036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:51.857148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:51.860133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:51.861136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:51.862855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:51.878878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:58:51.899659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Getting quotas for user cc0be0ed857d4c96b26724144e20d766 and project ad4d1fc14f404932ab515a6a4c5a3048. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:58:51.998918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:58:52.002188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aec89406-be8e-46e1-ab1c-8deca053880b',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:58:52.171591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:52.178024 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:52.210106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e355d71-36b9-4419-910b-f7667f68443c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.384384 Oct 24 08:58:52.231777 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 870/1669] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:51 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:52.251769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:52.255666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:52.279158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34f7b326-7fac-4946-9332-1594155a33f3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.158611 Oct 24 08:58:52.280069 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 800/1670] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 08:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 08:58:52.292789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dcc9b022-1802-476c-8825-c02e676f3440 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab4f7280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:52.310427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:52.310997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:52.311360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:52.312070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:52.312527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:52.312952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:52.363263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dcc9b022-1802-476c-8825-c02e676f3440 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.081139 Oct 24 08:58:52.368504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 801/1671] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:52 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:52.392091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e33fbb8-3708-4218-b7e3-4d947aa0218c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:52.395403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e33fbb8-3708-4218-b7e3-4d947aa0218c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:52.597387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e33fbb8-3708-4218-b7e3-4d947aa0218c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:52.613983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e33fbb8-3708-4218-b7e3-4d947aa0218c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:52.619221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e33fbb8-3708-4218-b7e3-4d947aa0218c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:52.622984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e33fbb8-3708-4218-b7e3-4d947aa0218c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1103 microversion: 2.25 time: 0.245701 Oct 24 08:58:52.625364 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 802/1672] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:52 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1103 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:52.885681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:52.904652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5177d1ff-0fb6-42e7-9034-743b1eb3bcee tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.670322 Oct 24 08:58:52.905392 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 871/1673] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:52 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:53.238252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:53.239844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:53.276940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:53.286092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:53.289904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:53.290964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:53.292418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:53.295966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:53.385160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b658b1b-6cfe-481a-b654-49c7779a8b27 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0cf550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:53.480320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b658b1b-6cfe-481a-b654-49c7779a8b27 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.099911 Oct 24 08:58:53.481234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 872/1674] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:53 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:53.533369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:53.546566 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-09ba458b-87a9-4d74-bd7a-3b6868573f41 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.312184 Oct 24 08:58:53.550068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 803/1675] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:53 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:53.648429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:53.649289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:53.658305 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:53.660254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:53.660759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:53.661266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:53.662009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:53.663010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:53.663445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:53.806683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-542103011", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f125655b-1594-4cfb-9de7-d70d5cecfa9c"}], "security_groups": [{"name": "tempest-securitygroup--1707108036"}], "key_name": "tempest-keypair-1130784208", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:53.986656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] validate_networks() for [('f125655b-1594-4cfb-9de7-d70d5cecfa9c', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:58:54.101289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:54.120653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:54.122970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:54.127354 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0449bf11-45d3-4f9b-a207-78b16d159210 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1184 microversion: 2.25 time: 0.483030 Oct 24 08:58:54.132632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 873/1676] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:53 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1184 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:54.141436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:54.152185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:54.179694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:54.187770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:54.188608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:54.190735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:54.192772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:54.193328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:54.637091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:54.689040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-263d5ff4-0e69-438c-b931-7095629d84f8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.555070 Oct 24 08:58:54.707738 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 874/1677] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:54 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:54.734307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6dd5a36-2072-4069-b9fa-66861d42dd45 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0b0700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:54.908847 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6dd5a36-2072-4069-b9fa-66861d42dd45 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.199431 Oct 24 08:58:54.942388 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 875/1678] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:54 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:54.971835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:54.972583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:55.018772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.019190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.019635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.022560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.024962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.025536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.161844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:58:55.163444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:58:55.164081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:58:55.164659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:58:55.165263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:58:55.190955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.193368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.195020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.195985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.198291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.198951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.262935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:55.264702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:58:55.273465 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c986dbb7-20e6-4f24-a39f-23096e2c0636 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.326579 Oct 24 08:58:55.273814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Getting quotas for user 7e709503bbff4c239491b0f109673264 and project b90fabc24c5d4f509e45e0eec0b323a7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:58:55.276261 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 876/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:54 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:55.301626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:58:55.307031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:58:55.320953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:55.321606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:55.352289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.355142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.355625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.360730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.362018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.362475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.413703 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f8946e9-d6cb-4d5c-8023-dafaf4831e12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.612033 Oct 24 08:58:55.415106 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 804/1680] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:58:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:58:55.427870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66f84885-682c-442d-99f2-11dc3c002467 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:55.429535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-66f84885-682c-442d-99f2-11dc3c002467 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:55.610008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-66f84885-682c-442d-99f2-11dc3c002467 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:55.619762 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-66f84885-682c-442d-99f2-11dc3c002467 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1245 microversion: 2.1 time: 0.197306 Oct 24 08:58:55.645365 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 805/1681] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:55 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1245 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:55.720431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:55.721384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:55.738391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.739329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.739997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.744535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:55.745647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:55.746312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:55.879325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:55.899000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:55.903735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:55.915349 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b46fa99d-e49a-49af-8976-a15fa9e32652 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1250 microversion: 2.25 time: 0.602947 Oct 24 08:58:55.916713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 877/1682] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:55 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1250 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:58:55.940002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b7e8081-24eb-4529-a4d0-290688c919cb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0cfb80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:56.051548 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b7e8081-24eb-4529-a4d0-290688c919cb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1414 microversion: 2.1 time: 0.127306 Oct 24 08:58:56.062516 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 878/1683] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:55 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:56.304113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:56.306332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:56.321277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.329770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.330434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.331871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.332727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.333314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.508542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:56.522412 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e15bcfe-344e-456e-9a17-6c53e6bdc57d tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.222930 Oct 24 08:58:56.538077 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 879/1684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:56 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:56.654110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:56.655055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:56.664934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.669440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.670215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.671200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.673019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.675710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.878925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:56.888009 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-432f3925-101c-43d2-b016-2676c991b581 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1249 microversion: 2.1 time: 0.239268 Oct 24 08:58:56.898186 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 880/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:56 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1249 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:56.942281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:56.944095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:56.955946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.956610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.957463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.961882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.963724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.966292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:57.283344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:57.302214 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1a62351-93f5-4416-b549-a4893b85c8b7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 1.585897 Oct 24 08:58:57.309638 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 806/1686] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:55 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:57.326131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed4a4e4c-6361-42c3-b9f1-9ec0097f85d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab3713a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:57.431940 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed4a4e4c-6361-42c3-b9f1-9ec0097f85d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1423 microversion: 2.1 time: 0.121029 Oct 24 08:58:57.435584 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 807/1687] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:57 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1423 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:57.454355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a169e58-418c-437c-a6ec-fb93adafe02c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab820ca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:57.552527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a169e58-418c-437c-a6ec-fb93adafe02c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 200 len: 1423 microversion: 2.1 time: 0.105096 Oct 24 08:58:57.553879 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 808/1688] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:57 2022] GET /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:58:57.558992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:57.560410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:57.572137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:57.572825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:57.574806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:57.575940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:57.579411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:57.586588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:57.805879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:57.827525 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9518f0d5-dc7e-45e5-819d-9f719a11e91e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.272305 Oct 24 08:58:57.828413 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 809/1689] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:57 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:57.833520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e270b4e-9a79-4575-beec-7b3e88ddc3e3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab229ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:58.717226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:58.733625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:58.735094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:58.744048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67764ccc-bdab-446f-879a-08cc68032a46 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 1.803684 Oct 24 08:58:58.765724 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 881/1690] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:56 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:58:58.776671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:58.777809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:58.784834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:58.785714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:58.786488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:58.788074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:58.788709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:58.789348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:58.983434 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e270b4e-9a79-4575-beec-7b3e88ddc3e3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 204 len: 0 microversion: 2.1 time: 1.153682 Oct 24 08:58:58.984578 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 810/1691] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:57 2022] DELETE /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:58.991405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:58.993383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:59.009732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.013577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.014237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.015361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.018872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.019325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.123658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:59.131806 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24c02168-83ad-4579-affe-624b5cf8eb9f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1303 microversion: 2.1 time: 0.360339 Oct 24 08:58:59.132399 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 882/1692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:58 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1303 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:59.158677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:59.159322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:59.177998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.178494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.179126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.180043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.194782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.195255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.421392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:59.436489 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eefc4300-628e-48b4-bb1e-ec373231d515 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 200 len: 1184 microversion: 2.1 time: 0.292418 Oct 24 08:58:59.438907 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 883/1693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:59 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 1184 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:59.444990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:59.445834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:59.453091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.455515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.456206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.457341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.458039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.459516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.527809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:58:59.668552 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-400b45e4-8de0-49f0-943d-eadcef8ff821 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 204 len: 0 microversion: 2.1 time: 0.227212 Oct 24 08:58:59.675288 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 884/1694] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:58:59 2022] DELETE /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:59.733934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:59.741756 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:59.761561 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6364f4d7-d437-4f64-9791-7e9628062ef3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.775070 Oct 24 08:58:59.762183 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 811/1695] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:58 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:59.780259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:59.782158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:59.801864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.802374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.803388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.811912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.812407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.816688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.832539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1741958163", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "62c56d9c-5126-43a0-b067-60873881adab"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:59.944784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] validate_networks() for [('62c56d9c-5126-43a0-b067-60873881adab', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:59:00.750242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:00.767243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:00.781440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:00.783364 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8117ad8-c56b-4599-895d-e6b3342be76d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 1.008117 Oct 24 08:59:00.786166 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 885/1696] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:58:59 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:00.800962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:00.802112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:00.819276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:00.820043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:00.822661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:00.824541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:00.826260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:00.826884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:00.988101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:01.002028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abb1b522-75e8-436e-957a-3abd0defbcb6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1303 microversion: 2.1 time: 0.214441 Oct 24 08:59:01.017360 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 886/1697] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:00 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1303 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:01.017360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:01.017360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:01.029424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.032375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.033166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.034003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.034603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.034901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.094703 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] HTTP exception thrown: Instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb could not be found. Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Request method failure captured: Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb HTTP/1.1 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlIHNW-h5MgMgq8KAhdYRfK8FBbPSAhJsCVgCsET3NCPcdgLLrx6vGirEbNLTHGlcLGmV9ZB34j48bBoZfRB5OEJRPQmPC2Dt_9uNwdfuIsV7oXoGZVd-Pfl7VtyEgx-UoCSBKN_mFxsjTj5M8p4mUrq1iPqeGt3EexWlr4HKDNgJ5k Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bdb9aeb0656347798749c2b8e4434c56"}]}] Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-LiveMigrationTest-476077671 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b43a269fe8b746b88c38db6b9e9bfa12 Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: exception: Instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb could not be found. Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb'} Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb could not be found. Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb could not be found. Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:01.098777 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb could not be found. Oct 24 08:59:01.103927 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:01.109251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Returning 404 to user: Instance bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:01.110492 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d712723-cc62-4850-81b3-a6fef2b81b6c tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb" status: 404 len: 111 microversion: 2.1 time: 0.105843 Oct 24 08:59:01.112108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 887/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:01 2022] GET /compute/v2.1/servers/bcaecfcc-dd39-456a-9e6d-9f3ae8d5a6bb => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:01.132714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:01.135391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:01.158124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.158881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.164016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.165161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.166296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.166996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.571485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:59:01.572047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:59:01.573017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:59:01.573578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:59:01.574096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:59:01.597241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.598110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.602372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.603533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.604179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.605947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.695318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:01.705075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for user ca932e5866274fc78b04689811e72746 and project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:01.744351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:59:01.747858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:59:01.769709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:01.779511 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98ccd925-9fc9-4871-88e6-04e21506afe7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.666033 Oct 24 08:59:01.799507 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 888/1699] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:01 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:01.811845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f672145a-85d2-4b65-8e68-e4b72943c575 req-7bf91445-750c-4f7d-aa61-1ef60c489705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7", "name": "network-vif-unplugged", "status": "completed", "tag": "5e25c21f-a445-4e66-af2e-c8872d507e65"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:01.835751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f672145a-85d2-4b65-8e68-e4b72943c575 req-7bf91445-750c-4f7d-aa61-1ef60c489705 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.839972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f672145a-85d2-4b65-8e68-e4b72943c575 req-7bf91445-750c-4f7d-aa61-1ef60c489705 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.844328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f672145a-85d2-4b65-8e68-e4b72943c575 req-7bf91445-750c-4f7d-aa61-1ef60c489705 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.871768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f672145a-85d2-4b65-8e68-e4b72943c575 req-7bf91445-750c-4f7d-aa61-1ef60c489705 service nova] Creating event network-vif-unplugged:5e25c21f-a445-4e66-af2e-c8872d507e65 for instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 on n-h1-master-1 Oct 24 08:59:01.898923 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f672145a-85d2-4b65-8e68-e4b72943c575 req-7bf91445-750c-4f7d-aa61-1ef60c489705 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088662 Oct 24 08:59:01.900614 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 889/1700] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:01.902224 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3624fed2-3aca-46b9-827d-13f5999d1158 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074941 Oct 24 08:59:01.906819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 812/1701] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:59:01.907988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c884451c-a215-4f5d-8a37-f0fb6855fe99 req-447795f7-d5a7-42aa-bb54-f28507092b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bdec22b-c1b9-43d0-925d-a336000ab69a", "tag": "a0f47b55-e796-401b-be51-e42505fa50e2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:01.918241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "335acad6-5e0b-422a-8c4f-2a5234de1566"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:01.923038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:01.932833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.933542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c884451c-a215-4f5d-8a37-f0fb6855fe99 req-447795f7-d5a7-42aa-bb54-f28507092b27 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.935485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.936583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.938004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.941856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.942913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.945936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c884451c-a215-4f5d-8a37-f0fb6855fe99 req-447795f7-d5a7-42aa-bb54-f28507092b27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.947763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c884451c-a215-4f5d-8a37-f0fb6855fe99 req-447795f7-d5a7-42aa-bb54-f28507092b27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.964082 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:01.991430 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c884451c-a215-4f5d-8a37-f0fb6855fe99 req-447795f7-d5a7-42aa-bb54-f28507092b27 service nova] Creating event network-changed:a0f47b55-e796-401b-be51-e42505fa50e2 for instance 5bdec22b-c1b9-43d0-925d-a336000ab69a on n-h2-master-1 Oct 24 08:59:02.003468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c884451c-a215-4f5d-8a37-f0fb6855fe99 req-447795f7-d5a7-42aa-bb54-f28507092b27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098905 Oct 24 08:59:02.007226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 890/1702] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:02.040178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:02.043384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:02.074428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:02.076322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:02.076793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:02.086798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:02.087352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:02.089758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:02.651415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:02.664586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:02.672779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:02.674404 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b9bf7c9-6e40-4911-9d02-80f411ab262b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 0.665828 Oct 24 08:59:02.675183 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 891/1703] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:02 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:02.688938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d9588d3-056b-4811-9ee0-1eb65c10ff75 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:02.697923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d9588d3-056b-4811-9ee0-1eb65c10ff75 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:02.719091 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d8ab436-bc25-4898-9f33-61c4106fe09c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "POST /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810976 Oct 24 08:59:02.727938 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 813/1704] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 08:59:01 2022] POST /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:02.738578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:02.753403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:02.763137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:02.764046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:02.766756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:02.768162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:02.768926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:02.770293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.332113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:03.344075 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-458e2747-b9b4-4273-9e86-b29e96b4d79b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.614740 Oct 24 08:59:03.350812 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 814/1705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:02 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:03.391506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:03.392131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:03.408425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:03.410962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:03.414168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.415642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:03.416276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:03.416866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.686008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5d9588d3-056b-4811-9ee0-1eb65c10ff75 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:03.698358 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d9588d3-056b-4811-9ee0-1eb65c10ff75 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1208 microversion: 2.1 time: 1.021539 Oct 24 08:59:03.699526 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 892/1706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:02 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1208 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:03.806546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:03.833659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d73d2e51-b074-4301-803c-38eb71b5e708 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.481362 Oct 24 08:59:03.839883 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 815/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:03 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:03.848338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:03.849444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:03.860749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:03.861699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:03.862387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.863392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:03.864216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:03.864855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.977937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e263c886-8416-4566-ab32-ddf775ade5c6 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8daafba040>, body: {"keypair": {"name": "tempest-keypair-916500620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOokUp+IYmF4vL3mKNhMwmAxAkfppmv9IZYkiku9v6v3BLm5gjOa14Kywbhf0jg5WpQMBP7+1iDgSHfYEQ/yvC8Fgq8MCUP5iICpzYkI8TloN7aw8/yoTlG+8S3lUKYNRA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:03.995959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e263c886-8416-4566-ab32-ddf775ade5c6 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:04.002091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e263c886-8416-4566-ab32-ddf775ade5c6 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:04.032480 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e263c886-8416-4566-ab32-ddf775ade5c6 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.331664 Oct 24 08:59:04.040438 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 893/1708] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 340 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 08:59:04.047170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f377799-8f62-442c-9d27-14ba018f07b0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab005040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.057947 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f377799-8f62-442c-9d27-14ba018f07b0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-916500620" status: 200 len: 512 microversion: 2.2 time: 0.015673 Oct 24 08:59:04.065674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 894/1709] 10.222.0.25 () {60 vars in 1255 bytes} [Mon Oct 24 08:59:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-916500620 => generated 512 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:04.072090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f24b850-52da-4b59-9f45-2ea364d54fca tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab0a2a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.110793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f24b850-52da-4b59-9f45-2ea364d54fca tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916500620" status: 204 len: 0 microversion: 2.2 time: 0.043396 Oct 24 08:59:04.111812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 895/1710] 10.222.0.25 () {60 vars in 1258 bytes} [Mon Oct 24 08:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916500620 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:04.131087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62a10e32-cffd-4764-b3a6-fad55d32a05c tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab10c310>, body: {"keypair": {"name": "tempest-keypair-1902574951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9AuXmr8+b5J0Affk4fMHM2+4W/CP7X6XTrjuenF8zNzA6qqt3ag8fPW9yTc3rDbkzNcKzbCxM+tnvFueu+SDPYxcE3N2/b+w4EU3QAAenuKZ30eajUDxS9Wtzek9mOww=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:04.170573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-62a10e32-cffd-4764-b3a6-fad55d32a05c tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:04.186028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-62a10e32-cffd-4764-b3a6-fad55d32a05c tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:04.241378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62a10e32-cffd-4764-b3a6-fad55d32a05c tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.119930 Oct 24 08:59:04.248530 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 896/1711] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 08:59:04.253761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:04.256033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a61fb89-1b7e-4a5f-8580-7e763c9f2853 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab0b7820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.273443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:04.278404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:04.280952 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9be3344d-06ea-4858-a0bf-87fdfca64610 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 0.438765 Oct 24 08:59:04.283821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 816/1712] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:03 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:04.311106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a61fb89-1b7e-4a5f-8580-7e763c9f2853 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902574951" status: 204 len: 0 microversion: 2.2 time: 0.060794 Oct 24 08:59:04.312421 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 897/1713] 10.222.0.25 () {60 vars in 1261 bytes} [Mon Oct 24 08:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902574951 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:04.323267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bd2a18c-a753-4ba6-b8a1-15a4a44475b4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab1f9dc0>, body: {"keypair": {"name": "tempest-keypair-368617039", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:04.335147 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:04.351353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5bd2a18c-a753-4ba6-b8a1-15a4a44475b4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:04.358374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5bd2a18c-a753-4ba6-b8a1-15a4a44475b4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:04.378502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.379480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:04.391602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.398070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.399121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:04.400230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.403311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.404321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:04.424860 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bd2a18c-a753-4ba6-b8a1-15a4a44475b4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.106325 Oct 24 08:59:04.428101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 817/1714] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:04 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 08:59:04.448386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99c28a0e-d323-474b-ae19-55c6953029ca tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8daba1e310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.492505 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99c28a0e-d323-474b-ae19-55c6953029ca tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368617039" status: 204 len: 0 microversion: 2.2 time: 0.058711 Oct 24 08:59:04.493020 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 818/1715] 10.222.0.25 () {60 vars in 1258 bytes} [Mon Oct 24 08:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368617039 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:59:04.516883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85242cf3-2ba9-4606-9a1a-222a9df2f0d0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab3710d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-122016443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwWHzFZ8n57sAbEm+pV4g1REuLgPzh3wQTWVOHcHixQUyQRo9gY9qC+d1THpM+nGNhyVrudbh672TZVwtoPTQq3R1Xh125Y5hjvguOgWc4Wezma+Kub9EZYrzUxe5HrOQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:04.559898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-85242cf3-2ba9-4606-9a1a-222a9df2f0d0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:04.567934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-85242cf3-2ba9-4606-9a1a-222a9df2f0d0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:04.607339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85242cf3-2ba9-4606-9a1a-222a9df2f0d0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.104350 Oct 24 08:59:04.610904 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 819/1716] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 08:59:04.624070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8b78c8a-ca3b-410e-8238-293dc41aa8dd tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab4f7160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-409816339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMfctFSkI+OYHHCv8ntESFDbpjrzQ/ZWQ2iCPbFKA7rIvw3zF329LuKsTVe+9+9qM7XwMzGpjvwwUz0nl7pu+OBgF3PmaWP12/sxLuA0Hk9ernsEKoCQYa+XBtlsNAgyg=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:04.675636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a8b78c8a-ca3b-410e-8238-293dc41aa8dd tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:04.684615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a8b78c8a-ca3b-410e-8238-293dc41aa8dd tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:04.717123 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8b78c8a-ca3b-410e-8238-293dc41aa8dd tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.098440 Oct 24 08:59:04.718131 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 820/1717] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 24 08:59:04.723976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6f9e2fc4-e09d-4765-8a0f-eec198c7f801 req-9d223e8a-bc63-4bc4-9cfe-458df2a562dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7", "name": "network-vif-deleted", "tag": "5e25c21f-a445-4e66-af2e-c8872d507e65"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:04.737897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6f9e2fc4-e09d-4765-8a0f-eec198c7f801 req-9d223e8a-bc63-4bc4-9cfe-458df2a562dd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.738383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6f9e2fc4-e09d-4765-8a0f-eec198c7f801 req-9d223e8a-bc63-4bc4-9cfe-458df2a562dd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.739225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6f9e2fc4-e09d-4765-8a0f-eec198c7f801 req-9d223e8a-bc63-4bc4-9cfe-458df2a562dd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:04.755226 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6f9e2fc4-e09d-4765-8a0f-eec198c7f801 req-9d223e8a-bc63-4bc4-9cfe-458df2a562dd service nova] Creating event network-vif-deleted:5e25c21f-a445-4e66-af2e-c8872d507e65 for instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 on n-h1-master-1 Oct 24 08:59:04.765677 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6f9e2fc4-e09d-4765-8a0f-eec198c7f801 req-9d223e8a-bc63-4bc4-9cfe-458df2a562dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045705 Oct 24 08:59:04.766848 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 821/1718] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:04.777869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.778476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:04.801776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.802281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.802871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:04.807449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.808116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.808587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:04.925068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:04.934879 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e257854e-47f7-42c9-81aa-6c32309bc632 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.563603 Oct 24 08:59:04.941928 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 898/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:04 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:04.947628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-295bf58f-bff1-4c33-9aea-dc1c57a8f9fc tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab005670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-178815084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEMbv5WsXXI78HOH4FUPPGbOclev1zmf5sYqrrxz8hYTCZfq5QsSihdqbocgs0pynGJlZjerw388U6F3J0/GQgvjVsy7KvnfRGgxo+5HpHdU3zqF2cNsVF2y0tsnev6IA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:04.995699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-295bf58f-bff1-4c33-9aea-dc1c57a8f9fc tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:05.013233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-295bf58f-bff1-4c33-9aea-dc1c57a8f9fc tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:05.065951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-295bf58f-bff1-4c33-9aea-dc1c57a8f9fc tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.122521 Oct 24 08:59:05.066737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 899/1720] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 08:59:05.082091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:05.084426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.087921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:05.097175 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0710f96-3738-48f0-9092-acd4b6619c11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1266 microversion: 2.1 time: 0.327726 Oct 24 08:59:05.109075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:05.109964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:05.112346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:05.113391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:05.120643 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 822/1721] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:04 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:05.122829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:05.123739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:05.134629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-645bb7aa-2e79-4722-ab4b-cb22ae34cdd9 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab9904c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.159402 n-d-master-1 devstack@n-api.service[126919]: WARNING oslo_db.sqlalchemy.utils [None req-645bb7aa-2e79-4722-ab4b-cb22ae34cdd9 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 08:59:05.175421 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-645bb7aa-2e79-4722-ab4b-cb22ae34cdd9 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.053279 Oct 24 08:59:05.178623 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 823/1722] 10.222.0.25 () {60 vars in 1177 bytes} [Mon Oct 24 08:59:05 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:05.198105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-762cfa30-5624-4415-9aef-53ee9f017cd0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab3c50d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.242249 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-762cfa30-5624-4415-9aef-53ee9f017cd0 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-178815084" status: 204 len: 0 microversion: 2.2 time: 0.058319 Oct 24 08:59:05.243511 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 824/1723] 10.222.0.25 () {60 vars in 1318 bytes} [Mon Oct 24 08:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-178815084 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:05.251934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-041cbae5-97a8-484e-97c1-1f77c3ebffca tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab820820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.295591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-041cbae5-97a8-484e-97c1-1f77c3ebffca tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-409816339" status: 204 len: 0 microversion: 2.2 time: 0.047420 Oct 24 08:59:05.299619 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 825/1724] 10.222.0.25 () {60 vars in 1318 bytes} [Mon Oct 24 08:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-409816339 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:59:05.305067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1531921b-3e51-47fc-b1f7-79e8d842508a tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab361a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.343752 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1531921b-3e51-47fc-b1f7-79e8d842508a tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-122016443" status: 204 len: 0 microversion: 2.2 time: 0.042969 Oct 24 08:59:05.351397 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 826/1725] 10.222.0.25 () {60 vars in 1318 bytes} [Mon Oct 24 08:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-122016443 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:05.356410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.357031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:05.381974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:05.382487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:05.382938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:05.383661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:05.384124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:05.384566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:05.668039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:05.693045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:05.700553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:05.718455 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d9a1bf0-0ea9-4ff7-91cb-9516d82d8797 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 0.354437 Oct 24 08:59:05.719110 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 827/1726] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:05 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:05.735014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0b2f06b-71c9-4c03-9997-65a1470adb9f tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab5b3ca0>, body: {"keypair": {"name": "tempest-keypair-398922209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSwXz0zTq+Xj1BU0eef+twThFPUJRJ3pKJZktCGCq/FAoxr+cIIeAG9aXxTAFfcppv2EJk08TmtdYqWAgX7souww2HNqa1meSWBb8ExoYVgR3B6Rhn5LZvlBOfAPdbaIA=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:05.779857 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c0b2f06b-71c9-4c03-9997-65a1470adb9f tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:05.788252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c0b2f06b-71c9-4c03-9997-65a1470adb9f tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:05.791844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:05.807760 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20a06e7d-44e0-4705-a50a-e9845509ba7a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.730731 Oct 24 08:59:05.824165 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 900/1727] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:05 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:05.842283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0b2f06b-71c9-4c03-9997-65a1470adb9f tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.120054 Oct 24 08:59:05.845702 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 828/1728] 10.222.0.25 () {62 vars in 1199 bytes} [Mon Oct 24 08:59:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 08:59:05.855138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e9f8188-c732-4ffb-b23a-912c9f5726d4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab0cfb80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.874844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e9f8188-c732-4ffb-b23a-912c9f5726d4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-398922209" status: 200 len: 512 microversion: 2.2 time: 0.023919 Oct 24 08:59:05.878997 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 901/1729] 10.222.0.25 () {60 vars in 1255 bytes} [Mon Oct 24 08:59:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-398922209 => generated 512 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:05.890606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-513f4297-47fb-4c85-8cb9-c368e9a28286 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab1f9310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.897132 n-d-master-1 devstack@n-api.service[126919]: WARNING oslo_db.sqlalchemy.utils [None req-513f4297-47fb-4c85-8cb9-c368e9a28286 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 08:59:05.912590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-513f4297-47fb-4c85-8cb9-c368e9a28286 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.022722 Oct 24 08:59:05.916202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 829/1730] 10.222.0.25 () {60 vars in 1177 bytes} [Mon Oct 24 08:59:05 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:05.927342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77d21bb0-34c4-459c-bd9b-4ab7a1c2bd18 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab0b0280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.968747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:05.969578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:05.972282 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77d21bb0-34c4-459c-bd9b-4ab7a1c2bd18 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398922209" status: 204 len: 0 microversion: 2.2 time: 0.051066 Oct 24 08:59:05.976962 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 902/1731] 10.222.0.25 () {60 vars in 1258 bytes} [Mon Oct 24 08:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398922209 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:05.989839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:05.999010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Action: 'create', calling method: .version_select at 0x7f8dab2ce670>, body: {"keypair": {"name": "tempest-keypair-1557671156", "type": "x509"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:05.999786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.001221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:06.005004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:06.005806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.006489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:06.025289 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:06.051499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:06.076381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:06.115490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.processutils [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp42ozc4ew/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp42ozc4ew/temp.key -subj /CN=06e8633f24fd4e06b3a249c19b144604 -extensions v3_req_client {{(pid=126920) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 24 08:59:06.506094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:06.519840 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a59dd062-0f28-46f0-8511-8e45e36e63e8 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.553912 Oct 24 08:59:06.525734 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 830/1732] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:05 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:06.542738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:06.544299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:06.559934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:06.562138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.563868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:06.564946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:06.567405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.568642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.030049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:07.040869 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43ede086-9f46-43b4-881f-e257688b535c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.512775 Oct 24 08:59:07.045150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 831/1733] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:06 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:07.062521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:07.063479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:07.095491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.095904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.096341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.097053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.109718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.110270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.137435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.processutils [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp42ozc4ew/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp42ozc4ew/temp.key -subj /CN=06e8633f24fd4e06b3a249c19b144604 -extensions v3_req_client" returned: 0 in 1.021s {{(pid=126920) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 24 08:59:07.139717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.processutils [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp42ozc4ew/temp.key -password pass: {{(pid=126920) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 24 08:59:07.208588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.processutils [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp42ozc4ew/temp.key -password pass:" returned: 0 in 0.068s {{(pid=126920) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 24 08:59:07.281255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:07.298466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Getting quotas for user 06e8633f24fd4e06b3a249c19b144604 and project 11b3b6dbce33484a949b672037a86f36. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:07.353099 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d534c03-6d34-437b-9b63-d2276a7a2ea4 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.370694 Oct 24 08:59:07.354193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 903/1734] 10.222.0.25 () {62 vars in 1198 bytes} [Mon Oct 24 08:59:05 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1373 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:07.370790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-4368093a-b7d3-4561-8555-ceda666ca2a4 req-9c883c69-36d9-48f2-a4f7-8a6a460df4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babd364b-580f-4919-a727-94169135c910", "tag": "c18a743d-0e9d-4395-9c8a-1ac34eca9c91"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:07.400253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4368093a-b7d3-4561-8555-ceda666ca2a4 req-9c883c69-36d9-48f2-a4f7-8a6a460df4f7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.400797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4368093a-b7d3-4561-8555-ceda666ca2a4 req-9c883c69-36d9-48f2-a4f7-8a6a460df4f7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.401241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4368093a-b7d3-4561-8555-ceda666ca2a4 req-9c883c69-36d9-48f2-a4f7-8a6a460df4f7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.431049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-4368093a-b7d3-4561-8555-ceda666ca2a4 req-9c883c69-36d9-48f2-a4f7-8a6a460df4f7 service nova] Creating event network-changed:c18a743d-0e9d-4395-9c8a-1ac34eca9c91 for instance babd364b-580f-4919-a727-94169135c910 on n-h2-master-1 Oct 24 08:59:07.444637 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-4368093a-b7d3-4561-8555-ceda666ca2a4 req-9c883c69-36d9-48f2-a4f7-8a6a460df4f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088900 Oct 24 08:59:07.445631 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 904/1735] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:07.451812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:07.452968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:07.464709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.465702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.467576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.468746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.469606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.471794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.898368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:07.907970 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2dd3919-76cd-42f9-b62a-4e491b1fda1c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.460864 Oct 24 08:59:07.930616 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 905/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:07 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:07.937968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e1e553d-fbd7-47f1-bda9-86f43f9f6b0f tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab2ce310>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:07.952328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e1e553d-fbd7-47f1-bda9-86f43f9f6b0f tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1557671156" status: 200 len: 1534 microversion: 2.2 time: 0.020152 Oct 24 08:59:07.953612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 906/1737] 10.222.0.25 () {60 vars in 1258 bytes} [Mon Oct 24 08:59:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1557671156 => generated 1534 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:07.960579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:07.961602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:07.973755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.975558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.978812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.980083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.981777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.983682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.998861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:08.010744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:08.012496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:08.015326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f23481c2-e75f-4ed3-b9cc-860a09d3f38a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 0.968758 Oct 24 08:59:08.015909 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 832/1738] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:07 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:08.051740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94e7bc89-5b4c-4a26-a546-2a87be5c5a12 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab8a41f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:08.067420 n-d-master-1 devstack@n-api.service[126919]: WARNING oslo_db.sqlalchemy.utils [None req-94e7bc89-5b4c-4a26-a546-2a87be5c5a12 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 08:59:08.077619 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94e7bc89-5b4c-4a26-a546-2a87be5c5a12 tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.037255 Oct 24 08:59:08.078221 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 833/1739] 10.222.0.25 () {60 vars in 1177 bytes} [Mon Oct 24 08:59:08 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:08.089575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:08.090192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:08.113346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:08.120796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:08.121811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:08.122999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:08.123717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:08.124383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:08.462759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:08.474901 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b5d3940-971b-4c70-b29d-c627b9e15d36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.388835 Oct 24 08:59:08.477901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 834/1740] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:08 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:08.482592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:08.496341 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8213a70-6596-43e5-972f-0616ff35637d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.541348 Oct 24 08:59:08.499476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 907/1741] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:07 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:08.503414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84f200d8-d86e-4e02-b824-f6b1e5d4ff8d tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] Calling method '.version_select at 0x7f8dab229b80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:08.573591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84f200d8-d86e-4e02-b824-f6b1e5d4ff8d tempest-KeyPairsV22TestJSON-2076059846 tempest-KeyPairsV22TestJSON-2076059846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557671156" status: 204 len: 0 microversion: 2.2 time: 0.086573 Oct 24 08:59:08.576574 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 835/1742] 10.222.0.25 () {60 vars in 1261 bytes} [Mon Oct 24 08:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557671156 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:08.709844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-68991b6d-8e98-4222-a567-56586a83e5fc req-1e804472-0135-4051-9d1e-c01172435ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da9c88a-b3be-4eef-aa43-aa08d5f3a59a", "tag": "8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:08.734123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68991b6d-8e98-4222-a567-56586a83e5fc req-1e804472-0135-4051-9d1e-c01172435ce0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:08.736888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68991b6d-8e98-4222-a567-56586a83e5fc req-1e804472-0135-4051-9d1e-c01172435ce0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:08.737674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68991b6d-8e98-4222-a567-56586a83e5fc req-1e804472-0135-4051-9d1e-c01172435ce0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:08.793798 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-68991b6d-8e98-4222-a567-56586a83e5fc req-1e804472-0135-4051-9d1e-c01172435ce0 service nova] Creating event network-changed:8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d for instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a on n-h1-master-1 Oct 24 08:59:08.808269 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-68991b6d-8e98-4222-a567-56586a83e5fc req-1e804472-0135-4051-9d1e-c01172435ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103537 Oct 24 08:59:08.809660 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 908/1743] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:08.932876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:08.933890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:08.946319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:08.950877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:08.952817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:08.954120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:08.956988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:08.959870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:09.048162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:09.049273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:09.066119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:09.073395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:09.074015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:09.076119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:09.077424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:09.080525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:09.405472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:09.414714 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d365ea5b-ae6d-4d41-85cb-fb1f117ea07a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.486440 Oct 24 08:59:09.415297 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 836/1744] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:08 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:09.505181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:09.505883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:09.519102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:09.521654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:09.522155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:09.530609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:09.531197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:09.533571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:09.789645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:09.807186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:09.808746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:09.809928 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad634d92-6b97-4bd8-a967-c54b17ed021a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 0.767355 Oct 24 08:59:09.813724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:09.822976 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ae34cca8-f7ce-4ab7-a8de-a40d765d45d2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.323133 Oct 24 08:59:09.825747 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 909/1745] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:09 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:59:09.840802 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 837/1746] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:09 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:09.841052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:09.841052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:09.841052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:09.841412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:09.841632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:09.842359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:09.842820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:09.843252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.374580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:10.375386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:10.388603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:10.397523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.398105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.402229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.403198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.403753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.404263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.408693 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b96634a-6a1b-4ff3-9362-f9aa4b24e6fb tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.581746 Oct 24 08:59:10.431641 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 910/1747] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:09 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:10.442485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:10.443149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:10.460892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.461422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.463974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:59:10.465050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.466141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.466778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.468028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.607536 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:10.676076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17e1d501-a190-4d06-b252-72d171843dc8 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 204 len: 0 microversion: 2.1 time: 0.305314 Oct 24 08:59:10.677032 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 838/1748] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:59:10 2022] DELETE /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:59:10.691463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:10.692473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:10.708234 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:10.721224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.721970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.723776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.726112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.728267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.729261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.867787 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:10.883484 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-beacd833-b05f-48f0-a595-e8aadde4f3a7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.447746 Oct 24 08:59:10.885248 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 911/1749] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:10 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:10.895086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:10.898569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:10.914522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.917067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.917741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:10.918693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:10.920923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:10.921408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:11.263792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:11.280977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:11.286203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:11.293546 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40d1ae72-b2ff-4991-9460-20c2dced77ae tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1292 microversion: 2.25 time: 0.401988 Oct 24 08:59:11.294821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 912/1750] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:10 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1292 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:11.322127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:11.328791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:11.337259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:11.338146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:11.339802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:11.343437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:11.344143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:11.344752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:11.643477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:11.654529 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd70925d-17cc-40d9-b773-266fb1787299 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1666 microversion: 2.1 time: 0.973302 Oct 24 08:59:11.677599 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 839/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:10 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1666 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:11.704777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:11.707134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:11.713261 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:11.727986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:11.729519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:11.730269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:11.732229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:11.732879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:11.735390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:11.878708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:11.894379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e6bc316-07aa-4834-8417-d4660c645d0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.582830 Oct 24 08:59:11.900381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 913/1752] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:11 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:11.926431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:11.928193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:11.937127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:11.937983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:11.938651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:11.939593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:11.940334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:11.940970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:12.604142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:12.617780 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65b562ce-9103-4391-b11c-eb5b86f0dcd1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.694048 Oct 24 08:59:12.622543 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 914/1753] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:11 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:12.640649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:12.642901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:12.663414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:12.664267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:12.668034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:12.669811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:12.672304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:12.673282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:12.813718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:12.847631 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f373ecca-b23a-4fd5-96a3-8990fef28d2e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 1.162062 Oct 24 08:59:12.862500 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 840/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:11 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:13.202494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Calling method '.version_select at 0x7f8dab48df70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:13.219157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.219851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.220499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.221448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.222200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.222820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.247706 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9914ea4f-5307-4ba3-a057-95ed60089ea0 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.383523 Oct 24 08:59:13.248888 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 841/1755] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:12 2022] GET /compute/v2.1/limits => generated 511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:13.254696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:13.256241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:13.262921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.263802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.264429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.272002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.272802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.273474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.464461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:13.474722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-978fbc4d-8858-4b23-866d-ba19d633948b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1666 microversion: 2.1 time: 0.224523 Oct 24 08:59:13.489358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 842/1756] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:13 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1666 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:13.489358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:13.489358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:13.491551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.492245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.492852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.493907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.494539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.496266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.677921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:13.691182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:13.692706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:13.700837 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8dc508c-ca57-445c-99cf-0b8379a5707f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 1.074159 Oct 24 08:59:13.702717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 915/1757] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:12 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:13.722459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-706058399", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:13.822308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:13.840661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b72c5b7-3b1d-4c51-9c9a-ac2befbcf830 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.361804 Oct 24 08:59:13.840906 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 843/1758] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:13 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:13.859162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:13.859832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:13.865207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:59:13.891041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.891546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.891981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:13.892693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:13.893145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:13.894205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:14.361286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Getting quotas for project 6d9720b209c74e2a884fb61f8a44ab3e. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:14.376727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Getting quotas for user 9f4cab290a6c4c5abe2e096fde3f2653 and project 6d9720b209c74e2a884fb61f8a44ab3e. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:14.417611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Request method failure captured: Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 1751 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlPgCxSNtRthWgkxpN25rwEGlG_6xxRC0eKHMZ2bHF0o3NYpsJyBbhPRaLjJwwIoWpYExc350iTQriGwN9IKtOFNM3Px_jYtLDG2mQskxb5oEQjne6YyVgKVYyEqodtz2L8v_IttPFP1wE3dpDwn9UWxAoOF39ay_4T4qAUsCyRlT2w Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 6d9720b209c74e2a884fb61f8a44ab3e Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-825156838 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d9720b209c74e2a884fb61f8a44ab3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6d9720b209c74e2a884fb61f8a44ab3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d9720b209c74e2a884fb61f8a44ab3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6d9720b209c74e2a884fb61f8a44ab3e"}]}] Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-825156838 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 6d9720b209c74e2a884fb61f8a44ab3e Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-825156838 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-825156838-project Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9f4cab290a6c4c5abe2e096fde3f2653 Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-825156838-project Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-706058399", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:59:14.445957 n-d-master-1 devstack@n-api.service[126920]: exception: Maximum number of metadata items exceeds 128 Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-706058399', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:14.448772 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9251a100-d907-487d-b011-0275092dd841 tempest-AbsoluteLimitsNegativeTestJSON-825156838 tempest-AbsoluteLimitsNegativeTestJSON-825156838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.742558 Oct 24 08:59:14.452804 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 916/1759] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Oct 24 08:59:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 745 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:59:14.454150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:14.454263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:14.454804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:14.460334 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2ff5bc0b-70b1-46dc-9d4c-7a8b49f2fde0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1507 microversion: 2.1 time: 0.610726 Oct 24 08:59:14.464979 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 844/1760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:13 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:14.488862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:14.490743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:14.491754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:14.492698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:14.493227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:14.494137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:14.506349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:14.507794 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:14.520212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:14.521684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:14.522304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:14.523233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:14.523852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:14.524444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:14.806889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:14.817425 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d4a69ed-a7dc-454f-911b-f16dc6b3a155 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1599 microversion: 2.1 time: 0.317174 Oct 24 08:59:14.819782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 845/1761] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:14 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1599 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:14.824772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:14.829477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:14.866487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:14.868610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:14.869397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:14.870868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:14.875069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:14.875648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:15.305524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:15.318659 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-78bb783f-4eb2-401a-b371-c9c23fff6cbe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.869109 Oct 24 08:59:15.335874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 917/1762] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:14 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:15.346460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:15.353133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:15.366706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:15.367544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:15.370157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:15.377583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:15.378298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:15.378917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:15.526475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:15.543338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:15.546852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:15.555511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a84396b-36e6-446b-99a1-f5582b0632c3 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.734107 Oct 24 08:59:15.558980 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 846/1763] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:14 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:15.570669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:15.584533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:15.600503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:15.604804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:15.606789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:15.609884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:15.610866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:15.612907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:15.857931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:15.872995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63b350e9-b7a2-4c86-a53f-b5bfbee63dba tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.534435 Oct 24 08:59:15.874127 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 918/1764] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:15 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:15.886796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f796a3a3-d556-4d1b-a6e1-71c41d7646c0 req-0e0b183b-6795-46ea-9d09-eccfa331bb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a0887e-b5c7-47d7-ad5b-72297f386d40", "name": "network-vif-deleted", "tag": "cdcac286-03e9-4041-84b1-896d805de241"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:15.913836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f796a3a3-d556-4d1b-a6e1-71c41d7646c0 req-0e0b183b-6795-46ea-9d09-eccfa331bb0a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:15.915096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f796a3a3-d556-4d1b-a6e1-71c41d7646c0 req-0e0b183b-6795-46ea-9d09-eccfa331bb0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:15.917066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f796a3a3-d556-4d1b-a6e1-71c41d7646c0 req-0e0b183b-6795-46ea-9d09-eccfa331bb0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:15.952847 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f796a3a3-d556-4d1b-a6e1-71c41d7646c0 req-0e0b183b-6795-46ea-9d09-eccfa331bb0a service nova] Creating event network-vif-deleted:cdcac286-03e9-4041-84b1-896d805de241 for instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 on n-h2-master-1 Oct 24 08:59:15.963524 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f796a3a3-d556-4d1b-a6e1-71c41d7646c0 req-0e0b183b-6795-46ea-9d09-eccfa331bb0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085867 Oct 24 08:59:15.966463 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 919/1765] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:15.986055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:15.986853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:16.002969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.003472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.003916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.006193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.007058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.007747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.080345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.080552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.082675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.083478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lazy-loading 'fault' on Instance uuid 56a0887e-b5c7-47d7-ad5b-72297f386d40 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:16.262447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:16.273871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-290e9029-89a0-4d16-b7bb-ccaffefc70a4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1528 microversion: 2.1 time: 0.711743 Oct 24 08:59:16.274211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:16.276170 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 847/1766] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:15 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1528 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:16.286970 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1703070-7df3-4d07-b994-7513abbc9028 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1325 microversion: 2.1 time: 0.316176 Oct 24 08:59:16.290968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 920/1767] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:15 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1325 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:16.341880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:16.342737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:16.358014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.361194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.363340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.365019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.366207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.367866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.583882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:16.585345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:16.598836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.602794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.603276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.611411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.612437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.613289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.664936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:16.668995 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:16.675436 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64e912d9-408e-4a52-9772-38f8006776b9 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.337375 Oct 24 08:59:16.682166 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 848/1768] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:16 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:16.892681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:16.904871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:16.905714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:16.906158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:16.910263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:16.916400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.916888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.917344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.917509 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7468a740-ffb5-4951-a403-95f9e1284142 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.336615 Oct 24 08:59:16.918051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:16.918501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:16.918921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:16.920337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 921/1769] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:16 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:17.035484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-fb7ee499-565f-480b-b588-0422a9cfa769 req-e8fc8986-6fc4-45fc-8c31-7078f86e497b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babd364b-580f-4919-a727-94169135c910", "name": "network-vif-plugged", "status": "completed", "tag": "c18a743d-0e9d-4395-9c8a-1ac34eca9c91"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:17.066486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fb7ee499-565f-480b-b588-0422a9cfa769 req-e8fc8986-6fc4-45fc-8c31-7078f86e497b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.068632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fb7ee499-565f-480b-b588-0422a9cfa769 req-e8fc8986-6fc4-45fc-8c31-7078f86e497b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.069073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fb7ee499-565f-480b-b588-0422a9cfa769 req-e8fc8986-6fc4-45fc-8c31-7078f86e497b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.122721 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-fb7ee499-565f-480b-b588-0422a9cfa769 req-e8fc8986-6fc4-45fc-8c31-7078f86e497b service nova] Creating event network-vif-plugged:c18a743d-0e9d-4395-9c8a-1ac34eca9c91 for instance babd364b-580f-4919-a727-94169135c910 on n-h2-master-1 Oct 24 08:59:17.135995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-fb7ee499-565f-480b-b588-0422a9cfa769 req-e8fc8986-6fc4-45fc-8c31-7078f86e497b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105326 Oct 24 08:59:17.143589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 922/1770] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:59:17.304621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:17.305737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:17.326642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.330827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.332968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.343843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.347238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.348927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.581535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:17.592742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c69a4e6-08f4-4519-96fd-aa8ae66a8cdd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.691923 Oct 24 08:59:17.593702 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 849/1771] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:16 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:17.618169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:17.619344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:17.626126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.626964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.627639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.628661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.629386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.630078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.653992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:17.666667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fce7eeba-bcb3-43cc-9a5d-8d9728ef88a2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1528 microversion: 2.1 time: 0.366858 Oct 24 08:59:17.675178 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 923/1772] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:17 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:17.706657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:17.707671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:17.715932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.716933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.719764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.720516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lazy-loading 'fault' on Instance uuid 56a0887e-b5c7-47d7-ad5b-72297f386d40 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:17.730212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.731989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.732734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.733760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.737598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.738485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.863675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:17.888340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c60648ca-1f8d-425a-ad57-6108d09f0634 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 200 len: 1325 microversion: 2.1 time: 0.272813 Oct 24 08:59:17.889038 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 850/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:17 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:17.949028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:17.949934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:17.966049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.968316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.968771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:17.969551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:17.972477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:17.973821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:18.021587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:18.049206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4e6e2a6-cb28-42e9-9814-50da3ef53709 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.345273 Oct 24 08:59:18.063111 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 924/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:17 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:18.508970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:18.528558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:18.533103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:18.538152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6b4a4b18-7b98-4490-bda3-b46c4989a359 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.591677 Oct 24 08:59:18.554059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 851/1775] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:17 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:59:18.627253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:18.628794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:18.642617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:18.647312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:18.649968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:18.650954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:18.652045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:18.652650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:18.697699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:18.698621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:18.709951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:18.711585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:18.713632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:18.715080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:18.718597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:18.728406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.039239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:19.048379 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25b6a16d-d419-44ac-9281-14b32c175b63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.354626 Oct 24 08:59:19.050075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 852/1776] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:18 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:19.055200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:19.056040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 56a0887e-b5c7-47d7-ad5b-72297f386d40] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:19.063332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.066107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.068838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.076068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.076931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.078031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.115624 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] HTTP exception thrown: Instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 could not be found. Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Request method failure captured: Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 HTTP/1.1 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIHNW-h5MgMgq8KAhdYRfK8FBbPSAhJsCVgCsET3NCPcdgLLrx6vGirEbNLTHGlcLGmV9ZB34j48bBoZfRB5OEJRPQmPC2Dt_9uNwdfuIsV7oXoGZVd-Pfl7VtyEgx-UoCSBKN_mFxsjTj5M8p4mUrq1iPqeGt3EexWlr4HKDNgJ5k Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bdb9aeb0656347798749c2b8e4434c56"}]}] Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationTest-476077671 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b43a269fe8b746b88c38db6b9e9bfa12 Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 could not be found. Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '56a0887e-b5c7-47d7-ad5b-72297f386d40'} Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 could not be found. Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 could not be found. Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:19.118879 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 could not be found. Oct 24 08:59:19.124876 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:19.126742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Returning 404 to user: Instance 56a0887e-b5c7-47d7-ad5b-72297f386d40 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:19.127917 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eeba1595-da57-4746-8a2b-e303ccd38f67 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40" status: 404 len: 111 microversion: 2.1 time: 0.076557 Oct 24 08:59:19.129001 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 853/1777] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:19 2022] GET /compute/v2.1/servers/56a0887e-b5c7-47d7-ad5b-72297f386d40 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:19.134886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:19.136607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:19.145622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.146762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.147454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.150841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.151550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.155917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.284413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:19.294359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4a030b1-37ed-4ce5-8b60-2231f76bc1d9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.672755 Oct 24 08:59:19.295968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 925/1778] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:18 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:19.310186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c29563ab-e7e4-4c6d-8b5b-ff9c6679047e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '.version_select at 0x7f8dab52f8b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:19.354629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c29563ab-e7e4-4c6d-8b5b-ff9c6679047e tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783171959" status: 202 len: 0 microversion: 2.1 time: 0.057037 Oct 24 08:59:19.361827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 926/1779] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 08:59:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783171959 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:59:19.377550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d68cca76-c7e9-4f7f-ba08-347e31135a14 req-5f7a003f-a372-4185-9142-fb9f0fa25429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c88a-b3be-4eef-aa43-aa08d5f3a59a", "name": "network-vif-plugged", "status": "completed", "tag": "8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:19.424738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d68cca76-c7e9-4f7f-ba08-347e31135a14 req-5f7a003f-a372-4185-9142-fb9f0fa25429 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.431846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d68cca76-c7e9-4f7f-ba08-347e31135a14 req-5f7a003f-a372-4185-9142-fb9f0fa25429 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.432615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d68cca76-c7e9-4f7f-ba08-347e31135a14 req-5f7a003f-a372-4185-9142-fb9f0fa25429 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.458086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:19.488532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d1ac1f3-022a-42c8-a456-ed0e2fa91326 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1371 microversion: 2.1 time: 0.358087 Oct 24 08:59:19.491286 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 854/1780] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:19 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:19.497181 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d68cca76-c7e9-4f7f-ba08-347e31135a14 req-5f7a003f-a372-4185-9142-fb9f0fa25429 service nova] Creating event network-vif-plugged:8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d for instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a on n-h1-master-1 Oct 24 08:59:19.517048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d68cca76-c7e9-4f7f-ba08-347e31135a14 req-5f7a003f-a372-4185-9142-fb9f0fa25429 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153565 Oct 24 08:59:19.523172 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 927/1781] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:19.566254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:19.567198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:19.597241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.599637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.602154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.604131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:19.608374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:19.610018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:19.897738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:19.918360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:19.921576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:19.923090 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8cc5e520-611c-4352-80ea-64e926a46729 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.361241 Oct 24 08:59:19.924477 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 855/1782] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:19 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:20.076915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:20.078095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:20.099310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.101702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.102369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.104325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.106075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.109252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.324918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:20.325894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:20.336746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.341327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.342889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.344676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.348041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.348762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.394595 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:20.638353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:20.649203 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eef99595-6eb5-4b2b-95d3-56c40b5f4a0e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.580243 Oct 24 08:59:20.671770 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 928/1783] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:20 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:20.678385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:20.679008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:20.695045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.695553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.695995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.696731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.697209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.707615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.949716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:20.962396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a6bf7877-7566-4d02-99ae-363ac4910e7b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1563 microversion: 2.1 time: 0.289411 Oct 24 08:59:20.963358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 929/1784] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:20 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1563 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:20.977829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:20.978452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:20.994454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.995200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.995636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:20.996349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:20.996808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:20.997227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:21.281020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:21.291263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e118900-ca8f-441f-8a46-f0ebec36e6a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1308 microversion: 2.1 time: 0.972211 Oct 24 08:59:21.300851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 856/1785] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:20 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1308 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:21.313104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:21.327213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:21.360450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:21.364815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:21.370709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:21.372303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:21.377765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:21.378325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:21.674553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:21.688601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:21.690256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:21.694570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c99de0bb-7610-4579-adc5-0c42173e9200 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.730008 Oct 24 08:59:21.698380 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 930/1786] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:20 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:21.712971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:21.713973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:21.723278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:21.725328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:21.726247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:21.728809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:21.729591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:21.734885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:21.803140 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52c8aa00-70e5-4c9f-b52e-e76f0a1b55f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.498994 Oct 24 08:59:21.815691 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 857/1787] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 08:59:21 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-interface => generated 284 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:21.821657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e49ddccb-0875-4871-a971-1a2017a09cb1 req-9905fecc-5ce3-49bb-83ec-475db5be6af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b57e8e-048a-4bcb-b104-f6c0243aa58d", "name": "network-vif-plugged", "status": "completed", "tag": "710188f0-b072-4171-8ddd-37cec90dd9c1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:21.866121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e49ddccb-0875-4871-a971-1a2017a09cb1 req-9905fecc-5ce3-49bb-83ec-475db5be6af8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:21.867631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e49ddccb-0875-4871-a971-1a2017a09cb1 req-9905fecc-5ce3-49bb-83ec-475db5be6af8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:21.869096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e49ddccb-0875-4871-a971-1a2017a09cb1 req-9905fecc-5ce3-49bb-83ec-475db5be6af8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:21.933148 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e49ddccb-0875-4871-a971-1a2017a09cb1 req-9905fecc-5ce3-49bb-83ec-475db5be6af8 service nova] Creating event network-vif-plugged:710188f0-b072-4171-8ddd-37cec90dd9c1 for instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d on n-h2-master-1 Oct 24 08:59:21.954877 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e49ddccb-0875-4871-a971-1a2017a09cb1 req-9905fecc-5ce3-49bb-83ec-475db5be6af8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137487 Oct 24 08:59:21.961073 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 858/1788] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:22.019346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:22.020116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:22.035637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:22.037026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:22.037719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:22.038694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:22.040141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:22.040666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:22.107420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:59:22.329479 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed8433d3-4d3d-4354-a5b6-c218ccfd6148 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 204 len: 0 microversion: 2.1 time: 0.314742 Oct 24 08:59:22.334913 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 859/1789] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:59:22 2022] DELETE /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:22.348902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:22.349971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:22.360001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:22.361122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:22.361774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:22.362701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:22.363418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:22.364121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:22.951062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:22.965888 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7ae63a4-f19d-4550-9b8d-126a06403694 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 1.261512 Oct 24 08:59:22.967162 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 931/1790] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:21 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:22.977401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:22.979549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:23.018411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:23.019399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:23.022772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:23.025143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:23.027884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:23.033092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:23.108860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:23.122869 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2dc51ba8-4f87-4326-92ef-67f2e18a91b4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1487 microversion: 2.1 time: 0.781402 Oct 24 08:59:23.124068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 860/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:22 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1487 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:23.141154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:23.146555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:23.162128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:23.163455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:23.164148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:23.164912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:23.165411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:23.170572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:23.220207 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=44 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:23.242485 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:23.708990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:23.723049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:23.729102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:23.730566 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23f9bf6e-2d38-44a7-9770-80f9e87564ca tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.603490 Oct 24 08:59:23.737449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 861/1792] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:23 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:23.762421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8eb21d1c-c802-422d-907b-0f6846b4726e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:23.782499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8eb21d1c-c802-422d-907b-0f6846b4726e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:23.786456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8eb21d1c-c802-422d-907b-0f6846b4726e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:23.787133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8eb21d1c-c802-422d-907b-0f6846b4726e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:23.789144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:23.806981 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02c6ab15-5e93-41a5-8b88-9ca4206b65ef tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1483 microversion: 2.1 time: 0.837298 Oct 24 08:59:23.839891 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 932/1793] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:22 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1483 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:23.943599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8eb21d1c-c802-422d-907b-0f6846b4726e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Going to try to stop instance {{(pid=126919) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 08:59:24.010573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:24.011609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:24.045346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.045885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.046340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.047426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.047546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.047961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.067704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8eb21d1c-c802-422d-907b-0f6846b4726e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a/action" status: 202 len: 0 microversion: 2.1 time: 0.328665 Oct 24 08:59:24.068634 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 862/1794] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:59:23 2022] POST /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:59:24.078549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f9d85e66-e620-49f5-9a00-66acdd09db8e req-9007e72a-9b3b-48c8-8485-2f83a7e12b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdec22b-c1b9-43d0-925d-a336000ab69a", "name": "network-vif-plugged", "status": "completed", "tag": "a0f47b55-e796-401b-be51-e42505fa50e2"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:24.116810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9d85e66-e620-49f5-9a00-66acdd09db8e req-9007e72a-9b3b-48c8-8485-2f83a7e12b34 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.123841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9d85e66-e620-49f5-9a00-66acdd09db8e req-9007e72a-9b3b-48c8-8485-2f83a7e12b34 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.125822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9d85e66-e620-49f5-9a00-66acdd09db8e req-9007e72a-9b3b-48c8-8485-2f83a7e12b34 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.175815 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f9d85e66-e620-49f5-9a00-66acdd09db8e req-9007e72a-9b3b-48c8-8485-2f83a7e12b34 service nova] Creating event network-vif-plugged:a0f47b55-e796-401b-be51-e42505fa50e2 for instance 5bdec22b-c1b9-43d0-925d-a336000ab69a on n-h2-master-1 Oct 24 08:59:24.187835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f9d85e66-e620-49f5-9a00-66acdd09db8e req-9007e72a-9b3b-48c8-8485-2f83a7e12b34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117427 Oct 24 08:59:24.188621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 863/1795] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:24.196082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:24.202349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:24.222704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.235672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.239618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.240657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.246942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.247733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.398335 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=26 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:24.642329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:24.657880 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42d66999-5fb9-4477-bec6-f35bb06bb8f4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.657989 Oct 24 08:59:24.669787 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 933/1796] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:23 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:24.789022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:24.790403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:24.799221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.800466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.801083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.802041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.802672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.803297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.232770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:25.247396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f6ce370-66e8-4db4-922d-bc087e2366d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 1.052152 Oct 24 08:59:25.248360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 864/1797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:24 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:25.260114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:25.261039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:25.296770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:25.297695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:25.298381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.299378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:25.305075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:25.308468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.403799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:25.420769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:25.422618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:25.424074 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-096033e5-0927-44bb-9edb-6b85bd3f2fee tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1280 microversion: 2.25 time: 0.643258 Oct 24 08:59:25.425979 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 934/1798] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:24 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1280 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:25.678923 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:25.697287 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6be8c26-c43a-4213-a487-ce625da43fe9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 200 len: 1441 microversion: 2.1 time: 0.444484 Oct 24 08:59:25.703490 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 865/1799] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:25 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 1441 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:25.721005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:25.728498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:25.755523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:25.756474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:25.758630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.760815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:25.762231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:25.763593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.973865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7f084644-08c3-4c80-a501-1edf49a9d720"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:25.977508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:25.997140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.001833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.002421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.003262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.007439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.007944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.193290 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] HTTP exception thrown: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Request method failure captured: Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments/335acad6-5e0b-422a-8c4f-2a5234de1566 HTTP/1.1 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 74 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOMajtW4st3INaIvqMDXv8ngUa5EKfqGlLI-Dty9J2is1v1stkNP5UbCeTnjf-rv2NX5oYe6Y3ZvNziKFpdvzpbbP-uiEcAVjTvUQRxgykwX3nQ82KoIWQOIicB6N9-drysb7_q_ZThyxBRWg-qkdR_F5CQG8f2SDOoFjWbz8T8-7M Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 50d8e630279847609d36865cdfb1bf96 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesAdminNegativeTest-851341015 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50d8e630279847609d36865cdfb1bf96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_50d8e630279847609d36865cdfb1bf96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50d8e630279847609d36865cdfb1bf96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/50d8e630279847609d36865cdfb1bf96"}]}] Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesAdminNegativeTest-851341015 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 50d8e630279847609d36865cdfb1bf96 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-851341015 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesAdminNegativeTest-851341015-project-admin Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d0ac6c6a70544337a25ab96d25156a07 Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesAdminNegativeTest-851341015-project-admin Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: {"volumeAttachment": {"volumeId": "7f084644-08c3-4c80-a501-1edf49a9d720"}} Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: exception: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: action_args: {'server_id': 'ffca5715-95e0-4499-a802-9b5e37649ce6', 'id': '335acad6-5e0b-422a-8c4f-2a5234de1566', 'body': {'volumeAttachment': {'volumeId': '7f084644-08c3-4c80-a501-1edf49a9d720'}}} Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. (HTTP 404) (Request-ID: req-41d3e2d8-6d1c-4450-a843-fbc8020c417f) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:59:26.237159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:26.243461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Returning 400 to user: Volume 7f084644-08c3-4c80-a501-1edf49a9d720 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:26.249131 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3dc539f4-8911-4c04-8c3d-c5536aa114b9 tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments/335acad6-5e0b-422a-8c4f-2a5234de1566" status: 400 len: 107 microversion: 2.1 time: 0.717329 Oct 24 08:59:26.254469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 935/1800] 10.222.0.25 () {60 vars in 1433 bytes} [Mon Oct 24 08:59:25 2022] PUT /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments/335acad6-5e0b-422a-8c4f-2a5234de1566 => generated 107 bytes in 724 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 08:59:26.266499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:26.291595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d8aa711f-8aa7-440a-a26c-ad198e477840 req-3607ac83-532d-4c01-a0a3-96b4ac0bda78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fd1ba6-d19b-4759-b494-1f85ffee607e", "name": "network-vif-deleted", "tag": "01b4c797-8d6c-4aed-b6fb-57e62d04db3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:26.295451 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abfb4d11-b49c-4471-a9a3-96fd792d814e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.590216 Oct 24 08:59:26.307819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 866/1801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:25 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:26.351871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:26.353104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:26.367929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d8aa711f-8aa7-440a-a26c-ad198e477840 req-3607ac83-532d-4c01-a0a3-96b4ac0bda78 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.378388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.378884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.379364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.383852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d8aa711f-8aa7-440a-a26c-ad198e477840 req-3607ac83-532d-4c01-a0a3-96b4ac0bda78 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.384519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d8aa711f-8aa7-440a-a26c-ad198e477840 req-3607ac83-532d-4c01-a0a3-96b4ac0bda78 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.393540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.394414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.398113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.417152 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d8aa711f-8aa7-440a-a26c-ad198e477840 req-3607ac83-532d-4c01-a0a3-96b4ac0bda78 service nova] Creating event network-vif-deleted:01b4c797-8d6c-4aed-b6fb-57e62d04db3a for instance 79fd1ba6-d19b-4759-b494-1f85ffee607e on n-h1-master-1 Oct 24 08:59:26.443343 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d8aa711f-8aa7-440a-a26c-ad198e477840 req-3607ac83-532d-4c01-a0a3-96b4ac0bda78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186390 Oct 24 08:59:26.444381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 936/1802] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:26.450121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:26.454482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:26.475726 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:26.477648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.478420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.479080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.480010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.480704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.481443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.705462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lazy-loading 'services' on Instance uuid ffca5715-95e0-4499-a802-9b5e37649ce6 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:26.971442 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c11f18b-f4ff-4c60-8d4c-4a2e817d5d0a tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments/335acad6-5e0b-422a-8c4f-2a5234de1566" status: 202 len: 0 microversion: 2.1 time: 0.525369 Oct 24 08:59:26.973515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 937/1803] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 08:59:26 2022] DELETE /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments/335acad6-5e0b-422a-8c4f-2a5234de1566 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:59:27.000365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.005653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.035614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:27.046789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.057681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.058174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a5b8602-5bd2-41f8-ab4b-6e39799118be tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 0.730266 Oct 24 08:59:27.058882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.059798 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 867/1804] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:26 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:27.061759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.062547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.064678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.068812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.088061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 79fd1ba6-d19b-4759-b494-1f85ffee607e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.120165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.120890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.122711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.123516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.130101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.130648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.180926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] HTTP exception thrown: Instance 79fd1ba6-d19b-4759-b494-1f85ffee607e could not be found. Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Request method failure captured: Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e HTTP/1.1 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIHNW-h5MgMgq8KAhdYRfK8FBbPSAhJsCVgCsET3NCPcdgLLrx6vGirEbNLTHGlcLGmV9ZB34j48bBoZfRB5OEJRPQmPC2Dt_9uNwdfuIsV7oXoGZVd-Pfl7VtyEgx-UoCSBKN_mFxsjTj5M8p4mUrq1iPqeGt3EexWlr4HKDNgJ5k Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bdb9aeb0656347798749c2b8e4434c56"}]}] Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationTest-476077671 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b43a269fe8b746b88c38db6b9e9bfa12 Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 79fd1ba6-d19b-4759-b494-1f85ffee607e could not be found. Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '79fd1ba6-d19b-4759-b494-1f85ffee607e'} Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79fd1ba6-d19b-4759-b494-1f85ffee607e could not be found. Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79fd1ba6-d19b-4759-b494-1f85ffee607e could not be found. Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:27.185424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79fd1ba6-d19b-4759-b494-1f85ffee607e could not be found. Oct 24 08:59:27.190720 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:27.191571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Returning 404 to user: Instance 79fd1ba6-d19b-4759-b494-1f85ffee607e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:27.194007 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d697029-e15d-4b1f-91a4-3d6eccaf4f3b tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e" status: 404 len: 111 microversion: 2.1 time: 0.132442 Oct 24 08:59:27.197283 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 868/1805] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:27 2022] GET /compute/v2.1/servers/79fd1ba6-d19b-4759-b494-1f85ffee607e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:27.202763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.205162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.212227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.212884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.213455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.214367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.215013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.215544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.251125 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9b0247f-3851-4bbd-9096-082075626a22 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052385 Oct 24 08:59:27.256681 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 869/1806] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:27 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:27.257665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.258282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.264687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.265448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.266011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.266855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.267710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.267940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.314902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:59:27.453557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9fef10bc-3199-43d2-95ab-1a69b6fef8d9 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 204 len: 0 microversion: 2.1 time: 0.199736 Oct 24 08:59:27.454743 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 870/1807] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:59:27 2022] DELETE /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:27.467186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.467942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.482326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.482956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.483476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.488439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.488947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.490617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.524984 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:27.574650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:27.586010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:27.591291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:27.594336 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe5bc8f9-6f44-4816-8d04-31364f02ab88 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1476 microversion: 2.25 time: 0.617638 Oct 24 08:59:27.597804 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 938/1808] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:26 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1476 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:27.609237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.611440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.630479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.634203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.635005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.636025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.637914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.641135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.775507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:27.786614 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46b40e8a-bc1f-4f18-91bf-7aa89e1f58f2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.329261 Oct 24 08:59:27.802862 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 871/1809] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:27 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:28.273583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:28.274273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:28.287907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.288401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.289270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:28.289579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.290036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.303113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:28.482660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:28.490663 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d51c331-5a50-4f21-80a3-38d7953c919a tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1497 microversion: 2.1 time: 0.891438 Oct 24 08:59:28.506386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 939/1810] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:27 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1497 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:28.523763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:28.524388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:28.562835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.563209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.563633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:28.564345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.564799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.565219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:28.644991 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:28.841398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 5bdec22b-c1b9-43d0-925d-a336000ab69a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:28.875216 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64550696-9565-4927-a81e-656844004030 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1968 microversion: 2.25 time: 1.070473 Oct 24 08:59:28.883147 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 872/1811] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:27 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1968 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:28.894986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:28.906199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:28.919204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.920864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.923424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:28.924170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.924639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.925063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:29.010526 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5620bc50-d903-45b4-8202-2cdf4b4fcf51 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125979 Oct 24 08:59:29.015820 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 873/1812] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:28 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:29.020808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a03b9994-15fb-458d-97e9-0d614377ced0 req-d2f0c471-d714-465f-838d-d412cc0a80e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babd364b-580f-4919-a727-94169135c910", "tag": "c18a743d-0e9d-4395-9c8a-1ac34eca9c91"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:29.049256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a03b9994-15fb-458d-97e9-0d614377ced0 req-d2f0c471-d714-465f-838d-d412cc0a80e2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:29.062953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a03b9994-15fb-458d-97e9-0d614377ced0 req-d2f0c471-d714-465f-838d-d412cc0a80e2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:29.063411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a03b9994-15fb-458d-97e9-0d614377ced0 req-d2f0c471-d714-465f-838d-d412cc0a80e2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:29.093777 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a03b9994-15fb-458d-97e9-0d614377ced0 req-d2f0c471-d714-465f-838d-d412cc0a80e2 service nova] Creating event network-changed:c18a743d-0e9d-4395-9c8a-1ac34eca9c91 for instance babd364b-580f-4919-a727-94169135c910 on n-h2-master-1 Oct 24 08:59:29.110104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a03b9994-15fb-458d-97e9-0d614377ced0 req-d2f0c471-d714-465f-838d-d412cc0a80e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092728 Oct 24 08:59:29.113620 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 874/1813] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:29.132517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:29.134689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:29.154715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:29.162831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:29.163581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:29.164508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:29.164970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:29.165423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:29.708847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:29.719151 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68dbe38a-4380-4fff-8cf7-8ac544e777fe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.604006 Oct 24 08:59:29.722064 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 875/1814] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:29 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:29.732272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:29.739321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:29.749726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:29.757255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:29.758021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:29.758965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:29.759713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:29.760332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.075854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 5bdec22b-c1b9-43d0-925d-a336000ab69a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:30.094965 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34e25731-f214-402f-8e08-97da3968e566 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1968 microversion: 2.25 time: 0.370922 Oct 24 08:59:30.099822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 876/1815] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:29 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1968 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:30.104947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:30.106043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:30.113746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.115090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.115956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.116948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.117680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.118354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.190263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.198741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.203611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.204146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lazy-loading 'fault' on Instance uuid 61ae30e9-993b-4756-97fd-4e52861acaa3 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:30.303613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43a269fe8b746b88c38db6b9e9bfa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb9aeb0656347798749c2b8e4434c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:30.322221 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1dd6c62a-140b-4b48-8367-2e5d192d9730 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 200 len: 1300 microversion: 2.1 time: 0.216410 Oct 24 08:59:30.323611 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 877/1816] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:30 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 1300 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:30.328900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:30.335704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:30.355770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.356489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.357048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.361572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.365913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.366498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.495728 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-311e7bd7-2816-4f48-b85a-a948228911c9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170899 Oct 24 08:59:30.496326 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 878/1817] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:30 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:30.503745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:30.525068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:30.537945 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41fd0c83-6fa0-4e0d-8f96-2542c106627b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 2.021992 Oct 24 08:59:30.538924 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 940/1818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:28 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:30.542477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.543054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.543502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.544255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.544718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.545147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.594514 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:30.653910 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99ddcaac-5f95-4948-9544-e0092807048e tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.156440 Oct 24 08:59:30.658025 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 879/1819] 10.222.0.25 () {60 vars in 1217 bytes} [Mon Oct 24 08:59:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:59:30.670857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:30.674058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:30.695842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.702937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.706554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.707371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.710480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.711419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.748185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:30.749491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:30.750201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'flavor' on Instance uuid 5bdec22b-c1b9-43d0-925d-a336000ab69a {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:30.759642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.761408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.761902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.762636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.765921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.766682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.768437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Going to try to live migrate instance to n-h1-master-1 {{(pid=126920) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 08:59:31.237925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:31.256428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14ad8d74-616a-473b-be33-a12a392ae66e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.512188 Oct 24 08:59:31.257040 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 880/1820] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:30 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:31.278586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6e7efd9a-91f0-4aa1-b9a1-66cfc5ff5440 req-44d3cf76-41a4-4709-9159-ff45d2995d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ae30e9-993b-4756-97fd-4e52861acaa3", "name": "network-vif-deleted", "tag": "5e0ef215-44b7-4229-a74d-7a8b0e943828"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:31.336296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e7efd9a-91f0-4aa1-b9a1-66cfc5ff5440 req-44d3cf76-41a4-4709-9159-ff45d2995d89 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.339828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e7efd9a-91f0-4aa1-b9a1-66cfc5ff5440 req-44d3cf76-41a4-4709-9159-ff45d2995d89 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.342187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e7efd9a-91f0-4aa1-b9a1-66cfc5ff5440 req-44d3cf76-41a4-4709-9159-ff45d2995d89 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.371453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6e7efd9a-91f0-4aa1-b9a1-66cfc5ff5440 req-44d3cf76-41a4-4709-9159-ff45d2995d89 service nova] Creating event network-vif-deleted:5e0ef215-44b7-4229-a74d-7a8b0e943828 for instance 61ae30e9-993b-4756-97fd-4e52861acaa3 on n-h1-master-1 Oct 24 08:59:31.379156 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6e7efd9a-91f0-4aa1-b9a1-66cfc5ff5440 req-44d3cf76-41a4-4709-9159-ff45d2995d89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103414 Oct 24 08:59:31.383007 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 881/1821] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:31.396869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:31.397739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] [instance: 61ae30e9-993b-4756-97fd-4e52861acaa3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:31.412178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.412686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.413123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.413867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.414322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.414747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.452851 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] HTTP exception thrown: Instance 61ae30e9-993b-4756-97fd-4e52861acaa3 could not be found. Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Request method failure captured: Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 HTTP/1.1 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlIHNW-h5MgMgq8KAhdYRfK8FBbPSAhJsCVgCsET3NCPcdgLLrx6vGirEbNLTHGlcLGmV9ZB34j48bBoZfRB5OEJRPQmPC2Dt_9uNwdfuIsV7oXoGZVd-Pfl7VtyEgx-UoCSBKN_mFxsjTj5M8p4mUrq1iPqeGt3EexWlr4HKDNgJ5k Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bdb9aeb0656347798749c2b8e4434c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bdb9aeb0656347798749c2b8e4434c56"}]}] Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationTest-476077671 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: bdb9aeb0656347798749c2b8e4434c56 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationTest-476077671 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b43a269fe8b746b88c38db6b9e9bfa12 Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationTest-476077671-project Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 61ae30e9-993b-4756-97fd-4e52861acaa3 could not be found. Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '61ae30e9-993b-4756-97fd-4e52861acaa3'} Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ae30e9-993b-4756-97fd-4e52861acaa3 could not be found. Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ae30e9-993b-4756-97fd-4e52861acaa3 could not be found. Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:31.454679 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ae30e9-993b-4756-97fd-4e52861acaa3 could not be found. Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] Returning 404 to user: Instance 61ae30e9-993b-4756-97fd-4e52861acaa3 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:31.461174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3302dc49-74cf-4112-ab2e-cdcce998dc89 tempest-LiveMigrationTest-476077671 tempest-LiveMigrationTest-476077671-project] 10.222.0.25 "GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3" status: 404 len: 111 microversion: 2.1 time: 0.071820 Oct 24 08:59:31.486779 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 882/1822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:31 2022] GET /compute/v2.1/servers/61ae30e9-993b-4756-97fd-4e52861acaa3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:31.514144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:31.516401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:31.554653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.555140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.555584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.556305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.556764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.557190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.776118 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2107ef59-16d6-4b5b-923d-4bc41a18093c tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.268443 Oct 24 08:59:31.805099 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 883/1823] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:31 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:31.824525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:31.841921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:31.864798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.865426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.865759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.866527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.866985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.867411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:32.610490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:32.639217 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e8ced64a-0d3c-4b19-9236-13687fe04a8e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 0.830565 Oct 24 08:59:32.643561 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 884/1824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:31 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:32.662337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:32.663997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:32.692374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:32.696382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:32.698172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:32.701208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:32.705177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:32.714067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:33.194105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:33.206499 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-951cbd6b-3ea0-41ec-a80c-10a7a92ba226 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.557383 Oct 24 08:59:33.207101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 885/1825] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:32 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:33.244505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:33.249040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:33.281728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:33.282570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:33.283170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:33.287962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:33.288696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:33.289330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:33.369241 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ccc801a1-4ffd-4583-96de-3f6289b167f8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141417 Oct 24 08:59:33.379056 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 886/1826] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:33 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:33.665128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:33.666387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:33.684804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:33.690382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:33.690853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:33.691587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:33.698215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:33.704109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.161688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:34.170245 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fc7e5e33-904d-4aee-ad70-6c47dfbbcd53 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 0.510290 Oct 24 08:59:34.178474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 887/1827] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:33 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:34.234168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:34.234947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:34.243317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.260137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.262722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.264635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.265120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.278648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.710330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3dda69a5-9001-429b-9834-d4aaa3cd00f1 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a/action" status: 202 len: 0 microversion: 2.25 time: 4.044196 Oct 24 08:59:34.711972 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 941/1828] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 08:59:30 2022] POST /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a/action => generated 0 bytes in 4046 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:34.719108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:34.733582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:34.759822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.766210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.767716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.769525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.774181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.787311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.828024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:34.841339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-733fac40-648d-40b6-8aa1-d037a3aceed6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.608707 Oct 24 08:59:34.847307 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 888/1829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:34 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:34.867097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:34.867726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:34.931228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.936007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.936600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.943809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.945904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.957431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.974872 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80b77b92-94de-4a7f-9b98-74e8c8288f24 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261470 Oct 24 08:59:34.975480 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 942/1830] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:34 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:35.090907 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:35.203976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:35.206418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:35.238142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:35.242738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:35.249755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:35.254283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:35.262807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:35.263604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:35.600229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:35.617803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:35.626446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:35.630507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98ad1d29-97ce-463d-84a7-375d6b0084bb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.777290 Oct 24 08:59:35.646663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 889/1831] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:34 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:35.747954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:35.762841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2546a944-35eb-47d9-84fe-7aedc3356a20 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 0.564259 Oct 24 08:59:35.763462 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 943/1832] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:35 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:35.870966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:35.872079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:35.894283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:35.899544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:35.901797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:35.904157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:35.909554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:35.910224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:35.987518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:35.992929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:36.015936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:36.024121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:36.025236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:36.027666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:36.029126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:36.040880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:36.164484 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42606730-5a74-4f14-b9ff-37a1985c6f6b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181836 Oct 24 08:59:36.182120 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 944/1833] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:35 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:59:36.457943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50ca7575-6385-4a28-9796-3c3aebe40c5e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Action: 'create', calling method: .version_select at 0x7f8dab297a60>, body: {"keypair": {"name": "tempest-keypair-1593641730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlhZk0QvupsgkA1IQjuIvaAd7ER/hSc1wCjNKJ5Iu/DHZXKB6e49fDHxW8scBYtfclc49kCVyJBauvX3vKY/ooPz3WD08AuRKRtJQi9FFn7ReJR7n1X1nNh8Fj7Q9o3lA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:36.510950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-50ca7575-6385-4a28-9796-3c3aebe40c5e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Getting quotas for project 92fabbee6f184b9b8ebff84ca55c3c67. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:36.537598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-50ca7575-6385-4a28-9796-3c3aebe40c5e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Getting quotas for user f381609a3c0d4583804a70c89d288881 and project 92fabbee6f184b9b8ebff84ca55c3c67. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:36.599930 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50ca7575-6385-4a28-9796-3c3aebe40c5e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.248105 Oct 24 08:59:36.602541 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 945/1834] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 08:59:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:59:36.664177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:36.665031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:36.672401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:36.683397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:36.686382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:36.687962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:36.692998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:36.693930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:36.973696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:36.985082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:36.987679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:36.987988 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40b5407f-7af9-442e-a29f-24e68ad2231b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.328046 Oct 24 08:59:37.006231 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 946/1835] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:36 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:59:37.031559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:37.036944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:37.072080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.083481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.084255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.085214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.085888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.086877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.330045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:37.349377 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1b79911f-e955-4948-853c-c1d2b62da1ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 1.477684 Oct 24 08:59:37.353910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 890/1836] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:35 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:37.381232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:37.388389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:37.402789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.403634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.404312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.405258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.405939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.406565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.528362 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08d98d53-0041-4527-8d26-048d5697d6be tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172992 Oct 24 08:59:37.536526 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 891/1837] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:37 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:37.593192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:37.614818 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e81ece48-eab1-4bd4-bd60-850792883959 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 0.600674 Oct 24 08:59:37.616199 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 947/1838] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:37 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:38.023382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:38.024105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:38.068966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.069532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.075088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.076042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.082956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.084928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.379903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:38.382971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:38.421028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.424721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.427477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.429903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.433618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.438314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.717043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:38.729272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:38.737028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:38.738319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ff33d4d1-07a9-47a2-91f3-ec8eb39c99b0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.720434 Oct 24 08:59:38.745756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 892/1839] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:38 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:38.751128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:38.769354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:38.792827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.799399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.802637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.806695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.807419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.810775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.935248 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43ff15aa-2426-45c7-ae79-306b6d287bfa tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187996 Oct 24 08:59:38.935856 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 893/1840] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:38 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:38.962515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:38.963152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:38.988554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.994345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.997021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.998899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:39.002067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:39.006489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:39.339064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:39.352540 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a66b3896-756f-4758-b611-9af9d66a758e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.980172 Oct 24 08:59:39.356759 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 948/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:38 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:39.769076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:39.770472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:39.816457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:39.827015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:39.832026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:39.833199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:39.844160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:39.850242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.325016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:40.350540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cda41c75-6eb1-49f6-8a06-6a11f511ba76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1497 microversion: 2.1 time: 1.397214 Oct 24 08:59:40.351485 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 894/1842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:38 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1497 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:40.366480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:40.374138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:40.397139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.397980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.400307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.401394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.408697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.409514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.492882 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-54e74f50-f0f0-4cb0-b808-45758e164ada tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136741 Oct 24 08:59:40.497043 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 895/1843] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 08:59:40 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:59:40.506701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:40.512167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:40.531863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.537439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.538899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.541543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.545856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.546639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.605148 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:40.978496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:40.992401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:41.002642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:41.005041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8bfe8734-3953-4563-b35f-12456958cdea tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 1.239919 Oct 24 08:59:41.006153 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 949/1844] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:39 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:41.011554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1247971140", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "1d9215cf-bd29-455b-8560-a233aa62ca29"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:41.264293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:41.272950 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-632f6468-506a-4cc1-8842-d50f61c14bfe tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1523 microversion: 2.1 time: 0.774451 Oct 24 08:59:41.275457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 896/1845] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:40 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1523 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:41.283323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-581917521", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ebbce080-1232-42cf-9144-fff8eaa816ec"}], "security_groups": [{"name": "tempest-securitygroup--86894462"}], "key_name": "tempest-keypair-1593641730", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:46.553464 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:49.148305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] validate_networks() for [('1d9215cf-bd29-455b-8560-a233aa62ca29', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:59:49.270467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] validate_networks() for [('ebbce080-1232-42cf-9144-fff8eaa816ec', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:59:50.435364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Getting quotas for project 92fabbee6f184b9b8ebff84ca55c3c67. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:50.453863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Getting quotas for user f381609a3c0d4583804a70c89d288881 and project 92fabbee6f184b9b8ebff84ca55c3c67. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:50.479179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:59:50.479888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:59:50.480835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:59:50.481524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:59:50.481945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:59:50.496670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:50.497157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:50.497828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:50.498765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:50.499222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:50.499839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:50.528486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Getting quotas for project 92fabbee6f184b9b8ebff84ca55c3c67. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:50.544246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Getting quotas for user f381609a3c0d4583804a70c89d288881 and project 92fabbee6f184b9b8ebff84ca55c3c67. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:50.568676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:59:50.572846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:59:50.596120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:59:50.596803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:59:50.597629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:59:50.598762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:59:50.599318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:59:50.644061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:50.646313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:50.648663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:50.651371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:50.652916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:50.660279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:50.680065 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-89a9c95c-a891-4caf-87ac-a405d4167888 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 9.402198 Oct 24 08:59:50.681189 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 897/1846] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:59:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 9404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:59:50.687780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:50.688946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:50.700118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:50.700987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:50.701748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:50.703236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:50.704374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:50.705221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:50.746139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Getting quotas for project c229d0d4780449dd9b751ffb8b1b734d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:50.771597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Getting quotas for user 9f3fa66a009149e8b5cec58e4b24a788 and project c229d0d4780449dd9b751ffb8b1b734d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:50.827884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:59:50.830386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:59:50.961489 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae274d5e-509e-4e24-91e8-ec5a6ec01f5f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.953922 Oct 24 08:59:50.968084 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 950/1847] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 9961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:59:50.983479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:50.987775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:51.006706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:51.008014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:51.008678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:51.013951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:51.017111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:51.018290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:51.062286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.089391 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b901c27d-5f8b-4832-a85d-f9965821c70e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 200 len: 1474 microversion: 2.1 time: 0.405316 Oct 24 08:59:51.093488 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 898/1848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:50 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:51.118220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:51.125432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:51.157221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:51.159450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:51.162342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:51.163120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:51.163595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:51.164032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:51.365873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.399370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.404374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.407102 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64c39616-dd1f-4fe4-9262-fb30b7f3f55e tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.432869 Oct 24 08:59:51.425322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 951/1849] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:50 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:51.425322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f6b03de-5a5c-4a51-a512-f2ca3c434d77 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:51.425322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f6b03de-5a5c-4a51-a512-f2ca3c434d77 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:51.571921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f6b03de-5a5c-4a51-a512-f2ca3c434d77 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.573417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.581650 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63f24d11-92c1-4a35-af77-8434b62b06ca tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1505 microversion: 2.1 time: 0.485930 Oct 24 08:59:51.588009 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f6b03de-5a5c-4a51-a512-f2ca3c434d77 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1277 microversion: 2.1 time: 0.176462 Oct 24 08:59:51.596952 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 899/1850] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:51 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:51.606883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-399aaa1a-0c88-4da4-8cce-67ac23758dbc tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:51.607750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-399aaa1a-0c88-4da4-8cce-67ac23758dbc tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:51.617317 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 952/1851] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:51 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:51.641152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2077425969"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:51.655189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:51.670634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:51.675419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:51.675987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:51.676749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:51.677224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:51.677680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:51.701921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-399aaa1a-0c88-4da4-8cce-67ac23758dbc tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:51.717055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-399aaa1a-0c88-4da4-8cce-67ac23758dbc tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1218 microversion: 2.1 time: 0.117228 Oct 24 08:59:51.724597 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 900/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:51 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:51.996091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b9d67b0-e312-4179-b14c-ec0d3c52eba5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a/action" status: 202 len: 0 microversion: 2.1 time: 0.377355 Oct 24 08:59:51.999440 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 953/1853] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 08:59:51 2022] POST /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 08:59:52.008050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63c72127-cc56-4002-ad8c-d409da9c9565 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf03ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:52.106347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63c72127-cc56-4002-ad8c-d409da9c9565 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.102774 Oct 24 08:59:52.106864 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 901/1854] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:52 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:52.439766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:52.440930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:52.447957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.448498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.449516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.450691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.451558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.452209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.611808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:52.613826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:52.625991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.627109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.628023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.629958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.630664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.633404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.646419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:52.657205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:52.658972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:52.661014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53982377-0b2a-4022-8f63-e05a4cc63786 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.225419 Oct 24 08:59:52.661963 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 954/1855] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:52 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:52.666895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:52.667625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:52.674545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.675119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.675566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.676924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.677416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.677851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.753877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:52.764609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9fdb7baa-9e9a-4766-aa11-b8505fcacc1e tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1273 microversion: 2.1 time: 0.101371 Oct 24 08:59:52.766086 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 955/1856] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:52 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:52.771934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:52.772601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:52.779088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.779402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.779854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.780593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:52.781039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:52.781549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:52.812534 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:52.841085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:52.854202 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9c31ecb-0490-4ef1-8028-7e56184657c7 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1505 microversion: 2.1 time: 0.247859 Oct 24 08:59:52.854962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 902/1857] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:52 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:52.883207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:52.897808 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c7531ab-f665-491f-8b9c-31bc0e415c7f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1270 microversion: 2.1 time: 0.129950 Oct 24 08:59:52.899189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 956/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:52 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:53.124343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ece4428d-8189-48a5-a7fa-d792f08b0bd6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf4c550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:53.202941 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ece4428d-8189-48a5-a7fa-d792f08b0bd6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.083886 Oct 24 08:59:53.209650 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 903/1859] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:53 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:53.687349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:53.737266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:53.737266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:53.737266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:53.737266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:53.739466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:53.741686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:53.742084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:53.794696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:53.795933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:53.820742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:53.823308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:53.823771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:53.824533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:53.825000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:53.825465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.059056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:54.067922 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d09e863-4560-4096-bf0d-dd942e3cfc79 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1329 microversion: 2.1 time: 0.279453 Oct 24 08:59:54.068519 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 904/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:53 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1329 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:54.085165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:54.087663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:54.100071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.101045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.105097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.105097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.105097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.109509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.115577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:54.135707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:54.140855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:54.161835 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc13225d-535c-495b-b05c-f5641904461d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.477976 Oct 24 08:59:54.165258 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 957/1861] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:53 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:54.175798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b6b6c266-24e9-462e-9543-450c02871fdc req-6afcbc82-0b83-4517-b81f-0f8d448eb6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b57e8e-048a-4bcb-b104-f6c0243aa58d", "name": "network-vif-unplugged", "status": "completed", "tag": "710188f0-b072-4171-8ddd-37cec90dd9c1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:54.205550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b6b6c266-24e9-462e-9543-450c02871fdc req-6afcbc82-0b83-4517-b81f-0f8d448eb6d5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.208275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b6b6c266-24e9-462e-9543-450c02871fdc req-6afcbc82-0b83-4517-b81f-0f8d448eb6d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.210133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b6b6c266-24e9-462e-9543-450c02871fdc req-6afcbc82-0b83-4517-b81f-0f8d448eb6d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.257587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_external_events [req-b6b6c266-24e9-462e-9543-450c02871fdc req-6afcbc82-0b83-4517-b81f-0f8d448eb6d5 service nova] Unable to find a host for instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d. Dropping event network-vif-unplugged {{(pid=126920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 08:59:54.260284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b6b6c266-24e9-462e-9543-450c02871fdc req-6afcbc82-0b83-4517-b81f-0f8d448eb6d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.093444 Oct 24 08:59:54.263950 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 958/1862] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 08:59:54.277600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:54.278379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:54.302937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.304566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.306088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.309000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.310287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.311659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.428834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:54.452918 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63f9e342-100c-4cbc-9385-c9b0326aca25 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 200 len: 1448 microversion: 2.1 time: 0.374240 Oct 24 08:59:54.455733 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 905/1863] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:54 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 1448 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:54.468387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-74659446-98e1-4f86-acec-e1fc1a356be3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab242d30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:54.562384 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-74659446-98e1-4f86-acec-e1fc1a356be3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.103953 Oct 24 08:59:54.565798 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 906/1864] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:54 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:54.576988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:54.577527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:54.594091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.594594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.595031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.595743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:54.605273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:54.606047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:54.668901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:59:54.683226 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Working on deleting snapshot 93a6b2c7-151e-4ce4-bf78-45ec871d485f from shelved instance... Oct 24 08:59:54.757268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:54.768285 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8f76a5d-1cad-4e50-adef-e2f4f47b21e8 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.500877 Oct 24 08:59:54.770639 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 959/1865] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:54 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:55.184388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5f79c81a-ce12-4e8d-9aa9-1a91afb62ceb tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Calling method '.version_select at 0x7f8daaef1160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:55.337018 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5f79c81a-ce12-4e8d-9aa9-1a91afb62ceb tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 371 microversion: 2.1 time: 0.465619 Oct 24 08:59:55.339080 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 960/1866] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 08:59:54 2022] GET /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:55.358039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:55.360117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:55.377769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:55.378908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:55.380582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:55.383312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:55.384118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:55.385458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:55.584611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:55.602009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Doing local delete in cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=126919) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 24 08:59:55.605756 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e416b23a-d62f-4eaa-98cb-5174a5c6347b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1335 microversion: 2.1 time: 0.265285 Oct 24 08:59:55.606238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:55.607008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:55.607768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:55.608619 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 24 08:59:55.617977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] deallocate_for_instance() {{(pid=126919) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 24 08:59:55.625490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 961/1867] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:55 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1335 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:55.635490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:55.636128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:55.651734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:55.653095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:55.653563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:55.655410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:55.657745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:55.658351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:55.998346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:56.009255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:56.016398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:56.018062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-75b49005-38d5-4ec8-85cd-23c7564859fb tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.391290 Oct 24 08:59:56.033893 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 962/1868] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:55 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:56.055973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Action: 'update', calling method: .version_select at 0x7f8daf304550>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:56.180008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:56.180663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:56.183409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:56.190797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:56.192003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:56.192590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:56.274229 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1feb9b6-b821-4dd5-ac32-426dce24b168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 328 microversion: 2.1 time: 0.238880 Oct 24 08:59:56.276062 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 963/1869] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 08:59:56 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 328 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:56.281432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a79dbf1f-47b9-4206-9290-0e19682be05a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab10c940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:56.339336 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a79dbf1f-47b9-4206-9290-0e19682be05a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.061839 Oct 24 08:59:56.339935 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 964/1870] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:56 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:56.364913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:56.371068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:56.383213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:56.383942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:56.384527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:56.385537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:56.386138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:56.388763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:56.741378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:56.754258 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a374449b-f4ec-4b7a-a109-9b7847bdb3de tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.399712 Oct 24 08:59:56.755385 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 965/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:56 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:56.847025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-479257880", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:56.884592 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:56.956206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:59:57.640855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:59:57.641534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:59:57.641805 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:59:57.642274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:59:57.642755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:59:57.677582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:57.678085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:57.678533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:57.679288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:57.684803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:57.685281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:57.814657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Getting quotas for project 485b239908a64ef29e1cab5773aee8e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:59:57.847208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Getting quotas for user 76e4055dc1f849e9a58e0fcc9bd6a98c and project 485b239908a64ef29e1cab5773aee8e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:59:57.894296 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.utils [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] cores quota exceeded for 485b239908a64ef29e1cab5773aee8e3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126920) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 24 08:59:57.895747 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Request method failure captured: Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 144 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlQJdkn7kEr6-4wv-aE3iry2_thj-sXq5az3XYlKmGiMzlkcAmrBMCRkNcCX-dNBCWqakHnZu0Woj10ffBwqBiUU6W4p9qNiZw_zF0rEJgT2J9j3qsI5ykCF6yUDwoOA3Rop9a9Yfg6FTAtft1EYHL-dfbagq3G2qqEEmjP1XdJYhwA Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485b239908a64ef29e1cab5773aee8e3"}]}] Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 76e4055dc1f849e9a58e0fcc9bd6a98c Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-479257880", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-479257880', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452'}}} Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 08:59:57.923011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 08:59:57.927273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 08:59:57.930175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:57.931076 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b097db4b-0d70-4ee1-82ee-b5bf09ea6fb2 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.173893 Oct 24 08:59:57.937118 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 966/1872] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:59:56 2022] POST /compute/v2.1/servers => generated 111 bytes in 1181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:57.943610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2413b902-d333-4fb1-bb7f-d95569c8cb2d req-a98e67f0-643a-4301-abe8-48c7c571b479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0264c1-cb57-49ac-b257-933fc285441c", "tag": "55358d20-1213-4bcb-be7c-cab16de89c5e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:57.963202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2413b902-d333-4fb1-bb7f-d95569c8cb2d req-a98e67f0-643a-4301-abe8-48c7c571b479 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:57.963697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2413b902-d333-4fb1-bb7f-d95569c8cb2d req-a98e67f0-643a-4301-abe8-48c7c571b479 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:57.964132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2413b902-d333-4fb1-bb7f-d95569c8cb2d req-a98e67f0-643a-4301-abe8-48c7c571b479 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:57.980666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2413b902-d333-4fb1-bb7f-d95569c8cb2d req-a98e67f0-643a-4301-abe8-48c7c571b479 service nova] Creating event network-changed:55358d20-1213-4bcb-be7c-cab16de89c5e for instance eb0264c1-cb57-49ac-b257-933fc285441c on n-h1-master-1 Oct 24 08:59:57.990812 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2413b902-d333-4fb1-bb7f-d95569c8cb2d req-a98e67f0-643a-4301-abe8-48c7c571b479 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052230 Oct 24 08:59:57.991430 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 967/1873] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:58.003582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:58.004722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:58.015337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.016093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.016681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.017575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.020526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.021145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.172896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Updating instance_info_cache with network_info: [] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 08:59:58.369387 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:58.500284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:58.512560 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8962090a-c1dd-41c9-beeb-8006633c8875 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.518844 Oct 24 08:59:58.513793 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 968/1874] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:57 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:58.528855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:58.529707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:58.542216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.542993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.544653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.552076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.552809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.553551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.583628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0acaf7f5-a9fe-4ada-915b-00c4412edd12 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 204 len: 0 microversion: 2.1 time: 4.016697 Oct 24 08:59:58.584530 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 907/1875] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 08:59:54 2022] DELETE /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 0 bytes in 4018 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:58.592169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-691fa3f6-86e0-4147-8ba3-a676bdaa02ab tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaedd5e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:58.678158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-691fa3f6-86e0-4147-8ba3-a676bdaa02ab tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.092531 Oct 24 08:59:58.679126 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 908/1876] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:58 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:58.693047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c6b6a93c-20ce-4af1-8a8f-ee8f055e857b req-26f16e6e-8e8c-41cb-ba6d-1a34df186098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c88a-b3be-4eef-aa43-aa08d5f3a59a", "name": "network-vif-plugged", "status": "completed", "tag": "8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:58.707985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c6b6a93c-20ce-4af1-8a8f-ee8f055e857b req-26f16e6e-8e8c-41cb-ba6d-1a34df186098 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.708669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c6b6a93c-20ce-4af1-8a8f-ee8f055e857b req-26f16e6e-8e8c-41cb-ba6d-1a34df186098 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.709262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c6b6a93c-20ce-4af1-8a8f-ee8f055e857b req-26f16e6e-8e8c-41cb-ba6d-1a34df186098 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.726487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c6b6a93c-20ce-4af1-8a8f-ee8f055e857b req-26f16e6e-8e8c-41cb-ba6d-1a34df186098 service nova] Creating event network-vif-plugged:8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d for instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a on n-h1-master-1 Oct 24 08:59:58.735133 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c6b6a93c-20ce-4af1-8a8f-ee8f055e857b req-26f16e6e-8e8c-41cb-ba6d-1a34df186098 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051813 Oct 24 08:59:58.736348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 909/1877] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:58.749945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:58.750889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:58.758493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.759172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.759748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.760601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.761387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.762058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.825772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:58.837589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:58.839785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:58.849458 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5be8e28a-b311-4263-9121-d4d144cb5c40 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.326586 Oct 24 08:59:58.862934 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 969/1878] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 08:59:58 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:59:58.877802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a3425d85-a160-4bbe-8470-3fa76fb9bdd5 req-300b3738-4aa5-4caf-8de4-c7df40a46b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80812fd-0278-4677-bc3c-c5e5c6915a87", "tag": "bc200002-faae-4234-b7b9-79cfaa369c80"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:58.889559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a3425d85-a160-4bbe-8470-3fa76fb9bdd5 req-300b3738-4aa5-4caf-8de4-c7df40a46b58 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:58.890226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a3425d85-a160-4bbe-8470-3fa76fb9bdd5 req-300b3738-4aa5-4caf-8de4-c7df40a46b58 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:58.890824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a3425d85-a160-4bbe-8470-3fa76fb9bdd5 req-300b3738-4aa5-4caf-8de4-c7df40a46b58 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:58.906964 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a3425d85-a160-4bbe-8470-3fa76fb9bdd5 req-300b3738-4aa5-4caf-8de4-c7df40a46b58 service nova] Creating event network-changed:bc200002-faae-4234-b7b9-79cfaa369c80 for instance b80812fd-0278-4677-bc3c-c5e5c6915a87 on n-h1-master-1 Oct 24 08:59:58.912870 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a3425d85-a160-4bbe-8470-3fa76fb9bdd5 req-300b3738-4aa5-4caf-8de4-c7df40a46b58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048327 Oct 24 08:59:58.913415 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 970/1879] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:58.925172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab40b280>, body: {"quota_set": {"cores": 20}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:59.002353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:59.008222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.008942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.009822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.011146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.011771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.012447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.014549 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5db104c-bdfe-487a-87bd-da1a39819f8b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.276620 Oct 24 08:59:59.020537 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 910/1880] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:58 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:59.030312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:59.030941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:59.047639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.048071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.048515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.049446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.050046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.055019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.083581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d HTTP/1.1 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a7b57e8e-048a-4bcb-b104-f6c0243aa58d'} Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:59.088818 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 08:59:59.091947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 08:59:59.096060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:59.097335 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60cde932-c375-41a1-ac4b-d93876bd35b4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 404 len: 111 microversion: 2.1 time: 0.075651 Oct 24 08:59:59.101388 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 911/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:59 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:59.133373 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fb44fcf-6785-4861-9043-183168fd2891 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 329 microversion: 2.1 time: 0.212814 Oct 24 08:59:59.141595 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 971/1882] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 08:59:58 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 329 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:59.147634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52603764-324d-476a-9071-4707f8fde964 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Calling method '.version_select at 0x7f8daaef0e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:59.269106 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52603764-324d-476a-9071-4707f8fde964 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 371 microversion: 2.1 time: 0.125755 Oct 24 08:59:59.271125 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 912/1883] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 08:59:59 2022] GET /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:59.283726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab10c9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:59.322586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-9189684", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:59.404323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.405412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.405954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.406873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.407509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.408531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.413026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:59:59.530682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f03352b-be70-447b-a0de-3619661e7c52 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 328 microversion: 2.1 time: 0.234904 Oct 24 08:59:59.538821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 972/1884] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 08:59:59 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 328 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:59.555379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:59.557055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:59.573107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.574098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.574811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.575580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:59.576056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:59.576492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:59.922367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:59.932355 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7984f188-4e0f-4d82-896e-12d46ddf409d tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.390537 Oct 24 08:59:59.933250 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 973/1885] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:59 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:59.957778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1258778729", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:00.029018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:00.463066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:00.464143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:00.464893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:00.465548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:00.466212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:00.490186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.491062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.491726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.492667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.493356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.494147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.515262 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:00.528643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Getting quotas for project 485b239908a64ef29e1cab5773aee8e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:00.534789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Getting quotas for user 76e4055dc1f849e9a58e0fcc9bd6a98c and project 485b239908a64ef29e1cab5773aee8e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:00.549033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.utils [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] instances quota exceeded for 485b239908a64ef29e1cab5773aee8e3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126920) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 24 09:00:00.549917 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Request method failure captured: Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 145 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlQJdkn7kEr6-4wv-aE3iry2_thj-sXq5az3XYlKmGiMzlkcAmrBMCRkNcCX-dNBCWqakHnZu0Woj10ffBwqBiUU6W4p9qNiZw_zF0rEJgT2J9j3qsI5ykCF6yUDwoOA3Rop9a9Yfg6FTAtft1EYHL-dfbagq3G2qqEEmjP1XdJYhwA Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485b239908a64ef29e1cab5773aee8e3"}]}] Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 76e4055dc1f849e9a58e0fcc9bd6a98c Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1258778729", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1258778729', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452'}}} Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 09:00:00.552382 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 09:00:00.555714 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:00.560466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:00.561871 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dec49d35-0f00-4124-96b4-ba26351c84bc tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.617596 Oct 24 09:00:00.563076 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 974/1886] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:59:59 2022] POST /compute/v2.1/servers => generated 119 bytes in 629 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:00.568056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4ae4eafd-a87b-4c8d-aedf-775b6c749ec5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab005430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:00.619123 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4ae4eafd-a87b-4c8d-aedf-775b6c749ec5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.054021 Oct 24 09:00:00.622753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:00.623157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:00.623630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:00.624040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:00.624450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:00.628299 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:00.635503 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 975/1887] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:00 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:00.660735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:00.661541 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:00.669733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.673671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.674152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.674986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.675457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.680815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.683600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.685569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.685569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.685847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.687747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.693014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.730847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:00.747904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:00.782940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:00:00.786979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:00:00.905048 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4dfe331c-48af-4ffa-8a7e-ebd3f4d532ea tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586317 Oct 24 09:00:00.907373 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 913/1888] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 08:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:00:00.927366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:00.930370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:00.951358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.954183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.954183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:00.954421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:00.954903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:00.956154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.101947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:01.114602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:01.119064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:01.123318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-222acf01-7996-4498-8ea4-d456f34111a0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.484267 Oct 24 09:00:01.124770 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 976/1889] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:00 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:01.139769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdec22b-c1b9-43d0-925d-a336000ab69a", "name": "network-vif-unplugged", "status": "completed", "tag": "a0f47b55-e796-401b-be51-e42505fa50e2"}, {"server_uuid": "a7b57e8e-048a-4bcb-b104-f6c0243aa58d", "name": "network-vif-deleted", "tag": "710188f0-b072-4171-8ddd-37cec90dd9c1"}, {"name": "network-changed", "server_uuid": "5bdec22b-c1b9-43d0-925d-a336000ab69a", "tag": "a0f47b55-e796-401b-be51-e42505fa50e2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:01.182931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.185526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.186177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.223823 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Creating event network-vif-unplugged:a0f47b55-e796-401b-be51-e42505fa50e2 for instance 5bdec22b-c1b9-43d0-925d-a336000ab69a on n-h2-master-1 Oct 24 09:00:01.224374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_external_events [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Unable to find a host for instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d. Dropping event network-vif-deleted {{(pid=126920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 09:00:01.227848 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] Creating event network-changed:a0f47b55-e796-401b-be51-e42505fa50e2 for instance 5bdec22b-c1b9-43d0-925d-a336000ab69a on n-h2-master-1 Oct 24 09:00:01.246293 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-35ccddac-6962-4bb0-a5e0-239a8db66f51 req-92bd8295-e1c9-4e41-b055-543b8cd546ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 520 microversion: 2.1 time: 0.109657 Oct 24 09:00:01.250701 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 977/1890] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 520 bytes in 124 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 09:00:01.259732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab3c5160>, body: {"quota_set": {"instances": 10}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:01.490851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.491387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.491833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.492613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.493079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.493571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.501203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:01.511319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c287338-c464-423f-ba86-dd8c4ed8af09 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.602049 Oct 24 09:00:01.533502 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 914/1891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:00 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:01.567885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8c6addd-c1ea-4f07-be23-f84b10acfa47"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:01.570926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:01.591447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.591949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.594234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.595002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.595474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.595888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.658090 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7205aa4c-15c7-4973-9c51-423f3ab3e265 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 329 microversion: 2.1 time: 0.404018 Oct 24 09:00:01.658849 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 978/1892] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:00:01 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 329 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:01.673994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94cec574-60ba-4bdc-a0a0-d1877aa27221 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:01.677235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94cec574-60ba-4bdc-a0a0-d1877aa27221 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:01.843399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-94cec574-60ba-4bdc-a0a0-d1877aa27221 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:01.857482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94cec574-60ba-4bdc-a0a0-d1877aa27221 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1212 microversion: 2.1 time: 0.194721 Oct 24 09:00:01.873679 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 979/1893] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:01 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1212 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:01.873679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:01.873679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:01.878771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.879517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.880055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:01.881577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:01.881577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:01.883094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:02.318741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb9f3578-ee91-413a-9174-2c547a5aef71 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779585 Oct 24 09:00:02.326639 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 915/1894] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:00:01 2022] POST /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:02.342661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb469a52-7146-468d-9d16-ee455ad6c1fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf24c160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:02.359069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:02.382328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30ce1047-7ad4-46fe-95cd-e0bd38af24b3 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.517761 Oct 24 09:00:02.384752 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 980/1895] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:01 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:02.405100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-432fa941-5a09-45c7-9178-15cef934e8ce tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Calling method '.version_select at 0x7f8dab10cb80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:02.487192 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb469a52-7146-468d-9d16-ee455ad6c1fb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.158602 Oct 24 09:00:02.496413 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 916/1896] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:02 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:02.511688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:02.512817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:02.530789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:02.531563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:02.532175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:02.534700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:02.537252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:02.537894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:02.630197 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-432fa941-5a09-45c7-9178-15cef934e8ce tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 371 microversion: 2.1 time: 0.242288 Oct 24 09:00:02.632222 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 981/1897] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:00:02 2022] GET /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:02.645185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:02.646107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:02.654180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:02.655609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:02.656193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:02.657058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:02.657697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:02.658820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.006816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:03.020949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:03.022469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:03.023666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8714bab2-c2d2-4eb6-a44b-88f594653d31 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.525837 Oct 24 09:00:03.024224 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 917/1898] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:02 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:03.050631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Action: 'update', calling method: .version_select at 0x7f8daf24d430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:03.076060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:03.096604 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25f9cb6f-b6d1-42e8-b86c-448931440f27 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.463312 Oct 24 09:00:03.097544 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 982/1899] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:02 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:03.107920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:03.108554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:03.137370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:03.137964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:03.141678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.146035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:03.152836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:03.153667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.193964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:03.194471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:03.194891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.195620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:03.196069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:03.196489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.320428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b656a6c0-e369-4a1b-9004-9965307d91a3 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 325 microversion: 2.1 time: 0.295108 Oct 24 09:00:03.322866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 918/1900] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:00:03 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:03.384441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:03.395094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5863a3ad-c7cc-4965-9480-e0ace11cecd6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1264 microversion: 2.1 time: 0.295691 Oct 24 09:00:03.395662 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 983/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:03 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1264 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:03.419958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:03.420599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:03.439621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:03.440115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:03.440557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.441272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:03.442119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:03.442546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:03.466000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-706269170", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:03.600709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:03.794890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:03.804359 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abf7a62b-ebd6-4509-b8e1-b26df62026a1 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.388123 Oct 24 09:00:03.808671 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 919/1902] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:03 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:03.822314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ac67f20-1a6b-4f50-9367-4b4d1dafb24c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab48e280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:03.906673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ac67f20-1a6b-4f50-9367-4b4d1dafb24c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.094307 Oct 24 09:00:03.907611 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 920/1903] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:03 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:04.052191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:04.053554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:04.072022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.075439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.076343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.083024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.085333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.086099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.161644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:04.162449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:04.163230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:04.163962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:04.165621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:04.179221 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:04.191270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.193344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.193969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.194977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.195859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.196619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.263138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Getting quotas for project 485b239908a64ef29e1cab5773aee8e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:04.276580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Getting quotas for user 76e4055dc1f849e9a58e0fcc9bd6a98c and project 485b239908a64ef29e1cab5773aee8e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:04.297834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.utils [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] ram quota exceeded for 485b239908a64ef29e1cab5773aee8e3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126920) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 24 09:00:04.299044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Request method failure captured: Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 144 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlQJdkn7kEr6-4wv-aE3iry2_thj-sXq5az3XYlKmGiMzlkcAmrBMCRkNcCX-dNBCWqakHnZu0Woj10ffBwqBiUU6W4p9qNiZw_zF0rEJgT2J9j3qsI5ykCF6yUDwoOA3Rop9a9Yfg6FTAtft1EYHL-dfbagq3G2qqEEmjP1XdJYhwA Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485b239908a64ef29e1cab5773aee8e3"}]}] Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 76e4055dc1f849e9a58e0fcc9bd6a98c Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-706269170", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-706269170', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452'}}} Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 09:00:04.301860 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 09:00:04.305376 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.307931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:04.308991 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25616383-04a3-4f00-9e71-ad5c437568b5 tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.847576 Oct 24 09:00:04.313272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 984/1904] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:00:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 852 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:00:04.322501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:04.323277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:04.331274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.332589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.333131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.344831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.345677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.346242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.373336 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:04.449651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:04.462011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:04.466850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:04.471100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e62fd03-6a32-445d-bf59-d84c9d80e97c tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.424098 Oct 24 09:00:04.485569 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 921/1905] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:04 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:00:04.497066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Action: 'update', calling method: .version_select at 0x7f8dab48e940>, body: {"quota_set": {"ram": 51200}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:04.598782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:04.607952 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e04f8ae2-4099-43f0-832f-4a78f3e1b35b tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.293364 Oct 24 09:00:04.611338 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 985/1906] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:04 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:04.617745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:04.620563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:04.627777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.628486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.629924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.631237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.631963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.632503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.657792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.658282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.658717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.668064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.671879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.675384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.720369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:04.731359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8738d975-207b-4b85-926f-b75d3bab8c43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1270 microversion: 2.1 time: 0.118748 Oct 24 09:00:04.732744 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 986/1907] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:04 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:04.739444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-99006451-1735-40a0-9852-3474e1909ef2 req-dc5ca11e-a17a-431e-b8f1-dd12f02282cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0264c1-cb57-49ac-b257-933fc285441c", "name": "network-vif-plugged", "status": "completed", "tag": "55358d20-1213-4bcb-be7c-cab16de89c5e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:04.751753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-99006451-1735-40a0-9852-3474e1909ef2 req-dc5ca11e-a17a-431e-b8f1-dd12f02282cc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.752416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-99006451-1735-40a0-9852-3474e1909ef2 req-dc5ca11e-a17a-431e-b8f1-dd12f02282cc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.752958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-99006451-1735-40a0-9852-3474e1909ef2 req-dc5ca11e-a17a-431e-b8f1-dd12f02282cc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.766140 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-99006451-1735-40a0-9852-3474e1909ef2 req-dc5ca11e-a17a-431e-b8f1-dd12f02282cc service nova] Creating event network-vif-plugged:55358d20-1213-4bcb-be7c-cab16de89c5e for instance eb0264c1-cb57-49ac-b257-933fc285441c on n-h1-master-1 Oct 24 09:00:04.777826 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-99006451-1735-40a0-9852-3474e1909ef2 req-dc5ca11e-a17a-431e-b8f1-dd12f02282cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042815 Oct 24 09:00:04.778949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 987/1908] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:04.812187 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3eb69804-827a-498c-9ec9-96b1f8fe28b6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 200 len: 329 microversion: 2.1 time: 0.325343 Oct 24 09:00:04.813443 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 922/1909] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:00:04 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 329 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:04.833512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1259d5e-ff5c-46f5-bfb5-66c4dd6f49ed tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Action: 'update', calling method: .version_select at 0x7f8daadaaaf0>, body: {"quota_set": {"ram": 0}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:04.839718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1259d5e-ff5c-46f5-bfb5-66c4dd6f49ed tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '76e4055dc1f849e9a58e0fcc9bd6a98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485b239908a64ef29e1cab5773aee8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:04.844356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:04.847351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1259d5e-ff5c-46f5-bfb5-66c4dd6f49ed tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Request method failure captured: Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 HTTP/1.1 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 25 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlQJdkn7kEr6-4wv-aE3iry2_thj-sXq5az3XYlKmGiMzlkcAmrBMCRkNcCX-dNBCWqakHnZu0Woj10ffBwqBiUU6W4p9qNiZw_zF0rEJgT2J9j3qsI5ykCF6yUDwoOA3Rop9a9Yfg6FTAtft1EYHL-dfbagq3G2qqEEmjP1XdJYhwA Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485b239908a64ef29e1cab5773aee8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485b239908a64ef29e1cab5773aee8e3"}]}] Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 485b239908a64ef29e1cab5773aee8e3 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1969846199 Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 76e4055dc1f849e9a58e0fcc9bd6a98c Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-QuotasAdminNegativeTest-1969846199-project Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: {"quota_set": {"ram": 0}} Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '485b239908a64ef29e1cab5773aee8e3', 'body': {'quota_set': {'ram': 0}}} Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 09:00:04.852100 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1259d5e-ff5c-46f5-bfb5-66c4dd6f49ed tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1259d5e-ff5c-46f5-bfb5-66c4dd6f49ed tempest-QuotasAdminNegativeTest-1969846199 tempest-QuotasAdminNegativeTest-1969846199-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3" status: 403 len: 116 microversion: 2.1 time: 0.025854 Oct 24 09:00:04.860758 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 988/1910] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:00:04 2022] PUT /compute/v2.1/os-quota-sets/485b239908a64ef29e1cab5773aee8e3 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:04.868565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.869985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.871188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.872311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:04.873098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:04.874070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:04.921926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5732589f-c576-460c-b498-c3a7fa454919 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0214c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:04.996408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5732589f-c576-460c-b498-c3a7fa454919 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.078139 Oct 24 09:00:04.997478 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 989/1911] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:04 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:05.343486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:05.355314 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f22618f-3a23-432b-a0e6-a916ec3c761f tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.514773 Oct 24 09:00:05.359044 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 923/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:04 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:05.502242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:05.502994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:05.519054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:05.520693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:05.521215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:05.523394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:05.531059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:05.532636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:05.636175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:05.636786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:05.659873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:05.663948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:05.674153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:05.677813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:05.678475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:05.679181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:06.070739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:06.079706 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-085e8637-1d8e-447a-a32d-3e982b80f66d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1318 microversion: 2.1 time: 0.447311 Oct 24 09:00:06.093351 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 924/1913] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:05 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:06.093351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:06.093351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:06.133911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:06.134406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:06.134863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:06.135537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:06.136077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:06.136500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:06.240453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:06.257697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:06.262383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:06.265698 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42cf5bd2-9df8-412c-afc6-e33da1079e7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.767717 Oct 24 09:00:06.285339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 990/1914] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:05 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:06.285339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7bb48450-1bee-498a-8c68-4ef63d85840f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab021af0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:06.376926 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7bb48450-1bee-498a-8c68-4ef63d85840f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.102593 Oct 24 09:00:06.377797 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 991/1915] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:06 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:06.400319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:06.401398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:06.409564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:06.410003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:06.410697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:06.411397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:06.411859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:06.412295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:06.874039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:06.893188 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1ad0136-c61c-4e6e-8926-0f824c1088a5 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.494538 Oct 24 09:00:06.896173 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 992/1916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:06 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:07.067563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:07.079869 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f5c044c-ad9e-4c06-9b10-1af704389f9a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.997996 Oct 24 09:00:07.085652 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 925/1917] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:06 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:07.112089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:07.112945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:07.123007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.126112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.126777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:07.129451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.134557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.135319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:07.302679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:07.303293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:07.312296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.312912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.313501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:07.314301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.338101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.344514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:07.757822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:07.767911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd937a40-6936-4fe1-b103-892f06cfb10f tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1509 microversion: 2.1 time: 0.662083 Oct 24 09:00:07.768503 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 993/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:07 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1509 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:07.789010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abf6a26a-024b-493d-a12f-39089bca0fb8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2bc3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:07.882197 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abf6a26a-024b-493d-a12f-39089bca0fb8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.107566 Oct 24 09:00:07.883666 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 994/1919] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:07 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:07.893044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1283dd3c-4232-4153-a6fe-ad8e95c2c8e5 req-e8bb7e58-14c1-44a7-ae78-32384868cf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80812fd-0278-4677-bc3c-c5e5c6915a87", "name": "network-vif-plugged", "status": "completed", "tag": "bc200002-faae-4234-b7b9-79cfaa369c80"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:07.906395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1283dd3c-4232-4153-a6fe-ad8e95c2c8e5 req-e8bb7e58-14c1-44a7-ae78-32384868cf84 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.907161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1283dd3c-4232-4153-a6fe-ad8e95c2c8e5 req-e8bb7e58-14c1-44a7-ae78-32384868cf84 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.907803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1283dd3c-4232-4153-a6fe-ad8e95c2c8e5 req-e8bb7e58-14c1-44a7-ae78-32384868cf84 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:07.921985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1283dd3c-4232-4153-a6fe-ad8e95c2c8e5 req-e8bb7e58-14c1-44a7-ae78-32384868cf84 service nova] Creating event network-vif-plugged:bc200002-faae-4234-b7b9-79cfaa369c80 for instance b80812fd-0278-4677-bc3c-c5e5c6915a87 on n-h1-master-1 Oct 24 09:00:07.930314 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1283dd3c-4232-4153-a6fe-ad8e95c2c8e5 req-e8bb7e58-14c1-44a7-ae78-32384868cf84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043897 Oct 24 09:00:07.931726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 995/1920] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:07.941413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:07.943096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:07.952525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.953402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.954051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:07.955076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:07.955754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:07.956543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:08.048722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:08.067197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:08.068654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:08.074781 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34348d6d-e080-4b2f-8c95-d135b081fd84 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.775920 Oct 24 09:00:08.079846 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 926/1921] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:07 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:08.108389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:08.109688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:08.121070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:08.126743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:08.130510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:08.136623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:08.138017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:08.147668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:08.159272 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=14,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:08.450405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:08.464171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a0614d59-e33f-48ed-b04f-2a93daf3fdb9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.528259 Oct 24 09:00:08.467584 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 996/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:07 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:08.865427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:08.883291 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0b32f69-de08-405f-9b12-2c53a1730780 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.776675 Oct 24 09:00:08.901841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-620d79f9-17c9-4d9f-b5c1-10d212865a72 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2c6dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:08.908364 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 927/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:08 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:09.004155 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-620d79f9-17c9-4d9f-b5c1-10d212865a72 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.108123 Oct 24 09:00:09.005243 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 997/1924] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:08 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:09.107135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:09.108209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:09.119435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.124341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.124893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.125750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.126233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.126665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.487414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-78434057-0b19-4420-b954-e6d39162749b req-387ef2a9-7d92-42f3-8708-3e607cfdb23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf822847-521b-44e9-a65b-4fad1b65b22b", "tag": "fbdb6016-f219-4ab0-8a19-94ba9eeee206"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:09.509471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-78434057-0b19-4420-b954-e6d39162749b req-387ef2a9-7d92-42f3-8708-3e607cfdb23f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.509734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-78434057-0b19-4420-b954-e6d39162749b req-387ef2a9-7d92-42f3-8708-3e607cfdb23f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.511353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-78434057-0b19-4420-b954-e6d39162749b req-387ef2a9-7d92-42f3-8708-3e607cfdb23f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.543824 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-78434057-0b19-4420-b954-e6d39162749b req-387ef2a9-7d92-42f3-8708-3e607cfdb23f service nova] Creating event network-changed:fbdb6016-f219-4ab0-8a19-94ba9eeee206 for instance bf822847-521b-44e9-a65b-4fad1b65b22b on n-h2-master-1 Oct 24 09:00:09.550190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-78434057-0b19-4420-b954-e6d39162749b req-387ef2a9-7d92-42f3-8708-3e607cfdb23f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069084 Oct 24 09:00:09.551476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 998/1925] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:09.557453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:09.558682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:09.567296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.568226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.569034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.571545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.572190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.572817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.854142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:09.867541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:09.875267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:09.876511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-900e377e-58f9-4ccb-ab36-a60c5a701c09 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.773415 Oct 24 09:00:09.877085 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 928/1926] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:09 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:09.915599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:09.916686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:09.932303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.934916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.935358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.938030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:09.940160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:09.942318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:09.973971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:09.987513 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84437cd7-72bb-45fc-97cd-1505f9877fd2 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1401 microversion: 2.1 time: 0.434522 Oct 24 09:00:10.002611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 999/1927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:09 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1401 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:10.027597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61474988-9701-4462-8b71-b1e26293ba4f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf9c3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:10.143698 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61474988-9701-4462-8b71-b1e26293ba4f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.122338 Oct 24 09:00:10.145329 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1000/1928] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:10 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:10.313365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:10.327540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0be56022-8947-423b-9b40-37f267683f8a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.413412 Oct 24 09:00:10.329113 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 929/1929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:09 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:10.912308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:10.912995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:10.940408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:10.940919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:10.957732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:10.958886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:10.966060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:10.966767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.002819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "418fdaf4-4e14-4524-9b5b-7fb2acfcd50d"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:11.005633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:11.024976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.025819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.026497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.027387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.027998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.029289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.156983 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] HTTP exception thrown: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Request method failure captured: Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: request: PUT /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c/os-volume_attachments/377c92cd-246a-407c-aa85-77f76c3df3b6 HTTP/1.1 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 74 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlOMajtW4st3INaIvqMDXv8ngUa5EKfqGlLI-Dty9J2is1v1stkNP5UbCeTnjf-rv2NX5oYe6Y3ZvNziKFpdvzpbbP-uiEcAVjTvUQRxgykwX3nQ82KoIWQOIicB6N9-drysb7_q_ZThyxBRWg-qkdR_F5CQG8f2SDOoFjWbz8T8-7M Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 50d8e630279847609d36865cdfb1bf96 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesAdminNegativeTest-851341015 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50d8e630279847609d36865cdfb1bf96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_50d8e630279847609d36865cdfb1bf96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50d8e630279847609d36865cdfb1bf96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/50d8e630279847609d36865cdfb1bf96"}]}] Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesAdminNegativeTest-851341015 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 50d8e630279847609d36865cdfb1bf96 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-851341015 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesAdminNegativeTest-851341015-project-admin Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d0ac6c6a70544337a25ab96d25156a07 Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesAdminNegativeTest-851341015-project-admin Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "418fdaf4-4e14-4524-9b5b-7fb2acfcd50d"}} Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: exception: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'eb0264c1-cb57-49ac-b257-933fc285441c', 'id': '377c92cd-246a-407c-aa85-77f76c3df3b6', 'body': {'volumeAttachment': {'volumeId': '418fdaf4-4e14-4524-9b5b-7fb2acfcd50d'}}} Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. (HTTP 404) (Request-ID: req-e5488e5e-ea96-4779-a73e-aeaead062fdd) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:00:11.161457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] Returning 404 to user: Volume 377c92cd-246a-407c-aa85-77f76c3df3b6 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c0436c6-a72b-42c1-8549-ec703a9ce62c tempest-VolumesAdminNegativeTest-851341015 tempest-VolumesAdminNegativeTest-851341015-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c/os-volume_attachments/377c92cd-246a-407c-aa85-77f76c3df3b6" status: 404 len: 109 microversion: 2.1 time: 0.164118 Oct 24 09:00:11.167504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 930/1930] 10.222.0.25 () {60 vars in 1433 bytes} [Mon Oct 24 09:00:10 2022] PUT /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c/os-volume_attachments/377c92cd-246a-407c-aa85-77f76c3df3b6 => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:11.172887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:11.173267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:11.205901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.206697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.209387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.216893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.219282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.219770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.400795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:11.447490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:11.449381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:11.450626 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11d9f717-decd-4828-9aa1-0669470ff3dd tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1486 microversion: 2.25 time: 0.544446 Oct 24 09:00:11.465592 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1001/1931] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:10 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1486 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:11.490164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7232e42-3f7b-400a-afcb-d91ee2320430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab40bc10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:11.569257 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7232e42-3f7b-400a-afcb-d91ee2320430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.102453 Oct 24 09:00:11.578733 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1002/1932] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:11 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:11.589981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:11.592688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:11.597388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:11.601488 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b2affef-4ebf-4878-87a6-fc2c9d7ba4a9 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1588 microversion: 2.1 time: 0.436406 Oct 24 09:00:11.616646 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 931/1933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:11 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1588 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:11.621248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.623146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.623601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.632730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.633258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.633789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.634451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:11.634954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:11.651270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.652152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.652805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.654495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:11.655961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:11.658304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:11.886295 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5f2bbe4f-70d9-45d1-8a09-cebcb9bf06ba tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255771 Oct 24 09:00:11.887233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 932/1934] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:00:11 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:12.045848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:12.068545 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7b863df-855b-407c-8c29-19689c48d001 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.491536 Oct 24 09:00:12.070023 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1003/1935] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:11 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:12.498688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:12.499408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:12.518645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:12.527913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:12.528574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:12.529567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:12.540806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:12.541515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:12.588501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bc31af17-9749-4fea-9900-887acd5c4567 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab40bc10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:12.646616 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bc31af17-9749-4fea-9900-887acd5c4567 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.063335 Oct 24 09:00:12.647808 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1004/1936] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:12 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:13.093222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:13.094279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:13.117184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:13.126703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:13.127479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:13.128394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:13.130119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:13.130835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:13.401531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:13.412405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:13.423076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:13.424813 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6cadba84-75ea-4ad5-ba33-d2600f6d677d tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1476 microversion: 2.25 time: 0.930629 Oct 24 09:00:13.425970 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 933/1937] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:12 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1476 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:13.460581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82d9ac94-8124-439f-926e-ec7d44da0daf tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '.version_select at 0x7f8daf2298b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:13.469342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82d9ac94-8124-439f-926e-ec7d44da0daf tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:13.470353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82d9ac94-8124-439f-926e-ec7d44da0daf tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:13.489100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82d9ac94-8124-439f-926e-ec7d44da0daf tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:13.513262 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82d9ac94-8124-439f-926e-ec7d44da0daf tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.056881 Oct 24 09:00:13.514500 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 934/1938] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Oct 24 09:00:13 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:00:13.533549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:13.545974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:13.574269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:13.575000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:13.575695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:13.576667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:13.577355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:13.577999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:13.720406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:13.729178 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6dfdaa7-1aa2-4c7c-8d99-f8d2b5ade8ad tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.640901 Oct 24 09:00:13.733521 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1005/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:13 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:13.745981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08c5253a-fb29-44c3-9902-ebd5472943cf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf30dca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:13.828876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08c5253a-fb29-44c3-9902-ebd5472943cf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.093307 Oct 24 09:00:13.829651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1006/1940] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:13 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:14.237031 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:14.290748 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=64 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:14.425807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84ebd071-1954-4e85-ae74-f53938a717c6 tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] Action: 'create', calling method: .version_select at 0x7f8dab0211f0>, body: {"security_group": {"name": "tempest-securitygroup-1293563217", "description": "tempest-description-1645970435"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:14.720507 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:14.802369 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=36 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:15.196103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] Lazy-loading 'services' on Instance uuid 5bdec22b-c1b9-43d0-925d-a336000ab69a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:15.247129 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87ce6a7b-a58d-4681-8da4-fd984c3e13f2 tempest-LiveAutoBlockMigrationV225Test-897138586 tempest-LiveAutoBlockMigrationV225Test-897138586-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1968 microversion: 2.25 time: 1.718884 Oct 24 09:00:15.269328 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 935/1941] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:13 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1968 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:15.269328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:15.269328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:15.289745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:15.290241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:15.290688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:15.291401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:15.291861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:15.292290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:15.429014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84ebd071-1954-4e85-ae74-f53938a717c6 tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.597773 Oct 24 09:00:15.429757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1007/1942] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:00:13 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:15.443204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74c9865b-b308-4aff-baa1-290ac0c946d6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab021f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:15.531922 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74c9865b-b308-4aff-baa1-290ac0c946d6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.100580 Oct 24 09:00:15.533829 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1008/1943] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:15 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:15.546256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:15.547108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:15.557936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:15.560820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:15.562507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:15.564446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:15.572878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:15.573610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:15.667342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:15.950519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48d9bb4b-b8f4-45fb-81ee-07d935d24cdf tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 204 len: 0 microversion: 2.25 time: 0.414672 Oct 24 09:00:15.951198 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1009/1944] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:00:15 2022] DELETE /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:00:15.963881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a23b3d4c-0303-40c6-b880-49ba6c08c2db tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] Action: 'create', calling method: .version_select at 0x7f8daafbfd30>, body: {"security_group": {"name": "tempest-securitygroup-928885368", "description": "tempest-description-1848392690"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:16.038848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:16.050691 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63306df1-f20c-48f7-8126-cae328b301aa tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.792799 Oct 24 09:00:16.057004 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 936/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:15 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:16.073280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:16.074225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:16.088379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:16.100225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:16.100760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:16.101629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:16.102238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:16.102902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:16.632573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:16.647988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:16.656436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:16.666022 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4182758-2fa5-40b4-b1a1-5240a267da9a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1482 microversion: 2.25 time: 0.603105 Oct 24 09:00:16.668723 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 937/1946] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:16 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1482 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:16.694286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-84c79aa3-059c-4207-b59f-0b9017545dac req-5c422baa-8cf1-4f16-b536-384a19f8407a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf822847-521b-44e9-a65b-4fad1b65b22b", "name": "network-vif-plugged", "status": "completed", "tag": "fbdb6016-f219-4ab0-8a19-94ba9eeee206"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:16.725019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-84c79aa3-059c-4207-b59f-0b9017545dac req-5c422baa-8cf1-4f16-b536-384a19f8407a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:16.725982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-84c79aa3-059c-4207-b59f-0b9017545dac req-5c422baa-8cf1-4f16-b536-384a19f8407a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:16.728413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-84c79aa3-059c-4207-b59f-0b9017545dac req-5c422baa-8cf1-4f16-b536-384a19f8407a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:16.759504 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-84c79aa3-059c-4207-b59f-0b9017545dac req-5c422baa-8cf1-4f16-b536-384a19f8407a service nova] Creating event network-vif-plugged:fbdb6016-f219-4ab0-8a19-94ba9eeee206 for instance bf822847-521b-44e9-a65b-4fad1b65b22b on n-h2-master-1 Oct 24 09:00:16.774066 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-84c79aa3-059c-4207-b59f-0b9017545dac req-5c422baa-8cf1-4f16-b536-384a19f8407a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099732 Oct 24 09:00:16.775473 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 938/1947] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:16.811020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c180c35e-3e9e-4e1b-a903-68366c0812a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2418b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:16.943491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c180c35e-3e9e-4e1b-a903-68366c0812a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.164442 Oct 24 09:00:16.944066 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 939/1948] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:16 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:16.976039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:16.976675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:16.988959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:16.989715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:16.990260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:16.991251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:16.991925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:16.992567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:17.042430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:17.202845 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a23b3d4c-0303-40c6-b880-49ba6c08c2db tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.244516 Oct 24 09:00:17.205262 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1010/1949] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:00:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:17.213637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:17.214649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:17.217364 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ea3f3a3-53b8-469c-92d0-caecdc938d65 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 204 len: 0 microversion: 2.1 time: 0.246995 Oct 24 09:00:17.223893 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 940/1950] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:00:16 2022] DELETE /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:00:17.234171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:17.234947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:17.235568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:17.236907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:17.237594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:17.238176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:17.404606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32352bb4-653f-48ec-b365-45483c02163e tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] Action: 'create', calling method: .version_select at 0x7f8daf251700>, body: {"security_group": {"name": "tempest-securitygroup-1764579375", "description": "tempest-description-1508640380"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:17.579272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:17.600273 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4087e224-3656-4e13-93eb-a97595bfb87f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1312 microversion: 2.1 time: 0.390183 Oct 24 09:00:17.603981 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1011/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:17 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:17.631572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:17.632473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:17.639694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:17.641355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:17.642022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:17.643008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:17.643711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:17.644371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:18.155767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:18.168019 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9f2c713-902b-4f5b-b439-6eb133721f78 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1588 microversion: 2.1 time: 0.561430 Oct 24 09:00:18.183715 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1012/1952] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:17 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1588 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:18.183715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:18.183715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:18.201261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:18.202410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:18.204130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:18.204973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:18.208028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:18.208524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:18.317740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32352bb4-653f-48ec-b365-45483c02163e tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.090975 Oct 24 09:00:18.318359 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 941/1953] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:00:17 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:18.331182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0377e950-2004-4ba0-8eab-a93376c10cc9 req-2557491e-5517-475b-b889-f1685b172bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80812fd-0278-4677-bc3c-c5e5c6915a87", "tag": "bc200002-faae-4234-b7b9-79cfaa369c80"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:18.367497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0377e950-2004-4ba0-8eab-a93376c10cc9 req-2557491e-5517-475b-b889-f1685b172bf9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:18.373129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0377e950-2004-4ba0-8eab-a93376c10cc9 req-2557491e-5517-475b-b889-f1685b172bf9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:18.373932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0377e950-2004-4ba0-8eab-a93376c10cc9 req-2557491e-5517-475b-b889-f1685b172bf9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:18.405742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0377e950-2004-4ba0-8eab-a93376c10cc9 req-2557491e-5517-475b-b889-f1685b172bf9 service nova] Creating event network-changed:bc200002-faae-4234-b7b9-79cfaa369c80 for instance b80812fd-0278-4677-bc3c-c5e5c6915a87 on n-h1-master-1 Oct 24 09:00:18.419835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0377e950-2004-4ba0-8eab-a93376c10cc9 req-2557491e-5517-475b-b889-f1685b172bf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092345 Oct 24 09:00:18.421032 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 942/1954] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:18.465927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:18.472817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:18.502208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:18.510643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:18.512827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:18.515163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:18.519357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:18.520028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:18.851834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:18.866438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b736ff66-fc88-4e37-9d9b-c6c4d2036de0 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1515 microversion: 2.1 time: 0.693934 Oct 24 09:00:18.887754 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1013/1955] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:18 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1515 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:18.910961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c1ba12e-3624-429e-a7fb-0eb83c20a87a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab023280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:19.025548 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c1ba12e-3624-429e-a7fb-0eb83c20a87a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.130619 Oct 24 09:00:19.029140 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1014/1956] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:18 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:19.052774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5712f87c-dea4-428b-8c18-196a99ab748d tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] Action: 'create', calling method: .version_select at 0x7f8dab5db040>, body: {"security_group": {"name": "tempest-securitygroup-1665762734", "description": "tempest-description-2076672031"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:19.379780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:19.390321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:19.414479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:19.417967 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bd81780-104f-4ab0-8f85-929641519d56 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1440 microversion: 2.25 time: 0.995568 Oct 24 09:00:19.421952 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 943/1957] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:18 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1440 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:19.435336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:19.436179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:19.474392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:19.475145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:19.475863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:19.477234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:19.478905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:19.481733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:20.128377 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5712f87c-dea4-428b-8c18-196a99ab748d tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.097834 Oct 24 09:00:20.129885 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1015/1958] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:00:19 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:20.140061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1f2e25bd-c4a1-43b4-8e4a-0304321f2029 req-7633d0c2-12b8-4932-a212-2c759d518892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdec22b-c1b9-43d0-925d-a336000ab69a", "name": "network-vif-deleted", "tag": "a0f47b55-e796-401b-be51-e42505fa50e2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:20.216053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1f2e25bd-c4a1-43b4-8e4a-0304321f2029 req-7633d0c2-12b8-4932-a212-2c759d518892 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:20.216819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1f2e25bd-c4a1-43b4-8e4a-0304321f2029 req-7633d0c2-12b8-4932-a212-2c759d518892 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:20.219731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1f2e25bd-c4a1-43b4-8e4a-0304321f2029 req-7633d0c2-12b8-4932-a212-2c759d518892 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:20.256936 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1f2e25bd-c4a1-43b4-8e4a-0304321f2029 req-7633d0c2-12b8-4932-a212-2c759d518892 service nova] Creating event network-vif-deleted:a0f47b55-e796-401b-be51-e42505fa50e2 for instance 5bdec22b-c1b9-43d0-925d-a336000ab69a on n-h1-master-1 Oct 24 09:00:20.273026 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1f2e25bd-c4a1-43b4-8e4a-0304321f2029 req-7633d0c2-12b8-4932-a212-2c759d518892 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141880 Oct 24 09:00:20.280134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1016/1959] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:20.291414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:20.293669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:20.311537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:20.312425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:20.313050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:20.313975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:20.314586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:20.317506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:20.331732 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:20.481885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:20.497287 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37300775-7c49-410d-aa2d-533db1983d02 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 200 len: 1473 microversion: 2.1 time: 0.209198 Oct 24 09:00:20.500994 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1017/1960] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:20 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 1473 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:20.509976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1fb1d62-0214-488a-9dff-236cabe28ca2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2bcb80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:20.615321 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1fb1d62-0214-488a-9dff-236cabe28ca2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.112859 Oct 24 09:00:20.615908 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1018/1961] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:20 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:20.626400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d43f49d-2a1c-4834-a67f-2feb72e9d969 tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] Calling method '.version_select at 0x7f8daf2c65e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:21.134909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:21.155121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37c770e5-0d89-4c27-b506-78f59d811da6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1499 microversion: 2.1 time: 1.728823 Oct 24 09:00:21.164188 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 944/1962] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:19 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1499 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:21.184184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:21.201277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:21.243749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:21.244293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:21.244731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:21.251813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:21.252276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:21.252721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:21.575654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:21.592439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:21.600412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:21.608433 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-845026db-d538-4205-89a3-19a819d836c1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1265 microversion: 2.25 time: 0.437928 Oct 24 09:00:21.625622 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 945/1963] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:21 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1265 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:21.643598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56a1361b-4164-4dc5-86eb-54208c211591 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:21.661512 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:21.666381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56a1361b-4164-4dc5-86eb-54208c211591 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:21.668330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56a1361b-4164-4dc5-86eb-54208c211591 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:21.670615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56a1361b-4164-4dc5-86eb-54208c211591 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:21.736728 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:21.745122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56a1361b-4164-4dc5-86eb-54208c211591 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Going to try to stop instance {{(pid=126919) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:00:21.863208 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56a1361b-4164-4dc5-86eb-54208c211591 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b/action" status: 202 len: 0 microversion: 2.1 time: 0.234737 Oct 24 09:00:21.864189 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 946/1964] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:00:21 2022] POST /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:21.871588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:21.872297 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: eb0264c1-cb57-49ac-b257-933fc285441c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:21.891494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:21.891991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:21.892431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:21.893135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:21.893636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:21.894064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:21.916802 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] HTTP exception thrown: Instance eb0264c1-cb57-49ac-b257-933fc285441c could not be found. Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Request method failure captured: Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c HTTP/1.1 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlN_FqYsUtgXypFmQ1qsHHMG5b_2axNQZtWuBk37phurA149-2Gmzk7DzIB6L-RFE5vFqBXYpoz0Zhfua0UNLISqV1qYd06JfKp1P57j6SeWbNyjN6Z4FdDGg_J-QzXHgYlPwnAnRBn-fGEsazfNLfQq_KBaT7wv5zPiiEYkjBKqUio Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: c229d0d4780449dd9b751ffb8b1b734d Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesAdminNegativeTest-75086040 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c229d0d4780449dd9b751ffb8b1b734d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c229d0d4780449dd9b751ffb8b1b734d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c229d0d4780449dd9b751ffb8b1b734d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c229d0d4780449dd9b751ffb8b1b734d"}]}] Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesAdminNegativeTest-75086040 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: c229d0d4780449dd9b751ffb8b1b734d Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-75086040 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesAdminNegativeTest-75086040-project Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9f3fa66a009149e8b5cec58e4b24a788 Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesAdminNegativeTest-75086040-project Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: exception: Instance eb0264c1-cb57-49ac-b257-933fc285441c could not be found. Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'eb0264c1-cb57-49ac-b257-933fc285441c'} Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0264c1-cb57-49ac-b257-933fc285441c could not be found. Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0264c1-cb57-49ac-b257-933fc285441c could not be found. Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:21.927371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0264c1-cb57-49ac-b257-933fc285441c could not be found. Oct 24 09:00:21.931434 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:21.936445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Returning 404 to user: Instance eb0264c1-cb57-49ac-b257-933fc285441c could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:21.938734 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4efb82e9-675f-451b-98e7-b15f51dcaa66 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c" status: 404 len: 111 microversion: 2.1 time: 0.073372 Oct 24 09:00:21.946058 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 947/1965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:21 2022] GET /compute/v2.1/servers/eb0264c1-cb57-49ac-b257-933fc285441c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:21.956438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d299d4cd-6699-420b-903b-485faa65a373 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab48edc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:22.070260 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d299d4cd-6699-420b-903b-485faa65a373 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.122620 Oct 24 09:00:22.081867 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 948/1966] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:21 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:22.095787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:22.109183 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:22.135244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:22.136511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:22.138272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:22.152478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:22.153210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:22.153931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:23.236962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:23.246703 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6b322d5-bd53-421c-a03c-2a439e192930 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 1.156916 Oct 24 09:00:23.269742 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 949/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:22 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:23.284657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-295ec8e8-8ddf-4dae-ad9a-cdc5f9de9776 req-d8224629-c5c7-4da7-b2ac-1c1fead3b372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0264c1-cb57-49ac-b257-933fc285441c", "name": "network-vif-deleted", "tag": "55358d20-1213-4bcb-be7c-cab16de89c5e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:23.322007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-295ec8e8-8ddf-4dae-ad9a-cdc5f9de9776 req-d8224629-c5c7-4da7-b2ac-1c1fead3b372 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:23.322491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-295ec8e8-8ddf-4dae-ad9a-cdc5f9de9776 req-d8224629-c5c7-4da7-b2ac-1c1fead3b372 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:23.322923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-295ec8e8-8ddf-4dae-ad9a-cdc5f9de9776 req-d8224629-c5c7-4da7-b2ac-1c1fead3b372 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:23.349284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-295ec8e8-8ddf-4dae-ad9a-cdc5f9de9776 req-d8224629-c5c7-4da7-b2ac-1c1fead3b372 service nova] Creating event network-vif-deleted:55358d20-1213-4bcb-be7c-cab16de89c5e for instance eb0264c1-cb57-49ac-b257-933fc285441c on n-h1-master-1 Oct 24 09:00:23.365758 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-295ec8e8-8ddf-4dae-ad9a-cdc5f9de9776 req-d8224629-c5c7-4da7-b2ac-1c1fead3b372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094374 Oct 24 09:00:23.366680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 950/1968] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:23.376877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:23.379831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:23.394209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:23.395197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:23.396328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:23.397896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:23.399815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:23.401792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:23.553729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:23.562254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:23.563688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:23.571372 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-09abac23-cf69-406f-9d2c-bb140587c0ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1265 microversion: 2.25 time: 0.203253 Oct 24 09:00:23.573839 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 951/1969] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:23 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:23.600776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac18b28a-6bcb-4c2f-94a1-b167e3b5eee5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf24d9d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:23.724599 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac18b28a-6bcb-4c2f-94a1-b167e3b5eee5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.132178 Oct 24 09:00:23.732529 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 952/1970] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:23 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:23.735282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:23.753225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:23.766563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:23.767058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:23.767492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:23.768204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:23.768660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:23.769085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:23.798601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'flavor' on Instance uuid babd364b-580f-4919-a727-94169135c910 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:24.160746 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f4c6073-0fec-42cc-99ee-bef45e0f0c4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/action" status: 200 len: 32 microversion: 2.1 time: 0.431529 Oct 24 09:00:24.174158 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 953/1971] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:00:23 2022] POST /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:00:24.182694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d205ab0-821a-495a-b765-7f347b886cf9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Action: 'create', calling method: .version_select at 0x7f8dab48e280>, body: {"keypair": {"name": "tempest-keypair-289734879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw36Zeg1mKfepiyBcii9em+IdI883m9Qd719+gZhLiTq53Ji3PrPBRjnVo+/ivDzJdHyjrDCUBh2AmNqqQU5mMQ8zkdQZ0H5Mdn9UFVbdNx/NTTAQik9/afge+MuZ9CaQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:24.230464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0d205ab0-821a-495a-b765-7f347b886cf9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Getting quotas for project 3c86dafe5aca46ecac15a54389270136. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:24.255030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0d205ab0-821a-495a-b765-7f347b886cf9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Getting quotas for user b245555254674c8eac74a684b9da59cc and project 3c86dafe5aca46ecac15a54389270136. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:24.318542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d205ab0-821a-495a-b765-7f347b886cf9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.141568 Oct 24 09:00:24.319371 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 954/1972] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 09:00:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 09:00:24.325579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:24.326572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:24.335751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:24.337157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:24.337842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:24.338782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:24.339442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:24.340665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:24.979950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:24.992368 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-edb0646e-9931-4445-9df3-09bae663c4d0 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.671596 Oct 24 09:00:24.993682 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 955/1973] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:24 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:25.002970 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d43f49d-2a1c-4834-a67f-2feb72e9d969 tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13607 microversion: 2.1 time: 4.385924 Oct 24 09:00:25.005075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1019/1974] 10.222.0.25 () {58 vars in 1191 bytes} [Mon Oct 24 09:00:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13607 bytes in 4388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:00:25.009707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:25.010720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:25.019620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:25.020254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:25.030290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:25.032220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:25.033143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:25.036564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:25.037334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:25.038031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:25.045424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:25.046184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:25.048154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:25.049091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:25.053889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:25.056073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:25.241158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:25.250045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:25.251597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:25.252783 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cdf615ce-b223-49ef-ac17-c7f3151ea215 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1265 microversion: 2.25 time: 0.246575 Oct 24 09:00:25.253394 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1020/1975] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:25 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:25.271048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39b188d2-d0e6-49c6-a953-ae552625619a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab021dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:25.356436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-39b188d2-d0e6-49c6-a953-ae552625619a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.101714 Oct 24 09:00:25.358234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1021/1976] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:25 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:25.373797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90cd0158-aa84-491d-b44c-11316f2d1d80 tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] Calling method '.version_select at 0x7f8dab023280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:25.649319 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90cd0158-aa84-491d-b44c-11316f2d1d80 tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.289329 Oct 24 09:00:25.649921 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1022/1977] 10.222.0.25 () {58 vars in 1191 bytes} [Mon Oct 24 09:00:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:25.664630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3995472-42a5-4c88-a361-d0008c9d51b2 tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] Calling method '.version_select at 0x7f8daf2c6dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:25.931369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:25.953263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c81bef92-8c29-46fd-a88a-a0114eef8b5c tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.957731 Oct 24 09:00:25.955169 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 956/1978] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:24 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:26.016933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.017707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:26.027768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:26.030376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:26.030986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:26.034514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:26.035159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:26.035703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:26.068689 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3995472-42a5-4c88-a361-d0008c9d51b2 tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/83e5e3d7-4451-40dd-bee5-435e4503fb99" status: 202 len: 0 microversion: 2.1 time: 0.408645 Oct 24 09:00:26.069617 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1023/1979] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:00:25 2022] DELETE /compute/v2.1/os-security-groups/83e5e3d7-4451-40dd-bee5-435e4503fb99 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:26.077611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-968083bb-1678-4723-b974-49d29dfa1f06 tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] Calling method '.version_select at 0x7f8daae00dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.279415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:26.288247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e5760cd-2414-48c9-a3e5-fe68d317ecc4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.275498 Oct 24 09:00:26.289392 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 957/1980] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:26 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:26.294186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.294984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:26.305221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:26.306599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:26.309911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:26.311158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:26.311637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:26.312071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:26.459867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:26.471757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:26.474926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:26.476480 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72339751-6fe0-4f6d-9386-672aa3472b98 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1265 microversion: 2.25 time: 0.185937 Oct 24 09:00:26.477176 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 958/1981] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:26 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:26.486317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18fb0d58-49e4-44fc-b676-970a8570e6fe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf4c1f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.557250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-968083bb-1678-4723-b974-49d29dfa1f06 tempest-SecurityGroupsTestAdminJSON-629311878 tempest-SecurityGroupsTestAdminJSON-629311878-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/af97e6db-41b6-4506-bc3e-a029934f13f7" status: 202 len: 0 microversion: 2.1 time: 0.483425 Oct 24 09:00:26.558435 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1024/1982] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:00:26 2022] DELETE /compute/v2.1/os-security-groups/af97e6db-41b6-4506-bc3e-a029934f13f7 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:26.582889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18fb0d58-49e4-44fc-b676-970a8570e6fe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1414 microversion: 2.1 time: 0.103822 Oct 24 09:00:26.583485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-880d45fb-ff36-40ed-9358-394a1f0eadcc tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] Calling method '.version_select at 0x7f8daf304940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.595144 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 959/1983] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:26 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:26.912241 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-880d45fb-ff36-40ed-9358-394a1f0eadcc tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5d4cecd6-e16b-4d7b-99d3-0f8791cc0845" status: 202 len: 0 microversion: 2.1 time: 0.349392 Oct 24 09:00:26.912864 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1025/1984] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:00:26 2022] DELETE /compute/v2.1/os-security-groups/5d4cecd6-e16b-4d7b-99d3-0f8791cc0845 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:26.921781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94de2696-3db2-49c4-b67c-106cc1f0e5a1 tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] Calling method '.version_select at 0x7f8daaef0700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.981466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:26.982444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:27.009967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.011044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.013747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.014747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.016971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.020360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.188741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94de2696-3db2-49c4-b67c-106cc1f0e5a1 tempest-SecurityGroupsTestAdminJSON-216540922 tempest-SecurityGroupsTestAdminJSON-216540922-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4a3434f4-0b36-4c62-b697-5871f1081c33" status: 202 len: 0 microversion: 2.1 time: 0.271274 Oct 24 09:00:27.190545 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 960/1985] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:00:26 2022] DELETE /compute/v2.1/os-security-groups/4a3434f4-0b36-4c62-b697-5871f1081c33 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:27.268579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:27.278301 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e6664853-f9c6-4958-b6d4-a128f732b1af tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.303973 Oct 24 09:00:27.281332 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1026/1986] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:26 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:27.311342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:27.312134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:27.335717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.340193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.341079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.342808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.347845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.348496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.507247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:27.507871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:27.520325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.520823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.529041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.530185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.530956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.531768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.612730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:27.626655 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8540e610-895d-4c30-9f39-36878c98cb56 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.318431 Oct 24 09:00:27.629131 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 961/1987] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:27 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:27.634007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:27.637735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc989216-1ac4-43b2-9873-04d8f0b52df6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf24d3a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:27.639126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:27.639770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:27.640416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lazy-loading 'fault' on Instance uuid 5bdec22b-c1b9-43d0-925d-a336000ab69a {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:27.710826 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc989216-1ac4-43b2-9873-04d8f0b52df6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1423 microversion: 2.1 time: 0.080295 Oct 24 09:00:27.721892 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 962/1988] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:27 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:27.728918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2ce85b3e-acbb-4d74-b968-1143a83e304f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf1f2af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:27.744373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:27.757470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:27.759396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:27.761551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f75a594f-afc1-47f3-9775-5e665a19003a tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 200 len: 1193 microversion: 2.25 time: 0.259288 Oct 24 09:00:27.766003 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1027/1989] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:27 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 1193 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:00:27.801836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-447222996", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "707e9a50-9841-48b2-801d-2d9dc036fe1b"}, {"port": "0a11bffb-3310-4bac-9860-ed7aa8d96370", "tag": "port-1"}, {"port": "06864302-5b6e-408a-82ba-2c2ea4aa1f8d", "tag": "port-2"}, {"uuid": "91a2f185-c14a-45a1-88b1-3c889befc3c8", "tag": "net-1"}, {"uuid": "91a2f185-c14a-45a1-88b1-3c889befc3c8"}, {"uuid": "6b3c9e51-754e-457b-a33c-5f5b876627d3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6b3c9e51-754e-457b-a33c-5f5b876627d3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f0c341b9-5949-43de-bb6f-82853643e92d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b2498b4e-f0b3-4e63-8bf0-bd826fce669c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d18b147b-a41f-49ee-a9cf-3da032a698ae", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--500769081"}], "key_name": "tempest-keypair-289734879", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:27.812422 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2ce85b3e-acbb-4d74-b968-1143a83e304f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 200 len: 1423 microversion: 2.1 time: 0.086604 Oct 24 09:00:27.823289 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 963/1990] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:27 2022] GET /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:27.828193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-999e3794-b4ca-4d94-aa1b-8e2422c68e03 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf4c160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:27.951492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] validate_networks() for [('707e9a50-9841-48b2-801d-2d9dc036fe1b', None, None, None, None, None), (None, None, '0a11bffb-3310-4bac-9860-ed7aa8d96370', None, None, None), (None, None, '06864302-5b6e-408a-82ba-2c2ea4aa1f8d', None, None, None), ('91a2f185-c14a-45a1-88b1-3c889befc3c8', None, None, None, None, None), ('91a2f185-c14a-45a1-88b1-3c889befc3c8', None, None, None, None, None), ('6b3c9e51-754e-457b-a33c-5f5b876627d3', '10.2.2.100', None, None, None, None), ('6b3c9e51-754e-457b-a33c-5f5b876627d3', '10.2.2.200', None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:28.624393 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-999e3794-b4ca-4d94-aa1b-8e2422c68e03 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 204 len: 0 microversion: 2.1 time: 0.799837 Oct 24 09:00:28.628215 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 964/1991] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:27 2022] DELETE /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:00:28.635097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:28.637091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:28.651580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:28.652532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:28.653150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:28.654045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:28.654655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:28.655234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:28.888903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:28.900525 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad9c4638-d1b7-4483-9cab-151379a9aca9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.269901 Oct 24 09:00:28.901412 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 965/1992] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:28 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:28.911952 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:28.912888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:28.923727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:28.924613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:28.925321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:28.926538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:28.927323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:28.928144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:28.964166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:29.086540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2da97c11-764c-4e20-b30b-80fdba6c0a7b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 204 len: 0 microversion: 2.1 time: 0.183139 Oct 24 09:00:29.088007 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 966/1993] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:00:28 2022] DELETE /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:00:29.096182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:29.097236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:29.140333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:29.140844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:29.141372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:29.142100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:29.142724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:29.143290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:29.456812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:29.460996 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:29.475144 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8bcca3b2-ea0f-4902-be5d-881cb71355de tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.382191 Oct 24 09:00:29.475762 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 967/1994] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:29 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:29.501837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:29.503494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 5bdec22b-c1b9-43d0-925d-a336000ab69a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:29.512432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:29.513421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:29.514351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:29.515847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:29.516645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:29.517079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:29.537558 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] HTTP exception thrown: Instance 5bdec22b-c1b9-43d0-925d-a336000ab69a could not be found. Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Request method failure captured: Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a HTTP/1.1 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlJXUJqRO_mBffhiQ_hQXrt-jOMEbcAO4ZRywYpVmQoywEoJowULAzRaxYuj9IfXJqGKqIvNeMpzansf30sqp0HRa5t98LogijdaNhLxSd30OyfBoCQkVukjuCI_AL8V843r-n0V4i9gbXgnDbXspOgcuWcVid7X8_Ewz211t1tfXDs Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad4d1fc14f404932ab515a6a4c5a3048"}]}] Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: cc0be0ed857d4c96b26724144e20d766 Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 5bdec22b-c1b9-43d0-925d-a336000ab69a could not be found. Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '5bdec22b-c1b9-43d0-925d-a336000ab69a'} Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bdec22b-c1b9-43d0-925d-a336000ab69a could not be found. Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bdec22b-c1b9-43d0-925d-a336000ab69a could not be found. Oct 24 09:00:29.540403 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bdec22b-c1b9-43d0-925d-a336000ab69a could not be found. Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Returning 404 to user: Instance 5bdec22b-c1b9-43d0-925d-a336000ab69a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:29.543573 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0b623c5-953a-4cbf-95fc-6a732fe63719 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a" status: 404 len: 111 microversion: 2.25 time: 0.055126 Oct 24 09:00:29.544719 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 968/1995] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:29 2022] GET /compute/v2.1/servers/5bdec22b-c1b9-43d0-925d-a336000ab69a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:00:29.551686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-946203695", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "62c56d9c-5126-43a0-b067-60873881adab"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:29.628626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] validate_networks() for [('62c56d9c-5126-43a0-b067-60873881adab', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:30.422694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:30.423459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:30.424159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:30.424773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:30.425508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:30.445421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:30.447571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:30.449763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:30.450767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:30.451623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:30.452912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:30.487418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:30.505074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for user ca932e5866274fc78b04689811e72746 and project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:30.538137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:00:30.545745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:00:30.668785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b5220673-e578-4193-9056-bce40e9515ac tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123333 Oct 24 09:00:30.675736 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 969/1996] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:00:30.680970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:30.688008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:30.734164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:30.735122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:30.735122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:30.735792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:30.736252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:30.736678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:31.478337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:31.493684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0472265-8596-4090-9436-81cf70b539b2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.811842 Oct 24 09:00:31.494650 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 970/1997] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:30 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:31.503230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:31.504689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:31.520682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:31.521538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:31.522209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:31.523307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:31.526934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:31.528140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.153125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:32.169894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c2de8db3-8fcf-450c-b00c-b4015a63534c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.673912 Oct 24 09:00:32.175637 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 971/1998] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:31 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:32.209782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:32.210855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:32.229922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.230865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.232331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.233796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.234493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.244275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.372348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:32.380854 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71cf1375-d395-4164-823e-1b45ee870759 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1259 microversion: 2.1 time: 0.202646 Oct 24 09:00:32.386570 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 972/1999] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:32 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:32.407090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b366a887-9a30-431a-a61b-b687051a7519 req-09b3aa26-d721-491f-a66e-90be753b4544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c88a-b3be-4eef-aa43-aa08d5f3a59a", "name": "network-vif-unplugged", "status": "completed", "tag": "8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:32.438960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b366a887-9a30-431a-a61b-b687051a7519 req-09b3aa26-d721-491f-a66e-90be753b4544 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.439814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b366a887-9a30-431a-a61b-b687051a7519 req-09b3aa26-d721-491f-a66e-90be753b4544 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.440480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b366a887-9a30-431a-a61b-b687051a7519 req-09b3aa26-d721-491f-a66e-90be753b4544 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.468528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b366a887-9a30-431a-a61b-b687051a7519 req-09b3aa26-d721-491f-a66e-90be753b4544 service nova] Creating event network-vif-unplugged:8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d for instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a on n-h1-master-1 Oct 24 09:00:32.479602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b366a887-9a30-431a-a61b-b687051a7519 req-09b3aa26-d721-491f-a66e-90be753b4544 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091581 Oct 24 09:00:32.487188 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 973/2000] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:32.493646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:32.494692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:32.503520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.504763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.505384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.506275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.506885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.507472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.560935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:32.562005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:32.562648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:32.563225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:32.563798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:32.573023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:32.577372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.578221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.578995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.579891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:32.580508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:32.581275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:32.631818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Getting quotas for project 3c86dafe5aca46ecac15a54389270136. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:32.644769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Getting quotas for user b245555254674c8eac74a684b9da59cc and project 3c86dafe5aca46ecac15a54389270136. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:32.718565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46681636-c9ee-4df6-a5b6-800e0e3342d1 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 204 len: 0 microversion: 2.1 time: 0.229664 Oct 24 09:00:32.722427 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 974/2001] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:00:32 2022] DELETE /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:00:32.919278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:00:32.923225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f0c341b9-5949-43de-bb6f-82853643e92d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b2498b4e-f0b3-4e63-8bf0-bd826fce669c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d18b147b-a41f-49ee-a9cf-3da032a698ae',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:00:33.037645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1859429483", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:33.140528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:33.489431 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e37658d-31ba-41da-915c-6909e30adbea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.692947 Oct 24 09:00:33.496701 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1028/2002] 10.222.0.25 () {62 vars in 1189 bytes} [Mon Oct 24 09:00:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 5698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 24 09:00:33.499448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:33.500080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:33.506892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.507384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.508058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.508802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.509265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.509716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.619453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:33.619875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:33.620313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:33.620766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:33.621501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:33.639545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.640973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.641518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.642498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.643171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.643796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.689379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Getting quotas for project 72bbfc5e1e574b689ef044341663b776. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:33.698090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Getting quotas for user 0fd6766aed02437eb254480dba23f9db and project 72bbfc5e1e574b689ef044341663b776. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:33.715962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:00:33.719105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:00:33.769217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:33.779146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-833d2dbe-0dc7-41a6-9ea5-fb860c5b6f2f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.284182 Oct 24 09:00:33.779737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1029/2003] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:33 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:33.784781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3a14c7e3-8ee8-4c63-8146-2047b9445ad9 req-ba6b68c9-c85c-42b9-9374-6c9f2f1cf7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c88a-b3be-4eef-aa43-aa08d5f3a59a", "name": "network-vif-deleted", "tag": "8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:33.793540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-365460df-9963-437c-a261-41bd625871c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069449 Oct 24 09:00:33.797073 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 975/2004] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:00:33.812508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:33.813133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:33.818412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3a14c7e3-8ee8-4c63-8146-2047b9445ad9 req-ba6b68c9-c85c-42b9-9374-6c9f2f1cf7ce service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.819095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3a14c7e3-8ee8-4c63-8146-2047b9445ad9 req-ba6b68c9-c85c-42b9-9374-6c9f2f1cf7ce service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.819700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3a14c7e3-8ee8-4c63-8146-2047b9445ad9 req-ba6b68c9-c85c-42b9-9374-6c9f2f1cf7ce service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.838090 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3a14c7e3-8ee8-4c63-8146-2047b9445ad9 req-ba6b68c9-c85c-42b9-9374-6c9f2f1cf7ce service nova] Creating event network-vif-deleted:8adece7f-9d8a-4c3d-90ae-93aa8b6a0d9d for instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a on n-h1-master-1 Oct 24 09:00:33.844378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3a14c7e3-8ee8-4c63-8146-2047b9445ad9 req-ba6b68c9-c85c-42b9-9374-6c9f2f1cf7ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062950 Oct 24 09:00:33.845665 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1030/2005] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:33.853763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:33.854685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:33.863299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.864868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.865648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.866599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.866956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.867564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.868304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.870175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.870774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:33.871851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:33.872320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:33.872749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:34.053009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:34.081708 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd685427-bd7a-4106-aa11-2529c67af2d5 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.232170 Oct 24 09:00:34.099795 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1031/2006] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:33 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:34.110767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:34.114940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:34.130055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:34.130730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:34.132573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:34.133517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:34.135586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:34.136603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:34.228925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:34.238377 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b510098a-2019-4ee9-9b49-11f8445729cb tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1683 microversion: 2.1 time: 0.439612 Oct 24 09:00:34.253792 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 976/2007] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:33 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1683 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:34.253792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c070bc1c-1be4-4efe-843c-822ee8a0aaab tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:34.253974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c070bc1c-1be4-4efe-843c-822ee8a0aaab tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:34.304146 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:34.317489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:34.326668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a2b3532-ae10-48c6-b866-44d38716a484 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1267 microversion: 2.1 time: 0.225444 Oct 24 09:00:34.346829 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1032/2008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:34 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:34.390943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-740431068", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:34.431568 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:34.513276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c070bc1c-1be4-4efe-843c-822ee8a0aaab tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:34.537209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c070bc1c-1be4-4efe-843c-822ee8a0aaab tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:34.551707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c070bc1c-1be4-4efe-843c-822ee8a0aaab tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:34.557608 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c070bc1c-1be4-4efe-843c-822ee8a0aaab tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1284 microversion: 2.42 time: 0.316398 Oct 24 09:00:34.568970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:34.575767 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 977/2009] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:34 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:34.807842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:34.808559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:34.828796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:34.831601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:34.833457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:34.837005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:34.839996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:34.842458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.018452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:00:35.020088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:00:35.020727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:00:35.021307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:00:35.021896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:00:35.037217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.038125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.038833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.039920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.040497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.041216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.071460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Getting quotas for project 72bbfc5e1e574b689ef044341663b776. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:00:35.077938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Getting quotas for user 0fd6766aed02437eb254480dba23f9db and project 72bbfc5e1e574b689ef044341663b776. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:00:35.091966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:00:35.094697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:00:35.161113 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab1a59ea-8ed3-47a7-9264-53cb39156819 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812083 Oct 24 09:00:35.166020 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1033/2010] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:00:35.175865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:35.175865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:35.190241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.192456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.192915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.193701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.194299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.207004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.244069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:35.260888 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d4d7cca-2852-49fb-97e6-8e0f5e71de63 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.457463 Oct 24 09:00:35.262955 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 978/2011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:34 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:35.275787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51a41813-55a7-4488-b74e-e38b7e29bf9a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:35.278069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-51a41813-55a7-4488-b74e-e38b7e29bf9a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:35.384875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-51a41813-55a7-4488-b74e-e38b7e29bf9a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:35.396860 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-51a41813-55a7-4488-b74e-e38b7e29bf9a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1213 microversion: 2.1 time: 0.132555 Oct 24 09:00:35.399621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 979/2012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:35 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:35.418878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:35.420272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:35.430796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.431502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.432140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.433179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.433997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.435264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.563494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:35.576572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f456d05-8885-4c5c-b310-a604a36a8e0c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.409353 Oct 24 09:00:35.579800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1034/2013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:35 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:35.594019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:35.594966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:35.616149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.618283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.618748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.624619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.625683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.626154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.684194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:35.692696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4497230e-cc20-4e1d-8a3e-a79df5ff8ab2 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1683 microversion: 2.1 time: 0.278017 Oct 24 09:00:35.704805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 980/2014] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:35 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1683 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:35.710132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:35.710890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:35.726172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.729886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.730639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.731675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.732344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.734013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.775924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:35.895449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31fde92f-0471-441a-9055-6e39152a6ee7 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 204 len: 0 microversion: 2.25 time: 0.188559 Oct 24 09:00:35.896395 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 981/2015] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:00:35 2022] DELETE /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:00:35.924398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:35.929038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:35.941817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.942320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.943053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:35.943765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:35.945913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:35.947944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.059819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.076609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e6304e2-94cf-430a-872f-0d3f87d33430 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.488717 Oct 24 09:00:36.078483 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1035/2016] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:35 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:36.093533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:36.094659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:36.103623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.115717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.116492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.119637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.120258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.123102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.259901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.275300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.276726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.280945 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a76babe-2811-4668-a317-2a5125e51e15 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1518 microversion: 2.42 time: 0.372496 Oct 24 09:00:36.286333 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 982/2017] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:35 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:36.471494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.481778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.483220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.491910 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6f0fa30-3a47-4a6a-9a8e-b58ff728bbd1 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1731 microversion: 2.25 time: 0.411890 Oct 24 09:00:36.499200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1036/2018] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:36 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1731 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:36.508220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:36.509162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:36.520658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.521980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.522698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.523734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.524648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.525250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.533173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:36.533991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:36.558148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.560940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.561632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.563540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.566592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.567226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.790472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:36.799150 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8b27ac3-1e27-4a1e-9398-d870aa6841f4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1209 microversion: 2.1 time: 0.298024 Oct 24 09:00:36.805605 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1037/2019] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:36 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1209 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:36.819159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:36.820135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:36.826668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.830950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.831637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:36.833105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:36.835038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:36.839181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.002819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.015974 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b81365e-6e1b-410d-a6ba-24270085e5d6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.727411 Oct 24 09:00:37.032383 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 983/2020] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:36 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:37.036927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:37.037597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:37.047296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.047894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.048334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.049057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.049610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.050026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.193127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3fa66a009149e8b5cec58e4b24a788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c229d0d4780449dd9b751ffb8b1b734d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.207274 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7240227-d8c5-4c13-8d25-a7557fd6734d tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 200 len: 1615 microversion: 2.1 time: 0.175770 Oct 24 09:00:37.208747 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 984/2021] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:37 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 1615 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:37.213234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.217460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:37.218469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:37.226501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.227402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.228966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.230272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.231097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.231745 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-83290f8f-49be-4db6-95e1-f90d7f7d21e7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.424798 Oct 24 09:00:37.231857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.236829 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1038/2022] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:36 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:37.263692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-73984068-a173-4371-a789-e39535989174 req-debda0ac-2045-47f6-8b9b-b1765a114795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffca5715-95e0-4499-a802-9b5e37649ce6", "name": "network-vif-deleted", "tag": "2a5d8582-20a9-4c8a-8a1b-ba8c036c2079"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:37.291635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-73984068-a173-4371-a789-e39535989174 req-debda0ac-2045-47f6-8b9b-b1765a114795 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.292415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-73984068-a173-4371-a789-e39535989174 req-debda0ac-2045-47f6-8b9b-b1765a114795 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.293000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-73984068-a173-4371-a789-e39535989174 req-debda0ac-2045-47f6-8b9b-b1765a114795 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.313488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-73984068-a173-4371-a789-e39535989174 req-debda0ac-2045-47f6-8b9b-b1765a114795 service nova] Creating event network-vif-deleted:2a5d8582-20a9-4c8a-8a1b-ba8c036c2079 for instance ffca5715-95e0-4499-a802-9b5e37649ce6 on n-h2-master-1 Oct 24 09:00:37.323161 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-73984068-a173-4371-a789-e39535989174 req-debda0ac-2045-47f6-8b9b-b1765a114795 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083133 Oct 24 09:00:37.324934 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1039/2023] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:37.330926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:37.332436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:37.341232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.341992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.343309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.344667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.345280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.346735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.689100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.692685 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:37.698669 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f780cfc3-1084-452e-96f0-88145e9fdbcf tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.488142 Oct 24 09:00:37.699264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 985/2024] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:37 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:37.716449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:37.719526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:37.734062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.734564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.736912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.737913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.739016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.739481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.744889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.777382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.779289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:37.781368 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-758329c0-c2e4-488f-921a-fc718cd05120 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1582 microversion: 2.42 time: 0.455078 Oct 24 09:00:37.813788 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1040/2025] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:37 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1582 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:37.829309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:37.831039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:37.845084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.845955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.846620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:37.847697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:37.848875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:37.849654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.022062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:38.036660 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19b3c749-8472-47fc-9f8e-57ab859e50e7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1265 microversion: 2.1 time: 0.212637 Oct 24 09:00:38.037332 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1041/2026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:37 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:38.050510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:38.053308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:38.073713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.075955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.075955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.080300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.080926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.088156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.435357 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:38.447478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35be9b6b-4a8f-4d6b-bb9a-08d47c4403ec tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.405488 Oct 24 09:00:38.450167 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1042/2027] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:38 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:38.455096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:38.455936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] [instance: ffca5715-95e0-4499-a802-9b5e37649ce6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:38.491443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.492194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.492780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.494129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.495923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.498111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.536695 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:38.538793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] HTTP exception thrown: Instance ffca5715-95e0-4499-a802-9b5e37649ce6 could not be found. Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Request method failure captured: Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 HTTP/1.1 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlN_FqYsUtgXypFmQ1qsHHMG5b_2axNQZtWuBk37phurA149-2Gmzk7DzIB6L-RFE5vFqBXYpoz0Zhfua0UNLISqV1qYd06JfKp1P57j6SeWbNyjN6Z4FdDGg_J-QzXHgYlPwnAnRBn-fGEsazfNLfQq_KBaT7wv5zPiiEYkjBKqUio Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c229d0d4780449dd9b751ffb8b1b734d Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesAdminNegativeTest-75086040 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c229d0d4780449dd9b751ffb8b1b734d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c229d0d4780449dd9b751ffb8b1b734d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c229d0d4780449dd9b751ffb8b1b734d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c229d0d4780449dd9b751ffb8b1b734d"}]}] Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesAdminNegativeTest-75086040 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c229d0d4780449dd9b751ffb8b1b734d Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-75086040 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesAdminNegativeTest-75086040-project Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9f3fa66a009149e8b5cec58e4b24a788 Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesAdminNegativeTest-75086040-project Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: exception: Instance ffca5715-95e0-4499-a802-9b5e37649ce6 could not be found. Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ffca5715-95e0-4499-a802-9b5e37649ce6'} Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffca5715-95e0-4499-a802-9b5e37649ce6 could not be found. Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffca5715-95e0-4499-a802-9b5e37649ce6 could not be found. Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:38.541130 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffca5715-95e0-4499-a802-9b5e37649ce6 could not be found. Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Returning 404 to user: Instance ffca5715-95e0-4499-a802-9b5e37649ce6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:38.546048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2ca8ff7-4554-4453-89d4-0b327ab908a9 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6" status: 404 len: 111 microversion: 2.1 time: 0.094289 Oct 24 09:00:38.548389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1043/2028] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:38 2022] GET /compute/v2.1/servers/ffca5715-95e0-4499-a802-9b5e37649ce6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:38.558635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:38.558635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:38.571138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.575666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.579358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.580269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.580762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.587186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.861612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:38.873988 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40a501b2-2ad5-402d-90e2-521724c5e37b tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.324452 Oct 24 09:00:38.876374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1044/2029] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:38 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:38.884078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-6ae79a42-8063-4e4a-addf-8368d9372514 req-980d6aec-fce1-42d3-af84-dafb9d25c100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ecb5b4-493b-4afa-bd2f-237024e8eebb", "tag": "128a0c2a-8eae-4433-92d4-8145d8ae3d3b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:38.905369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6ae79a42-8063-4e4a-addf-8368d9372514 req-980d6aec-fce1-42d3-af84-dafb9d25c100 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.906101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6ae79a42-8063-4e4a-addf-8368d9372514 req-980d6aec-fce1-42d3-af84-dafb9d25c100 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:38.907107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6ae79a42-8063-4e4a-addf-8368d9372514 req-980d6aec-fce1-42d3-af84-dafb9d25c100 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:38.920935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:38.933260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:38.940660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:38.944921 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-043a2412-db3e-4783-bd07-da83edfa8e15 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1731 microversion: 2.25 time: 1.238468 Oct 24 09:00:38.946302 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-6ae79a42-8063-4e4a-addf-8368d9372514 req-980d6aec-fce1-42d3-af84-dafb9d25c100 service nova] Creating event network-changed:128a0c2a-8eae-4433-92d4-8145d8ae3d3b for instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb on n-h2-master-1 Oct 24 09:00:38.948847 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 986/2030] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:37 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1731 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:38.959721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58b30c76-3173-4f60-86ef-4bd37edbf1b6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] Calling method '.version_select at 0x7f8daf1f2280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:38.963887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-6ae79a42-8063-4e4a-addf-8368d9372514 req-980d6aec-fce1-42d3-af84-dafb9d25c100 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085994 Oct 24 09:00:38.965031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1045/2031] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:38.980989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:38.982853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:38.996679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:38.999507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.000424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.001529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.002282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.002877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.009392 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58b30c76-3173-4f60-86ef-4bd37edbf1b6 tempest-VolumesAdminNegativeTest-75086040 tempest-VolumesAdminNegativeTest-75086040-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-912060532" status: 202 len: 0 microversion: 2.1 time: 0.057971 Oct 24 09:00:39.010805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 987/2032] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-912060532 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:39.015832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:39.016772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:39.025529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.027696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.028352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.031321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.032013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.032618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.471948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:39.499436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc1d493e-215f-4618-98ba-72a16a2b1903 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.523421 Oct 24 09:00:39.500092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1046/2033] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:38 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:39.506935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:39.514856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:39.527009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.529176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.529795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.532374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.533149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.537846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.697130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:39.707902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:39.710209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:39.711556 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d00a18ae-2e4c-41f8-a8ac-d2bfdcd71698 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1592 microversion: 2.42 time: 0.699587 Oct 24 09:00:39.726819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 988/2034] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:39 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1592 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:39.740013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-639fca6f-7cc7-4cfb-a554-4fca8e7abdd5 req-a44b0c8c-95d2-44da-b167-af041d031b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792bb51b-253c-4fdb-ac1e-99e18bd2fce7", "name": "network-vif-deleted", "tag": "a424feab-3312-458c-9dd4-f47480184a8f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:39.756595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-639fca6f-7cc7-4cfb-a554-4fca8e7abdd5 req-a44b0c8c-95d2-44da-b167-af041d031b2c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.757058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:39.757190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-639fca6f-7cc7-4cfb-a554-4fca8e7abdd5 req-a44b0c8c-95d2-44da-b167-af041d031b2c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.757522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-639fca6f-7cc7-4cfb-a554-4fca8e7abdd5 req-a44b0c8c-95d2-44da-b167-af041d031b2c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.770704 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-557a1675-18ad-4ee3-ad0a-0cea3869f59e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1271 microversion: 2.1 time: 0.269491 Oct 24 09:00:39.775352 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1047/2035] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:39 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:39.787311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:39.788435 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-639fca6f-7cc7-4cfb-a554-4fca8e7abdd5 req-a44b0c8c-95d2-44da-b167-af041d031b2c service nova] Creating event network-vif-deleted:a424feab-3312-458c-9dd4-f47480184a8f for instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 on n-h1-master-1 Oct 24 09:00:39.791442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:39.796061 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-639fca6f-7cc7-4cfb-a554-4fca8e7abdd5 req-a44b0c8c-95d2-44da-b167-af041d031b2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067777 Oct 24 09:00:39.796852 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 989/2036] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:39.806278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.806825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.808870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.809689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.811521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.812248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.900533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:39.901237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:39.917560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.918062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.918503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:39.919802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:39.920265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:39.920693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.152663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:40.167291 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c268a67e-95b2-4223-bd1c-b5d467eda04d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.390205 Oct 24 09:00:40.169601 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1048/2037] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:39 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:40.186359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:40.187466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:40.205557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.208080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.208722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.211980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.213439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.214192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.300482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.301333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.301936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.302546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lazy-loading 'fault' on Instance uuid 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:40.411512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:40.422409 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:40.423989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:40.436123 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-985815d7-3020-416a-9000-7fcc2b9f0c7f tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 200 len: 1376 microversion: 2.25 time: 0.265127 Oct 24 09:00:40.436877 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1049/2038] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:40 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 1376 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:40.518998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:40.528559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:40.529459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:40.539373 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8640d832-ecc0-42b1-8648-d1b420afbd92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.641621 Oct 24 09:00:40.541378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.542165 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 990/2039] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:39 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:40.542280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.542617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.543434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.547828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.548283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.745048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:40.745984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:40.773654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.775078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.775731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.777414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:40.778489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:40.779473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:40.971876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:40.977947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:41.001120 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2be4922-c346-4eae-b34f-317f9b01fbf8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.469565 Oct 24 09:00:41.014703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:41.016298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:41.021460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1050/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:40 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:41.026687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:41.027325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:41.034388 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-244c36d0-ddca-4cd9-b844-65a0e913141b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1592 microversion: 2.42 time: 0.279638 Oct 24 09:00:41.035874 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 991/2041] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:40 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1592 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:41.048321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.049058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.049676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.050541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.051187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.053008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.194855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:41.195481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:41.205280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.205800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.206307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.207655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.208091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.214106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:41.224078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02bbae68-f8a4-48dc-bc0f-e15fd3749205 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1271 microversion: 2.1 time: 0.201380 Oct 24 09:00:41.224862 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1051/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:41 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:41.245892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.467044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:41.467785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 792bb51b-253c-4fdb-ac1e-99e18bd2fce7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:41.492322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.493484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.494548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.499446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.500069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.500750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.532201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] HTTP exception thrown: Instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 could not be found. Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Request method failure captured: Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 HTTP/1.1 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJXUJqRO_mBffhiQ_hQXrt-jOMEbcAO4ZRywYpVmQoywEoJowULAzRaxYuj9IfXJqGKqIvNeMpzansf30sqp0HRa5t98LogijdaNhLxSd30OyfBoCQkVukjuCI_AL8V843r-n0V4i9gbXgnDbXspOgcuWcVid7X8_Ewz211t1tfXDs Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad4d1fc14f404932ab515a6a4c5a3048"}]}] Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: cc0be0ed857d4c96b26724144e20d766 Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 could not be found. Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '792bb51b-253c-4fdb-ac1e-99e18bd2fce7'} Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 could not be found. Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 could not be found. Oct 24 09:00:41.539634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 could not be found. Oct 24 09:00:41.543453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:41.545138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Returning 404 to user: Instance 792bb51b-253c-4fdb-ac1e-99e18bd2fce7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:41.546177 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93c6e398-c26c-43cb-a415-8e6ba1023ec4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7" status: 404 len: 111 microversion: 2.25 time: 0.083495 Oct 24 09:00:41.547283 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1052/2043] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:41 2022] GET /compute/v2.1/servers/792bb51b-253c-4fdb-ac1e-99e18bd2fce7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:00:41.555624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a76c5a8-750e-4684-8fb7-a530b884f8d9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '.version_select at 0x7f8daf2c64c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:41.600691 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a76c5a8-750e-4684-8fb7-a530b884f8d9 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094986771" status: 204 len: 0 microversion: 2.25 time: 0.048315 Oct 24 09:00:41.601485 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1053/2044] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094986771 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 09:00:41.606212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:41.606883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:41.615535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.616041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.616477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.617192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:41.617678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:41.618109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:41.715460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:41.729147 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cf49268-fe63-4038-b7c9-71c9918a8501 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.538612 Oct 24 09:00:41.730829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 992/2045] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:41 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:00:42.028076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:42.028691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:42.043738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.044425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.044662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.045407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.045861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.046279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.110295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:42.121597 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfbf0792-4b32-4690-8cf6-512662a2e104 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.518740 Oct 24 09:00:42.128681 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1054/2046] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:41 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:42.138120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:42.140824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:42.162363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.162873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.163322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.167020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.167536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.167987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.450130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:42.467887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:42.471651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:42.476054 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b997710-b8c7-436a-ae21-7cc31d075080 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1659 microversion: 2.42 time: 0.345908 Oct 24 09:00:42.494582 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1055/2047] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:42 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1659 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:42.494582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:42.494582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:42.494582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.495641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.495641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.496412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.496647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.502736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.866833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:42.869710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:42.886044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ceb4be12-8914-4d0c-ba7a-db98b60da153 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 0.404643 Oct 24 09:00:42.887096 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1056/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:42 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:42.892188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:42.898068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:42.909100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.909265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b509e630-5df2-400b-a8ae-f7da07fa1a64 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.862423 Oct 24 09:00:42.925284 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 993/2049] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:42 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:42.925697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.925697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:42.925697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:42.925697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:42.925697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:43.155065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:43.155685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:43.164811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:43.165673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:43.166400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:43.167525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:43.168360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:43.169036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:43.359885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:43.368583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5be75363-9cb0-4396-800c-f93f78d0d171 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.480219 Oct 24 09:00:43.369120 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1057/2050] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:42 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:43.502687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:43.503321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:43.516929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:43.517748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:43.518194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:43.518917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:43.519406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:43.519868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:43.677507 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:43.881567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:43.904400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:43.909575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:43.913940 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-69ab968f-3272-4161-8733-fb646866ce52 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1659 microversion: 2.42 time: 0.415224 Oct 24 09:00:43.917512 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1058/2051] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:43 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1659 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:00:43.925505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:43.930895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:43.946221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:43.947447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:43.949317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:43.951309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:43.953269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:43.954900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:44.351803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:44.371139 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49ca51cd-6ca0-4ac3-9d2f-5ba92b48c221 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 1.219572 Oct 24 09:00:44.373158 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 994/2052] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:43 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:44.381741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:44.382362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:44.394177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:44.397959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:44.398487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:44.400836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:44.402267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:44.402720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:44.484345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:44.514710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-622435a0-099e-4ccb-aac4-3f0a75a68352 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 0.595376 Oct 24 09:00:44.536209 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1059/2053] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:43 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:44.548948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:44.549623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:44.564414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:44.564916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:44.565394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:44.566143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:44.567179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:44.567623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:44.980693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:44.995139 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e13eba0c-cbe6-4a1d-9f35-5455ec194f02 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.457644 Oct 24 09:00:45.012640 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1060/2054] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:44 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:45.022864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:45.023733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:45.040315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.041825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.041825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.042565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.043107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.043609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.053165 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:45.086228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:45.094846 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:45.096751 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-178777e0-6fba-47b9-9ab0-1ebb3bfb3330 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.719357 Oct 24 09:00:45.097947 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 995/2055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:44 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:45.102695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-83682947-d0e9-48e1-9b56-b2a004117e98 req-9a3586e5-8274-4e55-a3b7-044b765c8e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:45.116982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:45.118001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-83682947-d0e9-48e1-9b56-b2a004117e98 req-9a3586e5-8274-4e55-a3b7-044b765c8e1f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.118583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-83682947-d0e9-48e1-9b56-b2a004117e98 req-9a3586e5-8274-4e55-a3b7-044b765c8e1f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.119085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-83682947-d0e9-48e1-9b56-b2a004117e98 req-9a3586e5-8274-4e55-a3b7-044b765c8e1f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.132185 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-83682947-d0e9-48e1-9b56-b2a004117e98 req-9a3586e5-8274-4e55-a3b7-044b765c8e1f service nova] Creating event network-changed:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:00:45.139417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-83682947-d0e9-48e1-9b56-b2a004117e98 req-9a3586e5-8274-4e55-a3b7-044b765c8e1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040065 Oct 24 09:00:45.140954 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 996/2056] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:45.157187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:45.157954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:45.165806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.166621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.167304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.168274 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:45.168475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.169165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.170036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.270176 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcc82a4b-9a38-44fd-b638-6e6c978a27d4 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 204 len: 0 microversion: 2.25 time: 0.255195 Oct 24 09:00:45.270846 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1061/2057] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:00:45 2022] DELETE /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:00:45.286725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:45.300260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:45.302401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Searching by: {'deleted': False, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:00:45.310810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.311532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.312151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.313060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.313732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.314341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.396356 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=20 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:45.431157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:00:45.584620 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3bd9f29f-f11c-4f83-8783-b2624183d02b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.309499 Oct 24 09:00:45.585811 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1062/2058] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:00:45 2022] GET /compute/v2.1/servers => generated 339 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:45.591264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:45.592200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:45.599268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.599965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.600561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.601444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:45.603098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:45.603689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:45.944497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:45.963992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:45.969080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:45.970938 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e7d33c36-ba93-49a8-82c0-424103180e75 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1705 microversion: 2.42 time: 0.818901 Oct 24 09:00:45.972216 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 997/2059] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:45 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1705 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:45.985329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:45.986648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:46.002602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.003457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.008556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.009687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.010450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.011278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.229608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:46.246613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:46.258421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:46.260040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-884665d8-2d34-446f-9ec2-cbfa9b55c743 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1548 microversion: 2.25 time: 0.672576 Oct 24 09:00:46.263857 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1063/2060] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:45 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1548 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:46.298450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:46.299774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:46.321808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.323465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.325509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.328553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.329219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.331615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.369780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:46.382809 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d398b693-1bb5-45b1-8780-7d604d657ed7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.408458 Oct 24 09:00:46.387717 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 998/2061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:45 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:46.392774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:46.405812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:46.410586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Searching by: {'deleted': False, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:00:46.421786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.425367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.429423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.430400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.431041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.432987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.492252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:00:46.556223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:46.564335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.564820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.565264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.766547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b71ef106-d99f-4efc-b39c-13f1cbc3d1d8 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.377459 Oct 24 09:00:46.767523 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 999/2062] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:00:46 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:46.773331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:46.773940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:46.794926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.799151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.800170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:46.801209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:46.801867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:46.802457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:47.504177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:47.528643 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b892aa5e-fbe0-40ad-aaef-4f27a0dd8f82 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 1.259385 Oct 24 09:00:47.529621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1064/2063] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:46 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:47.546494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:47.547227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:47.558126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:47.559845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:47.560304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:47.562816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:47.564699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:47.566983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:47.569560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:47.578204 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05c81bc6-2af7-4349-8739-50e6ace3b0c9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1509 microversion: 2.1 time: 0.809337 Oct 24 09:00:47.587605 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1000/2064] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:46 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1509 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:47.604274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-66ae7844-cb31-4859-8618-fdf548800b9c req-550f9c22-1716-4389-83fb-baa014ee3b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ecb5b4-493b-4afa-bd2f-237024e8eebb", "name": "network-vif-plugged", "status": "completed", "tag": "128a0c2a-8eae-4433-92d4-8145d8ae3d3b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:47.627064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-66ae7844-cb31-4859-8618-fdf548800b9c req-550f9c22-1716-4389-83fb-baa014ee3b6b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:47.627915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-66ae7844-cb31-4859-8618-fdf548800b9c req-550f9c22-1716-4389-83fb-baa014ee3b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:47.628570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-66ae7844-cb31-4859-8618-fdf548800b9c req-550f9c22-1716-4389-83fb-baa014ee3b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:47.659910 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-66ae7844-cb31-4859-8618-fdf548800b9c req-550f9c22-1716-4389-83fb-baa014ee3b6b service nova] Creating event network-vif-plugged:128a0c2a-8eae-4433-92d4-8145d8ae3d3b for instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb on n-h2-master-1 Oct 24 09:00:47.675681 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-66ae7844-cb31-4859-8618-fdf548800b9c req-550f9c22-1716-4389-83fb-baa014ee3b6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076202 Oct 24 09:00:47.676883 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1001/2065] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:47.696194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-663a99e3-b0cc-422d-af2d-33b79a021f98 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:47.708396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-663a99e3-b0cc-422d-af2d-33b79a021f98 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025514 Oct 24 09:00:47.709626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1002/2066] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:00:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:47.719468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:47.720199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:47.741285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:47.741954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:47.742983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:47.743108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:47.744976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:47.745623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.003080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.015135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.016593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.018033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a079e212-de77-4167-94fa-5e0b5fc1f0d8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1751 microversion: 2.42 time: 0.303928 Oct 24 09:00:48.019260 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1003/2067] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:47 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1751 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:48.026930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:48.029058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:48.038907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.039710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.040314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.041189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.041870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.042447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.127471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.138055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.140586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.148776 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96773631-d8e3-4534-852a-8c83038e4886 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1506 microversion: 2.25 time: 0.126804 Oct 24 09:00:48.150749 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1004/2068] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:48 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1506 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:48.155560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:48.156401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:48.175724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.177283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.178555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.179858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.180468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.181205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.198923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.216258 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5848eef7-eb0a-43e8-9acf-5109ebc6125f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1307 microversion: 2.1 time: 0.675812 Oct 24 09:00:48.218832 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1065/2069] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:47 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1307 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:48.234166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-91397250-c06a-49fc-92cf-dfdc135d1017 req-2b633343-6156-4ccd-a4de-0d98c2cc4d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3630dd52-81f8-4547-a032-4f3822744409", "tag": "bca999fc-fbfc-4b81-bcf1-2d4e9a9a03d7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:48.283581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91397250-c06a-49fc-92cf-dfdc135d1017 req-2b633343-6156-4ccd-a4de-0d98c2cc4d1a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.286702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91397250-c06a-49fc-92cf-dfdc135d1017 req-2b633343-6156-4ccd-a4de-0d98c2cc4d1a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.288081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91397250-c06a-49fc-92cf-dfdc135d1017 req-2b633343-6156-4ccd-a4de-0d98c2cc4d1a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.329175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-91397250-c06a-49fc-92cf-dfdc135d1017 req-2b633343-6156-4ccd-a4de-0d98c2cc4d1a service nova] Creating event network-changed:bca999fc-fbfc-4b81-bcf1-2d4e9a9a03d7 for instance 3630dd52-81f8-4547-a032-4f3822744409 on n-h1-master-1 Oct 24 09:00:48.351789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-91397250-c06a-49fc-92cf-dfdc135d1017 req-2b633343-6156-4ccd-a4de-0d98c2cc4d1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129436 Oct 24 09:00:48.355933 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1066/2070] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:48.367526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:48.368419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:48.378607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.379361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.380156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.383542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.384207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.388955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.474718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:48.569163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:48.573037 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:48.589481 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac22c2b4-f64d-473d-bfb8-3ab119346cd7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.437433 Oct 24 09:00:48.599635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1005/2071] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:48 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:48.614367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-102dd804-9d4e-40b9-b82d-e72dd6f6f0a3 req-1afd0daa-d393-4ee3-85e7-c056c8839ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aac9f24-0a77-40c9-b1e3-9c852bf29fe8", "name": "network-vif-deleted", "tag": "fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:48.649182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-102dd804-9d4e-40b9-b82d-e72dd6f6f0a3 req-1afd0daa-d393-4ee3-85e7-c056c8839ef2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.650887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-102dd804-9d4e-40b9-b82d-e72dd6f6f0a3 req-1afd0daa-d393-4ee3-85e7-c056c8839ef2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.653284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-102dd804-9d4e-40b9-b82d-e72dd6f6f0a3 req-1afd0daa-d393-4ee3-85e7-c056c8839ef2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.683596 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b4d5054-1f73-4c83-b621-eec4f846024b tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 204 len: 0 microversion: 2.1 time: 0.325940 Oct 24 09:00:48.684433 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-102dd804-9d4e-40b9-b82d-e72dd6f6f0a3 req-1afd0daa-d393-4ee3-85e7-c056c8839ef2 service nova] Creating event network-vif-deleted:fc8290f8-6dbd-4eb2-aa5b-46cb54cda5b8 for instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 on n-h1-master-1 Oct 24 09:00:48.687345 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1067/2072] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:00:48 2022] DELETE /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:00:48.693599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:48.694336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:48.697531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-102dd804-9d4e-40b9-b82d-e72dd6f6f0a3 req-1afd0daa-d393-4ee3-85e7-c056c8839ef2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094785 Oct 24 09:00:48.698290 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1006/2073] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:48.701629 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:48.711759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:48.715087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:48.715391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.716213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.716838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.717748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.718362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.718972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.728484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.735134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.735815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:48.736713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:48.740962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:48.741613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.000021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:49.008243 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b436231-8f4e-4999-adff-49484643ff3d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 0.319565 Oct 24 09:00:49.008847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1068/2074] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:48 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:49.022840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:49.023758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:49.040734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.041545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.042144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.045873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.046539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.047148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.232208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:49.244587 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37d874a5-07ca-486a-8eab-49636146bcd0 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1486 microversion: 2.1 time: 0.545027 Oct 24 09:00:49.245250 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1007/2075] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:48 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1486 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:49.253421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:49.254328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:49.267056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.287750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.290889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.291683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.292364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.292874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.335215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:49.346206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-098b4ef8-022e-4cf5-be64-e2ba21af2441 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1713 microversion: 2.1 time: 0.331932 Oct 24 09:00:49.360469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1069/2076] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:49 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1713 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:49.360469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:49.360469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:49.374465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.374967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.375406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.376126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.376582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.377006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.417539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.418051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.418487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.418947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lazy-loading 'fault' on Instance uuid 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:49.651945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:49.664537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:49.666504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:49.676821 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b1e178e-6c1d-4378-9fa4-459ce9d6d990 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 200 len: 1352 microversion: 2.25 time: 0.323613 Oct 24 09:00:49.677769 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1070/2077] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:49 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 1352 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:49.682542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:49.685536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:49.697722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.699870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.701441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:49.702404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:49.708389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:49.710744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.180575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:50.199006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:50.201333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:50.203001 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8302f25-9ba0-4a0e-a9c9-592c695b67c0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1751 microversion: 2.42 time: 0.954131 Oct 24 09:00:50.221453 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1008/2078] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:49 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1751 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:50.235491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:50.236354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:50.246752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.247606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.248247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.249159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.249871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.250290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.255476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:50.268883 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40127995-ee61-45fc-a53e-73e0358c0629 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1486 microversion: 2.1 time: 0.589839 Oct 24 09:00:50.272848 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1071/2079] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:49 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1486 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:50.284784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:50.284978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:50.287446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:50.307431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.308251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.308886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.310143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.311941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.312652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.418282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78d48ef5-8599-4df0-b264-3c3771743d78 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 204 len: 0 microversion: 2.1 time: 0.194024 Oct 24 09:00:50.419643 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1009/2080] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:00:50 2022] DELETE /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:00:50.428980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:50.430435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:50.439719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.440868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.442061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.443268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.444100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.444729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.795341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:50.810863 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0beaaa27-2068-40c4-bfff-d64244f04383 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.532620 Oct 24 09:00:50.812173 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1072/2081] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:50 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:50.819250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:50.821215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:50.828826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.829694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.831246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.832322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:50.833015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:50.833805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:50.884715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lazy-loading 'flavor' on Instance uuid 55ecb5b4-493b-4afa-bd2f-237024e8eebb {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:50.958654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:50.969003 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06c7637b-bde0-48d9-8e98-8a0b22fba1ab tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 0.547725 Oct 24 09:00:50.979591 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1010/2082] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:50 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:50.994841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:50.998298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.013091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.013844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.014472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.015665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.016933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.019310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.023009 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84841b6f-cfc1-4c1f-a85b-b9eb10b7d062 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb/action" status: 202 len: 0 microversion: 2.1 time: 0.204438 Oct 24 09:00:51.027068 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1073/2083] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:00:50 2022] POST /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:51.034838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:51.041082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.057145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.058380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.059966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.063437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.064174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.064803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.114103 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:51.312791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:51.323068 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e64ab961-f629-4cbe-bcc7-0a8ec9f5eb43 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1492 microversion: 2.1 time: 0.294024 Oct 24 09:00:51.337678 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1074/2084] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:51 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1492 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:51.337678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:51.337678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.358866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.359415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.359860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.360858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.361361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.361928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.378069 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] HTTP exception thrown: Instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 could not be found. Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Request method failure captured: Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 HTTP/1.1 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJXUJqRO_mBffhiQ_hQXrt-jOMEbcAO4ZRywYpVmQoywEoJowULAzRaxYuj9IfXJqGKqIvNeMpzansf30sqp0HRa5t98LogijdaNhLxSd30OyfBoCQkVukjuCI_AL8V843r-n0V4i9gbXgnDbXspOgcuWcVid7X8_Ewz211t1tfXDs Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad4d1fc14f404932ab515a6a4c5a3048"}]}] Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: cc0be0ed857d4c96b26724144e20d766 Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 could not be found. Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7aac9f24-0a77-40c9-b1e3-9c852bf29fe8'} Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 could not be found. Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 could not be found. Oct 24 09:00:51.379789 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 could not be found. Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Returning 404 to user: Instance 7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-052d45fb-02ef-409e-a4f5-6cb50c1715ef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8" status: 404 len: 111 microversion: 2.25 time: 0.054577 Oct 24 09:00:51.383103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1075/2085] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:51 2022] GET /compute/v2.1/servers/7aac9f24-0a77-40c9-b1e3-9c852bf29fe8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:00:51.386248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:51.387149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.395635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.396137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.396584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.397350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.397785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.398212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.628661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:51.645342 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35301fe5-848f-4a0f-a2db-6681b32b4595 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1713 microversion: 2.1 time: 0.662532 Oct 24 09:00:51.652402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:51.661911 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1011/2086] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:50 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1713 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:51.666900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:51.668035 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed866f92-6956-4dd3-a69d-3138c750af10 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1494 microversion: 2.1 time: 0.283804 Oct 24 09:00:51.669245 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1076/2087] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:51 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1494 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:51.677510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:51.679164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.684834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.692786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.693790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.695499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.695499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.696360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.696735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.696902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.697624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.697737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.698882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.699549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.700178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.742836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:00:51.869774 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8dc6575a-6b26-496b-a8a8-8593269b8eef tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 204 len: 0 microversion: 2.25 time: 0.198246 Oct 24 09:00:51.874189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1077/2088] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:00:51 2022] DELETE /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:00:51.881337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:51.881645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:51.891984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.893335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.894209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:51.895856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:51.896769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:51.897473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.229891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.242547 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a931621-7c09-4d36-b5ac-08d9fdbc941e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.368929 Oct 24 09:00:52.243778 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1078/2089] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:51 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:52.250852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:52.252136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:52.259618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.260447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.261130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.262436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.263232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.264117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.567027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.575513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.577166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.578466 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad205381-e4fc-4b65-a806-3ccf5e0835f6 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1563 microversion: 2.25 time: 0.333465 Oct 24 09:00:52.594054 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1079/2090] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:52 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1563 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:52.597065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.602645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-80687095-7826-4f13-bc64-98276a19a0e1 req-d077821e-ac6a-4f02-b7cc-8a8208771c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "name": "network-vif-plugged", "status": "completed", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:52.612298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.613847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80687095-7826-4f13-bc64-98276a19a0e1 req-d077821e-ac6a-4f02-b7cc-8a8208771c1d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.614359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80687095-7826-4f13-bc64-98276a19a0e1 req-d077821e-ac6a-4f02-b7cc-8a8208771c1d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.614797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80687095-7826-4f13-bc64-98276a19a0e1 req-d077821e-ac6a-4f02-b7cc-8a8208771c1d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.617748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:52.622427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e371f3e-251f-4d5a-ab78-3befeec0f872 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1797 microversion: 2.42 time: 0.959239 Oct 24 09:00:52.624218 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1012/2091] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:51 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1797 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:52.633289 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-80687095-7826-4f13-bc64-98276a19a0e1 req-d077821e-ac6a-4f02-b7cc-8a8208771c1d service nova] Creating event network-vif-plugged:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:00:52.636622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:52.640837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:52.651184 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-80687095-7826-4f13-bc64-98276a19a0e1 req-d077821e-ac6a-4f02-b7cc-8a8208771c1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055722 Oct 24 09:00:52.652055 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1080/2092] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:52.652633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.654260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.654654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.655757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.656247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.657043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:52.657152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.657789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:52.670420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.670925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.671373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:52.672105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:52.672571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:52.681017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:53.665785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:53.678594 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a5a0ee3-54ef-4cf7-abad-30357acb7809 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 1.051782 Oct 24 09:00:53.680745 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1013/2093] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:52 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:53.687514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:53.694325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:53.709738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:53.710233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:53.716689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:53.717667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:53.718441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:53.719029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:53.828152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:53.842175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a262982-ce7b-4137-8e91-45a5b99a33cb tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1492 microversion: 2.1 time: 1.187075 Oct 24 09:00:53.844239 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1081/2094] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:52 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1492 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:53.857992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:53.858711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:53.882989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:53.883513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:53.886456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:53.886456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:53.886900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:53.888758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:53.928271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f381609a3c0d4583804a70c89d288881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fabbee6f184b9b8ebff84ca55c3c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:53.953947 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c2b8383-d5d9-4666-b90a-edab5ff0d155 tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 200 len: 1647 microversion: 2.1 time: 0.271602 Oct 24 09:00:53.981087 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1014/2095] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:53 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 1647 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:53.996308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:54.004110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:54.033688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:54.036290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:54.038101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:54.039112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:54.040691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:54.041604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:54.786584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:54.803118 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37f17f0d-900e-436f-9b64-af0512b95e90 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1733 microversion: 2.1 time: 0.820759 Oct 24 09:00:54.803958 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1015/2096] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:53 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1733 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:54.809118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:54.816761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:54.827255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:54.828032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:54.829531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:54.833010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:54.833737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:54.834360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:55.351590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:55.372706 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:55.385005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:55.389618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:55.393470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-573307f9-4486-4959-b7ed-fc08cbb2050b tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1563 microversion: 2.25 time: 0.586167 Oct 24 09:00:55.394514 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1016/2097] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:54 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1563 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:55.396898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:55.408717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:55.410865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4df352b5-fcbc-4eb6-bf62-2c2c43a0b7fd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 200 len: 1477 microversion: 2.1 time: 1.561705 Oct 24 09:00:55.411176 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:55.414316 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1082/2098] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:53 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 1477 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:55.425160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3b1b133c-8fb0-4943-94ef-25a13552ebb8 req-b783ff1f-7d25-43bf-ab32-c34f22fbc57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80812fd-0278-4677-bc3c-c5e5c6915a87", "name": "network-vif-deleted", "tag": "bc200002-faae-4234-b7b9-79cfaa369c80"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:55.429203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:55.430949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:55.431507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:55.432248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:55.436060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:55.436181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:55.484298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3b1b133c-8fb0-4943-94ef-25a13552ebb8 req-b783ff1f-7d25-43bf-ab32-c34f22fbc57e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:55.487860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3b1b133c-8fb0-4943-94ef-25a13552ebb8 req-b783ff1f-7d25-43bf-ab32-c34f22fbc57e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:55.491031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3b1b133c-8fb0-4943-94ef-25a13552ebb8 req-b783ff1f-7d25-43bf-ab32-c34f22fbc57e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:55.516574 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3b1b133c-8fb0-4943-94ef-25a13552ebb8 req-b783ff1f-7d25-43bf-ab32-c34f22fbc57e service nova] Creating event network-vif-deleted:bc200002-faae-4234-b7b9-79cfaa369c80 for instance b80812fd-0278-4677-bc3c-c5e5c6915a87 on n-h1-master-1 Oct 24 09:00:55.527341 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3b1b133c-8fb0-4943-94ef-25a13552ebb8 req-b783ff1f-7d25-43bf-ab32-c34f22fbc57e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110345 Oct 24 09:00:55.531202 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1083/2099] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:55.543762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:55.544770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:55.559607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:55.562562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:55.563372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:55.564270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:55.566232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:55.567575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.096159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:56.136119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:56.138384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:56.149092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-674adbef-7b6e-4a02-a84a-8338cd96336e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1843 microversion: 2.42 time: 0.750131 Oct 24 09:00:56.155168 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1017/2100] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:55 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1843 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:56.165329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:56.168945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:56.190369 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:56.198753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.200715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.203618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.210195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.215278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.220084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.344540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.345280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.345778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.346242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lazy-loading 'fault' on Instance uuid bf822847-521b-44e9-a65b-4fad1b65b22b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:56.455031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:56.460292 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:56.471919 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97794fa3-ac70-4598-a782-8d4e634808cf tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 0.937912 Oct 24 09:00:56.504842 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1084/2101] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:55 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:56.506279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:56.512997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:56.514007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] [instance: b80812fd-0278-4677-bc3c-c5e5c6915a87] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:56.522548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a74683b6-c7d3-43bb-8691-edc8ef5f0810 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 200 len: 1302 microversion: 2.1 time: 0.362424 Oct 24 09:00:56.538132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.540694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.543684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.544076 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1018/2102] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:56 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 1302 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:56.547941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.553195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.553931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.561180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b9b25249-bf11-4e10-bfbc-4f198d568364 req-212cc830-edf2-420b-9926-4fb5ddee2c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf822847-521b-44e9-a65b-4fad1b65b22b", "name": "network-vif-deleted", "tag": "fbdb6016-f219-4ab0-8a19-94ba9eeee206"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:56.575788 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:56.595765 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] HTTP exception thrown: Instance b80812fd-0278-4677-bc3c-c5e5c6915a87 could not be found. Oct 24 09:00:56.603109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9b25249-bf11-4e10-bfbc-4f198d568364 req-212cc830-edf2-420b-9926-4fb5ddee2c9d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Request method failure captured: Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 HTTP/1.1 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlP4cjkq78oHzzuX15KJwAKwbfbArX9je6k9M3AMmJmdCL89SJWUvl1favL5-_riJhFXh6Gdx-qTMaaSS4KGr_PNvIEuGgvxhIStSEoQEmkpNtq1Gb_LQJrX894I4dEfHfN_vS8DYmzS5G4r8wv_g8L7lRpJ2Tzm0GZMB3V1-5gB3CY Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 92fabbee6f184b9b8ebff84ca55c3c67 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestManualDisk-2121434251 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92fabbee6f184b9b8ebff84ca55c3c67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92fabbee6f184b9b8ebff84ca55c3c67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92fabbee6f184b9b8ebff84ca55c3c67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92fabbee6f184b9b8ebff84ca55c3c67"}]}] Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestManualDisk-2121434251 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 92fabbee6f184b9b8ebff84ca55c3c67 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestManualDisk-2121434251 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestManualDisk-2121434251-project Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f381609a3c0d4583804a70c89d288881 Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestManualDisk-2121434251-project Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b80812fd-0278-4677-bc3c-c5e5c6915a87 could not be found. Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b80812fd-0278-4677-bc3c-c5e5c6915a87'} Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80812fd-0278-4677-bc3c-c5e5c6915a87 could not be found. Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80812fd-0278-4677-bc3c-c5e5c6915a87 could not be found. Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:56.603715 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80812fd-0278-4677-bc3c-c5e5c6915a87 could not be found. Oct 24 09:00:56.607250 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:00:56.609640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Returning 404 to user: Instance b80812fd-0278-4677-bc3c-c5e5c6915a87 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:56.611224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9b25249-bf11-4e10-bfbc-4f198d568364 req-212cc830-edf2-420b-9926-4fb5ddee2c9d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.614987 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eacd52b3-87fd-4b96-b273-c8a8443ba35c tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87" status: 404 len: 111 microversion: 2.1 time: 0.102863 Oct 24 09:00:56.616213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9b25249-bf11-4e10-bfbc-4f198d568364 req-212cc830-edf2-420b-9926-4fb5ddee2c9d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.617795 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1085/2103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:56 2022] GET /compute/v2.1/servers/b80812fd-0278-4677-bc3c-c5e5c6915a87 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:56.645324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-677173951"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:56.652688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:56.667563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.668683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.669363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.671489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.672356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.672952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.690078 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b9b25249-bf11-4e10-bfbc-4f198d568364 req-212cc830-edf2-420b-9926-4fb5ddee2c9d service nova] Creating event network-vif-deleted:fbdb6016-f219-4ab0-8a19-94ba9eeee206 for instance bf822847-521b-44e9-a65b-4fad1b65b22b on n-h2-master-1 Oct 24 09:00:56.709033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b9b25249-bf11-4e10-bfbc-4f198d568364 req-212cc830-edf2-420b-9926-4fb5ddee2c9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162134 Oct 24 09:00:56.711908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1019/2104] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:56.726925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:56.729091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:56.760731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.763467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.764130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:56.765044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:56.766096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:56.767137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.129376 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff4805c5-3bd2-437a-9e8d-f56414fdd4e1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb/action" status: 202 len: 0 microversion: 2.1 time: 0.509147 Oct 24 09:00:57.130078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1086/2105] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:00:56 2022] POST /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:00:57.163532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:57.165973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:57.183567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.184321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.184922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.185844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.187722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.188375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.286367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.286952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.287396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.287854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lazy-loading 'fault' on Instance uuid f95b3010-cd07-42e1-81e5-e1cc4800988b {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:57.302304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:57.328673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b8ed054e-a2d2-48a2-ab00-8fa060485a96 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1713 microversion: 2.1 time: 0.614217 Oct 24 09:00:57.329306 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1020/2106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:56 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1713 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:57.345327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-25d6f360-50de-4254-b645-9a3141b0d144 req-8c4ee22b-0e68-4d3a-8e44-34d88490670b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3630dd52-81f8-4547-a032-4f3822744409", "name": "network-vif-plugged", "status": "completed", "tag": "bca999fc-fbfc-4b81-bcf1-2d4e9a9a03d7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:57.379254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:57.387988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:57.395254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:57.398896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-25d6f360-50de-4254-b645-9a3141b0d144 req-8c4ee22b-0e68-4d3a-8e44-34d88490670b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.399854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-25d6f360-50de-4254-b645-9a3141b0d144 req-8c4ee22b-0e68-4d3a-8e44-34d88490670b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.400793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72690657-004d-4ae4-b7a9-03f47d2e48fe tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1352 microversion: 2.25 time: 0.257828 Oct 24 09:00:57.401419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1087/2107] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:57 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1352 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:57.403697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-25d6f360-50de-4254-b645-9a3141b0d144 req-8c4ee22b-0e68-4d3a-8e44-34d88490670b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.418740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1cca0f0-7a19-4d2f-908b-87a1398c27cf tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] Calling method '.version_select at 0x7f8daf0ffb80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:57.462064 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-25d6f360-50de-4254-b645-9a3141b0d144 req-8c4ee22b-0e68-4d3a-8e44-34d88490670b service nova] Creating event network-vif-plugged:bca999fc-fbfc-4b81-bcf1-2d4e9a9a03d7 for instance 3630dd52-81f8-4547-a032-4f3822744409 on n-h1-master-1 Oct 24 09:00:57.474371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-25d6f360-50de-4254-b645-9a3141b0d144 req-8c4ee22b-0e68-4d3a-8e44-34d88490670b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139906 Oct 24 09:00:57.482800 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1021/2108] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:57.495276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1cca0f0-7a19-4d2f-908b-87a1398c27cf tempest-ServersTestManualDisk-2121434251 tempest-ServersTestManualDisk-2121434251-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593641730" status: 202 len: 0 microversion: 2.1 time: 0.092379 Oct 24 09:00:57.498879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c3f3f61-c6ce-43c1-bc1f-fbcdd277b8c7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf4caf0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:57.499312 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1088/2109] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593641730 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:57.511460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:57.512603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:57.531692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.532096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.532542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.533257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.538689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.539148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.625051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c3f3f61-c6ce-43c1-bc1f-fbcdd277b8c7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.140779 Oct 24 09:00:57.625858 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1022/2110] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:57 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:57.637647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:57.638528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:57.660398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.660398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.664104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.666744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:57.667273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:57.668305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:57.702692 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:58.102567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.113768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6375b256-0b90-4da1-b51a-b04b993770ec tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1313 microversion: 2.1 time: 0.486142 Oct 24 09:00:58.133358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1023/2111] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:57 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:58.138425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:58.154154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:58.168866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.169401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.169844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.170563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.171208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.171813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.208004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b HTTP/1.1 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: exception: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'bf822847-521b-44e9-a65b-4fad1b65b22b'} Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:58.210381 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:00:58.214680 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.222198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:58.223570 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c898bfe5-d127-49d6-ba6c-d43c865705d8 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 404 len: 111 microversion: 2.1 time: 0.089116 Oct 24 09:00:58.228822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1024/2112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:58 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:58.234185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:58.234870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:58.242866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.244496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.245142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.246150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.247033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.248301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.393145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.437044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.443163 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Cannot 'detach_volume' instance babd364b-580f-4919-a727-94169135c910 while it is in vm_state rescued Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments/e8c6addd-c1ea-4f07-be23-f84b10acfa47 HTTP/1.1 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'detach_volume' instance babd364b-580f-4919-a727-94169135c910 while it is in vm_state rescued Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'babd364b-580f-4919-a727-94169135c910', 'id': 'e8c6addd-c1ea-4f07-be23-f84b10acfa47'} Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance babd364b-580f-4919-a727-94169135c910 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance babd364b-580f-4919-a727-94169135c910 while it is in vm_state rescued Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.445535 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:00:58.448921 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:00:58.448921 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:00:58.448921 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:00:58.448921 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:00:58.448921 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance babd364b-580f-4919-a727-94169135c910 while it is in vm_state rescued Oct 24 09:00:58.448921 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:00:58.449255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.454294 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 409 to user: Cannot 'detach_volume' instance babd364b-580f-4919-a727-94169135c910 while it is in vm_state rescued {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:00:58.455619 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3baf39bc-20ab-49e6-8165-58e6ac685ad4 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments/e8c6addd-c1ea-4f07-be23-f84b10acfa47" status: 409 len: 152 microversion: 2.1 time: 0.225500 Oct 24 09:00:58.460360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1025/2113] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:00:58 2022] DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments/e8c6addd-c1ea-4f07-be23-f84b10acfa47 => generated 152 bytes in 231 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:00:58.464220 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-33fec602-b693-4cd3-8357-4e50549acb26 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1843 microversion: 2.42 time: 0.951595 Oct 24 09:00:58.466635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9fcd4d3c-d6b3-400b-a126-30664fa90554 req-f6918cf8-cd80-4c45-bf14-b6245d853a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "9a5a2cfa-da17-4a1f-bfd7-98eca3fde566"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:58.467353 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1089/2114] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:57 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1843 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:58.485043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9fcd4d3c-d6b3-400b-a126-30664fa90554 req-f6918cf8-cd80-4c45-bf14-b6245d853a7a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.487070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1156613744", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9fff8fcd-0710-4bad-88b1-aad9e59ef215"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:58.487467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9fcd4d3c-d6b3-400b-a126-30664fa90554 req-f6918cf8-cd80-4c45-bf14-b6245d853a7a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.487999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9fcd4d3c-d6b3-400b-a126-30664fa90554 req-f6918cf8-cd80-4c45-bf14-b6245d853a7a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.514850 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9fcd4d3c-d6b3-400b-a126-30664fa90554 req-f6918cf8-cd80-4c45-bf14-b6245d853a7a service nova] Creating event network-changed:9a5a2cfa-da17-4a1f-bfd7-98eca3fde566 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:00:58.530691 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9fcd4d3c-d6b3-400b-a126-30664fa90554 req-f6918cf8-cd80-4c45-bf14-b6245d853a7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068494 Oct 24 09:00:58.532191 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1026/2115] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:58.569159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:58.571310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:58.594777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.602317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.603190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.605931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.612302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.612755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.632855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] validate_networks() for [('9fff8fcd-0710-4bad-88b1-aad9e59ef215', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:00:58.668539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:58.669262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:58.669833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:58.680852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lazy-loading 'fault' on Instance uuid f95b3010-cd07-42e1-81e5-e1cc4800988b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:00:58.921362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.933064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.936501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc0be0ed857d4c96b26724144e20d766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4d1fc14f404932ab515a6a4c5a3048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:58.940241 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e9fd842-798b-4c82-86ac-7c057484af58 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 200 len: 1352 microversion: 2.25 time: 0.406009 Oct 24 09:00:58.941057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1027/2116] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:00:58 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 1352 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:00:59.003158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:59.005215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:59.022000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.023753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.025632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:59.026452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.026931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.031757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:59.183457 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3075ddd0-e2d6-4e90-bd3c-a9b60fcbc81a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/action" status: 202 len: 0 microversion: 2.1 time: 0.226359 Oct 24 09:00:59.187233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1028/2117] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:00:58 2022] POST /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:00:59.246330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e435bc9-ee47-4790-bdd6-9f2cd88260fe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf1e44c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:59.360365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e435bc9-ee47-4790-bdd6-9f2cd88260fe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.174056 Oct 24 09:00:59.365279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1029/2118] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:59 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:59.373257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-dbcbfb89-1980-42d6-b8e9-476cefd338a9 req-d3b6568d-658d-4a2a-8aca-e87a07f4c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95b3010-cd07-42e1-81e5-e1cc4800988b", "name": "network-vif-deleted", "tag": "da9d9831-4f58-409e-b129-af4960d568db"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:00:59.404278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dbcbfb89-1980-42d6-b8e9-476cefd338a9 req-d3b6568d-658d-4a2a-8aca-e87a07f4c3f6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.404770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dbcbfb89-1980-42d6-b8e9-476cefd338a9 req-d3b6568d-658d-4a2a-8aca-e87a07f4c3f6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.405204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dbcbfb89-1980-42d6-b8e9-476cefd338a9 req-d3b6568d-658d-4a2a-8aca-e87a07f4c3f6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:59.417264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-dbcbfb89-1980-42d6-b8e9-476cefd338a9 req-d3b6568d-658d-4a2a-8aca-e87a07f4c3f6 service nova] Creating event network-vif-deleted:da9d9831-4f58-409e-b129-af4960d568db for instance f95b3010-cd07-42e1-81e5-e1cc4800988b on n-h2-master-1 Oct 24 09:00:59.430974 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-dbcbfb89-1980-42d6-b8e9-476cefd338a9 req-d3b6568d-658d-4a2a-8aca-e87a07f4c3f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064372 Oct 24 09:00:59.431851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1030/2119] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:00:59.436757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:59.437502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:59.462234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.462874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.463166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:59.464219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.464347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.464772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:59.810744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:00:59.819718 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24ebacae-7de0-40a4-ab71-13991ae20e7a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1462 microversion: 2.1 time: 0.386884 Oct 24 09:00:59.829353 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1031/2120] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:59 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1462 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:00:59.841608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:00:59.842936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:00:59.857462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.864880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.865906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:00:59.866904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:00:59.867603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:00:59.868268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:00.477920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:01:00.478902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:01:00.479553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:01:00.480123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:01:00.480821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:01:00.507805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:00.510717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:00.512285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:00.514031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:00.515052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:00.515991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:00.586116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:01:00.612654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Getting quotas for user 0a5f0704d95640a99457ddd8652f83ca and project 8296bcb4ff034194b66485ce116bb18a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:01:00.655236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:01:00.666876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:01:00.778853 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3c2bf3a-eca6-4d7f-96b1-d89eb508b01b tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.310349 Oct 24 09:01:00.786634 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1090/2121] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:01:00.799044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:00.799985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:00.816347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:00.817168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:00.817794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:00.818735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:00.819786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:00.821491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:01.399793 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:01.413506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:01.417181 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:01.426710 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-469b6185-b6db-4bbc-bff3-c801c0bd122c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1721 microversion: 2.1 time: 1.592211 Oct 24 09:01:01.427443 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1032/2122] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:00:59 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1721 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:01.430638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:01.432900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:01.434519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb24776f-4bcb-4107-bdc6-5e63f26a4473 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1864 microversion: 2.42 time: 0.646282 Oct 24 09:01:01.442039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:01.450713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1091/2123] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:00 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1864 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:01.450848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:01.455536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:01.456156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] [instance: f95b3010-cd07-42e1-81e5-e1cc4800988b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:01.467950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:01.468446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:01.468885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:01.469620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:01.470080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:01.470506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:01.474433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:01.475121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:01.475573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:01.476296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:01.476756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:01.478441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:01.502529 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] HTTP exception thrown: Instance f95b3010-cd07-42e1-81e5-e1cc4800988b could not be found. Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Request method failure captured: Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b HTTP/1.1 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlJXUJqRO_mBffhiQ_hQXrt-jOMEbcAO4ZRywYpVmQoywEoJowULAzRaxYuj9IfXJqGKqIvNeMpzansf30sqp0HRa5t98LogijdaNhLxSd30OyfBoCQkVukjuCI_AL8V843r-n0V4i9gbXgnDbXspOgcuWcVid7X8_Ewz211t1tfXDs Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad4d1fc14f404932ab515a6a4c5a3048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad4d1fc14f404932ab515a6a4c5a3048"}]}] Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ad4d1fc14f404932ab515a6a4c5a3048 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: cc0be0ed857d4c96b26724144e20d766 Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2144351191-project Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: exception: Instance f95b3010-cd07-42e1-81e5-e1cc4800988b could not be found. Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'f95b3010-cd07-42e1-81e5-e1cc4800988b'} Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95b3010-cd07-42e1-81e5-e1cc4800988b could not be found. Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95b3010-cd07-42e1-81e5-e1cc4800988b could not be found. Oct 24 09:01:01.505526 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95b3010-cd07-42e1-81e5-e1cc4800988b could not be found. Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] Returning 404 to user: Instance f95b3010-cd07-42e1-81e5-e1cc4800988b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:01.509237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77cabdae-f0c2-454d-8bcc-53923fa714f0 tempest-LiveAutoBlockMigrationV225Test-2144351191 tempest-LiveAutoBlockMigrationV225Test-2144351191-project] 10.222.0.25 "GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b" status: 404 len: 111 microversion: 2.25 time: 0.055139 Oct 24 09:01:01.513165 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1092/2124] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:01 2022] GET /compute/v2.1/servers/f95b3010-cd07-42e1-81e5-e1cc4800988b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:01:01.524532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70dfd729-bf0b-4689-9e71-2fd3644688b5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf1839d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:01.635839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70dfd729-bf0b-4689-9e71-2fd3644688b5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.121419 Oct 24 09:01:01.642769 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1093/2125] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:01 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:01.665632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-febbce41-3011-47e2-be00-435565e3ec4d req-60a75a59-9054-4161-a853-7cbe3cdc1931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "0a11bffb-3310-4bac-9860-ed7aa8d96370"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:01.718961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-febbce41-3011-47e2-be00-435565e3ec4d req-60a75a59-9054-4161-a853-7cbe3cdc1931 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:01.719497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-febbce41-3011-47e2-be00-435565e3ec4d req-60a75a59-9054-4161-a853-7cbe3cdc1931 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:01.719946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-febbce41-3011-47e2-be00-435565e3ec4d req-60a75a59-9054-4161-a853-7cbe3cdc1931 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:01.759505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-febbce41-3011-47e2-be00-435565e3ec4d req-60a75a59-9054-4161-a853-7cbe3cdc1931 service nova] Creating event network-changed:0a11bffb-3310-4bac-9860-ed7aa8d96370 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:01.776868 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-febbce41-3011-47e2-be00-435565e3ec4d req-60a75a59-9054-4161-a853-7cbe3cdc1931 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126873 Oct 24 09:01:01.781573 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1094/2126] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:01.807256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12d1fe96-1c84-46a2-a832-4d2317def2e5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:01.810787 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12d1fe96-1c84-46a2-a832-4d2317def2e5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:02.259985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12d1fe96-1c84-46a2-a832-4d2317def2e5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:02.289582 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12d1fe96-1c84-46a2-a832-4d2317def2e5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1215 microversion: 2.1 time: 0.490233 Oct 24 09:01:02.289582 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1095/2127] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:01 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1215 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:02.389487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3c892ef1-58b8-4409-882d-747e752d0a52 req-238817f5-19bd-4499-9d3c-4d32a70468b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ecb5b4-493b-4afa-bd2f-237024e8eebb", "name": "network-vif-plugged", "status": "completed", "tag": "128a0c2a-8eae-4433-92d4-8145d8ae3d3b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:02.394159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:02.409468 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b92bf269-04ff-4810-9c0e-91332fa6ba3c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1463 microversion: 2.1 time: 0.973792 Oct 24 09:01:02.426132 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1033/2128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:01 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1463 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:02.453268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:02.454229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:02.461726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:02.462497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:02.464986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:02.466489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:02.467328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:02.467991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:02.511582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3c892ef1-58b8-4409-882d-747e752d0a52 req-238817f5-19bd-4499-9d3c-4d32a70468b4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:02.514780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3c892ef1-58b8-4409-882d-747e752d0a52 req-238817f5-19bd-4499-9d3c-4d32a70468b4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:02.517447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3c892ef1-58b8-4409-882d-747e752d0a52 req-238817f5-19bd-4499-9d3c-4d32a70468b4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:02.557593 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3c892ef1-58b8-4409-882d-747e752d0a52 req-238817f5-19bd-4499-9d3c-4d32a70468b4 service nova] Creating event network-vif-plugged:128a0c2a-8eae-4433-92d4-8145d8ae3d3b for instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb on n-h2-master-1 Oct 24 09:01:02.564294 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3c892ef1-58b8-4409-882d-747e752d0a52 req-238817f5-19bd-4499-9d3c-4d32a70468b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179259 Oct 24 09:01:02.565923 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1096/2129] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:01:02.573726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:02.576266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:02.589519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:02.590289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:02.591048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:02.591943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:02.594183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:02.594816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:02.898022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:02.919453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0691e91-1feb-4704-af41-905bc1d2b559 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1721 microversion: 2.1 time: 0.469946 Oct 24 09:01:02.921781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1034/2130] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:02 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1721 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:02.939096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a50ed68d-18af-40db-9f30-441553390077 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf22d820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:03.019847 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a50ed68d-18af-40db-9f30-441553390077 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.096500 Oct 24 09:01:03.021553 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1035/2131] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:02 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:03.050023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-27281818", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1ff77d2e-5b67-4660-b896-24a8716d0a8d"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:03.166042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:01:03.821115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:01:03.824125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:01:03.824932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:01:03.825601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:01:03.826496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:01:03.858066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:03.860021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:03.862215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:03.864618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:03.867688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:03.871302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:03.952730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Getting quotas for project 72bbfc5e1e574b689ef044341663b776. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:01:03.970264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Getting quotas for user 0fd6766aed02437eb254480dba23f9db and project 72bbfc5e1e574b689ef044341663b776. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:01:03.990012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:01:03.990207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:03.993309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:01:04.012087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:04.015855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:04.019645 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c91cb30f-4833-4119-b035-ca258f29e406 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1864 microversion: 2.42 time: 1.450372 Oct 24 09:01:04.041557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1097/2132] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:02 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1864 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:04.054320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:04.057956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:04.071504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:04.078338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:04.079159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:04.079988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:04.080529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:04.081123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:04.096925 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-593a37e4-7720-4f3f-b96c-1fbdf5a615d6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073989 Oct 24 09:01:04.098256 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1036/2133] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:01:04.120914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4dd7c7d2-776b-4f3c-b030-d0b3bb1348de req-164a3376-cb42-4d62-b452-1c03226e2331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "06864302-5b6e-408a-82ba-2c2ea4aa1f8d"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:04.150618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4dd7c7d2-776b-4f3c-b030-d0b3bb1348de req-164a3376-cb42-4d62-b452-1c03226e2331 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:04.153110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4dd7c7d2-776b-4f3c-b030-d0b3bb1348de req-164a3376-cb42-4d62-b452-1c03226e2331 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:04.153957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4dd7c7d2-776b-4f3c-b030-d0b3bb1348de req-164a3376-cb42-4d62-b452-1c03226e2331 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:04.180477 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4dd7c7d2-776b-4f3c-b030-d0b3bb1348de req-164a3376-cb42-4d62-b452-1c03226e2331 service nova] Creating event network-changed:06864302-5b6e-408a-82ba-2c2ea4aa1f8d for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:04.188189 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4dd7c7d2-776b-4f3c-b030-d0b3bb1348de req-164a3376-cb42-4d62-b452-1c03226e2331 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088244 Oct 24 09:01:04.198391 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1037/2134] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:04.212647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:04.213492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:04.220591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:04.221380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:04.222058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:04.223399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:04.224956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:04.226006 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:04.576725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:04.593248 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-601db801-de60-4d09-9b68-c5b4127c630f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1267 microversion: 2.1 time: 0.558274 Oct 24 09:01:04.605324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1098/2135] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:04 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1267 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:04.612864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9703839b-ff14-4748-ae9d-88cc7e391607 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf16c940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:04.748698 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9703839b-ff14-4748-ae9d-88cc7e391607 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.149554 Oct 24 09:01:04.750190 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1099/2136] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:04 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:04.755737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f50f735-41f1-489b-b69c-8133b618e11d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:04.776626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f50f735-41f1-489b-b69c-8133b618e11d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:04.810736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:04.828340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b505497e-0200-42a6-bbfc-b55027d2f650 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1721 microversion: 2.1 time: 0.627584 Oct 24 09:01:04.830716 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1038/2137] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:04 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1721 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:05.053773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:05.054426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:05.078817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f50f735-41f1-489b-b69c-8133b618e11d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:05.087486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:05.088101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:05.088580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:05.089575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:05.089690 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f50f735-41f1-489b-b69c-8133b618e11d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1212 microversion: 2.1 time: 0.338023 Oct 24 09:01:05.089795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:05.090131 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1100/2138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:04 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1212 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:05.090264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:05.600054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:05.624502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:05.630174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:05.645360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:05.651592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:05.653920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:05.656752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:05.658304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:05.664229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:05.665715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:05.666489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:05.667408 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f33e20f2-17de-46e9-bd6d-e09e97f892bd tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.616533 Oct 24 09:01:05.670859 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1039/2139] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:05 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:05.771213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1676e2db-86d2-46ec-9364-aed7729bd60f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab359f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:05.802424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:05.813790 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56c845ac-dbb5-4592-8f49-52b7a14bfde4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1273 microversion: 2.1 time: 0.196430 Oct 24 09:01:05.815182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1101/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:05 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:05.875157 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1676e2db-86d2-46ec-9364-aed7729bd60f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.113876 Oct 24 09:01:05.876718 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1040/2141] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:05 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:05.879934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:05.880834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:05.896156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:05.899251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:05.900524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:05.902636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:05.904596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:05.906938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:06.119244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:06.120179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:06.156119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:06.157092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:06.157774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:06.159361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:06.174390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:06.177788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:06.415139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:06.426506 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4fa1d7f2-d3fa-4e4b-ad69-19655828dae4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1272 microversion: 2.1 time: 0.312834 Oct 24 09:01:06.430571 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1041/2142] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:06 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:06.731452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-02341f5c-fbdd-439a-847d-c500b3698a7b req-13b924cf-8abe-4c29-a968-60e2ad7039fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "35793050-203b-480a-aeab-dbd45b7acd5b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:06.750372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-02341f5c-fbdd-439a-847d-c500b3698a7b req-13b924cf-8abe-4c29-a968-60e2ad7039fb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:06.752834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-02341f5c-fbdd-439a-847d-c500b3698a7b req-13b924cf-8abe-4c29-a968-60e2ad7039fb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:06.761484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-02341f5c-fbdd-439a-847d-c500b3698a7b req-13b924cf-8abe-4c29-a968-60e2ad7039fb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:06.792024 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-02341f5c-fbdd-439a-847d-c500b3698a7b req-13b924cf-8abe-4c29-a968-60e2ad7039fb service nova] Creating event network-changed:35793050-203b-480a-aeab-dbd45b7acd5b for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:06.802231 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-02341f5c-fbdd-439a-847d-c500b3698a7b req-13b924cf-8abe-4c29-a968-60e2ad7039fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369777 Oct 24 09:01:06.808031 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1042/2143] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:06.813769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:06.814634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:06.822688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:06.823175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:06.824226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:06.825245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:06.825895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:06.826471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:06.931843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:06.951551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4edb7c8-1c0b-4398-9aee-edd0c87c396e tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1727 microversion: 2.1 time: 1.088698 Oct 24 09:01:06.969830 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1102/2144] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:05 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1727 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:06.986554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:06.987100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:07.004210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:07.004703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:07.006227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:07.007573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:07.008176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:07.008751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:07.252012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:07.276743 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfb90958-6114-465d-83cf-1f9209761117 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1273 microversion: 2.1 time: 0.305907 Oct 24 09:01:07.284712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1103/2145] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:06 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:07.297969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11cffc2c-3796-483d-8754-7946d49744f6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf107550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:07.415805 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11cffc2c-3796-483d-8754-7946d49744f6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.126958 Oct 24 09:01:07.416854 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1104/2146] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:07 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:07.424385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:07.426805 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:07.440801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:07.441735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:07.442499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:07.443385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:07.444593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:07.446539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:07.452872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:07.468281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:07.470381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:07.475452 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1beef164-4da4-413b-93c6-84008d668753 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.666137 Oct 24 09:01:07.478408 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1043/2147] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:06 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:07.489030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:07.493829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:07.513153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:07.513997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:07.514596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:07.515496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:07.516124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:07.516713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:07.663069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:07.690824 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a7db03c-6474-4e94-a8ef-bf055a8a3fae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1270 microversion: 2.1 time: 0.210763 Oct 24 09:01:07.694462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1044/2148] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:07 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:07.761764 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1186afb0-46dc-4802-b96f-f0c277729a09 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.343400 Oct 24 09:01:07.762466 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1105/2149] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:01:07 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-interface => generated 284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:08.311635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:08.312651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:08.328717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:08.335241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:08.336525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:08.339957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:08.341929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:08.343180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:08.433771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b23444e1-3c4e-459b-a802-ad99e0967e81 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf115d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:08.498429 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b23444e1-3c4e-459b-a802-ad99e0967e81 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.068038 Oct 24 09:01:08.499950 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1106/2150] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:08 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:08.514326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:08.515196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:08.524624 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:08.527337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:08.528275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:08.529025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:08.529935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:08.530558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:08.531136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:09.108036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:09.112696 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:09.123037 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b177468-6ee7-4b3b-92bd-aa26d2ca5996 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.816516 Oct 24 09:01:09.157820 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1045/2151] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:08 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:09.166190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:09.167096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:09.179415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:09.180802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:09.181651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:09.182685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:09.183859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:09.184475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:09.672369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:09.690263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4899139a-4fb4-4a5e-b48f-4029162b2a53 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1270 microversion: 2.1 time: 0.530959 Oct 24 09:01:09.691734 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1046/2152] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:09 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1270 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:09.696828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4f9edad3-c994-4149-b72d-08531b672f62 req-f93e8035-9a27-4934-b3c3-22f2665a3100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "7633943c-b1d2-4ca2-a70d-10e5b43a0f47"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:09.729230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4f9edad3-c994-4149-b72d-08531b672f62 req-f93e8035-9a27-4934-b3c3-22f2665a3100 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:09.729801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4f9edad3-c994-4149-b72d-08531b672f62 req-f93e8035-9a27-4934-b3c3-22f2665a3100 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:09.730452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4f9edad3-c994-4149-b72d-08531b672f62 req-f93e8035-9a27-4934-b3c3-22f2665a3100 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:09.735999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:09.755020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4f9edad3-c994-4149-b72d-08531b672f62 req-f93e8035-9a27-4934-b3c3-22f2665a3100 service nova] Creating event network-changed:7633943c-b1d2-4ca2-a70d-10e5b43a0f47 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:09.759522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:09.761269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:09.762340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4f9edad3-c994-4149-b72d-08531b672f62 req-f93e8035-9a27-4934-b3c3-22f2665a3100 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067987 Oct 24 09:01:09.763100 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1047/2153] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:09.764481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd41da3c-bf6c-4c4c-9d35-4db6fa1e1fb3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.254319 Oct 24 09:01:09.765089 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1107/2154] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:08 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:09.771203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ec8e244-45d0-47b0-9674-23c83f18d282 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab1b0700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:09.848852 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ec8e244-45d0-47b0-9674-23c83f18d282 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.082641 Oct 24 09:01:09.849936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1048/2155] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:09 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:10.152920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:10.153588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:10.167767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:10.168342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:10.170156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:10.171195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:10.172590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:10.174587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:10.542592 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:10.726511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:10.729642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:10.750967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:10.752833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:10.754633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:10.757361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:10.758137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:10.758820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:10.780506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:10.805286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e0db2ba-2855-4284-af78-8b0a07527784 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.656447 Oct 24 09:01:10.805941 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1108/2156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:10 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:10.835415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:10.837116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:10.845643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:10.846435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:10.853334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:10.854660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:10.855407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:10.856104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:11.375812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:11.386217 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5a0e579d-baf3-473b-b69b-1fda56ac993c tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 0.673833 Oct 24 09:01:11.398053 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1049/2157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:10 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:11.403237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a3b41d3-f438-4fb2-a2d8-4a87ece67bdc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaeff430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:11.483430 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a3b41d3-f438-4fb2-a2d8-4a87ece67bdc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.083926 Oct 24 09:01:11.492688 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1050/2158] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:11 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:11.829021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:11.830470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:11.854956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:11.857611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:11.859632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:11.863879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:11.868251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:11.870228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:12.174145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:12.188319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:12.190383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:12.191959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5e32ea7-a918-4b48-8695-e63e79b2c0b4 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.373920 Oct 24 09:01:12.207303 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1109/2159] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:10 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:12.218453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babd364b-580f-4919-a727-94169135c910", "tag": "c18a743d-0e9d-4395-9c8a-1ac34eca9c91"}, {"name": "network-changed", "server_uuid": "babd364b-580f-4919-a727-94169135c910", "tag": "c18a743d-0e9d-4395-9c8a-1ac34eca9c91"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:12.232216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:12.232997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:12.233636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:12.263833 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] Creating event network-changed:c18a743d-0e9d-4395-9c8a-1ac34eca9c91 for instance babd364b-580f-4919-a727-94169135c910 on n-h2-master-1 Oct 24 09:01:12.264602 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] Creating event network-changed:c18a743d-0e9d-4395-9c8a-1ac34eca9c91 for instance babd364b-580f-4919-a727-94169135c910 on n-h2-master-1 Oct 24 09:01:12.278110 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a6ac86ed-0f99-4f26-b35f-6e4d606582fd req-33e3c6c7-9db7-4add-aad8-b25eeb140d8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068961 Oct 24 09:01:12.279642 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1110/2160] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:12.423227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:12.427815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:12.464124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:12.464648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:12.470718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:12.478315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:12.483987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:12.488799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:12.932740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:12.942301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5aa72d0-de75-4077-9dea-afe358046478 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 1.117960 Oct 24 09:01:12.942908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1051/2161] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:11 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:12.980346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bddd6d6-8b2f-4cae-937e-accb2de7fe85 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab3aedc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:13.082790 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bddd6d6-8b2f-4cae-937e-accb2de7fe85 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.121772 Oct 24 09:01:13.083708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1052/2162] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:12 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:13.223129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:13.224029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:13.239695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:13.241723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:13.242334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:13.243240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:13.243854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:13.244497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:13.910811 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:13.983424 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:14.306669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:14.322853 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-66f847de-8bb7-464f-a021-3d892994e7b5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 1.903965 Oct 24 09:01:14.323493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1111/2163] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:12 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:14.349993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:14.361909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:14.384059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:14.386060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:14.387306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:14.388065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:14.388538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:14.388971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:15.015312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:15.032808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:15.034163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:15.035949 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59b99032-c80f-426d-822b-073136b5ea0d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.817529 Oct 24 09:01:15.036537 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1053/2164] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:13 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:01:15.060072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-787e0f3f-738b-40bc-9d2b-89088a757bb9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daba1e4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:15.084265 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:15.154542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-787e0f3f-738b-40bc-9d2b-89088a757bb9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.116896 Oct 24 09:01:15.155761 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1054/2165] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:15 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:15.160985 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-80462c8e-5b11-40b5-98fb-ced2c5f9f154 req-d775d6d4-a5ba-4720-bd09-0f9f68aaa693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "4f2e3565-64aa-492a-810f-751d064afa17"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:15.172996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-80462c8e-5b11-40b5-98fb-ced2c5f9f154 req-d775d6d4-a5ba-4720-bd09-0f9f68aaa693 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:15.174976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-80462c8e-5b11-40b5-98fb-ced2c5f9f154 req-d775d6d4-a5ba-4720-bd09-0f9f68aaa693 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:15.175694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-80462c8e-5b11-40b5-98fb-ced2c5f9f154 req-d775d6d4-a5ba-4720-bd09-0f9f68aaa693 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:15.193406 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-80462c8e-5b11-40b5-98fb-ced2c5f9f154 req-d775d6d4-a5ba-4720-bd09-0f9f68aaa693 service nova] Creating event network-changed:4f2e3565-64aa-492a-810f-751d064afa17 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:15.202874 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-80462c8e-5b11-40b5-98fb-ced2c5f9f154 req-d775d6d4-a5ba-4720-bd09-0f9f68aaa693 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045058 Oct 24 09:01:15.204228 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1055/2166] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:15.318371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6e06990e-c8c1-4415-942d-9ed1e06ab917 req-2572f50f-5f38-4a9c-bbaf-4f8a425e3ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a529fec-ad62-454b-abf3-10314e46fa99", "tag": "39124742-b06d-4f0a-8184-6ebc6d71c4a0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:15.338962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e06990e-c8c1-4415-942d-9ed1e06ab917 req-2572f50f-5f38-4a9c-bbaf-4f8a425e3ded service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:15.339720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e06990e-c8c1-4415-942d-9ed1e06ab917 req-2572f50f-5f38-4a9c-bbaf-4f8a425e3ded service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:15.340489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e06990e-c8c1-4415-942d-9ed1e06ab917 req-2572f50f-5f38-4a9c-bbaf-4f8a425e3ded service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:15.355475 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6e06990e-c8c1-4415-942d-9ed1e06ab917 req-2572f50f-5f38-4a9c-bbaf-4f8a425e3ded service nova] Creating event network-changed:39124742-b06d-4f0a-8184-6ebc6d71c4a0 for instance 7a529fec-ad62-454b-abf3-10314e46fa99 on n-h1-master-1 Oct 24 09:01:15.361288 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6e06990e-c8c1-4415-942d-9ed1e06ab917 req-2572f50f-5f38-4a9c-bbaf-4f8a425e3ded service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155447 Oct 24 09:01:15.362692 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1056/2167] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:15.369443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:15.370596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:15.379367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:15.380286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:15.381433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:15.385159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:15.385966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:15.387680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:15.604772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:15.616635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bbf69f4a-c6b3-4c03-83f5-41d03baf2e09 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 1.292013 Oct 24 09:01:15.617911 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1112/2168] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:14 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:16.066802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:16.067427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:16.075505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:16.076294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:16.077194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:16.078215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:16.078856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:16.079603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:16.354193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:16.385241 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-899853aa-4a4f-430a-ac02-c3b4bffd486b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 1.020393 Oct 24 09:01:16.398097 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1057/2169] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:15 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:16.403862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f8c33eb-b735-45d9-b24f-e208b1061d6d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf22d820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:16.474131 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f8c33eb-b735-45d9-b24f-e208b1061d6d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.071982 Oct 24 09:01:16.476218 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1058/2170] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:16 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:16.647504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:16.648592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:16.660768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:16.661659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:16.662329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:16.663294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:16.663959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:16.664596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:17.273319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:17.291702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:17.295266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:17.297445 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-437499d7-99fc-43af-b009-cb00ec7551ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.234604 Oct 24 09:01:17.301989 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1113/2171] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:16 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:17.379551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-918ef338-b011-4c8f-9deb-7914ed95f760 req-3680ed35-9a73-4a38-be55-654182d42c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:17.399208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-918ef338-b011-4c8f-9deb-7914ed95f760 req-3680ed35-9a73-4a38-be55-654182d42c73 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:17.399807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-918ef338-b011-4c8f-9deb-7914ed95f760 req-3680ed35-9a73-4a38-be55-654182d42c73 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:17.400313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-918ef338-b011-4c8f-9deb-7914ed95f760 req-3680ed35-9a73-4a38-be55-654182d42c73 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:17.438937 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-918ef338-b011-4c8f-9deb-7914ed95f760 req-3680ed35-9a73-4a38-be55-654182d42c73 service nova] Creating event network-changed:9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:17.449996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-918ef338-b011-4c8f-9deb-7914ed95f760 req-3680ed35-9a73-4a38-be55-654182d42c73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074970 Oct 24 09:01:17.453720 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1114/2172] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:01:17.468997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:17.470071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:17.484648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:17.485669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:17.486264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:17.488795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:17.498073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:17.498771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:17.780954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:17.792423 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87e8b52c-46ff-4217-9e85-888fa6f0b8a5 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 1.151206 Oct 24 09:01:17.794178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1059/2173] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:16 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:17.812720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4343a649-07c5-46ae-b618-10535e1a59b3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2413a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:17.901808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4343a649-07c5-46ae-b618-10535e1a59b3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.094948 Oct 24 09:01:17.919822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1060/2174] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:17 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:17.925148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-eeb206f5-651e-48d2-86b2-8b3f4c6fac7c req-db8c5388-ec3e-4f83-a553-7c20b4ca7a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "571fbcc3-1d59-4166-80ec-699289aab28e", "tag": "0c1baa16-cde7-4fab-8631-309506b49b33"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:17.959254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eeb206f5-651e-48d2-86b2-8b3f4c6fac7c req-db8c5388-ec3e-4f83-a553-7c20b4ca7a74 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:17.960426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eeb206f5-651e-48d2-86b2-8b3f4c6fac7c req-db8c5388-ec3e-4f83-a553-7c20b4ca7a74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:17.965625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eeb206f5-651e-48d2-86b2-8b3f4c6fac7c req-db8c5388-ec3e-4f83-a553-7c20b4ca7a74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:17.987081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-eeb206f5-651e-48d2-86b2-8b3f4c6fac7c req-db8c5388-ec3e-4f83-a553-7c20b4ca7a74 service nova] Creating event network-changed:0c1baa16-cde7-4fab-8631-309506b49b33 for instance 571fbcc3-1d59-4166-80ec-699289aab28e on n-h2-master-1 Oct 24 09:01:17.999936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-eeb206f5-651e-48d2-86b2-8b3f4c6fac7c req-db8c5388-ec3e-4f83-a553-7c20b4ca7a74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078371 Oct 24 09:01:18.003966 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1061/2175] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:18.218406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:18.228153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-694acc97-1b16-41dc-be5b-15f9e94f3715 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 0.773019 Oct 24 09:01:18.245882 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1115/2176] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:17 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:18.333245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:18.334363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:18.353598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:18.354327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:18.354921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:18.355796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:18.356461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:18.356934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:18.820517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:18.821860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:18.834085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:18.834891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:18.842185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:18.843508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:18.844153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:18.844744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:19.269841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:19.284559 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b32e972a-a517-4f9b-a169-b66bb50f6cb4 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.465200 Oct 24 09:01:19.289651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1116/2177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:18 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:19.296971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-27411417-443a-47b2-8524-619af276b717 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf115f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:19.364881 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-27411417-443a-47b2-8524-619af276b717 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.074072 Oct 24 09:01:19.373436 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1117/2178] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:19 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:19.373436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:19.373436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:19.378267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:19.379299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:19.379740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:19.380455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:19.380908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:19.381357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:19.803659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:19.815850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:19.823984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:19.830522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36fcf1c3-5494-4689-9028-995e18c9b56b tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.502141 Oct 24 09:01:19.831380 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1062/2179] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:18 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:20.312968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:20.313667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:20.326239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:20.329278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:20.332460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:20.333510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:20.334184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:20.334814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:20.870920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:20.887791 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-367c3b64-23a2-4d7e-9590-6db8bff35b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 1.517088 Oct 24 09:01:20.901913 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1118/2180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:19 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:20.917643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-435517f9-dbb6-45c9-8339-ba0e9c5f1c36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf0c0ee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:21.000098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:21.016378 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5e62144-8847-444b-91e8-cf01e1849120 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.707657 Oct 24 09:01:21.017264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1063/2181] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:20 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:21.026083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:21.030782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:21.039869 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-435517f9-dbb6-45c9-8339-ba0e9c5f1c36 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.136961 Oct 24 09:01:21.041009 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1119/2182] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:20 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:21.066326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.066852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.067305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.068116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.068640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.069081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.368315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:21.388733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:21.394985 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:21.402446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8642a740-e8a3-4d04-b1ac-d2a1cd437adb tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.383856 Oct 24 09:01:21.406945 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1064/2183] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:21 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:21.918560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:21.920089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:21.933142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.934007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.935397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.937403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.939003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.939718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.951156 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:22.047301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:22.049077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:22.057034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:22.057903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:22.059493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:22.060478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:22.061503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:22.062239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:22.299174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:22.309007 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1041b31-9967-4d12-b95b-be9857d56b1d tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 0.399569 Oct 24 09:01:22.313275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1120/2184] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:21 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:22.329041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c21b09cc-dae4-45a6-99eb-a451e239c738 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf1550d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:22.400800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c21b09cc-dae4-45a6-99eb-a451e239c738 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.085150 Oct 24 09:01:22.401713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1121/2185] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:22 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:22.432194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:22.440607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:22.441478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:22.442991 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88ffb557-6c16-4b39-94db-518caff6302e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.400897 Oct 24 09:01:22.449409 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1065/2186] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:22 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:22.464315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:22.465174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:22.465876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:22.466839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:22.467683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:22.468563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.368427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:23.369783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:23.380055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.380798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.381467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.413046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.415834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.417378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.503241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:23.530915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:23.537951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:23.541632 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b70dbf7-e526-4c2c-b6f7-d5a7cbe5da45 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.106208 Oct 24 09:01:23.569129 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1122/2187] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:22 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:01:23.590056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e2637c00-d8cd-474a-88cf-f7b8fb31a758 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf1079d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:23.665186 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e2637c00-d8cd-474a-88cf-f7b8fb31a758 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1439 microversion: 2.1 time: 0.090801 Oct 24 09:01:23.680516 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1123/2188] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:23 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:23.694807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:23.695821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:23.712416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.712989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.719419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.720378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.720940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.729252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:24.076839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:24.085223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ede61f4d-cc22-4d62-9cb0-3a5e22e359fa tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 0.726327 Oct 24 09:01:24.090200 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1066/2189] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:23 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:24.139550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:24.148453 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c029e8a-3d22-4691-a40d-74adb39fef84 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.464706 Oct 24 09:01:24.153601 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1124/2190] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:23 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:24.577473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:24.578186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:24.593013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:24.595466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:24.596787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:24.600629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:24.612524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:24.614374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:24.696187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7441ae1-3907-496c-951d-2392c7424352 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf296160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:24.802628 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7441ae1-3907-496c-951d-2392c7424352 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1448 microversion: 2.1 time: 0.110849 Oct 24 09:01:24.806748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1125/2191] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:24 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1448 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:24.817759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-edb1bc2e-0a37-484b-a224-c13fac510c33 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf1150d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:24.949406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-edb1bc2e-0a37-484b-a224-c13fac510c33 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 200 len: 1448 microversion: 2.1 time: 0.135990 Oct 24 09:01:24.962588 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1126/2192] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:24 2022] GET /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 1448 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:24.986625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b42e0ead-0de6-4932-8124-9ff72f4a6b95 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf0ffd30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:25.329683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:25.349184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:25.354024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:25.357210 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cf25159-5812-4049-b6c2-94362edb6755 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.784776 Oct 24 09:01:25.370136 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1067/2193] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:24 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:25.388374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:25.389003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:25.400103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:25.400607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:25.410322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:25.411530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:25.412023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:25.412464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:25.699535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:25.708724 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cae3f8c1-9f69-4a5e-9e73-1942ad4db1e0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 0.340546 Oct 24 09:01:25.708724 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1068/2194] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:25 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:25.718621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:25.719250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:25.728100 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:25.731386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:25.732296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:25.733347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:25.734259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:25.734923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:25.735657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:25.968140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:25.979768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc543e09-1e38-4bdd-9a35-0c2bcf2bb2c3 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.270184 Oct 24 09:01:25.982627 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1069/2195] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:25 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:25.998323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-81f458db-cac1-42fc-939e-c420e41cf7b1 req-80944ec8-6484-4ba1-b2b7-b1aa82457c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a529fec-ad62-454b-abf3-10314e46fa99", "name": "network-vif-plugged", "status": "completed", "tag": "39124742-b06d-4f0a-8184-6ebc6d71c4a0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:26.025730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-81f458db-cac1-42fc-939e-c420e41cf7b1 req-80944ec8-6484-4ba1-b2b7-b1aa82457c42 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:26.026219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-81f458db-cac1-42fc-939e-c420e41cf7b1 req-80944ec8-6484-4ba1-b2b7-b1aa82457c42 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:26.030560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-81f458db-cac1-42fc-939e-c420e41cf7b1 req-80944ec8-6484-4ba1-b2b7-b1aa82457c42 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:26.047762 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-81f458db-cac1-42fc-939e-c420e41cf7b1 req-80944ec8-6484-4ba1-b2b7-b1aa82457c42 service nova] Creating event network-vif-plugged:39124742-b06d-4f0a-8184-6ebc6d71c4a0 for instance 7a529fec-ad62-454b-abf3-10314e46fa99 on n-h1-master-1 Oct 24 09:01:26.054539 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-81f458db-cac1-42fc-939e-c420e41cf7b1 req-80944ec8-6484-4ba1-b2b7-b1aa82457c42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068815 Oct 24 09:01:26.055893 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1070/2196] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:26.343235 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b42e0ead-0de6-4932-8124-9ff72f4a6b95 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 204 len: 0 microversion: 2.1 time: 1.364357 Oct 24 09:01:26.344185 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1127/2197] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:24 2022] DELETE /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 0 bytes in 1366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:01:26.356890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:26.357899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:26.382021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:26.382717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:26.383058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:26.383860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:26.384310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:26.384782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:26.393844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:26.396229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:26.412558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:26.414927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:26.415793 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:01:26.416443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:26.419522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:26.420623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:26.422284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:26.423706 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:26.529228 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8a70fe0-7e5f-4991-a0b3-68c966eba1d7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 204 len: 0 microversion: 2.1 time: 0.178124 Oct 24 09:01:26.530150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1071/2198] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:26 2022] DELETE /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:01:26.674082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1263188035", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "62c56d9c-5126-43a0-b067-60873881adab"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:26.755678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] validate_networks() for [('62c56d9c-5126-43a0-b067-60873881adab', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:01:27.135090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:27.154335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:27.157122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:27.160857 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca707ec1-c317-4142-b541-2775d057f207 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.771568 Oct 24 09:01:27.162065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1128/2199] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:26 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:01:27.173607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:27.177971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:27.198520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:27.199220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:27.199675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:27.200404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:27.200867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:27.201315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:27.617416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:27.630348 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c0c5482-d741-44b6-b092-a48275d3284f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1312 microversion: 2.1 time: 0.466820 Oct 24 09:01:27.631608 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1129/2200] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:27 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1312 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:27.636902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:27.637885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:27.645067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:27.646029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:27.646705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:27.647639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:27.648312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:27.648956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:27.897990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:01:27.898546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:01:27.899093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:01:27.900312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:01:27.901069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:01:27.915831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:27.917933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:27.918636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:27.921996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:27.922746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:27.923578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:27.955691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:01:27.962494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for user ca932e5866274fc78b04689811e72746 and project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:01:27.979064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:01:27.982416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:01:28.054223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d5e5931-66dd-4f19-a0f2-aea55863d359 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386859 Oct 24 09:01:28.055913 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1072/2201] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:01:28.095776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:28.106990 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-335d44c4-7079-4bec-858d-84a598bafab2 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.473719 Oct 24 09:01:28.107685 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1130/2202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:27 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:28.126188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e9196fc-dec7-45ac-a326-8539ae74bafe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:28.127165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e9196fc-dec7-45ac-a326-8539ae74bafe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:28.248168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d25ad97c-e732-45f7-bde1-2f44e030cbd0 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Action: 'create', calling method: .version_select at 0x7f8daf241790>, body: {"pool": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:28.253640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e9196fc-dec7-45ac-a326-8539ae74bafe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:28.261665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e9196fc-dec7-45ac-a326-8539ae74bafe tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1208 microversion: 2.1 time: 0.140701 Oct 24 09:01:28.265597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1131/2203] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:28 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:28.276734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-938521de-b99f-4d74-8099-482427bd4710 req-3b6134a8-98ff-487b-9841-d1be0732affd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571fbcc3-1d59-4166-80ec-699289aab28e", "name": "network-vif-plugged", "status": "completed", "tag": "0c1baa16-cde7-4fab-8631-309506b49b33"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:28.296606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938521de-b99f-4d74-8099-482427bd4710 req-3b6134a8-98ff-487b-9841-d1be0732affd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:28.297383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938521de-b99f-4d74-8099-482427bd4710 req-3b6134a8-98ff-487b-9841-d1be0732affd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:28.298039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938521de-b99f-4d74-8099-482427bd4710 req-3b6134a8-98ff-487b-9841-d1be0732affd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:28.317340 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-938521de-b99f-4d74-8099-482427bd4710 req-3b6134a8-98ff-487b-9841-d1be0732affd service nova] Creating event network-vif-plugged:0c1baa16-cde7-4fab-8631-309506b49b33 for instance 571fbcc3-1d59-4166-80ec-699289aab28e on n-h2-master-1 Oct 24 09:01:28.344322 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-938521de-b99f-4d74-8099-482427bd4710 req-3b6134a8-98ff-487b-9841-d1be0732affd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075703 Oct 24 09:01:28.347159 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1132/2204] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:28.361819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:28.365996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:28.388527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:28.389042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:28.389538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:28.390320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:28.390782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:28.401443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:28.965978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:28.977561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:28.980216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:28.982120 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c48fc8ea-cbfb-4ca4-af59-61465730a248 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.632737 Oct 24 09:01:28.983489 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1133/2205] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:28 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:28.990529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:28.991468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:28.998595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:28.999567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:29.000790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:29.006252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:29.006766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:29.007345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:29.502923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:29.512486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ffe71b67-93b7-409f-9e47-c0955f4020cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1461 microversion: 2.1 time: 0.527165 Oct 24 09:01:29.551725 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1134/2206] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:28 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1461 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:29.561365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:29.562196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:29.573275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:29.574047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:29.574851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:29.575743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:29.576825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:29.580506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:30.527933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:30.539164 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80e853c8-a221-405e-aaa7-839cf86b4bd9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1315 microversion: 2.1 time: 0.985507 Oct 24 09:01:30.540336 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1135/2207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:29 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:30.547987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:30.548913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:30.559540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:30.560576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:30.561157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:30.562179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:30.562740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:30.563261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:30.658081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:30.668117 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d25ad97c-e732-45f7-bde1-2f44e030cbd0 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.610515 Oct 24 09:01:30.668563 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d75cfcd0-64f5-4819-94f9-cc440457df04 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1260 microversion: 2.1 time: 0.126662 Oct 24 09:01:30.673520 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1073/2208] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 09:01:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:30.682001 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1136/2209] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:30 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1260 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:30.692314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-4f5316d5-fad2-43b2-a8a3-2a30290abeaa req-ed121ba4-c8d8-422a-a8a0-90c095ea645c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ecb5b4-493b-4afa-bd2f-237024e8eebb", "name": "network-vif-deleted", "tag": "128a0c2a-8eae-4433-92d4-8145d8ae3d3b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:30.729722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4f5316d5-fad2-43b2-a8a3-2a30290abeaa req-ed121ba4-c8d8-422a-a8a0-90c095ea645c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:30.730597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4f5316d5-fad2-43b2-a8a3-2a30290abeaa req-ed121ba4-c8d8-422a-a8a0-90c095ea645c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:30.731188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4f5316d5-fad2-43b2-a8a3-2a30290abeaa req-ed121ba4-c8d8-422a-a8a0-90c095ea645c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:30.753226 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-4f5316d5-fad2-43b2-a8a3-2a30290abeaa req-ed121ba4-c8d8-422a-a8a0-90c095ea645c service nova] Creating event network-vif-deleted:128a0c2a-8eae-4433-92d4-8145d8ae3d3b for instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb on n-h2-master-1 Oct 24 09:01:30.760146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-4f5316d5-fad2-43b2-a8a3-2a30290abeaa req-ed121ba4-c8d8-422a-a8a0-90c095ea645c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076971 Oct 24 09:01:30.765809 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1137/2210] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:30.783886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:30.785226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:30.797487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:30.802258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:30.803004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:30.803914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:30.806704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:30.808866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:31.042855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:31.074011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'deleted': False, 'project_id': '3044fc3726124c13980277eda94bbd3e'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:31.089732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:31.091354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:31.091820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:31.092592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:31.093061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:31.104077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:31.178116 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65b9b728-9e1b-44a9-8942-e62f624f44e7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.503422 Oct 24 09:01:31.179436 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1074/2211] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:01:30 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:31.185445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-852716a5-5435-48bf-ac61-a7133a124614 req-2a7c5348-ef2f-437e-9567-4125e93c228f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ecb5b4-493b-4afa-bd2f-237024e8eebb", "name": "network-vif-unplugged", "status": "completed", "tag": "128a0c2a-8eae-4433-92d4-8145d8ae3d3b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:31.232531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-852716a5-5435-48bf-ac61-a7133a124614 req-2a7c5348-ef2f-437e-9567-4125e93c228f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:31.233388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-852716a5-5435-48bf-ac61-a7133a124614 req-2a7c5348-ef2f-437e-9567-4125e93c228f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:31.235168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-852716a5-5435-48bf-ac61-a7133a124614 req-2a7c5348-ef2f-437e-9567-4125e93c228f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:31.268879 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-852716a5-5435-48bf-ac61-a7133a124614 req-2a7c5348-ef2f-437e-9567-4125e93c228f service nova] Creating event network-vif-unplugged:128a0c2a-8eae-4433-92d4-8145d8ae3d3b for instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb on n-h2-master-1 Oct 24 09:01:31.283943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-852716a5-5435-48bf-ac61-a7133a124614 req-2a7c5348-ef2f-437e-9567-4125e93c228f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102602 Oct 24 09:01:31.286750 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1075/2212] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:31.304135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f96a67c8-18e5-4cc5-883b-e557484c66d6 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Action: 'create', calling method: .version_select at 0x7f8daf241160>, body: {"pool": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:31.504522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:31.519535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:31.531800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:31.539800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6b0dd82-e1e1-4afa-9110-6fce474c5232 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.772572 Oct 24 09:01:31.541675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1138/2213] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:30 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:31.562059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:31.602834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'deleted': False} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:31.615254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:31.615755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:31.616188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:31.617101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:31.617680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:31.618587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:31.845056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:01:32.237344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:32.237901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:32.238354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:33.259389 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2308cb9-3de0-4d14-b357-d2f6dc8fc527 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14903 microversion: 2.1 time: 1.715450 Oct 24 09:01:33.262465 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1139/2214] 10.222.0.25 () {58 vars in 1171 bytes} [Mon Oct 24 09:01:31 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14903 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:01:33.268700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:33.272691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:33.288994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:33.289545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:33.289993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:33.301904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:33.302460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:33.302910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:33.698402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:33.714517 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-982a1faa-f47a-494f-918a-e7539de2a3ff tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1501 microversion: 2.1 time: 0.447071 Oct 24 09:01:33.716005 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1140/2215] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:33 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1501 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:33.730783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:33.731809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:33.741462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:33.742529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:33.743213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:33.746352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:33.750828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:33.751503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:34.444298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:34.459755 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e125fbf-9fce-4d65-b7b4-befb92822250 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1308 microversion: 2.1 time: 0.742290 Oct 24 09:01:34.462376 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1141/2216] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:33 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:34.477963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:34.478680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:34.495439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:34.496800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:34.497684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:34.498752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:34.499366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:34.499939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:34.880972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:34.909111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:34.911131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:34.912399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e38043dd-8820-46e9-bca3-51694525a60e tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.447453 Oct 24 09:01:34.919618 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1142/2217] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:34 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:34.928565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:34.939966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'deleted': False, 'project_id': '3044fc3726124c13980277eda94bbd3e'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:34.947800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:34.948951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:34.949620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:34.951257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:34.952376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:34.953282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.127122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-946db442-4697-4631-b2b0-0f21dd4872d4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=72bbfc5e1e574b689ef044341663b776" status: 200 len: 15 microversion: 2.1 time: 0.203749 Oct 24 09:01:35.131834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1143/2218] 10.222.0.25 () {58 vars in 1231 bytes} [Mon Oct 24 09:01:34 2022] GET /compute/v2.1/servers/detail?tenant_id=72bbfc5e1e574b689ef044341663b776 => generated 15 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:35.136924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:35.139885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:35.161534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.162285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.162869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.164772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.165430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.166011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.178131 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:35.224050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lazy-loading 'flavor' on Instance uuid 571fbcc3-1d59-4166-80ec-699289aab28e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:01:35.330331 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f96a67c8-18e5-4cc5-883b-e557484c66d6 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.040179 Oct 24 09:01:35.333068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1076/2219] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 09:01:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:35.339002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:35.354231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'tenant_id': '72bbfc5e1e574b689ef044341663b776', 'deleted': False} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:35.359038 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-893658a8-24c9-439f-84b5-59b9b8c57833 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "POST /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e/action" status: 202 len: 0 microversion: 2.1 time: 0.225677 Oct 24 09:01:35.359723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1144/2220] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:35 2022] POST /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:35.374532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.375461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.376954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.378242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89610bbb-c20e-4061-b226-1004097644c0 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Action: 'create', calling method: .version_select at 0x7f8daf2dd8b0>, body: {"pool": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:35.379033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.379677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.382158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.467382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:01:35.537911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.538766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.539427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.901522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4579600-db77-42e0-8663-314b94d0d948 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72bbfc5e1e574b689ef044341663b776" status: 200 len: 4822 microversion: 2.1 time: 0.567049 Oct 24 09:01:35.903806 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1077/2221] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:01:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72bbfc5e1e574b689ef044341663b776 => generated 4822 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:35.914955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:35.917535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:35.946877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.947375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.948005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:35.948862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:35.952070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:35.954580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.357394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:36.367815 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33c760cf-2edb-470f-9c68-0ea7cb6f47ed tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1492 microversion: 2.1 time: 0.461114 Oct 24 09:01:36.369035 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1078/2222] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:35 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1492 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:36.375660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:36.376505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:36.385421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.386151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.389390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.401367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.402999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.403599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.586455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:36.595528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb9e601e-5f2b-4511-9add-83e4ef5e3b89 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1308 microversion: 2.1 time: 0.225099 Oct 24 09:01:36.596485 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1079/2223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:36 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:36.604440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3e415414-36ca-44be-b9a4-7212d76ca5e3 req-0d4f8abe-a53b-4ca4-a909-d1004a9d8d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e5c236-d625-4c16-ba83-f805f400ec74", "tag": "236f2595-87f6-4629-b0b5-b05acc3a91fe"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:36.618541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3e415414-36ca-44be-b9a4-7212d76ca5e3 req-0d4f8abe-a53b-4ca4-a909-d1004a9d8d99 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.618930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3e415414-36ca-44be-b9a4-7212d76ca5e3 req-0d4f8abe-a53b-4ca4-a909-d1004a9d8d99 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.619541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3e415414-36ca-44be-b9a4-7212d76ca5e3 req-0d4f8abe-a53b-4ca4-a909-d1004a9d8d99 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.636763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3e415414-36ca-44be-b9a4-7212d76ca5e3 req-0d4f8abe-a53b-4ca4-a909-d1004a9d8d99 service nova] Creating event network-changed:236f2595-87f6-4629-b0b5-b05acc3a91fe for instance 20e5c236-d625-4c16-ba83-f805f400ec74 on n-h2-master-1 Oct 24 09:01:36.643309 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3e415414-36ca-44be-b9a4-7212d76ca5e3 req-0d4f8abe-a53b-4ca4-a909-d1004a9d8d99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045035 Oct 24 09:01:36.644965 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1080/2224] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:36.656057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:36.662945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'tenant_id': '3044fc3726124c13980277eda94bbd3e', 'deleted': False} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:36.668259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.668744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.669393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.670307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.671033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.671702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.708338 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-299a9d2c-5ad5-4894-a9da-fde5b575ec1d tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3044fc3726124c13980277eda94bbd3e" status: 200 len: 15 microversion: 2.1 time: 0.061881 Oct 24 09:01:36.709669 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1081/2225] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:01:36 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3044fc3726124c13980277eda94bbd3e => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:36.715146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:36.716408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:36.723384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.724392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.725652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:36.726558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:36.727183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:36.727788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.053953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:37.072623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:37.074928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:37.076348 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53430fd5-d47b-4da8-aae7-c8a590491d2f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.365457 Oct 24 09:01:37.077075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1082/2226] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:36 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:37.082831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:37.083670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:37.090749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.091600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.092537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.094146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.099250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.099800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.172898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:01:37.314942 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bab6318-95e2-4280-bfbc-eb851b478295 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 204 len: 0 microversion: 2.1 time: 0.236072 Oct 24 09:01:37.318196 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1083/2227] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:37 2022] DELETE /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:01:37.327879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e84f106-84d0-453c-aafc-d1b3fe91c70b tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:37.334363 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e84f106-84d0-453c-aafc-d1b3fe91c70b tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014416 Oct 24 09:01:37.338389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1084/2228] 10.222.0.25 () {58 vars in 1189 bytes} [Mon Oct 24 09:01:37 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:37.343797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:37.345375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:37.352875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.353625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.354236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.355103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.355713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.356325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.602728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:37.614635 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24e07d5f-bf97-442d-a5e8-13f3b828c2ce tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1498 microversion: 2.1 time: 0.274814 Oct 24 09:01:37.627733 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1085/2229] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:37 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:37.639575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:37.642380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:37.649957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.650845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.651445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.653141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.653968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.654675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.782212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbd2f395-3d6f-4a45-933d-99f24ee235a7 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.150942 Oct 24 09:01:37.783782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1086/2230] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:37 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:37.791641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:37.792271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:37.799782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.800258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.800650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.801710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:37.802164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:37.803916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:37.949699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:37.958032 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9aa6000c-1c56-494f-8a0e-3befa09746c2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1308 microversion: 2.1 time: 0.170610 Oct 24 09:01:37.958976 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1087/2231] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:37 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:38.038458 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89610bbb-c20e-4061-b226-1004097644c0 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.675358 Oct 24 09:01:38.039110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1145/2232] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 09:01:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:38.044356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:38.052140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:38.053349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '72bbfc5e1e574b689ef044341663b776'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:38.059135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:38.059760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:38.060483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:38.061759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:38.062331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:38.063010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:38.104013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1653874634", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "43ee9331-4cbe-456a-8a7a-c8bd354210fa"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:38.156968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:01:38.166027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] validate_networks() for [('43ee9331-4cbe-456a-8a7a-c8bd354210fa', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:01:38.220284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4286ed31-f6e3-4b18-be4b-fca4dc45394a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.179931 Oct 24 09:01:38.220872 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1146/2233] 10.222.0.25 () {58 vars in 1150 bytes} [Mon Oct 24 09:01:38 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:38.279960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1216331153", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:38.336294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:01:38.736925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:01:38.737470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:01:38.737876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:01:38.738286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:01:38.738840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:01:38.753182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:38.754257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:38.755055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:38.756131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:38.756817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:38.757571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:38.782895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Getting quotas for project e39ab7b5b92a41668acea520536e4537. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:01:38.790465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Getting quotas for user 8941a72c029246b99e52925781a4d1e6 and project e39ab7b5b92a41668acea520536e4537. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:01:38.805074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:01:38.807674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:01:38.821445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:01:38.822013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:01:38.823144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:01:38.823144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:01:38.823567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:01:38.834161 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=72 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:38.852027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:38.852744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:38.857019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:38.859056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:38.859563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:38.863800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:38.890855 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a802aee-52bc-45e1-8476-4646c8c389ea tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.930293 Oct 24 09:01:38.891902 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1088/2234] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:01:38.903530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bdd02c12-6c78-4854-bdcc-9339ed908fe3 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Action: 'create', calling method: .version_select at 0x7f8dab495790>, body: {"pool": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:38.905023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Getting quotas for project 33ae68ba2a584665992f3856fab416a5. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:01:38.915360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Getting quotas for user 0ba0cbf327634abdb5a1be7d2ee31e30 and project 33ae68ba2a584665992f3856fab416a5. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:01:38.935617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:01:38.939072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:01:39.016436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc9df044-53fc-41ea-a0a7-e11a11430897 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791825 Oct 24 09:01:39.018254 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1147/2235] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:01:39.043748 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:39.046590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:39.090095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:39.090824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:39.091410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:39.092552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:39.093165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:39.093855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:39.500075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:39.521593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:39.529553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:39.533167 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15738031-68a7-4559-bc0c-757f093164c7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.513852 Oct 24 09:01:39.538238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1148/2236] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:39 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:39.558984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:39.565407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:39.580980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:39.582859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:39.587867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:39.590223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:39.590661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:39.591701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:39.794276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da3ebb51-63ab-4156-9f19-b74da1d315be tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.254197 Oct 24 09:01:39.799110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1149/2237] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:39 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:39.808605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:39.814553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:39.828969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:39.833061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:39.835468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:39.838606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:39.840306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:39.841955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.099121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:40.115832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12121a34-72d5-45ba-861a-0db60578b33d tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1456 microversion: 2.1 time: 0.309533 Oct 24 09:01:40.118386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1150/2238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:39 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1456 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:40.126586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:40.127282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:40.134431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.134812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.135233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.135976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.136429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.136861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.228254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:40.239760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:40.241191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:40.242670 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3800a541-758e-4ce4-8df0-6157083328ec tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1314 microversion: 2.26 time: 0.123063 Oct 24 09:01:40.243586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1151/2239] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:40 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1314 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:40.251094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:40.251734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:40.266922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.267817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.268558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.270596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.271386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.272069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.454062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:40.486398 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87c9cca0-c62f-44a2-9fc8-c92e46360349 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1308 microversion: 2.1 time: 0.241452 Oct 24 09:01:40.498232 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1152/2240] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:40 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:40.511973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:40.512762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:40.537509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.538205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.538647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.539617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.539849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.540283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.606928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:40.618458 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c855846e-16d7-4164-a649-b81b156adc9f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1215 microversion: 2.1 time: 0.118125 Oct 24 09:01:40.619057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1153/2241] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:40 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:40.630084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:40.632734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:40.641961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.642521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.643044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.643847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:40.644496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:40.645396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:40.998997 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3563c05-39c4-484e-b05e-efc3baab13c4 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1614 microversion: 2.1 time: 0.377784 Oct 24 09:01:41.014374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1154/2242] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:40 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1614 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:41.022726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-fabfd762-7e2e-4bd2-9621-0e15632c43a5 req-6af49848-e0dc-4cb9-ab05-f3d08187dd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "571fbcc3-1d59-4166-80ec-699289aab28e", "name": "network-vif-deleted", "tag": "0c1baa16-cde7-4fab-8631-309506b49b33"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:41.056144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fabfd762-7e2e-4bd2-9621-0e15632c43a5 req-6af49848-e0dc-4cb9-ab05-f3d08187dd29 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.056995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fabfd762-7e2e-4bd2-9621-0e15632c43a5 req-6af49848-e0dc-4cb9-ab05-f3d08187dd29 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.062958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fabfd762-7e2e-4bd2-9621-0e15632c43a5 req-6af49848-e0dc-4cb9-ab05-f3d08187dd29 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.084050 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-fabfd762-7e2e-4bd2-9621-0e15632c43a5 req-6af49848-e0dc-4cb9-ab05-f3d08187dd29 service nova] Creating event network-vif-deleted:0c1baa16-cde7-4fab-8631-309506b49b33 for instance 571fbcc3-1d59-4166-80ec-699289aab28e on n-h2-master-1 Oct 24 09:01:41.118959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-fabfd762-7e2e-4bd2-9621-0e15632c43a5 req-6af49848-e0dc-4cb9-ab05-f3d08187dd29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102770 Oct 24 09:01:41.121589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1155/2243] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:41.144017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.145124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:41.162739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.163853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.166005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.167129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.167757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.169534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.307618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bdd02c12-6c78-4854-bdcc-9339ed908fe3 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.414375 Oct 24 09:01:41.308234 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1089/2244] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 09:01:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:41.313035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.313497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:41.320714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.321815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.322280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.323002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.323460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.323889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.423071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'services' on Instance uuid babd364b-580f-4919-a727-94169135c910 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:01:41.462482 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:41.520327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.532614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.534346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.536681 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c23e891-1f28-4ca8-9304-cedac81f5b77 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.413717 Oct 24 09:01:41.537658 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1156/2245] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:41 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:41.542171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.542791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:41.551934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.552655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.553908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.554768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.555359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.556049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.560994 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41a91f8e-9310-4ed2-a02a-a615c0df1ee6 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments/e8c6addd-c1ea-4f07-be23-f84b10acfa47" status: 202 len: 0 microversion: 2.1 time: 0.251277 Oct 24 09:01:41.563654 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1090/2246] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:01:41 2022] DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments/e8c6addd-c1ea-4f07-be23-f84b10acfa47 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:41.569527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.570467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:41.578316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.579012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.579639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.580355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.580813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.581316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.615639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.616433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.617025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.617665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lazy-loading 'fault' on Instance uuid 571fbcc3-1d59-4166-80ec-699289aab28e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:01:41.671158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5f0704d95640a99457ddd8652f83ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8296bcb4ff034194b66485ce116bb18a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.690800 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d0b00685-1d7e-407f-bb39-97ac247a619a tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 200 len: 1305 microversion: 2.1 time: 0.125641 Oct 24 09:01:41.693732 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1091/2247] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:41 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:41.700112 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.700960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:41.710210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.710924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.711556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.712486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.713234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.714028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.810278 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62d19312-226d-4b05-9ad4-b518f6317d87 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1614 microversion: 2.1 time: 0.271714 Oct 24 09:01:41.811370 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1157/2248] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:41 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1614 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:41.817481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6ec04ef-3fae-4068-8937-beb945daa455 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8daf28ae50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.822563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.840965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.842462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:41.852949 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9077935f-1934-4305-a441-c8d242c4dfd5 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1320 microversion: 2.26 time: 0.157574 Oct 24 09:01:41.853670 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1092/2249] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:41 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:41.858368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:41.858981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:41.873543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.874071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.874471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:41.875179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:41.875666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:41.876088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.062654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:42.072848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02b5aef0-180d-4c7d-821d-e7a1afdb31e0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1308 microversion: 2.1 time: 0.218043 Oct 24 09:01:42.073532 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1093/2250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:41 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:42.078586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:42.081098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:42.088370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.089048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.089523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.090321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.090785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.091219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.105693 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6ec04ef-3fae-4068-8937-beb945daa455 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/36ac822f-a9a2-4af2-b599-52d6c6a0d905" status: 200 len: 141 microversion: 2.1 time: 0.292933 Oct 24 09:01:42.106286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1158/2251] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 09:01:41 2022] GET /compute/v2.1/os-floating-ips/36ac822f-a9a2-4af2-b599-52d6c6a0d905 => generated 141 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:42.118998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:42.120473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:42.124951 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06638e64-3584-44eb-b900-d6977ee735ca tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050113 Oct 24 09:01:42.125899 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1094/2252] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:01:42 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:42.130053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.130859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.131002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:42.131790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.132937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.133712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.134481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.138705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:42.157598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.158488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.159181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.160381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.161606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.162695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.239567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:42.266156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ea42c19-786f-4ddc-840d-d3f22d1f0b11 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1289 microversion: 2.1 time: 0.150822 Oct 24 09:01:42.284447 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1159/2253] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:42 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1289 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:42.285027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:01:42.291630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a02ea51a-093e-4fa9-8bfa-ec3a58d2cc66 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8daad45310>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:42.409058 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7fb04799-5049-44c3-9d2a-6e5ee4b85ed0 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1641 microversion: 2.1 time: 0.276510 Oct 24 09:01:42.411049 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1095/2254] 10.222.0.25 () {58 vars in 1190 bytes} [Mon Oct 24 09:01:42 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1641 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:42.439125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:42.452513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:01:42.464457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.465567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.466158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.467422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.468041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.468637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.511191 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20b72d02-0b27-419c-9c7c-453f2e680e33 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.088334 Oct 24 09:01:42.512022 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1096/2255] 10.222.0.25 () {58 vars in 1196 bytes} [Mon Oct 24 09:01:42 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:42.530656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:42.535849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:42.548213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.548985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.550094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.551679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.552401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.553264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.686016 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-702830e2-fe69-421f-964b-118382e46fcc tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.162786 Oct 24 09:01:42.687054 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1097/2256] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:42 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:01:42.703296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:42.705229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:42.722820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.725033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.725622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:42.727277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:42.730635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:42.731613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:43.605434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:43.627628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:43.633267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:43.634505 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f20649d-b5f3-46df-89f2-e054c6eee0d7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.945032 Oct 24 09:01:43.638307 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1098/2257] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:42 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:43.648522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:43.654175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:43.659711 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:43.664314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:43.665371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:43.665371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:43.666060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:43.666567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:43.667096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:43.764826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:01:43.764826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:01:43.765494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:01:43.765983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:01:43.766557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:01:43.860089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:43.880553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:43.883363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:43.884535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:43.886578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:43.888464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:43.888986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:43.960536 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6676b572-5654-45cf-8986-78fc44e341ef tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 1067 microversion: 2.1 time: 0.318804 Oct 24 09:01:43.965283 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1099/2258] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:43 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 1067 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 09:01:43.976836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:43.980472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:43.999675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.001824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.002352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.003169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.006381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.008858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.031272 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e HTTP/1.1 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '571fbcc3-1d59-4166-80ec-699289aab28e'} Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:44.033097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.037694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:44.051731 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b7d46e94-8b21-4d09-a047-6aaa2961f19e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 404 len: 111 microversion: 2.1 time: 0.071208 Oct 24 09:01:44.053169 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1100/2259] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:43 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:44.068366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:44.069081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:44.084222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.084804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.085333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.086380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.086920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.087869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.334425 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a02ea51a-093e-4fa9-8bfa-ec3a58d2cc66 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/36ac822f-a9a2-4af2-b599-52d6c6a0d905" status: 202 len: 0 microversion: 2.1 time: 2.058725 Oct 24 09:01:44.340648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1160/2260] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:01:42 2022] DELETE /compute/v2.1/os-floating-ips/36ac822f-a9a2-4af2-b599-52d6c6a0d905 => generated 0 bytes in 2061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:44.345400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-fb0de76c-164f-4794-a997-f11944c56da3 req-55a364f6-9f7c-46be-b08b-b7ede34e7c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e5c236-d625-4c16-ba83-f805f400ec74", "name": "network-vif-plugged", "status": "completed", "tag": "236f2595-87f6-4629-b0b5-b05acc3a91fe"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:44.362901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fb0de76c-164f-4794-a997-f11944c56da3 req-55a364f6-9f7c-46be-b08b-b7ede34e7c91 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.363601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fb0de76c-164f-4794-a997-f11944c56da3 req-55a364f6-9f7c-46be-b08b-b7ede34e7c91 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.364373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fb0de76c-164f-4794-a997-f11944c56da3 req-55a364f6-9f7c-46be-b08b-b7ede34e7c91 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.381147 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-fb0de76c-164f-4794-a997-f11944c56da3 req-55a364f6-9f7c-46be-b08b-b7ede34e7c91 service nova] Creating event network-vif-plugged:236f2595-87f6-4629-b0b5-b05acc3a91fe for instance 20e5c236-d625-4c16-ba83-f805f400ec74 on n-h2-master-1 Oct 24 09:01:44.398844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-fb0de76c-164f-4794-a997-f11944c56da3 req-55a364f6-9f7c-46be-b08b-b7ede34e7c91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061795 Oct 24 09:01:44.402027 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1161/2261] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:44.408275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:44.418579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:44.427892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.429961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.431149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.433544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.434160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.434708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.456790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:44.483544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:44.486064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:44.488130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5dbc1c7-7be6-42d6-a48a-d28d24058c17 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.432650 Oct 24 09:01:44.492535 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:44.504218 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1101/2262] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:44 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:44.518154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:44.522569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:44.530468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.531162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.531707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.532605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.533336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.534051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.586688 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0fbc65b-6e87-44d9-bbca-20d5d77f1613 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074401 Oct 24 09:01:44.590664 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1102/2263] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:01:44 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:44.600064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:44.604903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:44.615797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.616475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.617802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.619353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.619984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.624983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.870612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:44.883897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-202a4124-a62f-45d5-bcd5-38834bf979b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1308 microversion: 2.1 time: 0.480462 Oct 24 09:01:44.885111 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1162/2264] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:44 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:44.890229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:44.891053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:44.897627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.898348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.898956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.899984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.900591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.901166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.916369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:44.928259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a961120e-d412-419d-b138-fa652a562185 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.336354 Oct 24 09:01:44.932838 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1103/2265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:44 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:44.941058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:44.941721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:44.950884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.951469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.951981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.953092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:44.953773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:44.954270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:44.969430 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:44.970762 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e HTTP/1.1 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '571fbcc3-1d59-4166-80ec-699289aab28e'} Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:44.973162 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:44.977266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:44.978072 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bae60620-3b3e-4ec1-aa28-da2aecbd9d98 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 404 len: 111 microversion: 2.1 time: 0.043261 Oct 24 09:01:44.979008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1104/2266] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:44 2022] DELETE /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:44.994275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-320b5a17-2147-4d2f-be92-d2c3fd5e6328 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8dab2290d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:45.165091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:45.174341 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-172c78a2-eaa1-4caa-992b-2dc4299587f0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.287896 Oct 24 09:01:45.175557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1163/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:44 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:45.180574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:45.181189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:45.188468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.188468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.188468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.189337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.189899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.190339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.421708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:45.437146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:45.439008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:45.440579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00c1e75d-fe87-42ea-a2dc-1b429b37fcaf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.263639 Oct 24 09:01:45.441775 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1164/2268] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:45 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:45.453347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-09d3002e-05a0-4dd2-bf19-846fbd0690ba req-5ab3345d-83b4-4440-8470-4c4eb563b4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebb81d1-e202-4c33-b357-da3afcc0adb0", "tag": "8cbb841a-4c62-4efa-8468-7ee757161bdd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:45.477877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-09d3002e-05a0-4dd2-bf19-846fbd0690ba req-5ab3345d-83b4-4440-8470-4c4eb563b4c2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.478762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-09d3002e-05a0-4dd2-bf19-846fbd0690ba req-5ab3345d-83b4-4440-8470-4c4eb563b4c2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.479526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-09d3002e-05a0-4dd2-bf19-846fbd0690ba req-5ab3345d-83b4-4440-8470-4c4eb563b4c2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.496779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-09d3002e-05a0-4dd2-bf19-846fbd0690ba req-5ab3345d-83b4-4440-8470-4c4eb563b4c2 service nova] Creating event network-changed:8cbb841a-4c62-4efa-8468-7ee757161bdd for instance aebb81d1-e202-4c33-b357-da3afcc0adb0 on n-h2-master-1 Oct 24 09:01:45.503454 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-09d3002e-05a0-4dd2-bf19-846fbd0690ba req-5ab3345d-83b4-4440-8470-4c4eb563b4c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059992 Oct 24 09:01:45.511326 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1165/2269] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:45.518355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:45.520043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 571fbcc3-1d59-4166-80ec-699289aab28e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:45.542319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.543884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.544347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.546409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.548373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.549970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.571905 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-320b5a17-2147-4d2f-be92-d2c3fd5e6328 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.591710 Oct 24 09:01:45.572899 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1105/2270] 10.222.0.25 () {58 vars in 1164 bytes} [Mon Oct 24 09:01:44 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:45.577905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:45.578868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:45.588918 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:45.595024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.597961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e HTTP/1.1 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '571fbcc3-1d59-4166-80ec-699289aab28e'} Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:45.598240 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. Oct 24 09:01:45.602594 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:45.603115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.604553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 571fbcc3-1d59-4166-80ec-699289aab28e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:45.605611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:45.606450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:45.607801 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-943ad1f3-bc87-449a-8bf7-fa582087f8b1 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e" status: 404 len: 111 microversion: 2.1 time: 0.093630 Oct 24 09:01:45.608181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:45.611293 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1166/2271] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:45 2022] GET /compute/v2.1/servers/571fbcc3-1d59-4166-80ec-699289aab28e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:45.624422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffb3605a-02e3-40a1-af65-e148501c1d77 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8daf304af0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:45.989096 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ffb3605a-02e3-40a1-af65-e148501c1d77 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.376273 Oct 24 09:01:45.990234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1167/2272] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 09:01:45 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:45.995424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:46.013494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:46.026367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.031906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.040512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.041689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.042368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.042959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.108154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04b2c7db-f2e1-4811-93a8-2a99e77c0c7c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116549 Oct 24 09:01:46.112675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1168/2273] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:01:45 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:46.125920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:46.126670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:46.141092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.142610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.144503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.146648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.149177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.149979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.180838 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b HTTP/1.1 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: exception: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'bf822847-521b-44e9-a65b-4fad1b65b22b'} Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:46.185975 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:46.189587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:46.195884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:46.196872 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-892437e5-2bea-44e7-addb-7d1f06a42cde tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 404 len: 111 microversion: 2.1 time: 0.082757 Oct 24 09:01:46.197482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1169/2274] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:46 2022] DELETE /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:46.207511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f4649b06-38b7-43fc-ab8a-a4e0cb637a58 req-efc887f1-9cb0-46a5-99ba-479e9e270739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b29b7f4-9358-4af1-b178-e162afc66477", "tag": "fd188331-4d68-4f31-a4df-94ad724052d6"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:46.226553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:46.232883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f4649b06-38b7-43fc-ab8a-a4e0cb637a58 req-efc887f1-9cb0-46a5-99ba-479e9e270739 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.233408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f4649b06-38b7-43fc-ab8a-a4e0cb637a58 req-efc887f1-9cb0-46a5-99ba-479e9e270739 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.234028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f4649b06-38b7-43fc-ab8a-a4e0cb637a58 req-efc887f1-9cb0-46a5-99ba-479e9e270739 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.244610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:46.249821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:46.251781 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9bbebe59-2a60-4cad-9db8-68505dc4076c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.677891 Oct 24 09:01:46.257341 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1106/2275] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:45 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:46.272782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:46.274214 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f4649b06-38b7-43fc-ab8a-a4e0cb637a58 req-efc887f1-9cb0-46a5-99ba-479e9e270739 service nova] Creating event network-changed:fd188331-4d68-4f31-a4df-94ad724052d6 for instance 1b29b7f4-9358-4af1-b178-e162afc66477 on n-h2-master-1 Oct 24 09:01:46.275118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:46.288801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.294392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.295092 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f4649b06-38b7-43fc-ab8a-a4e0cb637a58 req-efc887f1-9cb0-46a5-99ba-479e9e270739 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093734 Oct 24 09:01:46.295633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.296061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1170/2276] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:46.296777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.297448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.298692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.303700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:46.304428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:46.323223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.323734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.324183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.324913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:46.325424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:46.325986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:46.705548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:46.714559 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-814cef7a-c0fa-4b1d-9b66-0f62210e2362 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 200 len: 1487 microversion: 2.1 time: 0.458075 Oct 24 09:01:46.719769 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1107/2277] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:46 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 1487 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:46.734081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f57a693d-0f49-48a0-b399-d5a0e423e8b7 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8dab4881f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:46.989844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:46.999501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16838f43-6ab3-451f-936e-921344961067 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.702185 Oct 24 09:01:47.000983 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1171/2278] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:46 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:47.006044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.006858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.019607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.020355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.020955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.021878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.025048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.025721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.175522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:47.186100 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f5f872d-76a3-47f3-979d-d4c88e36e7cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.183840 Oct 24 09:01:47.187473 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1172/2279] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:47 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:47.193069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.194020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: bf822847-521b-44e9-a65b-4fad1b65b22b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.200873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.201759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.202549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.203512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.204231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.204774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.219663 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b HTTP/1.1 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: exception: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'bf822847-521b-44e9-a65b-4fad1b65b22b'} Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:47.221597 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.226641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance bf822847-521b-44e9-a65b-4fad1b65b22b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:47.228066 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-82e59a49-a4a6-48d6-9e98-1937031693ae tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b" status: 404 len: 111 microversion: 2.1 time: 0.039283 Oct 24 09:01:47.231843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1173/2280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:47 2022] GET /compute/v2.1/servers/bf822847-521b-44e9-a65b-4fad1b65b22b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:47.233831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.234612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.241227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.241822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.242372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.243296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.243853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.244380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.451858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:47.466144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:47.468134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:47.469575 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cbaaf966-2366-41c0-abd2-4a448fa666dc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.239809 Oct 24 09:01:47.471701 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1174/2281] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:47 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:47.477214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-109130793"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:47.479797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.487399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.497464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.498388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.499506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.500148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.500596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.789668 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f57a693d-0f49-48a0-b399-d5a0e423e8b7 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/fd22685c-99dd-41e3-896f-f21d87982ca3" status: 202 len: 0 microversion: 2.1 time: 1.068527 Oct 24 09:01:47.790303 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1108/2282] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:01:46 2022] DELETE /compute/v2.1/os-floating-ips/fd22685c-99dd-41e3-896f-f21d87982ca3 => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:47.795725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.798302 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.806432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.807194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.807909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.808828 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fcd09851-5e09-4335-ad99-99d3688e8d2f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74/action" status: 202 len: 0 microversion: 2.1 time: 0.335275 Oct 24 09:01:47.808955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.809570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.809856 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1175/2283] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:47 2022] POST /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:01:47.810499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.819748 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.820377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.828913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.829455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.830377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.831105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.831729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.833261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.850051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af0d1c8b-c1e7-4c65-a138-f842519ac452 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058058 Oct 24 09:01:47.851313 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1109/2284] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:01:47 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:47.856579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.857497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:47.861826 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d HTTP/1.1 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a7b57e8e-048a-4bcb-b104-f6c0243aa58d'} Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:47.863749 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:47.870525 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13dbc02f-4f27-4543-8bf4-8ea809c1a4f9 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 404 len: 111 microversion: 2.1 time: 0.054149 Oct 24 09:01:47.872229 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1176/2285] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:47 2022] DELETE /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:47.873668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.874385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.875097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:47.876045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:47.876695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:47.877185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56bf2932-36eb-4692-8f6f-d67cbf27542d tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8daf28af70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:47.877634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.033266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.043999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.045714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.047032 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71eb4c1d-98ba-4069-89d2-ae54a21bd726 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.194575 Oct 24 09:01:48.052744 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1110/2286] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:47 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:48.059465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-150fa311-0c0e-44dd-9eb7-439a81741990 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab4f75e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.121036 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-150fa311-0c0e-44dd-9eb7-439a81741990 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.066763 Oct 24 09:01:48.130185 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1111/2287] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:48.135123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.135753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: a7b57e8e-048a-4bcb-b104-f6c0243aa58d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.142788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.143293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.143732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.144517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.145160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.145786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.164448 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d HTTP/1.1 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a7b57e8e-048a-4bcb-b104-f6c0243aa58d'} Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.167800 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. Oct 24 09:01:48.171973 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.173592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance a7b57e8e-048a-4bcb-b104-f6c0243aa58d could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:48.174629 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34bf1cca-e913-4a46-917f-a2b73f333e15 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d" status: 404 len: 111 microversion: 2.1 time: 0.043397 Oct 24 09:01:48.176414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1112/2288] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/a7b57e8e-048a-4bcb-b104-f6c0243aa58d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:48.181441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.182270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.189072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.189853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.190441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.191479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.192094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.192703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.339566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.347294 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3beb61f4-2312-47d7-9b28-81443d834f2d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.169556 Oct 24 09:01:48.347871 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1113/2289] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:48.352317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.352862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.358716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.359220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.359620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.360307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.360766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.361175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.376240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 HTTP/1.1 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ad171800-a972-4956-8c16-df04c6ef8f13'} Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:48.377872 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5371b95-88c0-48cb-8d85-07ad6a67b1df tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 404 len: 111 microversion: 2.1 time: 0.031039 Oct 24 09:01:48.383508 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1114/2290] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:48 2022] DELETE /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:48.388152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.388748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.394662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.395142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.395571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.396263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.396710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.397126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.529947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.538244 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a405d88-f4b1-489f-8088-eb0af4506f71 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.153592 Oct 24 09:01:48.538986 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1115/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:48.543495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.544119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: ad171800-a972-4956-8c16-df04c6ef8f13] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.551610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.552346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.553112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.554032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.554766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.555254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.569711 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 HTTP/1.1 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ad171800-a972-4956-8c16-df04c6ef8f13'} Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.571255 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance ad171800-a972-4956-8c16-df04c6ef8f13 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b230cffd-0970-4df1-a2e7-c13705430aaf tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13" status: 404 len: 111 microversion: 2.1 time: 0.032736 Oct 24 09:01:48.575212 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1116/2292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/ad171800-a972-4956-8c16-df04c6ef8f13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:48.578263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.579004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.584977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.585495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.585936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.586635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.587111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.587533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.732906 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56bf2932-36eb-4692-8f6f-d67cbf27542d tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/aed2ee05-a016-4fa0-9d41-8ecf8d8bcd56" status: 202 len: 0 microversion: 2.1 time: 0.860263 Oct 24 09:01:48.733798 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1177/2293] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:01:47 2022] DELETE /compute/v2.1/os-floating-ips/aed2ee05-a016-4fa0-9d41-8ecf8d8bcd56 => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:48.742363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.742976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.762676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.763418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.764039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.764935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.765568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.766341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.783202 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba HTTP/1.1 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '486f96da-5dc9-432d-8f06-da45c8f4c1ba'} Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:48.785426 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.789076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.791238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:48.792312 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd45c38f-a095-4531-b177-50a7db09bb20 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba" status: 404 len: 111 microversion: 2.1 time: 0.053890 Oct 24 09:01:48.796919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1178/2294] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:48 2022] DELETE /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:48.798370 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=14 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:48.803224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-427cccc8-a840-4f49-be46-22055ca33359 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] Calling method '.version_select at 0x7f8daf3049d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.877876 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:48.928099 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:48.930557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.943002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.944448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:48.945685 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c7bc297-f979-4cec-8d83-3363a1032012 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.371228 Oct 24 09:01:48.946266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1117/2295] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:48.950701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.951313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 486f96da-5dc9-432d-8f06-da45c8f4c1ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.957941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.958430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.958868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.959605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.960027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.960456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:48.976051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba HTTP/1.1 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '486f96da-5dc9-432d-8f06-da45c8f4c1ba'} Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:48.977620 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 486f96da-5dc9-432d-8f06-da45c8f4c1ba could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-351427d1-6761-41cc-8650-0db712087d40 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba" status: 404 len: 111 microversion: 2.1 time: 0.031789 Oct 24 09:01:48.981848 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1118/2296] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/486f96da-5dc9-432d-8f06-da45c8f4c1ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:48.987013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:48.990566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:48.998234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:48.999054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:48.999756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.000654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.001267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.001890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.038605 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63554965-d7ca-4856-a175-d4c20bd9e1f7 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057713 Oct 24 09:01:49.039635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1119/2297] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:01:48 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:01:49.080962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:49.082614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:49.094161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.096206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.096836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.098448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.100199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.102630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.357912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:49.377383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:49.379567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:49.381092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cdbd873e-7932-4a20-b037-8c7ebd97dabe tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.306557 Oct 24 09:01:49.382081 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1120/2298] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:49 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:01:49.387184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8813b78a-05ce-4bfd-900c-46b6d64ffca4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab5bcdc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:49.448782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8813b78a-05ce-4bfd-900c-46b6d64ffca4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.065437 Oct 24 09:01:49.458407 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1121/2299] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:49 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:49.463890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:49.466685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:49.474804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.475638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.476335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.477287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.477994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.478881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.523237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Cannot 'reboot' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action HTTP/1.1 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 28 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: {"reboot": {"type": "HARD"}} Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'reboot' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'add07d56-c8d6-4722-8f2f-8feae52e0d8c', 'body': {'reboot': {'type': 'HARD'}}} Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:01:49.525201 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.528668 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.530246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 409 to user: Cannot 'reboot' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:49.531104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-585b41a4-30e6-49f6-9035-ea561a2887f1 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action" status: 409 len: 145 microversion: 2.1 time: 0.071350 Oct 24 09:01:49.531771 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1122/2300] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:49 2022] POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action => generated 145 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:01:49.546029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:49.546674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:49.554534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.555241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.556008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.556839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.557560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.558172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.877953 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-427cccc8-a840-4f49-be46-22055ca33359 tempest-FloatingIPDetailsTestJSON-128882671 tempest-FloatingIPDetailsTestJSON-128882671-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/309e26de-1d35-46bb-ad9d-c0ad670849a1" status: 202 len: 0 microversion: 2.1 time: 1.079604 Oct 24 09:01:49.879435 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1179/2301] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:01:48 2022] DELETE /compute/v2.1/os-floating-ips/309e26de-1d35-46bb-ad9d-c0ad670849a1 => generated 0 bytes in 1082 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:01:49.887280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:49.893121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:49.901559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.902415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.903040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.904304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.904993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.905795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.940465 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Cannot 'rebuild' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action HTTP/1.1 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 65 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'rebuild' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'add07d56-c8d6-4722-8f2f-8feae52e0d8c', 'body': {'rebuild': {'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2'}}} Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:01:49.944317 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued Oct 24 09:01:49.948357 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:49.951501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 409 to user: Cannot 'rebuild' instance add07d56-c8d6-4722-8f2f-8feae52e0d8c while it is in vm_state rescued {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:49.953954 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7dae4bed-8232-48ea-9c8b-03ccc534782c tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action" status: 409 len: 146 microversion: 2.1 time: 0.072356 Oct 24 09:01:49.954814 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1180/2302] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:01:49 2022] POST /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c/action => generated 146 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:01:49.960349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:49.961278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:49.969656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.970255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.974478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:49.975576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:49.976808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:49.977825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.004762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.019545 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc4dff7f-d466-4eb5-82ad-3cd0bf97bff9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.475235 Oct 24 09:01:50.020536 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1123/2303] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:49 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:50.029010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-baaf9a69-7329-4cee-a6ca-a50dfc45dc5b req-77cb3fb3-d2bb-43fb-8084-b32caf73a7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "35793050-203b-480a-aeab-dbd45b7acd5b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:50.076171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-baaf9a69-7329-4cee-a6ca-a50dfc45dc5b req-77cb3fb3-d2bb-43fb-8084-b32caf73a7ea service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.079070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-baaf9a69-7329-4cee-a6ca-a50dfc45dc5b req-77cb3fb3-d2bb-43fb-8084-b32caf73a7ea service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.079783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-baaf9a69-7329-4cee-a6ca-a50dfc45dc5b req-77cb3fb3-d2bb-43fb-8084-b32caf73a7ea service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.113491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-baaf9a69-7329-4cee-a6ca-a50dfc45dc5b req-77cb3fb3-d2bb-43fb-8084-b32caf73a7ea service nova] Creating event network-vif-plugged:35793050-203b-480a-aeab-dbd45b7acd5b for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:50.160475 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-baaf9a69-7329-4cee-a6ca-a50dfc45dc5b req-77cb3fb3-d2bb-43fb-8084-b32caf73a7ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131425 Oct 24 09:01:50.161077 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1124/2304] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:50.178347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:50.178875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:50.196740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.197235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.202298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.204005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.204500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.207245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.260829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:01:50.327617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.336909 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-beb2b6a8-2c86-4219-9796-61a827186717 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.380672 Oct 24 09:01:50.337531 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1181/2305] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:49 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:50.358453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:50.359069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:50.366398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.367761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.368357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.369251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.369897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.370507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.401184 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad367738-d94e-4f19-8c21-b72e1249762d tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 204 len: 0 microversion: 2.1 time: 0.237504 Oct 24 09:01:50.402303 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1125/2306] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:50 2022] DELETE /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:01:50.414571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:50.415287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:50.428809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.446447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.446901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.447657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.448117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.450016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.681900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.698116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.702313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.705182 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6872f675-8089-4e61-9ddf-2579bfb48551 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.350731 Oct 24 09:01:50.707558 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1182/2307] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:50 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:50.714389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:50.715210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:50.724944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.725812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.726714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.728046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:50.728665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:50.730590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:50.793984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.806796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.810945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.812145 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e894a32-6c34-4a98-a3eb-03169c00a423 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.406480 Oct 24 09:01:50.812911 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1126/2308] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:50 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:50.826112 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-baaa1409-40ec-4165-bddb-deb22f35d91c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab115430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:50.885230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-baaa1409-40ec-4165-bddb-deb22f35d91c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.071450 Oct 24 09:01:50.886247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1127/2309] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:50 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:50.948514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:50.958669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-17b22f1a-4496-412c-8b9b-1651015be043 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1687 microversion: 2.1 time: 0.249862 Oct 24 09:01:50.961631 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1183/2310] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:50 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1687 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:51.046067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:51.047395 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:51.054363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.055083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.055698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.056550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.057324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.058010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.098803 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:51.362276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:51.363504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:51.370832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.371326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.371766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.372479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.373198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.373957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.523507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:51.539119 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87e544c9-028f-4219-a6cf-3311ea8dd0da tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.181069 Oct 24 09:01:51.540863 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1184/2311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:51 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:51.653275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:51.662326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-388dd7f2-6336-4694-bffb-2171fedde51f tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.620365 Oct 24 09:01:51.662908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1128/2312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:51 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:51.735901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:51.736981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:51.743836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.744338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.744771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.745672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.746135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.746757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.842372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:51.843504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:51.852321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.853555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.854221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.855242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:51.855920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:51.856555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:51.963228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:51.966621 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:51.976432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:51.978824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:51.979552 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97cd7147-50b3-4df0-ac2a-04b7a8219a50 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.247852 Oct 24 09:01:51.980128 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1185/2313] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:51 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:51.985347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73ef1b58-99cf-462c-921f-88713fbde61f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab10ce50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:52.050675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73ef1b58-99cf-462c-921f-88713fbde61f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.068329 Oct 24 09:01:52.051884 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1186/2314] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:51 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:52.088041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:52.100876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:52.102537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:52.103722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-738ea0c4-11d0-4fb5-a24a-3d9632bc278c tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.265204 Oct 24 09:01:52.108215 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1129/2315] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:51 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:01:52.226222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ab6914ca-2786-4ef3-9b90-c07c0d089c38 req-1d386484-4e9a-4a22-9116-250a7c5fce96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:52.243885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ab6914ca-2786-4ef3-9b90-c07c0d089c38 req-1d386484-4e9a-4a22-9116-250a7c5fce96 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.247686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ab6914ca-2786-4ef3-9b90-c07c0d089c38 req-1d386484-4e9a-4a22-9116-250a7c5fce96 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.249904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ab6914ca-2786-4ef3-9b90-c07c0d089c38 req-1d386484-4e9a-4a22-9116-250a7c5fce96 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.256755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:52.257539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:52.266752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.268234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.268685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.270012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.270502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.270918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.280130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ab6914ca-2786-4ef3-9b90-c07c0d089c38 req-1d386484-4e9a-4a22-9116-250a7c5fce96 service nova] Creating event network-vif-plugged:9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:52.297340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ab6914ca-2786-4ef3-9b90-c07c0d089c38 req-1d386484-4e9a-4a22-9116-250a7c5fce96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077173 Oct 24 09:01:52.298522 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1130/2316] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:52.510667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:52.521150 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d855e3aa-45eb-46fd-bd8f-1219f6a71eb3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1687 microversion: 2.1 time: 0.467578 Oct 24 09:01:52.529349 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1187/2317] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:52 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1687 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:52.561603 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=14 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:52.566680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:52.567403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:52.574343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.574850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.575268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.576163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.576651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.577078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.686353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:52.686971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:52.694271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.697659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.699784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.702672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:52.704225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:52.706474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:52.832080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:52.848639 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b09f2a53-d5ad-40d9-bc21-7f4b03e42477 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.287628 Oct 24 09:01:52.850680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1131/2318] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:52 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:52.913888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:52.924939 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8455d2ab-7286-43c7-bcbd-2c5dcf9ea3d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.242342 Oct 24 09:01:52.951265 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1188/2319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:52 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:53.007629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.008227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.026495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.026914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.027357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.028074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.028528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.028946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.067683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c72753d-50f3-469a-919d-d4f5ac03625b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf28af70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.146001 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c72753d-50f3-469a-919d-d4f5ac03625b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.083020 Oct 24 09:01:53.147105 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1189/2320] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:53.159838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.163038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.179853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.180520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.181121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.185270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.186006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.190525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.411997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:53.442843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:53.447022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:53.450273 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-504a0885-ae1e-4b26-92cd-8701e08ef95a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.446575 Oct 24 09:01:53.473671 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1132/2321] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:53.491145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.492648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.500864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.501556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.502437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:53.505332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.508329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.508836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.509277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.514993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:53.516612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:53.518010 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3908e8a-66f5-4336-9bc1-9987c4d5f771 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.368050 Oct 24 09:01:53.536957 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1190/2322] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 HTTP/1.1 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '087182c5-5ac3-4775-861b-db31388889b5'} Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:53.537140 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:53.541149 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29d05571-aa9b-4bf7-86c8-e3b90822c35e tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 404 len: 111 microversion: 2.1 time: 0.063150 Oct 24 09:01:53.542247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1133/2323] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:53 2022] DELETE /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:53.546268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.547213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.556813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.557402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.557846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.558551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.559142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.559542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.562758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.563898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: 087182c5-5ac3-4775-861b-db31388889b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.579097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.579868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.580454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.581338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.582539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.583122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.613875 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 HTTP/1.1 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '087182c5-5ac3-4775-861b-db31388889b5'} Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.616160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. Oct 24 09:01:53.620978 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.622675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance 087182c5-5ac3-4775-861b-db31388889b5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:53.623958 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86d876ba-ee22-49e1-ba11-8078b2dee1b6 tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5" status: 404 len: 111 microversion: 2.1 time: 0.080843 Oct 24 09:01:53.625002 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1134/2324] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/servers/087182c5-5ac3-4775-861b-db31388889b5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:53.642985 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.646600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.654755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.655489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.656105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.657314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.657976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.658586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.682264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a HTTP/1.1 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b92f3cc7-ce7c-493d-85cf-72e7a8fc702a'} Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:53.684364 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.688145 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.689808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:53.691857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc7211fe-196e-4f6a-8d72-9a456696ff6f tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 404 len: 111 microversion: 2.1 time: 0.062938 Oct 24 09:01:53.694216 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1135/2325] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:53 2022] DELETE /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:53.702240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.702882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] [instance: b92f3cc7-ce7c-493d-85cf-72e7a8fc702a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.719807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.720306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.720745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.721500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.722099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.722453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.760755 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] HTTP exception thrown: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Request method failure captured: Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a HTTP/1.1 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlMI7TYqdfKaGdQddSKmM6LzlqPxeMsCRc0GDp_f031gc7mHyjLYNY4Lq8I--y5COH4MPwd9DphVdE_WYyLe7INqVVAa8p-5d6UbGrLioTvVMxKGiZtz2HXL7hnrvwq7naQqlgDCmjGo1WPorW0d8L35JrUaIrMQdNcIIzrLEdVU5T8 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8296bcb4ff034194b66485ce116bb18a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8296bcb4ff034194b66485ce116bb18a"}]}] Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8296bcb4ff034194b66485ce116bb18a Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1868322211 Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0a5f0704d95640a99457ddd8652f83ca Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1868322211-project Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b92f3cc7-ce7c-493d-85cf-72e7a8fc702a'} Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:53.762423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. Oct 24 09:01:53.766093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:01:53.769102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] Returning 404 to user: Instance b92f3cc7-ce7c-493d-85cf-72e7a8fc702a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:53.774222 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d13fe17e-1380-4467-8b9d-c52e16f74cba tempest-DeleteServersTestJSON-1868322211 tempest-DeleteServersTestJSON-1868322211-project] 10.222.0.25 "GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a" status: 404 len: 111 microversion: 2.1 time: 0.075731 Oct 24 09:01:53.775434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1136/2326] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/servers/b92f3cc7-ce7c-493d-85cf-72e7a8fc702a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:01:53.874753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:53.875816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:53.892979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.895166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.897276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:53.898757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:53.902181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:53.902927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:54.048414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:54.059048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-166bd2fc-1a62-4bcc-a424-c101d03c5282 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1687 microversion: 2.1 time: 0.516724 Oct 24 09:01:54.060344 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1191/2327] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1687 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:54.065499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:54.067029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:54.073637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:54.075072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:54.075708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:54.076629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:54.077344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:54.077969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:54.576818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:54.592965 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b149b933-3f82-4f69-a5a8-51afdbdcc683 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.722381 Oct 24 09:01:54.612468 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1137/2328] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:53 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:01:54.614966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:54.617278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f9cecbd1-3be0-4d03-bdcd-cd74400f40df tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab7cd040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:54.650427 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e519cad-bcdd-49a1-a22f-340ba37600e8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.574579 Oct 24 09:01:54.651112 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1192/2329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:54 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:54.677744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:54.680599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:54.703373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:54.704156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:54.705692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:54.716003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:54.716729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:54.717368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:54.740270 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f9cecbd1-3be0-4d03-bdcd-cd74400f40df tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.126540 Oct 24 09:01:54.749528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1138/2330] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:54 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:54.757327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:54.757972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:54.780139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:54.780927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:54.781597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:54.782613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:54.783284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:54.783922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:55.149581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:55.165015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:55.167657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:55.169732 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c74b64b3-b383-43ff-94b3-91eabe2502ef tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.514522 Oct 24 09:01:55.183037 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1193/2331] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:54 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:55.197533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cbe1f3cf-a3e0-4675-b26a-5c949e68f081 req-aad8fdfd-9a71-45e7-bab8-dd923df1c575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebb81d1-e202-4c33-b357-da3afcc0adb0", "name": "network-vif-plugged", "status": "completed", "tag": "8cbb841a-4c62-4efa-8468-7ee757161bdd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:55.231375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cbe1f3cf-a3e0-4675-b26a-5c949e68f081 req-aad8fdfd-9a71-45e7-bab8-dd923df1c575 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:55.232110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cbe1f3cf-a3e0-4675-b26a-5c949e68f081 req-aad8fdfd-9a71-45e7-bab8-dd923df1c575 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:55.232720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cbe1f3cf-a3e0-4675-b26a-5c949e68f081 req-aad8fdfd-9a71-45e7-bab8-dd923df1c575 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:55.270481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cbe1f3cf-a3e0-4675-b26a-5c949e68f081 req-aad8fdfd-9a71-45e7-bab8-dd923df1c575 service nova] Creating event network-vif-plugged:8cbb841a-4c62-4efa-8468-7ee757161bdd for instance aebb81d1-e202-4c33-b357-da3afcc0adb0 on n-h2-master-1 Oct 24 09:01:55.279237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cbe1f3cf-a3e0-4675-b26a-5c949e68f081 req-aad8fdfd-9a71-45e7-bab8-dd923df1c575 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091631 Oct 24 09:01:55.281162 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1194/2332] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:55.287995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:55.289005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:55.295808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:55.296656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:55.297469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:55.298575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:55.299257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:55.299925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:55.669537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:55.686791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:55.688317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:55.689557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73f36bf0-383c-4fcf-a295-5a1e0b6a35c7 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.938932 Oct 24 09:01:55.701332 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1139/2333] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:54 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:55.701332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:55.701332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:55.714629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:55.715145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:55.715596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:55.716336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:55.716821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:55.717253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:56.002290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:56.011541 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37af4d70-7e1f-4e85-96a1-c27e44c6e8a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.319459 Oct 24 09:01:56.012348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1140/2334] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:55 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:56.022305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:56.025920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:56.046147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:56.046893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:56.048249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:56.049164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:56.052657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:56.057641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:56.515676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:56.539924 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f8702fa-5800-4db4-9f49-cecd7df8edb7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.523021 Oct 24 09:01:56.544525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1141/2335] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:56 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:56.555909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b57e0ae6-81ee-417c-8d6e-1915b2d40ecc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0ba820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:56.576641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:56.599859 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43ed9695-600c-4dfb-972b-55158e038385 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1687 microversion: 2.1 time: 1.317161 Oct 24 09:01:56.600469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1195/2336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:55 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1687 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:56.605084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:56.624812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:56.650597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:56.656609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:56.657906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:56.661765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:56.663610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:56.665826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:56.678442 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b57e0ae6-81ee-417c-8d6e-1915b2d40ecc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.119162 Oct 24 09:01:56.679608 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1142/2337] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:56 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:56.721128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:56.722232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:56.739025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:56.743421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:56.745918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:56.748337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:56.748822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:56.749263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:57.242930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.260828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.262575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.269747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8142bc6b-2d97-4d87-92da-d93a40b6e32a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1362 microversion: 2.26 time: 0.548991 Oct 24 09:01:57.270852 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1143/2338] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:56 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1362 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:01:57.276975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:57.289460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:57.306514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:57.307465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:57.308170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:57.309239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:57.309972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:57.313421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:57.652850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.683890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.694499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.699372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cca4522-54b2-41f1-9c20-75b3cf770027 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.097772 Oct 24 09:01:57.700523 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1196/2339] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:56 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:57.863534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b29b7f4-9358-4af1-b178-e162afc66477", "name": "network-vif-plugged", "status": "completed", "tag": "fd188331-4d68-4f31-a4df-94ad724052d6"}, {"server_uuid": "20e5c236-d625-4c16-ba83-f805f400ec74", "name": "network-vif-plugged", "status": "completed", "tag": "236f2595-87f6-4629-b0b5-b05acc3a91fe"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "7633943c-b1d2-4ca2-a70d-10e5b43a0f47"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "4f2e3565-64aa-492a-810f-751d064afa17"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "06864302-5b6e-408a-82ba-2c2ea4aa1f8d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:57.890532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:57.891275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:57.891867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:57.924147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:57.937871 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Creating event network-vif-plugged:fd188331-4d68-4f31-a4df-94ad724052d6 for instance 1b29b7f4-9358-4af1-b178-e162afc66477 on n-h2-master-1 Oct 24 09:01:57.939302 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15f5c2f9-3094-4dd7-a9a9-e2bf9e7934ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.667016 Oct 24 09:01:57.940428 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Creating event network-vif-plugged:236f2595-87f6-4629-b0b5-b05acc3a91fe for instance 20e5c236-d625-4c16-ba83-f805f400ec74 on n-h2-master-1 Oct 24 09:01:57.941779 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1144/2340] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:57 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:57.952304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:57.956429 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Creating event network-vif-plugged:7633943c-b1d2-4ca2-a70d-10e5b43a0f47 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:57.957558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:57.961948 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Creating event network-vif-plugged:4f2e3565-64aa-492a-810f-751d064afa17 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:57.963851 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] Creating event network-vif-plugged:06864302-5b6e-408a-82ba-2c2ea4aa1f8d for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:01:57.974268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:57.975298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:57.978348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:57.979515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:57.980215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:57.981530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:57.995677 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b8e6ea12-4e67-4852-8119-e1471965d787 req-38fc791c-6129-4562-95ba-8e9b61a5c4fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.277348 Oct 24 09:01:57.997717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1197/2341] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:58.013261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:58.019606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:58.035946 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:58.038326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.039101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.039754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.040633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.041966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.046775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.122608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.124337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.125511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.127244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'fault' on Instance uuid babd364b-580f-4919-a727-94169135c910 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:01:58.270779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:58.281714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-75eb560e-717a-4f06-99f9-c70e24389cfe tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 200 len: 1335 microversion: 2.1 time: 0.275449 Oct 24 09:01:58.282556 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1198/2342] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:57 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 1335 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:58.297696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b73c07f3-1072-4a78-9e5f-da4ceaaf9647 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab08e4c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:58.438024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b73c07f3-1072-4a78-9e5f-da4ceaaf9647 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.153583 Oct 24 09:01:58.446869 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1199/2343] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:58 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:58.470318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-373dc307-44f5-4889-9f3d-c4bb52cf7663 req-2f81df36-3bbc-4728-b7bd-d62cacbd94f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babd364b-580f-4919-a727-94169135c910", "name": "network-vif-deleted", "tag": "c18a743d-0e9d-4395-9c8a-1ac34eca9c91"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:58.513763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-373dc307-44f5-4889-9f3d-c4bb52cf7663 req-2f81df36-3bbc-4728-b7bd-d62cacbd94f9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.519411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-373dc307-44f5-4889-9f3d-c4bb52cf7663 req-2f81df36-3bbc-4728-b7bd-d62cacbd94f9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.520019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-373dc307-44f5-4889-9f3d-c4bb52cf7663 req-2f81df36-3bbc-4728-b7bd-d62cacbd94f9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.555036 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-373dc307-44f5-4889-9f3d-c4bb52cf7663 req-2f81df36-3bbc-4728-b7bd-d62cacbd94f9 service nova] Creating event network-vif-deleted:c18a743d-0e9d-4395-9c8a-1ac34eca9c91 for instance babd364b-580f-4919-a727-94169135c910 on n-h2-master-1 Oct 24 09:01:58.568789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-373dc307-44f5-4889-9f3d-c4bb52cf7663 req-2f81df36-3bbc-4728-b7bd-d62cacbd94f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119136 Oct 24 09:01:58.569988 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1200/2344] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:58.576983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:58.578146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:58.584877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.585526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.586019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.587324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.588017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.588572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.762473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:58.785473 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-80103df7-9696-420e-8b57-907c60d2fdfd tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1319 microversion: 2.1 time: 0.842490 Oct 24 09:01:58.786596 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1145/2345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:57 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:58.807060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:58.807892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:58.836395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.836724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.837174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.837949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:58.838409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:58.838828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:58.996794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:59.023861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:59.036846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:59.038379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01b2a0f4-447f-458d-8089-89fc0b59b446 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1547 microversion: 2.26 time: 0.466544 Oct 24 09:01:59.052238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1201/2346] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:58 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1547 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:01:59.070917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:59.078270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:59.091854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.095061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.095728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.096680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.098016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.098614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.452888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:59.461878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf616d42-2d5a-4322-a175-2b67b83bd32f tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.406816 Oct 24 09:01:59.470731 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1202/2347] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:59 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:59.496386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8daf111160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:59.516919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.517624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.518612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.519960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:59.529525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.530397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.531899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.533490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.534148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.534890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.575126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.575897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.576788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.626129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.626869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.627859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.673681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:01:59.703972 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58c3aa1a-3737-4fb1-aa47-7e3108154d30 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1366070774" status: 201 len: 0 microversion: 2.26 time: 0.228131 Oct 24 09:01:59.706981 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1203/2348] 10.222.0.25 () {62 vars in 1380 bytes} [Mon Oct 24 09:01:59 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1366070774 => generated 0 bytes in 234 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 24 09:01:59.723962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:59.725453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: babd364b-580f-4919-a727-94169135c910] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:59.734359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.736517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.737240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.741701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.742711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.744330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.777094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Instance babd364b-580f-4919-a727-94169135c910 could not be found. Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 HTTP/1.1 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: exception: Instance babd364b-580f-4919-a727-94169135c910 could not be found. Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'babd364b-580f-4919-a727-94169135c910'} Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babd364b-580f-4919-a727-94169135c910 could not be found. Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babd364b-580f-4919-a727-94169135c910 could not be found. Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:59.782951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babd364b-580f-4919-a727-94169135c910 could not be found. Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 404 to user: Instance babd364b-580f-4919-a727-94169135c910 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:59.786862 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f59d33f4-e46f-4538-8a21-2ccf55740f12 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910" status: 404 len: 111 microversion: 2.1 time: 0.074013 Oct 24 09:01:59.791574 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1204/2349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:59 2022] GET /compute/v2.1/servers/babd364b-580f-4919-a727-94169135c910 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:59.805600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ccd320e2-52bf-4096-8107-243e308ec8f8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab10c940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:59.898655 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ccd320e2-52bf-4096-8107-243e308ec8f8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.105831 Oct 24 09:01:59.908307 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1205/2350] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:59 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:59.909105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3fb588ce-e132-4a7f-a0f1-6acdbf9ef4bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab2d1a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:59.931366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fb588ce-e132-4a7f-a0f1-6acdbf9ef4bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:59.931879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fb588ce-e132-4a7f-a0f1-6acdbf9ef4bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:59.932313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fb588ce-e132-4a7f-a0f1-6acdbf9ef4bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:59.973461 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3fb588ce-e132-4a7f-a0f1-6acdbf9ef4bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1366070774" status: 204 len: 0 microversion: 2.26 time: 0.070811 Oct 24 09:01:59.974092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1206/2351] 10.222.0.25 () {60 vars in 1361 bytes} [Mon Oct 24 09:01:59 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1366070774 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:01:59.989831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-afc31ae5-1f4b-4105-9ebf-26f36258ff92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '.version_select at 0x7f8dab3d5c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:00.076201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-afc31ae5-1f4b-4105-9ebf-26f36258ff92 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130784208" status: 202 len: 0 microversion: 2.1 time: 0.097850 Oct 24 09:02:00.082657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1207/2352] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130784208 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:00.106674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:00.107329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:00.127110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.127778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.128279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.129042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.129538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.129973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.136318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:00.160378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:00.165553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:00.170607 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b406f978-172d-4d43-bcd9-20f27dfe1baf tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.370246 Oct 24 09:02:00.172528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1146/2353] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:01:58 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:00.184187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab115040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:00.192843 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:00.225531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.231219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.233696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.235233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:00.267466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.271455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.272227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.280960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.281636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.282095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.363136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.366715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.367224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.413659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:00.485128 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb9bc774-46b9-4174-9f0f-70f7e3fc4610 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 204 len: 0 microversion: 2.26 time: 0.307100 Oct 24 09:02:00.489357 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1147/2354] 10.222.0.25 () {60 vars in 1295 bytes} [Mon Oct 24 09:02:00 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:00.497472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "0a11bffb-3310-4bac-9860-ed7aa8d96370"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "9a5a2cfa-da17-4a1f-bfd7-98eca3fde566"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:00.544951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.552090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.552662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.580961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] Creating event network-vif-plugged:0a11bffb-3310-4bac-9860-ed7aa8d96370 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:02:00.581553 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] Creating event network-vif-plugged:9a5a2cfa-da17-4a1f-bfd7-98eca3fde566 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:02:00.607204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:00.621107 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9a7b241-5485-4c9e-a808-53698e2501f8 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1469 microversion: 2.1 time: 0.536412 Oct 24 09:02:00.625349 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0d0c8242-09f7-4e5a-a656-bdc5e044dbd3 req-6715e985-2600-4bc8-8f43-77967ee0f73e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134401 Oct 24 09:02:00.626471 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1208/2355] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:00 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1469 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:00.630621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1148/2356] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:00.638698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:00.639851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:00.655119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.655119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.655119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.655485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c00a3bb2-99f3-47a5-bc03-d46c69f504f8 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab8e3a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:00.655577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.655577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.656392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.675894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00a3bb2-99f3-47a5-bc03-d46c69f504f8 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:00.678968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00a3bb2-99f3-47a5-bc03-d46c69f504f8 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:00.681560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c00a3bb2-99f3-47a5-bc03-d46c69f504f8 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:00.721434 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c00a3bb2-99f3-47a5-bc03-d46c69f504f8 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 200 len: 12 microversion: 2.26 time: 0.088901 Oct 24 09:02:00.726402 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1149/2357] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 09:02:00 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 12 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:00.949244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:00.972578 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6db7254-126f-4aba-821a-e8ba368eb9ca tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1471 microversion: 2.1 time: 0.344067 Oct 24 09:02:00.973186 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1209/2358] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:00 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:00.996014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8daafbfca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:01.029193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.029762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.031935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.032312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:01.051096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.051738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.052196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.053008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.053491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.053927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.126654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.128713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.132234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.155808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.156315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.160214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.241759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:01.312793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-54dc9e03-534c-4a65-8088-d2400b43a6a2 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1525483304" status: 201 len: 0 microversion: 2.26 time: 0.338477 Oct 24 09:02:01.322252 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1210/2359] 10.222.0.25 () {62 vars in 1380 bytes} [Mon Oct 24 09:02:00 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1525483304 => generated 0 bytes in 344 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 24 09:02:01.330385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba3fe5b9-be2a-4419-b58b-5a1f4201a44f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0b0700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:01.428872 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba3fe5b9-be2a-4419-b58b-5a1f4201a44f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.109526 Oct 24 09:02:01.429536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1211/2360] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:01 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:01.466601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:01.467135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:01.505730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.506254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.506737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.516954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.519674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.520135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.617425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1003978159", "block_migration": true, "disk_over_commit": false}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:01.626647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:01.643939 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:01.648292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.649611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.653059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.654191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.656799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.660402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.727672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lazy-loading 'flavor' on Instance uuid 1b29b7f4-9358-4af1-b178-e162afc66477 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:01.770341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Going to try to live migrate instance to tempest-host-1003978159 {{(pid=126919) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 09:02:01.780828 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:01.784546 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] HTTP exception thrown: Compute host tempest-host-1003978159 could not be found. Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Request method failure captured: Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477/action HTTP/1.1 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 107 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlRx__BGYxQTU3aJR9H10USdHHK65eQvZA7kBbitITa-8cK2FC33Iw4zjAXkWyjiEBLQPwbBn2QPvOBv2rLfdGJoC8kqHSBT2ZsM6JQvdUexiCMGfDZdyCVxX0-aXPXQI7nxzsnc30659W9qLoYa29_S7SFJOXa6t-8OETMQ0lU7ktw Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b34da25e70e54621b0409ec47faf2b0b Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationNegativeTest-134586986 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b34da25e70e54621b0409ec47faf2b0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b34da25e70e54621b0409ec47faf2b0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b34da25e70e54621b0409ec47faf2b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b34da25e70e54621b0409ec47faf2b0b"}]}] Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationNegativeTest-134586986 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b34da25e70e54621b0409ec47faf2b0b Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-134586986 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationNegativeTest-134586986-project-admin Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: dbad87a7ad024511aa5e6668fda00328 Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationNegativeTest-134586986-project-admin Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: {"os-migrateLive": {"host": "tempest-host-1003978159", "block_migration": true, "disk_over_commit": false}} Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: exception: Compute host tempest-host-1003978159 could not be found. Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1b29b7f4-9358-4af1-b178-e162afc66477', 'body': {'os-migrateLive': {'host': 'tempest-host-1003978159', 'block_migration': True, 'disk_over_commit': False}}} Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 24 09:02:01.799387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1003978159 could not be found. Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1003978159 could not be found. Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1003978159 could not be found. Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Returning 400 to user: Compute host tempest-host-1003978159 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9b8ffa4-1c92-4919-92d1-2646083bf70d tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477/action" status: 400 len: 100 microversion: 2.1 time: 1.073350 Oct 24 09:02:01.803251 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1150/2361] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Oct 24 09:02:00 2022] POST /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477/action => generated 100 bytes in 1074 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:02:01.806779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-251904f7-c808-4262-8549-5a979a2dc599 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab138940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:01.821408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-251904f7-c808-4262-8549-5a979a2dc599 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.826212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-251904f7-c808-4262-8549-5a979a2dc599 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.827399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-251904f7-c808-4262-8549-5a979a2dc599 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.841764 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-251904f7-c808-4262-8549-5a979a2dc599 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 200 len: 36 microversion: 2.26 time: 0.039078 Oct 24 09:02:01.845370 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1151/2362] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 09:02:01 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 36 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:01.848734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:01.849691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:01.858105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.859433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.860093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:01.860900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:01.861509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:01.862014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.257929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:02.283326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e9f2d3a-0079-406c-b25b-5bd7c25fccce tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1469 microversion: 2.1 time: 0.438309 Oct 24 09:02:02.285607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1152/2363] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:01 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:02.297476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dabba58b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:02.318774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:02.333858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:02.342552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.343441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:02.371305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:02.371982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:02.372639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.374076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:02.374774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:02.388506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.429050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:02.450185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:02.455450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:02.458695 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06718754-4af3-47d0-98ca-2aca05fedbfc tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 1.012328 Oct 24 09:02:02.462632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1212/2364] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:01 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:02.480808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:02.482335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:02.498918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:02.501440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:02.502548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.508340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:02.509128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:02.509803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.568356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:02.569231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:02.588469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:02.706507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:02.788343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9744ca21-81ea-4c0a-a892-395a0fb371c1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1525483304" status: 204 len: 0 microversion: 2.26 time: 0.496276 Oct 24 09:02:02.790799 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1153/2365] 10.222.0.25 () {60 vars in 1364 bytes} [Mon Oct 24 09:02:02 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1525483304 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:02.806719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd51401e-0b8a-49d0-8103-7e38407fc1f7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab5bc550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:02.955432 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd51401e-0b8a-49d0-8103-7e38407fc1f7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.162452 Oct 24 09:02:02.966577 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1154/2366] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:02 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:02.972449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-140352372", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:02.998850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:03.010478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d8e6018-c9da-44c2-aa7a-1d0dd58993e3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1477 microversion: 2.1 time: 0.543413 Oct 24 09:02:03.025824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1213/2367] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:02 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:03.044408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eaadd9c5-c40d-4cb7-b26a-05c5bc294cc0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8daf111a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:03.055022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:02:03.059644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaadd9c5-c40d-4cb7-b26a-05c5bc294cc0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.065368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaadd9c5-c40d-4cb7-b26a-05c5bc294cc0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.066293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaadd9c5-c40d-4cb7-b26a-05c5bc294cc0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.082038 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eaadd9c5-c40d-4cb7-b26a-05c5bc294cc0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 200 len: 12 microversion: 2.26 time: 0.056836 Oct 24 09:02:03.084338 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1214/2368] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 09:02:03 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:03.246889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45713a38-962a-42b0-950c-c595b933a1d9 tempest-ListImageFiltersNegativeTestJSON-1576777127 tempest-ListImageFiltersNegativeTestJSON-1576777127-project] Calling method '.version_select at 0x7f8dab10c9d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:03.309814 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-45713a38-962a-42b0-950c-c595b933a1d9 tempest-ListImageFiltersNegativeTestJSON-1576777127 tempest-ListImageFiltersNegativeTestJSON-1576777127-project] HTTP exception thrown: Image not found. Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45713a38-962a-42b0-950c-c595b933a1d9 tempest-ListImageFiltersNegativeTestJSON-1576777127 tempest-ListImageFiltersNegativeTestJSON-1576777127-project] Request method failure captured: Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/images/8fe5e07e-9a49-47b4-9801-1c0c5eed82ce HTTP/1.1 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSKCH86rXLZGu0iXGa-iwQvjM0t47JisQ0Q1mXoaDDpEyljC4VeMBiTwJAyqEJwz-UQpJbh3_uPNQBa4whxRC_YM03l4SJMWK3Bs6xF558Xd3mcT9a-kZ1l3omBItKvjx3Smz771s3aXo07nLVhzSN3AlAyUKFW7veVCNl33Xbdgwg Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 3d86f261dab443f285d12a39b85da0ce Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1576777127 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d86f261dab443f285d12a39b85da0ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d86f261dab443f285d12a39b85da0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d86f261dab443f285d12a39b85da0ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d86f261dab443f285d12a39b85da0ce"}]}] Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1576777127 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 3d86f261dab443f285d12a39b85da0ce Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1576777127 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListImageFiltersNegativeTestJSON-1576777127-project Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e5418897ffec4982917708414f3279a0 Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1576777127-project Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8fe5e07e-9a49-47b4-9801-1c0c5eed82ce'} Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8fe5e07e-9a49-47b4-9801-1c0c5eed82ce Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 09:02:03.312756 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fe5e07e-9a49-47b4-9801-1c0c5eed82ce could not be found. Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:03.318315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45713a38-962a-42b0-950c-c595b933a1d9 tempest-ListImageFiltersNegativeTestJSON-1576777127 tempest-ListImageFiltersNegativeTestJSON-1576777127-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:03.323270 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-45713a38-962a-42b0-950c-c595b933a1d9 tempest-ListImageFiltersNegativeTestJSON-1576777127 tempest-ListImageFiltersNegativeTestJSON-1576777127-project] 10.222.0.25 "GET /compute/v2.1/images/8fe5e07e-9a49-47b4-9801-1c0c5eed82ce" status: 404 len: 62 microversion: 2.1 time: 0.236685 Oct 24 09:02:03.327111 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1215/2369] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:03 2022] GET /compute/v2.1/images/8fe5e07e-9a49-47b4-9801-1c0c5eed82ce => generated 62 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:02:03.339893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab6951f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:03.361825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.362373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.362880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.367105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:03.380157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.384353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.385014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.386041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.387819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.390330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.447395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.447924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.448585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.477958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:03.515052 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-320e8036-e75a-480c-83a1-fe17f72baeb0 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 204 len: 0 microversion: 2.26 time: 0.186852 Oct 24 09:02:03.518989 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1216/2370] 10.222.0.25 () {60 vars in 1295 bytes} [Mon Oct 24 09:02:03 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:03.533094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:03.535105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:03.545650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.546162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.546703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.547420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.547892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.548324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.763162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:02:03.763793 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:02:03.764432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:02:03.764921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:02:03.765250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:02:03.790494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.791000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.791442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.805811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:03.809920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:03.812090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:03.861837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Getting quotas for project 33ae68ba2a584665992f3856fab416a5. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:02:03.883315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Getting quotas for user 0ba0cbf327634abdb5a1be7d2ee31e30 and project 33ae68ba2a584665992f3856fab416a5. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:02:03.952634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:02:03.961845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:02:04.153862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8652602d-f3f9-45de-a564-eedfbfceb3af tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173533 Oct 24 09:02:04.154792 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1155/2371] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:02:04.177951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab11ef70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:04.191691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.192466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.193245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.193928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:04.202600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.203537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.204133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.205047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.205704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.206374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.207351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:04.219422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:04.256022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:04.257650 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35c22526-14d2-4ec7-9970-c28d76951044 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1873 microversion: 2.42 time: 0.733865 Oct 24 09:02:04.265505 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1217/2372] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:03 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1873 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:04.294147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4bf388eb-6870-4340-943b-e0a066ef4ffb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab08edc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:04.339972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.340473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.342053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.357098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.357665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.358178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.406668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4bf388eb-6870-4340-943b-e0a066ef4ffb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.139739 Oct 24 09:02:04.407407 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1218/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:04 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:04.422293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:04.423138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:04.423249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:04.431819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.434223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.434878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.435832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.437727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.438400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.485307 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69f3d32e-3b13-421a-9e11-a50d2841c665 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1079293653" status: 201 len: 0 microversion: 2.26 time: 0.312740 Oct 24 09:02:04.489340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1156/2374] 10.222.0.25 () {62 vars in 1380 bytes} [Mon Oct 24 09:02:04 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-1079293653 => generated 0 bytes in 334 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 24 09:02:04.535714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fbf71702-2ae0-49ac-bc03-ab95b587c75b req-70c6e742-947c-451e-96a3-e1a0aa5f02fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "name": "network-vif-unplugged", "status": "completed", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:04.595627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fbf71702-2ae0-49ac-bc03-ab95b587c75b req-70c6e742-947c-451e-96a3-e1a0aa5f02fd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.596137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fbf71702-2ae0-49ac-bc03-ab95b587c75b req-70c6e742-947c-451e-96a3-e1a0aa5f02fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.596674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fbf71702-2ae0-49ac-bc03-ab95b587c75b req-70c6e742-947c-451e-96a3-e1a0aa5f02fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.650147 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fbf71702-2ae0-49ac-bc03-ab95b587c75b req-70c6e742-947c-451e-96a3-e1a0aa5f02fd service nova] Creating event network-vif-unplugged:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:02:04.667140 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fbf71702-2ae0-49ac-bc03-ab95b587c75b req-70c6e742-947c-451e-96a3-e1a0aa5f02fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172344 Oct 24 09:02:04.672055 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1157/2375] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:04.693529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6899e749-a920-48b6-b835-920c0aa5c57a tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:04.695354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6899e749-a920-48b6-b835-920c0aa5c57a tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:04.762382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:04.774508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-965bcf03-dc36-4846-a014-476bfa782f6a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1477 microversion: 2.1 time: 0.355181 Oct 24 09:02:04.791378 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1219/2376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:04 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:04.791378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab3c5940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:04.814717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.818861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.819445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.820025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:04.828854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.830454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.831745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.832802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.833554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.834209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.851468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6899e749-a920-48b6-b835-920c0aa5c57a tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:04.871180 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6899e749-a920-48b6-b835-920c0aa5c57a tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1218 microversion: 2.1 time: 0.196408 Oct 24 09:02:04.885322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1158/2377] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:04 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:04.889260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.889809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.890259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:04.933437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:04.933944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:04.942732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.054988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:05.124364 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9e89228-74bf-4306-b5dd-5e09e79e0788 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-2084316988" status: 201 len: 0 microversion: 2.26 time: 0.346145 Oct 24 09:02:05.134183 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1220/2378] 10.222.0.25 () {62 vars in 1380 bytes} [Mon Oct 24 09:02:04 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-2084316988 => generated 0 bytes in 357 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 24 09:02:05.137474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab93f790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:05.152671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.153809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.154478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.155199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:05.182703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.184292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.184981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.186371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.187615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.188433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.234056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.239783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.240696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.279188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:05.299385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:05.300056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:05.321171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.321729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.322187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.330426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.331112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.332146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.368646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6afc611-a9a0-4aa9-a980-f655fe36045b tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 204 len: 0 microversion: 2.26 time: 0.237679 Oct 24 09:02:05.372366 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1159/2379] 10.222.0.25 () {60 vars in 1295 bytes} [Mon Oct 24 09:02:05 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:05.394887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fb84d5a-c674-464c-8cde-86fb34143f28 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab0d0820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:05.422694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb84d5a-c674-464c-8cde-86fb34143f28 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.425719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb84d5a-c674-464c-8cde-86fb34143f28 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.428911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb84d5a-c674-464c-8cde-86fb34143f28 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.454408 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5fb84d5a-c674-464c-8cde-86fb34143f28 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 200 len: 12 microversion: 2.26 time: 0.071344 Oct 24 09:02:05.463363 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1160/2380] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 09:02:05 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 12 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:05.479093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92984a25-6013-434e-b4fd-104e21917c0a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab138b80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:05.679055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92984a25-6013-434e-b4fd-104e21917c0a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.212423 Oct 24 09:02:05.679988 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1161/2381] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:05 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:05.696354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab0885e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:05.727956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:05.746268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.746461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:05.748872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:05.749538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.751281 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe04e8f1-aabb-4b89-8dd0-25efb5b06d69 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2832 microversion: 2.42 time: 0.456680 Oct 24 09:02:05.751955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.752679 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1221/2382] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:05 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2832 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:05.755950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:05.787219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:05.787809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:05.790656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.791262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.791728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.796683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.797317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.797785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.799941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.800588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.801048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.801975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.802447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.802884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.853716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:05.854273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:05.854670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:05.878848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:05.967143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27f7f6c5-9414-4d78-a87b-b6f007a3c48e tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 204 len: 0 microversion: 2.26 time: 0.285709 Oct 24 09:02:05.967807 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1162/2383] 10.222.0.25 () {60 vars in 1295 bytes} [Mon Oct 24 09:02:05 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:05.999263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:06.001177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:06.027871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.028740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.030584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.031533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.034063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.036472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.199287 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f8369dd-85dd-490a-83bc-24e1a50bb552 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.417584 Oct 24 09:02:06.200078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1222/2384] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 09:02:05 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5/os-interface => generated 1832 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:06.205925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:06.207627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:06.232640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.233163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.233648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.234358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.234828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.235262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.601589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:06.601933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:06.611450 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1711c5a9-da51-4233-b125-180d0c6f3ac7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1270 microversion: 2.1 time: 0.409926 Oct 24 09:02:06.613454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cb6420f-e417-4a5e-835a-1d24e07871f1 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1477 microversion: 2.1 time: 0.636647 Oct 24 09:02:06.615337 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1163/2385] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:05 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1477 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:06.624427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab0d05e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:06.630395 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1223/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:06 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1270 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:06.670254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.671121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.671755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.672418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:06.683315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.684116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.684753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.685860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.686510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.687303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.695608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f30558c-5df7-4cb3-85c2-2e296aafbe93 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab005160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:06.764004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.764357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.765439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.776663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.777731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.778338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.807883 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f30558c-5df7-4cb3-85c2-2e296aafbe93 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.116654 Oct 24 09:02:06.808508 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1224/2387] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:06 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:06.864216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:06.940638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-052d11ad-8c72-42a6-80fe-7b2e6cbc7201 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-460830575" status: 201 len: 0 microversion: 2.26 time: 0.319571 Oct 24 09:02:06.946558 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1164/2388] 10.222.0.25 () {62 vars in 1377 bytes} [Mon Oct 24 09:02:06 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-460830575 => generated 0 bytes in 325 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 24 09:02:06.957560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab6951f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:06.989632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:06.992525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:06.993702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:06.997019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:07.011170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.015159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.016142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.017368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.020442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.021260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.106661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.109658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.110260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.125186 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:07.152049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.153829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.154342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.214598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:07.260401 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1169380c-127c-4eed-818e-378d17375fe1 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-865292858" status: 201 len: 0 microversion: 2.26 time: 0.311886 Oct 24 09:02:07.263265 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1225/2389] 10.222.0.25 () {62 vars in 1377 bytes} [Mon Oct 24 09:02:06 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags/tempest-tag-865292858 => generated 0 bytes in 315 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 24 09:02:07.274844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Action: 'update_all', calling method: .version_select at 0x7f8dab93f280>, body: {"tags": ["tempest-tag-1327186498", "tempest-tag-1262543552"]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:07.304868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.312040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.314049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.316358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:07.339606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.342571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.343218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.344165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.344814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.349914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.409998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.417165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.418098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.460899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:07.503674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b59049dc-3967-4635-ba08-25bf6e6758ae tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 200 len: 62 microversion: 2.26 time: 0.234999 Oct 24 09:02:07.512062 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1165/2390] 10.222.0.25 () {62 vars in 1312 bytes} [Mon Oct 24 09:02:07 2022] PUT /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 62 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:07.518237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-736ee1b3-6d40-41f3-8873-14a1307b214a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab094790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:07.548672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-736ee1b3-6d40-41f3-8873-14a1307b214a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.559042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-736ee1b3-6d40-41f3-8873-14a1307b214a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.560613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-736ee1b3-6d40-41f3-8873-14a1307b214a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.615884 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-736ee1b3-6d40-41f3-8873-14a1307b214a tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 200 len: 62 microversion: 2.26 time: 0.103984 Oct 24 09:02:07.645067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '.version_select at 0x7f8dab488a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:07.647568 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1226/2391] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Oct 24 09:02:07 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 62 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:07.693516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:07.695692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:07.699487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.702741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.706838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.715188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:07.724925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.727064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.727793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.728697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.730688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.731895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.748493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.754106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.755935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.758694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.762564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.764675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.846796 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:07.859477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:07.859936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:07.861289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:07.900569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lazy-loading 'flavor' on Instance uuid aebb81d1-e202-4c33-b357-da3afcc0adb0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:07.958747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0cf3dcfe-fd46-482b-ad1e-8e5783b65c1f tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags" status: 204 len: 0 microversion: 2.26 time: 0.329522 Oct 24 09:02:07.965346 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1166/2392] 10.222.0.25 () {60 vars in 1295 bytes} [Mon Oct 24 09:02:07 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0/tags => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:07.982355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:07.982992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:08.009216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.009747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.017333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:08.018390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.019451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.020090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:08.269150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:08.278628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71ff1eb3-d140-414f-834c-0950e2dfc2b4 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1276 microversion: 2.1 time: 0.312120 Oct 24 09:02:08.282571 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1167/2393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:07 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:08.305259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e72ee47-cf04-4a3d-9566-797422e95c13 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daae95550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:08.386837 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e72ee47-cf04-4a3d-9566-797422e95c13 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.101631 Oct 24 09:02:08.387573 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1168/2394] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:08 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:08.402216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:08.402466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:08.436251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.436251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.436628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:08.437366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.437815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.438253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:08.525977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:08.695258 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9fd38cf2-fae7-41b0-b90b-102e10387588 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 204 len: 0 microversion: 2.26 time: 0.305071 Oct 24 09:02:08.697908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1169/2395] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:02:08 2022] DELETE /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:02:08.709719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cd06c72e-43e3-42fa-b5eb-9d84aa724307 req-1e5a7a4f-984d-4e48-b1bb-5b3c2027f2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "name": "network-vif-plugged", "status": "completed", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:08.732991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cd06c72e-43e3-42fa-b5eb-9d84aa724307 req-1e5a7a4f-984d-4e48-b1bb-5b3c2027f2ec service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.733760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cd06c72e-43e3-42fa-b5eb-9d84aa724307 req-1e5a7a4f-984d-4e48-b1bb-5b3c2027f2ec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.740334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cd06c72e-43e3-42fa-b5eb-9d84aa724307 req-1e5a7a4f-984d-4e48-b1bb-5b3c2027f2ec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:08.755564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cd06c72e-43e3-42fa-b5eb-9d84aa724307 req-1e5a7a4f-984d-4e48-b1bb-5b3c2027f2ec service nova] Creating event network-vif-plugged:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:02:08.771747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cd06c72e-43e3-42fa-b5eb-9d84aa724307 req-1e5a7a4f-984d-4e48-b1bb-5b3c2027f2ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071535 Oct 24 09:02:08.773366 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1170/2396] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:08.785738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:08.788421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:08.804929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.805805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.806504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:08.807454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:08.809416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:08.810120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:09.193628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:09.202773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff50ecee-bc1e-48d5-abc6-b2558b84d664 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1477 microversion: 2.1 time: 1.553353 Oct 24 09:02:09.221189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1227/2397] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:07 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1477 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:09.221447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:09.235185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:09.237087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:09.242365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3213ab51-92e5-44de-b346-e62985a51540 tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1553 microversion: 2.26 time: 0.467467 Oct 24 09:02:09.245323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1171/2398] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:08 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1553 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:09.310327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:09.312202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:09.325273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:09.326199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:09.330947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:09.332745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:09.333857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:09.335669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:09.405171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8dea5e7-2bd6-4c82-80f3-d1c33b7b1dcb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab1091f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:09.543109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8dea5e7-2bd6-4c82-80f3-d1c33b7b1dcb tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.141855 Oct 24 09:02:09.544384 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1172/2399] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:09 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:09.658864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:09.668003 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2feff785-e94a-4354-8e85-eaf566282d33 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1276 microversion: 2.1 time: 0.365511 Oct 24 09:02:09.681657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1228/2400] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:09 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1276 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:10.229924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:10.230558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:10.262607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:10.263166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:10.263717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:10.264695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:10.265275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:10.265862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:10.284004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:10.285003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:10.303372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:10.314466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:10.315232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:10.316648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:10.317264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:10.317833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:11.341025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:11.351500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8fef25bf-21c2-4470-a08c-9cbbd7338652 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1477 microversion: 2.1 time: 1.127081 Oct 24 09:02:11.353058 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1173/2401] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:10 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1477 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:11.358263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-849794dc-8f96-4b49-a930-fa3d906ab05b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab138ca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:11.436653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:11.445751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:11.454250 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-849794dc-8f96-4b49-a930-fa3d906ab05b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.099821 Oct 24 09:02:11.459129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:11.460734 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e822394b-c1e4-4b40-ae25-716d0fede0db tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1553 microversion: 2.26 time: 1.180692 Oct 24 09:02:11.470420 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1229/2402] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:10 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1553 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:11.470716 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1174/2403] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:11 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:11.484707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:11.485474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:11.505478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:11.506096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:11.506615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:11.507417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:11.516472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:11.517711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:12.381243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:12.382328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:12.404893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:12.405790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:12.409129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:12.413088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:12.416867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:12.417617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:13.262334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:13.275455 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef92c72f-7fcf-4d47-935e-5ba69dffbdbc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 1.801584 Oct 24 09:02:13.277731 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1230/2404] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:11 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:13.295400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e105742-b030-4570-b635-b5b3c011d696 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab4569d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:13.431444 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e105742-b030-4570-b635-b5b3c011d696 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.150156 Oct 24 09:02:13.432033 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1231/2405] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:13 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:13.444440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:13.460157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:13.468082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:13.468581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:13.469024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:13.469771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:13.470231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:13.473734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:13.736247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:13.749775 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-380b08e8-2ac8-4fe6-8cb8-549982b9a388 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1463 microversion: 2.1 time: 1.373003 Oct 24 09:02:13.756685 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1175/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:12 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1463 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:13.775243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fd8e643e-dcd3-47c0-a49f-1e1d68f03e20 req-aa3d1197-d0f2-4f36-a294-906f3e492711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "tag": "9a5a2cfa-da17-4a1f-bfd7-98eca3fde566"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:13.820811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fd8e643e-dcd3-47c0-a49f-1e1d68f03e20 req-aa3d1197-d0f2-4f36-a294-906f3e492711 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:13.821807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fd8e643e-dcd3-47c0-a49f-1e1d68f03e20 req-aa3d1197-d0f2-4f36-a294-906f3e492711 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:13.822642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fd8e643e-dcd3-47c0-a49f-1e1d68f03e20 req-aa3d1197-d0f2-4f36-a294-906f3e492711 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:13.852847 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:13.864041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fd8e643e-dcd3-47c0-a49f-1e1d68f03e20 req-aa3d1197-d0f2-4f36-a294-906f3e492711 service nova] Creating event network-changed:9a5a2cfa-da17-4a1f-bfd7-98eca3fde566 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:02:13.896134 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fd8e643e-dcd3-47c0-a49f-1e1d68f03e20 req-aa3d1197-d0f2-4f36-a294-906f3e492711 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135827 Oct 24 09:02:13.897070 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1176/2407] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:13.907099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:13.907847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:13.927110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:13.927626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:13.928082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:13.928846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:13.929352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:13.929800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:14.236625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:14.271530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:14.277026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8941a72c029246b99e52925781a4d1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39ab7b5b92a41668acea520536e4537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:14.278729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-363c5100-61eb-4ea0-bfa7-e5ea6aa2fdfc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 200 len: 1553 microversion: 2.26 time: 0.838298 Oct 24 09:02:14.279533 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1232/2408] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:13 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 1553 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:14.304876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:14.306490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:14.346665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:14.352716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:14.358348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:14.364604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:14.369604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:14.371029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:14.869235 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:14.984536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:14.994938 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23d2148a-3d7a-4a9b-a0eb-a3ca14210ce0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1463 microversion: 2.1 time: 1.096572 Oct 24 09:02:15.016239 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1177/2409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:13 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1463 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:15.026267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-238c28fd-06b6-493a-bcc9-8dd5d1721711 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaf7f820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:15.105902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:15.125808 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28bd716d-ce30-497b-a7a0-dbaa44ff9437 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.825087 Oct 24 09:02:15.126746 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1233/2410] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:14 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:15.154042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:15.158363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:15.170463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.171243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.171879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.175990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.176661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.177208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.188771 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-238c28fd-06b6-493a-bcc9-8dd5d1721711 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.171454 Oct 24 09:02:15.194285 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1178/2411] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:15 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:15.205223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:15.208499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:15.224233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.231049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.231740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.232796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.233862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.234468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.294524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:15.384014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:02:15.393503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:02:15.397323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:02:15.399685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:02:15.401820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:02:15.497621 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01d69246-599f-4eff-b955-807fc2d7f482 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "DELETE /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 204 len: 0 microversion: 2.1 time: 0.298921 Oct 24 09:02:15.503388 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1179/2412] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:15 2022] DELETE /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:15.514917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:15.515664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] [instance: aebb81d1-e202-4c33-b357-da3afcc0adb0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:15.532793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.534227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.536283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.538776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.539851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.541357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.598972 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] HTTP exception thrown: Instance aebb81d1-e202-4c33-b357-da3afcc0adb0 could not be found. Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Request method failure captured: Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 HTTP/1.1 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlRx7-ibmZybxUo1LAWyFp0nbXVfF_nCbfjOGVEDqeFBab6xQHypH0-4UEnTMeeS_VNLEjbZYyKXpgq198-wKAP1PGln8mAO4_DbIcpXzGwaCrnVjZF4kIkxr1k9poyW7O7n34QaaizYTNLWsVH-NBtmgEcE7DkCQzKTm20d56n8WT4 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.26 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e39ab7b5b92a41668acea520536e4537 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerTagsTestJSON-980114468 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39ab7b5b92a41668acea520536e4537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e39ab7b5b92a41668acea520536e4537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39ab7b5b92a41668acea520536e4537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e39ab7b5b92a41668acea520536e4537"}]}] Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerTagsTestJSON-980114468 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e39ab7b5b92a41668acea520536e4537 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerTagsTestJSON-980114468 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerTagsTestJSON-980114468-project Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8941a72c029246b99e52925781a4d1e6 Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerTagsTestJSON-980114468-project Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: exception: Instance aebb81d1-e202-4c33-b357-da3afcc0adb0 could not be found. Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'aebb81d1-e202-4c33-b357-da3afcc0adb0'} Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebb81d1-e202-4c33-b357-da3afcc0adb0 could not be found. Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebb81d1-e202-4c33-b357-da3afcc0adb0 could not be found. Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:15.604398 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebb81d1-e202-4c33-b357-da3afcc0adb0 could not be found. Oct 24 09:02:15.609745 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:15.613879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] Returning 404 to user: Instance aebb81d1-e202-4c33-b357-da3afcc0adb0 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:15.615720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02339d68-9289-4137-9b76-96fa1940e0bc tempest-ServerTagsTestJSON-980114468 tempest-ServerTagsTestJSON-980114468-project] 10.222.0.25 "GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0" status: 404 len: 111 microversion: 2.26 time: 0.113295 Oct 24 09:02:15.618724 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1180/2413] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:15 2022] GET /compute/v2.1/servers/aebb81d1-e202-4c33-b357-da3afcc0adb0 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:02:15.629759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:15.633208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:15.634242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:15.650379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.652338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.653576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.656458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.657128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.658642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.667942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.668519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.671631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.674826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.677831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.680731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.807255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b40adb8-b172-4f9e-8879-2bcf1bf87509 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 1067 microversion: 2.1 time: 0.676692 Oct 24 09:02:15.809823 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1234/2414] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:02:15 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 1067 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 09:02:15.839885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:15.840798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:15.847395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.848174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.848805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:15.849774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:15.850413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:15.851008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:16.365574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:16.398942 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ad55557-8b93-4e62-a133-e1a4da219346 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1506 microversion: 2.1 time: 0.777619 Oct 24 09:02:16.410119 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1181/2415] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:15 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:16.414722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebb81d1-e202-4c33-b357-da3afcc0adb0", "name": "network-vif-deleted", "tag": "8cbb841a-4c62-4efa-8468-7ee757161bdd"}, {"name": "network-changed", "server_uuid": "9df9fec5-ffd6-4972-b801-c18783b6c19a", "tag": "92f21969-18f6-4d4f-a14e-924612f203e8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:16.446128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:16.446610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:16.447092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:16.479684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] Creating event network-vif-deleted:8cbb841a-4c62-4efa-8468-7ee757161bdd for instance aebb81d1-e202-4c33-b357-da3afcc0adb0 on n-h2-master-1 Oct 24 09:02:16.480624 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] Creating event network-changed:92f21969-18f6-4d4f-a14e-924612f203e8 for instance 9df9fec5-ffd6-4972-b801-c18783b6c19a on n-h2-master-1 Oct 24 09:02:16.498847 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-29115e1a-e3c5-492d-803c-df2c6ccb48e6 req-2f07a4c3-939d-45f4-929f-72b0ed72a4ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.095155 Oct 24 09:02:16.499996 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1182/2416] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:16.510063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:16.511965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:16.527900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:16.531365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:16.532849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:16.534110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:16.535946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:16.540999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:16.871780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:16.912471 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ef6e282-6875-4d5f-96b2-e410e20552b2 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 1.073410 Oct 24 09:02:16.917884 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1235/2417] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:15 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:16.935054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15c75e6e-b6b7-481c-b3d6-f9c6b8d06966 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab08e5e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:17.155971 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15c75e6e-b6b7-481c-b3d6-f9c6b8d06966 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.232949 Oct 24 09:02:17.161628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1236/2418] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:16 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:17.439189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:17.443148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:17.467304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:17.469873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:17.473259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:17.475218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:17.476830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:17.477922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:17.838558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:17.855647 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d487857f-aeab-4578-abde-fa55eaa9deb0 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 1.353651 Oct 24 09:02:17.859044 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1183/2419] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:16 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:17.941513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:17.942377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:17.950883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:17.951676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:17.952288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:17.954657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:17.961155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:17.961902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:18.825153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:18.844019 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b43f9c2-9fde-4f3c-b750-2d171bf63e99 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.907645 Oct 24 09:02:18.851233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1184/2420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:17 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:18.868711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56418a55-594c-4bbd-ae1e-bc0f8c6778af tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daae95430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:18.993024 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56418a55-594c-4bbd-ae1e-bc0f8c6778af tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.140409 Oct 24 09:02:18.999973 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1185/2421] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:18 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:19.014339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:19.015167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:19.019301 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:19.027237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:19.028907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:19.029550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:19.031486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:19.033412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:19.034060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:19.439323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:19.452473 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f11a5eeb-b95a-42c7-b731-cba003e33f78 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1506 microversion: 2.1 time: 2.024940 Oct 24 09:02:19.476179 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1237/2422] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:17 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1506 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:19.487268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a2e34b11-6b33-475d-9403-4fbaaabd204c req-d204f22c-1a8c-43e3-87b9-b4de79739158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add07d56-c8d6-4722-8f2f-8feae52e0d8c", "name": "network-vif-deleted", "tag": "0ed081e0-c576-45fb-a26f-6dccbf7ffa72"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:19.517902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2e34b11-6b33-475d-9403-4fbaaabd204c req-d204f22c-1a8c-43e3-87b9-b4de79739158 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:19.518385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2e34b11-6b33-475d-9403-4fbaaabd204c req-d204f22c-1a8c-43e3-87b9-b4de79739158 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:19.522258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2e34b11-6b33-475d-9403-4fbaaabd204c req-d204f22c-1a8c-43e3-87b9-b4de79739158 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:19.547467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a2e34b11-6b33-475d-9403-4fbaaabd204c req-d204f22c-1a8c-43e3-87b9-b4de79739158 service nova] Creating event network-vif-deleted:0ed081e0-c576-45fb-a26f-6dccbf7ffa72 for instance add07d56-c8d6-4722-8f2f-8feae52e0d8c on n-h1-master-1 Oct 24 09:02:19.562715 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a2e34b11-6b33-475d-9403-4fbaaabd204c req-d204f22c-1a8c-43e3-87b9-b4de79739158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083611 Oct 24 09:02:19.564490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1238/2423] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:19.893506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:19.894553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:19.910317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:19.910825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:19.913552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:19.915809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:19.918711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:19.921427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:20.361501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:20.370192 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c0856c86-5e95-41a1-98af-bd3c635f48cb tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.490903 Oct 24 09:02:20.374965 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1239/2424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:19 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:20.392986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-144b4484-5d97-492a-8d56-341e42f65cb7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab0cf820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:20.497571 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-144b4484-5d97-492a-8d56-341e42f65cb7 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.121330 Oct 24 09:02:20.500183 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1240/2425] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:20 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:20.512985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:20.513670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:20.545035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:20.545629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:20.551085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:20.552358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:20.554875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:20.555706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:20.646901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:20.647405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:20.647845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:20.648312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lazy-loading 'fault' on Instance uuid add07d56-c8d6-4722-8f2f-8feae52e0d8c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:20.964374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:20.973648 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0696a61a-c54e-4569-9387-53a9d919a27f tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 200 len: 1312 microversion: 2.1 time: 0.472272 Oct 24 09:02:20.992356 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1241/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:20 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:21.000128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:21.003816 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:21.019905 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4cabb3ce-c886-4a82-a252-e1819d6063f9 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 2.014462 Oct 24 09:02:21.027845 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1186/2427] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:19 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:21.393701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:21.394874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:21.406812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:21.407328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:21.407784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:21.409282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:21.413777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:21.414523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:21.436278 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:21.515905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce31e085-741d-4680-a946-c5162bbf2605 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab488a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:21.586830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ce31e085-741d-4680-a946-c5162bbf2605 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.076031 Oct 24 09:02:21.588689 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1187/2428] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:21 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:22.001143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:22.001876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: add07d56-c8d6-4722-8f2f-8feae52e0d8c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:22.012287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.018005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.018557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.020069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.020755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.021409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.061830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c could not be found. Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c HTTP/1.1 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: exception: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c could not be found. Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'add07d56-c8d6-4722-8f2f-8feae52e0d8c'} Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c could not be found. Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c could not be found. Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:22.063893 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c could not be found. Oct 24 09:02:22.068008 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:22.070014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 404 to user: Instance add07d56-c8d6-4722-8f2f-8feae52e0d8c could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:22.071181 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6812c7f0-9410-403c-a9f1-1feab557baf3 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c" status: 404 len: 111 microversion: 2.1 time: 0.074520 Oct 24 09:02:22.076965 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1188/2429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:21 2022] GET /compute/v2.1/servers/add07d56-c8d6-4722-8f2f-8feae52e0d8c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:22.088903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:22.091938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:22.106761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.107506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.110841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.112287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.113106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.116258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.337337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:22.346001 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d84bff2e-3065-4693-9521-89d415724ba0 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.956254 Oct 24 09:02:22.351041 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1242/2430] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:21 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:22.356057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:22.359393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:22.371021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.375206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.376521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.378847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.383169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.383830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.450312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:22.527280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:22.540598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-764a9a69-f770-42da-8b81-73195a5c9b93 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.461010 Oct 24 09:02:22.542450 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1189/2431] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:22 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:22.603482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37718c39-6512-48e3-9b48-5dab0d768c0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab138a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:22.636668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-326022f8-42f8-41d0-913d-f5669e790a05 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 204 len: 0 microversion: 2.1 time: 0.282873 Oct 24 09:02:22.637460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1243/2432] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:22 2022] DELETE /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:22.651495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:22.652855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:22.681363 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37718c39-6512-48e3-9b48-5dab0d768c0d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.081756 Oct 24 09:02:22.682452 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1190/2433] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:22 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:22.682636 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:22.684796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.685564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.686257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.687188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:22.687855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:22.688496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:22.961116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:22.975335 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f7b5aa4-fd8d-4f0f-9e93-e596fe71d776 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.333269 Oct 24 09:02:22.978372 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1244/2434] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:22 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:23.383375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:23.384224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:23.399643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:23.401587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:23.402573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:23.404854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:23.405457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:23.408516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:23.573821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:23.575165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:23.586846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:23.589005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:23.589767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:23.593085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:23.593899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:23.594638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:23.914032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:23.923332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09d60e66-0880-4bf7-b064-1e5946388371 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.353694 Oct 24 09:02:23.929253 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1245/2435] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:23 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:23.941020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2684d206-c25b-4ab8-9685-5bc461df2217 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab4569d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:24.042147 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2684d206-c25b-4ab8-9685-5bc461df2217 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1413 microversion: 2.1 time: 0.111321 Oct 24 09:02:24.045502 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1246/2436] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:23 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:24.062225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:24.063291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:24.080264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:24.088477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:24.089801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:24.090952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:24.091622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:24.092746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:24.255730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:24.272601 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0122b89e-7e18-46f8-817c-1538be4ad7c4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.891619 Oct 24 09:02:24.274068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1191/2437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:23 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:24.422693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:24.438053 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cda8c6a4-1a56-4b73-81f1-bb956a0e3075 tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.390281 Oct 24 09:02:24.439542 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1247/2438] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:24 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:24.955542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:24.957002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:24.964375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:24.965254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:24.965933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:24.966851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:24.967509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:24.968142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:25.062287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a90ae753-dd50-4219-a092-0ea8f0848658 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daafbf040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:25.144107 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a90ae753-dd50-4219-a092-0ea8f0848658 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1422 microversion: 2.1 time: 0.086226 Oct 24 09:02:25.155378 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1248/2439] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:25 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:25.160933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9de1d1ae-4a93-4244-995a-dc9fcec2052f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab04a9d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:25.224330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9de1d1ae-4a93-4244-995a-dc9fcec2052f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 200 len: 1422 microversion: 2.1 time: 0.067584 Oct 24 09:02:25.225242 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1249/2440] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:25 2022] GET /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:25.300232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:25.301218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:25.308309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:25.309181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:25.309876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:25.310844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:25.311532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:25.312178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:25.545196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:25.560720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56905001-244b-4875-8e84-7734ebf9168c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.609066 Oct 24 09:02:25.584549 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1192/2441] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:24 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:25.600126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1623327990", "imageRef": "4c2e464b-e418-400c-8a59-f6e20757addc", "flavorRef": "452", "networks": [{"uuid": "62c56d9c-5126-43a0-b067-60873881adab"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:25.689145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] validate_networks() for [('62c56d9c-5126-43a0-b067-60873881adab', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:02:25.789595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:25.799198 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01830c81-c5b1-4797-a20a-1216153f008a tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.501895 Oct 24 09:02:25.816156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1250/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:25 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:25.829463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:25.830405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:25.837480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:25.838253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:25.838856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:25.840401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:25.841038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:25.841678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:26.297173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e709503bbff4c239491b0f109673264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90fabc24c5d4f509e45e0eec0b323a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:26.323787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac2caabb-113d-4e63-803a-e533a70aff4a tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 200 len: 1520 microversion: 2.1 time: 0.503485 Oct 24 09:02:26.327907 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1251/2443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:25 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 1520 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:26.759424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d9fd6a3-7c33-4023-a6cd-3bf14775e8d5 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab04ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1436529962", "description": "tempest-description-28865681"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:26.881085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:02:26.882089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:02:26.882712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:02:26.883291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:02:26.883849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:02:26.903739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:26.906535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:26.907301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:26.907973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:26.908511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:26.908951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:26.974609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:02:27.001975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for user ca932e5866274fc78b04689811e72746 and project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:02:27.034757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:02:27.042236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c2e464b-e418-400c-8a59-f6e20757addc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:02:27.089195 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d9fd6a3-7c33-4023-a6cd-3bf14775e8d5 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.606732 Oct 24 09:02:27.090408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1252/2444] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:02:26 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:27.096080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:27.096939 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:27.114268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.116775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.120820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.122792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.123359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.124255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.143032 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3d09ab4-54d7-4fb7-bd70-65e115b9198a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.556937 Oct 24 09:02:27.144575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1193/2445] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:02:27.160360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f048f094-bd80-4f2f-a00e-00ab3a969580 req-afae9540-be31-4670-b12e-cf3f62ff66c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e62742-ceeb-4336-bf67-b6ae657b4852", "name": "network-vif-deleted", "tag": "97452f9d-c71f-4d41-bcc9-56b11baf935a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:27.189088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f048f094-bd80-4f2f-a00e-00ab3a969580 req-afae9540-be31-4670-b12e-cf3f62ff66c2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.190153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f048f094-bd80-4f2f-a00e-00ab3a969580 req-afae9540-be31-4670-b12e-cf3f62ff66c2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.190892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f048f094-bd80-4f2f-a00e-00ab3a969580 req-afae9540-be31-4670-b12e-cf3f62ff66c2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.208921 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f048f094-bd80-4f2f-a00e-00ab3a969580 req-afae9540-be31-4670-b12e-cf3f62ff66c2 service nova] Creating event network-vif-deleted:97452f9d-c71f-4d41-bcc9-56b11baf935a for instance c2e62742-ceeb-4336-bf67-b6ae657b4852 on n-h2-master-1 Oct 24 09:02:27.217978 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f048f094-bd80-4f2f-a00e-00ab3a969580 req-afae9540-be31-4670-b12e-cf3f62ff66c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071805 Oct 24 09:02:27.222962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1194/2446] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:27.238434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:27.242050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:27.258013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.261764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.262466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.263351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.263800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.264269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.434573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:27.452282 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71148fb4-3565-47db-8509-f8fdb3f2dc03 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.359611 Oct 24 09:02:27.453658 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1253/2447] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:27 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:27.459404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1822d3a0-3d0c-440c-a419-f5da5cf9e964 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab0a2550>, body: {"security_group_rule": {"parent_group_id": "f36ea4cd-0ccf-42c5-9187-bbe957c8f120", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:27.743133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:27.762526 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08c976a1-c01f-4265-bb8e-f53c5e863f26 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.537470 Oct 24 09:02:27.766256 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1195/2448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:27 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:27.779954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87e1c497-bc52-483b-ad3f-4fda8ced4a9a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:27.782009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87e1c497-bc52-483b-ad3f-4fda8ced4a9a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:27.873011 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1822d3a0-3d0c-440c-a419-f5da5cf9e964 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.418159 Oct 24 09:02:27.873962 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1254/2449] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:27.879622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:27.880169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] [instance: c2e62742-ceeb-4336-bf67-b6ae657b4852] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:27.892567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.895519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.895967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.900222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:27.902392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:27.904280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:27.932028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] HTTP exception thrown: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 could not be found. Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Request method failure captured: Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 HTTP/1.1 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlNSQHr3IAyTQSTjEn4TTLeB3XuIDn17w4HQ_m0ogb3DtLve00REhsG21OudalOFi5Dk9IWkfCu8nv_srZiSqi2WtT8-ix5RI05slyQrMUnMlTWGKB1YbmYIPQI9HsvDSqp9NUYLPh4ae_YzgGgE_mcpct6k_Hz093yh0AQjBqRaAgM Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b90fabc24c5d4f509e45e0eec0b323a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b90fabc24c5d4f509e45e0eec0b323a7"}]}] Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: b90fabc24c5d4f509e45e0eec0b323a7 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1889919454 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7e709503bbff4c239491b0f109673264 Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1889919454-project Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: exception: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 could not be found. Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c2e62742-ceeb-4336-bf67-b6ae657b4852'} Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 could not be found. Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 could not be found. Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:27.934293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 could not be found. Oct 24 09:02:27.937991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:27.940304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] Returning 404 to user: Instance c2e62742-ceeb-4336-bf67-b6ae657b4852 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:27.941713 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f09138dd-141e-4bf1-a113-7fef6effc8ce tempest-ServerRescueNegativeTestJSON-1889919454 tempest-ServerRescueNegativeTestJSON-1889919454-project] 10.222.0.25 "GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852" status: 404 len: 111 microversion: 2.1 time: 0.066384 Oct 24 09:02:27.943279 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1255/2450] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:27 2022] GET /compute/v2.1/servers/c2e62742-ceeb-4336-bf67-b6ae657b4852 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:27.951292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9753339-77f7-4a31-8936-9f4fbbe5776b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab005670>, body: {"security_group_rule": {"parent_group_id": "f36ea4cd-0ccf-42c5-9187-bbe957c8f120", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:28.219727 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b9753339-77f7-4a31-8936-9f4fbbe5776b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: This rule already exists in group f36ea4cd-0ccf-42c5-9187-bbe957c8f120 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9753339-77f7-4a31-8936-9f4fbbe5776b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 138 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: {"security_group_rule": {"parent_group_id": "f36ea4cd-0ccf-42c5-9187-bbe957c8f120", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: exception: This rule already exists in group f36ea4cd-0ccf-42c5-9187-bbe957c8f120 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f36ea4cd-0ccf-42c5-9187-bbe957c8f120', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f36ea4cd-0ccf-42c5-9187-bbe957c8f120 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f36ea4cd-0ccf-42c5-9187-bbe957c8f120 Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:28.223273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:28.227289 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:28.227289 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:28.227289 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f36ea4cd-0ccf-42c5-9187-bbe957c8f120 Oct 24 09:02:28.227289 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:28.228015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9753339-77f7-4a31-8936-9f4fbbe5776b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 400 to user: This rule already exists in group f36ea4cd-0ccf-42c5-9187-bbe957c8f120 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:28.229134 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9753339-77f7-4a31-8936-9f4fbbe5776b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.284220 Oct 24 09:02:28.230936 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1256/2451] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:27 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:02:28.244145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e8cb2d60-c11b-48cd-beb3-050528d8a3dc req-6be7e257-3de5-4b90-a5db-d24bfc6fd186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df9fec5-ffd6-4972-b801-c18783b6c19a", "name": "network-vif-plugged", "status": "completed", "tag": "92f21969-18f6-4d4f-a14e-924612f203e8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:28.303383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e8cb2d60-c11b-48cd-beb3-050528d8a3dc req-6be7e257-3de5-4b90-a5db-d24bfc6fd186 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:28.309526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e8cb2d60-c11b-48cd-beb3-050528d8a3dc req-6be7e257-3de5-4b90-a5db-d24bfc6fd186 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:28.310819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e8cb2d60-c11b-48cd-beb3-050528d8a3dc req-6be7e257-3de5-4b90-a5db-d24bfc6fd186 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:28.354238 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e8cb2d60-c11b-48cd-beb3-050528d8a3dc req-6be7e257-3de5-4b90-a5db-d24bfc6fd186 service nova] Creating event network-vif-plugged:92f21969-18f6-4d4f-a14e-924612f203e8 for instance 9df9fec5-ffd6-4972-b801-c18783b6c19a on n-h2-master-1 Oct 24 09:02:28.372096 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e8cb2d60-c11b-48cd-beb3-050528d8a3dc req-6be7e257-3de5-4b90-a5db-d24bfc6fd186 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135456 Oct 24 09:02:28.373317 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1257/2452] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:28.392966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02529487-8c1f-4996-b867-09198cb1491a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8dab04a0d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:28.429083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-87e1c497-bc52-483b-ad3f-4fda8ced4a9a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:28.438320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87e1c497-bc52-483b-ad3f-4fda8ced4a9a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1208 microversion: 2.1 time: 0.670694 Oct 24 09:02:28.443046 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1196/2453] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:27 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1208 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:28.479551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:28.480210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:28.497843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:28.498353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:28.499187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:28.500095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:28.500578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:28.501004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:28.875964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:28.886782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c9c308b-03c5-47d8-aecb-1e8b03385f87 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.411002 Oct 24 09:02:28.905908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1197/2454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:28 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:28.912587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:28.913512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:28.922194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:28.922904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:28.923525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:28.924674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:28.926224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:28.926828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:29.298180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02529487-8c1f-4996-b867-09198cb1491a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/d3928267-9311-4301-8ac8-fd88856941f5" status: 202 len: 0 microversion: 2.1 time: 0.919814 Oct 24 09:02:29.302650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:29.304812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1258/2455] 10.222.0.25 () {58 vars in 1287 bytes} [Mon Oct 24 09:02:28 2022] DELETE /compute/v2.1/os-security-group-rules/d3928267-9311-4301-8ac8-fd88856941f5 => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:29.310798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91af0214-04a2-471f-b374-db184167da09 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab023310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2048860498", "description": "tempest-description-200907739"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:29.323608 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1bdfb1b0-fcd5-43c3-a539-4c8ee3f05a43 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.411694 Oct 24 09:02:29.324391 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1198/2456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:28 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:29.466885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:29.467541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:29.480036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:29.481751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:29.484413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:29.485786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:29.486687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:29.488419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:29.610207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:29.641241 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed0f83dd-a424-4ae6-898a-3eefb320d8b6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1266 microversion: 2.1 time: 0.178001 Oct 24 09:02:29.660459 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1199/2457] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:29 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:29.822959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91af0214-04a2-471f-b374-db184167da09 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.516279 Oct 24 09:02:29.838450 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1259/2458] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:02:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:29.852790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5279886-f7ba-427a-879e-ab50d2cd0709 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8daaffb8b0>, body: {"security_group_rule": {"parent_group_id": "2e4731ba-2565-480c-af96-f4ce67e6688a", "ip_protocol": "tcp", "from_port": 1328110743, "to_port": 22}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:29.920439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:29.921859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:29.931326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:29.932171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:29.933153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:29.934325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:29.935142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:29.935852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:30.101877 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c5279886-f7ba-427a-879e-ab50d2cd0709 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Invalid port range 1328110743:22. Former value cannot be greater than the later Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5279886-f7ba-427a-879e-ab50d2cd0709 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 146 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: {"security_group_rule": {"parent_group_id": "2e4731ba-2565-480c-af96-f4ce67e6688a", "ip_protocol": "tcp", "from_port": 1328110743, "to_port": 22}} Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid port range 1328110743:22. Former value cannot be greater than the later Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e4731ba-2565-480c-af96-f4ce67e6688a', 'ip_protocol': 'tcp', 'from_port': 1328110743, 'to_port': 22}}} Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1328110743:22. Former value cannot be greater than the later Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1328110743:22. Former value cannot be greater than the later Oct 24 09:02:30.104494 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1328110743:22. Former value cannot be greater than the later Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5279886-f7ba-427a-879e-ab50d2cd0709 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 400 to user: Invalid port range 1328110743:22. Former value cannot be greater than the later {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5279886-f7ba-427a-879e-ab50d2cd0709 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.269215 Oct 24 09:02:30.108312 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1200/2459] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:29 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:02:30.118932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7d43674-28cf-4b04-99c4-c051229ca648 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8daaf34b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-443830860", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:30.123962 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f7d43674-28cf-4b04-99c4-c051229ca648 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Security group id should be uuid Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7d43674-28cf-4b04-99c4-c051229ca648 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 130 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-443830860", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: exception: Security group id should be uuid Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-443830860', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:30.129322 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:30.133833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 24 09:02:30.133833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:30.133833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7d43674-28cf-4b04-99c4-c051229ca648 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 400 to user: Security group id should be uuid {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:30.133833 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7d43674-28cf-4b04-99c4-c051229ca648 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017284 Oct 24 09:02:30.133833 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1201/2460] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:30 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:30.157624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0d89700-0a40-43a6-8795-3aaed776349f tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8daaf34b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-33667743", "description": "tempest-description-219468812"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:30.541047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:30.558107 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-980addb1-8442-4ee2-ac9b-0348e6748481 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1318 microversion: 2.1 time: 0.641267 Oct 24 09:02:30.561561 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1260/2461] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:29 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:30.576130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:30.576852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:30.591231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:30.591888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:30.592412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:30.594200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:30.595985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:30.597518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:30.830957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:30.847389 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-995262fc-025b-4553-b566-12f57207f497 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.283301 Oct 24 09:02:30.850603 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1261/2462] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:30 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:30.871727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8b60df38-424c-4974-8dc0-8d4f20f5d66a req-a51af588-4a83-44db-a565-d1b2be93e542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e5c236-d625-4c16-ba83-f805f400ec74", "name": "network-vif-unplugged", "status": "completed", "tag": "236f2595-87f6-4629-b0b5-b05acc3a91fe"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:30.910687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8b60df38-424c-4974-8dc0-8d4f20f5d66a req-a51af588-4a83-44db-a565-d1b2be93e542 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:30.913172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8b60df38-424c-4974-8dc0-8d4f20f5d66a req-a51af588-4a83-44db-a565-d1b2be93e542 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:30.914237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8b60df38-424c-4974-8dc0-8d4f20f5d66a req-a51af588-4a83-44db-a565-d1b2be93e542 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:30.957365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8b60df38-424c-4974-8dc0-8d4f20f5d66a req-a51af588-4a83-44db-a565-d1b2be93e542 service nova] Creating event network-vif-unplugged:236f2595-87f6-4629-b0b5-b05acc3a91fe for instance 20e5c236-d625-4c16-ba83-f805f400ec74 on n-h2-master-1 Oct 24 09:02:30.973987 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8b60df38-424c-4974-8dc0-8d4f20f5d66a req-a51af588-4a83-44db-a565-d1b2be93e542 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118729 Oct 24 09:02:30.975367 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1262/2463] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:30.984867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:30.987065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:31.005260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:31.008028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:31.008746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:31.011483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:31.012385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:31.013688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:31.196170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:31.208334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aca23b54-007a-4be7-b16f-c5e7872f4501 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1266 microversion: 2.1 time: 0.231506 Oct 24 09:02:31.209057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1263/2464] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:30 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:31.602689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:31.604597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:31.623506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:31.626006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:31.627057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:31.629843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:31.632489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:31.633449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.308257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:32.326189 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09cab8ea-d0ab-41c5-afb9-0958dc5831d2 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1467 microversion: 2.1 time: 0.729773 Oct 24 09:02:32.334470 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1264/2465] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:31 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1467 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:32.375386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:32.376091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:32.395739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:32.396730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:32.401617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.402755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:32.403626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:32.404417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.428622 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0d89700-0a40-43a6-8795-3aaed776349f tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 2.289115 Oct 24 09:02:32.430162 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1202/2466] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:02:30 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:32.435319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:32.436094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:32.463361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:32.464151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:32.464914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.466030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:32.466884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:32.467763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.725191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:32.746082 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b8d22085-040a-46df-8f29-1ce36b127742 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1266 microversion: 2.1 time: 0.314640 Oct 24 09:02:32.752544 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1203/2467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:32 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:32.776810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:32.788873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:32.825035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:32.826736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:32.827193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.834214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:32.838265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:32.840730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:32.975730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lazy-loading 'flavor' on Instance uuid 9df9fec5-ffd6-4972-b801-c18783b6c19a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:33.237969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:33.246814 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ea25841-d8ff-43d1-ae01-6352d37238a9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.910902 Oct 24 09:02:33.274195 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-74700c9c-c5fc-4217-b4b5-22f71a701b33 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a/action" status: 202 len: 0 microversion: 2.1 time: 0.518546 Oct 24 09:02:33.274782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1204/2468] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:02:32 2022] POST /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:33.281763 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1265/2469] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:32 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:33.312250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-945e583f-4bb6-4730-8357-e513119b91bd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab0883a0>, body: {"security_group_rule": {"parent_group_id": "4578611a-0531-40b1-b36c-e1e5ed962cce", "ip_protocol": "tempest-999-477816160", "from_port": 22, "to_port": 22}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:33.433284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-945e583f-4bb6-4730-8357-e513119b91bd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Invalid IP protocol tempest-999-477816160. Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-945e583f-4bb6-4730-8357-e513119b91bd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 156 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: {"security_group_rule": {"parent_group_id": "4578611a-0531-40b1-b36c-e1e5ed962cce", "ip_protocol": "tempest-999-477816160", "from_port": 22, "to_port": 22}} Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid IP protocol tempest-999-477816160. Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4578611a-0531-40b1-b36c-e1e5ed962cce', 'ip_protocol': 'tempest-999-477816160', 'from_port': 22, 'to_port': 22}}} Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-477816160. Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-477816160. Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:33.435823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-477816160. Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-945e583f-4bb6-4730-8357-e513119b91bd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 400 to user: Invalid IP protocol tempest-999-477816160. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-945e583f-4bb6-4730-8357-e513119b91bd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.143801 Oct 24 09:02:33.445183 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1205/2470] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:33 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:33.449537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:33.450286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:33.463481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:33.464146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:33.464993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:33.465804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:33.466262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:33.466878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:33.651278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1849252611", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e750be1d-29b3-4a6d-a671-961ca61743ab"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:33.713612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:33.724138 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d0deae9d-7747-48b5-9208-f9d10a4906b1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1475 microversion: 2.1 time: 0.283603 Oct 24 09:02:33.725366 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1206/2471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:33 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:33.730506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c55d169b-ee07-493b-9fc9-a8ce218dfcc8 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab138670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1295873394", "description": "tempest-description-1375005610"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:33.809000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] validate_networks() for [('e750be1d-29b3-4a6d-a671-961ca61743ab', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:02:34.083079 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c55d169b-ee07-493b-9fc9-a8ce218dfcc8 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.356340 Oct 24 09:02:34.084859 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1207/2472] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:02:33 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:34.091445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:34.093152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:34.123334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:34.124323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:34.133173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:34.134051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:34.136888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:34.137412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:34.539917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:34.557926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd9e09e6-3566-406e-b9ff-abd8cc6dfffd tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.462653 Oct 24 09:02:34.558782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1208/2473] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:34 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:34.576585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27ae355a-ed30-4f21-8b1e-605c366645fd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab088160>, body: {"security_group_rule": {"parent_group_id": "7be2bbeb-c093-44db-995f-b1cdb0514182", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:34.718989 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-27ae355a-ed30-4f21-8b1e-605c366645fd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27ae355a-ed30-4f21-8b1e-605c366645fd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 138 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: {"security_group_rule": {"parent_group_id": "7be2bbeb-c093-44db-995f-b1cdb0514182", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7be2bbeb-c093-44db-995f-b1cdb0514182', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 09:02:34.721425 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 09:02:34.725116 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:34.727685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27ae355a-ed30-4f21-8b1e-605c366645fd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:34.729656 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27ae355a-ed30-4f21-8b1e-605c366645fd tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.168896 Oct 24 09:02:34.735423 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1209/2474] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:02:34.747080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:34.750829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:34.772122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:34.781257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:34.782649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:34.783565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:34.784730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:34.788702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:35.314739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:35.355965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:02:35.355965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:02:35.355965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:02:35.355965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:02:35.355965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:02:35.356726 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d79eb0fa-eb64-46ba-aa0e-3cc4c209a827 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1472 microversion: 2.1 time: 0.616022 Oct 24 09:02:35.363618 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1210/2475] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:34 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1472 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:35.380219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05e2ca1c-afaa-428f-a0a5-7189f3ca7f69 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8daafadc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-557609055", "description": "tempest-description-425155832"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:35.387831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:35.388536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:35.389123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:35.390501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:35.391155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:35.391742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:35.413844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Getting quotas for project 30dbbc2d63444107b5518dbabd023d2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:02:35.420832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Getting quotas for user ba45d4c2ea4c46aabee199ebc7e9d6f2 and project 30dbbc2d63444107b5518dbabd023d2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:02:35.435031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Going to run 3 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:02:35.438527 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:02:35.505148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=966f9941-3d19-4add-a960-7834fe8bb1b6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:02:35.581247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=255da1a7-934f-4ece-a56c-31921f9605c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:02:35.739379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1598a5dc-0af7-4207-b259-023d536a88f4 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454021 Oct 24 09:02:35.741453 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1266/2476] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:02:35.768908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:35.773641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:35.785939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:35.786487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:35.789643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:35.790489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:35.790973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:35.791415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:36.041998 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05e2ca1c-afaa-428f-a0a5-7189f3ca7f69 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.676451 Oct 24 09:02:36.042948 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1211/2477] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:02:35 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:36.047709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:36.048328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:36.069934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:36.070674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:36.072434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:36.074813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:36.076537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:36.076993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:36.444273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:36.456014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b27ed88d-c88e-475a-a113-b4af67e2f3fc tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1458 microversion: 2.1 time: 0.713038 Oct 24 09:02:36.456645 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1267/2478] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:35 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1458 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:36.474831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:36.499478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:36.501375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:02:36.600487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:36.601181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:36.601843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:36.603308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:36.604976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:36.605777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:36.651871 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:36.703059 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-500eb1c0-d8cb-433c-b87e-40ad92a64e9c tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.244678 Oct 24 09:02:36.708489 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1268/2479] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:02:36 2022] GET /compute/v2.1/servers => generated 1018 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:36.729610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d78094da-c701-432d-a286-00cf4524c3e1 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8daafcd9d0>, body: {"security_group_rule": {"parent_group_id": "6997434b-9678-47c9-bd34-d55f43ae4a86", "ip_protocol": "tcp", "from_port": 22, "to_port": 1253070812}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:36.934324 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:37.197282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:37.208743 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06cc2f26-f858-42f8-8ef6-16a3229b156a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 1.164639 Oct 24 09:02:37.221336 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1212/2480] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:36 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:37.221336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:37.243770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:37.261835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:37.262343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:37.262783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:37.263508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:37.263962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:37.264384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:37.798295 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d78094da-c701-432d-a286-00cf4524c3e1 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Invalid port range 22:1253070812. Valid TCP ports should be between 1-65535 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d78094da-c701-432d-a286-00cf4524c3e1 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 146 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: {"security_group_rule": {"parent_group_id": "6997434b-9678-47c9-bd34-d55f43ae4a86", "ip_protocol": "tcp", "from_port": 22, "to_port": 1253070812}} Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid port range 22:1253070812. Valid TCP ports should be between 1-65535 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6997434b-9678-47c9-bd34-d55f43ae4a86', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1253070812}}} Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1253070812. Valid TCP ports should be between 1-65535 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1253070812. Valid TCP ports should be between 1-65535 Oct 24 09:02:37.801510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1253070812. Valid TCP ports should be between 1-65535 Oct 24 09:02:37.806275 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:37.809412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d78094da-c701-432d-a286-00cf4524c3e1 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 400 to user: Invalid port range 22:1253070812. Valid TCP ports should be between 1-65535 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:37.810607 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d78094da-c701-432d-a286-00cf4524c3e1 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 1.092800 Oct 24 09:02:37.817103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1269/2481] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:36 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 1100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:02:37.833990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:37.835495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:37.886364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:37.886877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:37.888863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:37.891615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:37.893769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:37.894435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:37.966299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:37.970433 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:38.016028 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a32902c8-2906-46fa-829a-9da102a1d7be tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1478 microversion: 2.1 time: 0.802903 Oct 24 09:02:38.016786 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1213/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:37 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1478 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:38.068679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:38.070031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:38.094729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:38.098065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:38.098762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:38.100415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:38.101876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:38.103310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:38.436044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:38.441997 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:38.460757 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ff4388bc-5c5a-4367-9fb4-7de85c0e35f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1227 microversion: 2.1 time: 0.430208 Oct 24 09:02:38.461925 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1214/2483] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:38 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1227 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:38.491628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Action: 'create', calling method: .version_select at 0x7f8dab0d0310>, body: {"security_group_rule": {"parent_group_id": "66fca8ae-9e39-4570-8fcc-281c99163a51", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:38.579646 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:02:38.580251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Neutron security group 66fca8ae-9e39-4570-8fcc-281c99163a51 not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:02:38.580805 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.580805 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 138 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: {"security_group_rule": {"parent_group_id": "66fca8ae-9e39-4570-8fcc-281c99163a51", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: exception: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'security_group_rule': {'parent_group_id': '66fca8ae-9e39-4570-8fcc-281c99163a51', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:02:38.587830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] Oct 24 09:02:38.592436 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:38.599937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 404 to user: Security group 66fca8ae-9e39-4570-8fcc-281c99163a51 does not exist Oct 24 09:02:38.599937 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-777c33f4-50c9-43f1-80ea-2562c9e25e71'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:38.601121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a197547b-8503-45bc-a6cf-745228a1685a tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.132561 Oct 24 09:02:38.601920 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1215/2484] 10.222.0.25 () {60 vars in 1195 bytes} [Mon Oct 24 09:02:38 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:38.614216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:38.616090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:38.635073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:38.638503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:38.639585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:38.641287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:38.644469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:38.645122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.031952 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-170ff0eb-34c7-42bf-858d-9e35443ed18e tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1609 microversion: 2.1 time: 1.212120 Oct 24 09:02:39.035856 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1270/2485] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:37 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1609 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:39.062627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-03674a32-28f6-4375-98e0-736771e8fc71 req-3e36178b-939a-49ef-9150-c9b6b1b47bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deeb9a97-651f-43b5-81f0-6aad105e27fe", "tag": "2fbcdccb-a78d-4e8d-8244-01295a54bd51"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:39.099623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-03674a32-28f6-4375-98e0-736771e8fc71 req-3e36178b-939a-49ef-9150-c9b6b1b47bba service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.100116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-03674a32-28f6-4375-98e0-736771e8fc71 req-3e36178b-939a-49ef-9150-c9b6b1b47bba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.100554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-03674a32-28f6-4375-98e0-736771e8fc71 req-3e36178b-939a-49ef-9150-c9b6b1b47bba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.124308 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-03674a32-28f6-4375-98e0-736771e8fc71 req-3e36178b-939a-49ef-9150-c9b6b1b47bba service nova] Creating event network-changed:2fbcdccb-a78d-4e8d-8244-01295a54bd51 for instance deeb9a97-651f-43b5-81f0-6aad105e27fe on n-h1-master-1 Oct 24 09:02:39.130856 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-03674a32-28f6-4375-98e0-736771e8fc71 req-3e36178b-939a-49ef-9150-c9b6b1b47bba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093405 Oct 24 09:02:39.132112 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1271/2486] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:39.139297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8daafcd8b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:39.160990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:39.164676 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:02:39.165596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Neutron security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd not found {{(pid=126920) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 24 09:02:39.166584 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] HTTP exception thrown: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.166584 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Request method failure captured: Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-security-group-rules/3e8c2eec-43f6-4860-ae43-5849620a01dd HTTP/1.1 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSh989TbcLiiRnEJE3bcvTjteOIBCbmhXdt-pooKqtPcMQSotsJV4fhzSgy7OBzYlHmzZCDZwhzP559ZURVlOPK3lHa0DLCuHV-AkejlG9oQ5lFE_u059dcIS804TlOwcqk6OHXU-3E6BLxgzCKCSeQ6hRhRS_5C-vZlSNacAS6nKI Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8b23bc011414545b6ee64c17d866805"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8b23bc011414545b6ee64c17d866805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8b23bc011414545b6ee64c17d866805"}]}] Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d8b23bc011414545b6ee64c17d866805 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 28d6776b4c53419ea6a3a4260adc0d45 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-782516195-project Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: exception: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '3e8c2eec-43f6-4860-ae43-5849620a01dd'} Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:02:39.174043 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Returning 404 to user: Security group rule 3e8c2eec-43f6-4860-ae43-5849620a01dd does not exist Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-698169ef-8635-41dc-9a64-c7a66686d94c'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:39.179734 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c64bbc4b-6bac-4d9e-8e12-240acebfffec tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/3e8c2eec-43f6-4860-ae43-5849620a01dd" status: 404 len: 199 microversion: 2.1 time: 0.045528 Oct 24 09:02:39.194213 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1272/2487] 10.222.0.25 () {58 vars in 1287 bytes} [Mon Oct 24 09:02:39 2022] DELETE /compute/v2.1/os-security-group-rules/3e8c2eec-43f6-4860-ae43-5849620a01dd => generated 199 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:39.201459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d3ca8aa1-2d99-44cb-8ecf-d43f7a89ddd2 req-30e19f27-315c-4f0a-89c9-1e73d866fe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "name": "network-vif-unplugged", "status": "completed", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:39.210264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e701624-8523-4df7-a342-b3af2a6c97ef tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.607079 Oct 24 09:02:39.210925 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1216/2488] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:38 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:39.218317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:39.220011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:39.232847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.233647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.234271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.235154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.235770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.236358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.250373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d3ca8aa1-2d99-44cb-8ecf-d43f7a89ddd2 req-30e19f27-315c-4f0a-89c9-1e73d866fe7d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.250671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d3ca8aa1-2d99-44cb-8ecf-d43f7a89ddd2 req-30e19f27-315c-4f0a-89c9-1e73d866fe7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.251111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d3ca8aa1-2d99-44cb-8ecf-d43f7a89ddd2 req-30e19f27-315c-4f0a-89c9-1e73d866fe7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.290523 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d3ca8aa1-2d99-44cb-8ecf-d43f7a89ddd2 req-30e19f27-315c-4f0a-89c9-1e73d866fe7d service nova] Creating event network-vif-unplugged:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:02:39.305953 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d3ca8aa1-2d99-44cb-8ecf-d43f7a89ddd2 req-30e19f27-315c-4f0a-89c9-1e73d866fe7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114842 Oct 24 09:02:39.306569 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1273/2489] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:39.326009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:39.332231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.332735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.333176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.334006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.334463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.334891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.406981 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30c0156e-4b9f-43f5-8aae-dbeb6a0bf237 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092130 Oct 24 09:02:39.417182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1274/2490] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 09:02:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:39.425669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-867839ae-bb79-4d90-aeb3-440aea8b988b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8daadd9c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:39.897248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:39.914919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ecb302c0-459a-4b40-a603-64ee3b71f3e4 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1478 microversion: 2.1 time: 0.702623 Oct 24 09:02:39.922521 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1217/2491] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:39 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1478 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:39.935787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:39.950563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:39.976931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.977487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.977954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:39.979529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:39.979997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:39.980432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.036065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Lazy-loading 'flavor' on Instance uuid 9df9fec5-ffd6-4972-b801-c18783b6c19a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:40.061803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 9df9fec5-ffd6-4972-b801-c18783b6c19a while it is in vm_state suspended Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Request method failure captured: Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a/action HTTP/1.1 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 97 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlRx__BGYxQTU3aJR9H10USdHHK65eQvZA7kBbitITa-8cK2FC33Iw4zjAXkWyjiEBLQPwbBn2QPvOBv2rLfdGJoC8kqHSBT2ZsM6JQvdUexiCMGfDZdyCVxX0-aXPXQI7nxzsnc30659W9qLoYa29_S7SFJOXa6t-8OETMQ0lU7ktw Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: b34da25e70e54621b0409ec47faf2b0b Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationNegativeTest-134586986 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b34da25e70e54621b0409ec47faf2b0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b34da25e70e54621b0409ec47faf2b0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b34da25e70e54621b0409ec47faf2b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b34da25e70e54621b0409ec47faf2b0b"}]}] Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationNegativeTest-134586986 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: b34da25e70e54621b0409ec47faf2b0b Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-134586986 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationNegativeTest-134586986-project-admin Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: dbad87a7ad024511aa5e6668fda00328 Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationNegativeTest-134586986-project-admin Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'os-migrateLive' instance 9df9fec5-ffd6-4972-b801-c18783b6c19a while it is in vm_state suspended Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9df9fec5-ffd6-4972-b801-c18783b6c19a', 'body': {'os-migrateLive': {'host': 'n-h1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:40.065584 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 9df9fec5-ffd6-4972-b801-c18783b6c19a while it is in vm_state suspended Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 9df9fec5-ffd6-4972-b801-c18783b6c19a while it is in vm_state suspended Oct 24 09:02:40.070951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:40.079880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 9df9fec5-ffd6-4972-b801-c18783b6c19a while it is in vm_state suspended {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:40.081211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3787e7a3-0443-4397-ae07-13aa6244f805 tempest-LiveMigrationNegativeTest-134586986 tempest-LiveMigrationNegativeTest-134586986-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a/action" status: 409 len: 155 microversion: 2.1 time: 0.156944 Oct 24 09:02:40.084958 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1218/2492] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:02:39 2022] POST /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a/action => generated 155 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:02:40.093010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:40.095749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:40.115644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.121653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.123094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.124352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.125386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.126000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.294463 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-867839ae-bb79-4d90-aeb3-440aea8b988b tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/6997434b-9678-47c9-bd34-d55f43ae4a86" status: 202 len: 0 microversion: 2.1 time: 0.875973 Oct 24 09:02:40.295827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1275/2493] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:02:39 2022] DELETE /compute/v2.1/os-security-groups/6997434b-9678-47c9-bd34-d55f43ae4a86 => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:40.302613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:40.303517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:40.318102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.319177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.319975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.323452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.324172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.324606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.399920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:40.466461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:40.488153 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7be1c689-0107-402a-a7e5-e2943c86e7ef tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1219 microversion: 2.1 time: 0.400645 Oct 24 09:02:40.492580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1219/2494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:40 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:40.505074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:40.506853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:40.542085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.543411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.544835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.546435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.547792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.550254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.635719 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-debc16ae-1ea2-4e57-929f-3050375946c7 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 204 len: 0 microversion: 2.1 time: 0.329113 Oct 24 09:02:40.643697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1276/2495] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:40 2022] DELETE /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:40.658423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c3918e1-9a26-46db-982d-d09272a9aace tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8daae000d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:40.923960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:40.939897 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b956bcc4-7472-43c7-a3b1-fdbbe1130d11 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.446072 Oct 24 09:02:40.941515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1220/2496] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:40 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:40.955233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:40.962540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:40.984001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.984576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.991636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:40.992427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:40.992911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:40.993477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:41.397984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:41.421754 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-80a846de-d483-43f1-92b7-cb8974810e3d tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1464 microversion: 2.1 time: 0.465235 Oct 24 09:02:41.424536 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1221/2497] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:40 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1464 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:41.433352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:41.438304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:41.477458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:41.480019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:41.481420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:41.485667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:41.486668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:41.488437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:41.539893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c3918e1-9a26-46db-982d-d09272a9aace tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7be2bbeb-c093-44db-995f-b1cdb0514182" status: 202 len: 0 microversion: 2.1 time: 0.892588 Oct 24 09:02:41.541693 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1277/2498] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:02:40 2022] DELETE /compute/v2.1/os-security-groups/7be2bbeb-c093-44db-995f-b1cdb0514182 => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:41.549147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:41.551368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:41.585385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:41.589720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:41.590762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:41.593504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:41.600204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:41.601054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:41.833933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:41.842809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:41.857146 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a858535-10ac-4416-ab24-aca3e27caad7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1463 microversion: 2.1 time: 0.429341 Oct 24 09:02:41.864626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1222/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:41 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:41.865074 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3e40a15-efa2-4e4e-bdc4-80d1885a47a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1219 microversion: 2.1 time: 0.317707 Oct 24 09:02:41.866986 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1278/2500] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:41 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1219 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:41.879329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bf5747c8-2677-4711-8bb5-ac0419fa0740 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8dab488a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:41.897360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:41.905517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:41.920943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:41.921681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:41.922565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:41.923671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:41.924439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:41.925154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:42.161493 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0109b129-ee32-4c44-8ec7-6dfc08166df3 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.269700 Oct 24 09:02:42.164268 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1279/2501] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:02:41 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:42.177581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:42.190586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:42.217659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:42.221069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:42.222805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:42.225757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:42.228092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:42.231150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:42.483199 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bf5747c8-2677-4711-8bb5-ac0419fa0740 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4578611a-0531-40b1-b36c-e1e5ed962cce" status: 202 len: 0 microversion: 2.1 time: 0.613349 Oct 24 09:02:42.489553 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1223/2502] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:02:41 2022] DELETE /compute/v2.1/os-security-groups/4578611a-0531-40b1-b36c-e1e5ed962cce => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:42.498271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:42.530597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:42.604781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:42.625033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:42.629595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:42.632484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:42.634873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:42.635607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:42.782054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:42.784064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:42.786921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:42.787940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lazy-loading 'fault' on Instance uuid 1ff77d2e-5b67-4660-b896-24a8716d0a8d {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:43.572777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:43.586642 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c1d3842-3bf4-4752-94b8-d2d225e036f5 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 1.417476 Oct 24 09:02:43.589909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1280/2503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:42 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:43.592303 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f2a86cb-81ee-4a8e-962e-0821f7949004 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1597 microversion: 2.1 time: 1.099693 Oct 24 09:02:43.593984 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1224/2504] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:42 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1597 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:43.599271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82c95d1c-daed-48fc-b3a3-13e67b320519 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8dab138790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:43.607091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:43.607753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:43.625445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:43.625773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:43.626469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:43.628545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:43.629177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:43.629810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.120295 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82c95d1c-daed-48fc-b3a3-13e67b320519 tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2e4731ba-2565-480c-af96-f4ce67e6688a" status: 202 len: 0 microversion: 2.1 time: 0.524284 Oct 24 09:02:44.121094 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1225/2505] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:02:43 2022] DELETE /compute/v2.1/os-security-groups/2e4731ba-2565-480c-af96-f4ce67e6688a => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:44.133473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:44.137805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:44.154027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.154516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.159812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.161140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.161796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.172249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.338197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:44.348615 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c45d2c0-70db-4706-a3d6-27255bd9b0d3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1275 microversion: 2.1 time: 0.225978 Oct 24 09:02:44.366197 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1226/2506] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:44 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:44.372888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f5ad92b6-9b0a-4b4b-888b-fd3aafcd0dbf req-259190a9-927f-44c5-8729-be4f1748af15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "name": "network-vif-plugged", "status": "completed", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:44.404597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f5ad92b6-9b0a-4b4b-888b-fd3aafcd0dbf req-259190a9-927f-44c5-8729-be4f1748af15 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.405700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f5ad92b6-9b0a-4b4b-888b-fd3aafcd0dbf req-259190a9-927f-44c5-8729-be4f1748af15 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.407671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f5ad92b6-9b0a-4b4b-888b-fd3aafcd0dbf req-259190a9-927f-44c5-8729-be4f1748af15 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.441872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f5ad92b6-9b0a-4b4b-888b-fd3aafcd0dbf req-259190a9-927f-44c5-8729-be4f1748af15 service nova] Creating event network-vif-plugged:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:02:44.452047 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f5ad92b6-9b0a-4b4b-888b-fd3aafcd0dbf req-259190a9-927f-44c5-8729-be4f1748af15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082301 Oct 24 09:02:44.461730 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1227/2507] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:44.475897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:44.479603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:44.515899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.517874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.520087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.522094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.524087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.528844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.715826 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08bbb3b0-3d04-409d-b3d1-1c24dafa50e9 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.252158 Oct 24 09:02:44.721560 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1228/2508] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:02:44 2022] POST /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:44.731835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11b06726-b7b5-4545-ab7a-2e66c9a6d7ce tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] Calling method '.version_select at 0x7f8dab8201f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:44.796317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:44.827520 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31dc6879-182d-4391-8876-9fb676b0e2b6 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 200 len: 1464 microversion: 2.1 time: 1.235928 Oct 24 09:02:44.829170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1281/2509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:43 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 1464 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:44.836251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:44.837422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:44.872729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.873761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.874805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:44.876304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:44.877002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:44.878637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:45.430190 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:45.507715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:45.519250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f1c4fda-f029-4169-9b8e-fe404117c1a3 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.688370 Oct 24 09:02:45.531100 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1282/2510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:44 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:45.559939 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:45.562822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:45.589281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:45.594037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:45.595504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:45.598934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:45.600069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:45.600516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.208762 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb42238d-331d-4ae3-96de-8fc49bb71bf6 tempest-ServersAdminTestJSON-2142867512 tempest-ServersAdminTestJSON-2142867512-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1614 microversion: 2.1 time: 0.663981 Oct 24 09:02:46.221788 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1283/2511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:45 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1614 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:46.233249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:46.234266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:46.241052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.241982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.242648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.243609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.244361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.245061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.367515 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11b06726-b7b5-4545-ab7a-2e66c9a6d7ce tempest-SecurityGroupRulesNegativeTestJSON-782516195 tempest-SecurityGroupRulesNegativeTestJSON-782516195-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f36ea4cd-0ccf-42c5-9187-bbe957c8f120" status: 202 len: 0 microversion: 2.1 time: 1.647168 Oct 24 09:02:46.372661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1229/2512] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:02:44 2022] DELETE /compute/v2.1/os-security-groups/f36ea4cd-0ccf-42c5-9187-bbe957c8f120 => generated 0 bytes in 1653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:02:46.380387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-15cc9b37-78d9-46a1-9c93-806142439143 req-6827cc1a-392c-44fa-a786-7084d3078a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df9fec5-ffd6-4972-b801-c18783b6c19a", "name": "network-vif-deleted", "tag": "92f21969-18f6-4d4f-a14e-924612f203e8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:46.419183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-15cc9b37-78d9-46a1-9c93-806142439143 req-6827cc1a-392c-44fa-a786-7084d3078a03 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.419771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-15cc9b37-78d9-46a1-9c93-806142439143 req-6827cc1a-392c-44fa-a786-7084d3078a03 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.420223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-15cc9b37-78d9-46a1-9c93-806142439143 req-6827cc1a-392c-44fa-a786-7084d3078a03 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.454100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-15cc9b37-78d9-46a1-9c93-806142439143 req-6827cc1a-392c-44fa-a786-7084d3078a03 service nova] Creating event network-vif-deleted:92f21969-18f6-4d4f-a14e-924612f203e8 for instance 9df9fec5-ffd6-4972-b801-c18783b6c19a on n-h2-master-1 Oct 24 09:02:46.466626 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-15cc9b37-78d9-46a1-9c93-806142439143 req-6827cc1a-392c-44fa-a786-7084d3078a03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091959 Oct 24 09:02:46.467736 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1230/2513] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:46.474067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:46.475398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 9df9fec5-ffd6-4972-b801-c18783b6c19a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:46.484529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.485450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.486196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.487725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.488601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.489394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.508254 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] HTTP exception thrown: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a could not be found. Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Request method failure captured: Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a HTTP/1.1 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlRwItXOv58oKzHBklrT6aEQ8o5rfkwchjuuf7n6fmRdZr7tki7n19ACC0yVMnwcWXmfXDJZC5_q_X2TUwXdUUbvC2ftJKZZtWxACUyhvASzPiQxHkemYB1u9DEf4f56MADpeWiWSvcNfL3LEokD8WsKK4PkCH5XHT5SgRuMdoqrIaY Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 33ae68ba2a584665992f3856fab416a5 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationNegativeTest-1520986018 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33ae68ba2a584665992f3856fab416a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33ae68ba2a584665992f3856fab416a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33ae68ba2a584665992f3856fab416a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33ae68ba2a584665992f3856fab416a5"}]}] Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationNegativeTest-1520986018 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 33ae68ba2a584665992f3856fab416a5 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1520986018 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationNegativeTest-1520986018-project Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0ba0cbf327634abdb5a1be7d2ee31e30 Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationNegativeTest-1520986018-project Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a could not be found. Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9df9fec5-ffd6-4972-b801-c18783b6c19a'} Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a could not be found. Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a could not be found. Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:46.510651 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a could not be found. Oct 24 09:02:46.515387 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:46.516659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:46.520008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Returning 404 to user: Instance 9df9fec5-ffd6-4972-b801-c18783b6c19a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:46.521169 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c90521b9-a53f-48ff-b1a4-bceb86a0cf68 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a" status: 404 len: 111 microversion: 2.1 time: 0.052296 Oct 24 09:02:46.522607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1231/2514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:46 2022] GET /compute/v2.1/servers/9df9fec5-ffd6-4972-b801-c18783b6c19a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:46.528567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:46.529749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:46.530238 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ea1a2838-c9e4-4902-955d-da3e37b4c179 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1281 microversion: 2.1 time: 0.307200 Oct 24 09:02:46.546578 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1284/2515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:46 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:46.546578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:46.546578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:46.559141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.559141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.559604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.559935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.560352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.560735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.562332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.562472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.563605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.564136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.564703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.565030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.596962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:46.614412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:46.665848 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:46.706366 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d0c8a4e-d3bd-43e3-9fbb-1498c589841b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 204 len: 0 microversion: 2.1 time: 0.182006 Oct 24 09:02:46.707759 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1232/2516] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:46 2022] DELETE /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:46.721354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:46.723421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:46.734401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.735471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.736477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.739403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.740596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.741318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.822603 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-465ee25f-312e-4fbd-baf4-53cba3332407 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 204 len: 0 microversion: 2.1 time: 0.289766 Oct 24 09:02:46.823549 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1285/2517] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:46 2022] DELETE /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:46.831241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:46.832140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:46.840350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.842025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.842976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.844054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:46.845421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:46.846346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:46.871930 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:47.075179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:47.086914 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b13892d-8c70-4318-885a-75da8998be3b tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1467 microversion: 2.1 time: 0.260088 Oct 24 09:02:47.088281 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1286/2518] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:46 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1467 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:47.093786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:47.094672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:47.103610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:47.104339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:47.105126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:47.106061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:47.106714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:47.107384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:47.273622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:47.283594 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-010bbdae-cfe3-40fd-8a48-6287544f830c tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1475 microversion: 2.1 time: 0.193837 Oct 24 09:02:47.284927 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1287/2519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:47 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1475 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:47.335306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:47.343279 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15f03894-44c9-4755-b9b8-c1571b2b8e83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.630018 Oct 24 09:02:47.353193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1233/2520] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:46 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:47.562952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:47.564143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:47.567238 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:47.575916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:47.576744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:47.577450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:47.578542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:47.579866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:47.580651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:47.728116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:47.751795 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5bc3eb2-ad1b-4fc3-9b55-3b5c7db5d74d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1281 microversion: 2.1 time: 0.193098 Oct 24 09:02:47.752578 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1288/2521] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:47 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:48.117252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:48.117901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:48.130961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:48.131548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:48.132095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:48.132883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:48.133489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:48.133976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:48.307385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:48.308009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:48.322383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:48.324657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:48.325196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:48.331621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:48.332121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:48.332562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:48.906821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:48.921990 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3a4ad99-028e-4a8a-8427-b7c17cfdddc5 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1475 microversion: 2.1 time: 0.618291 Oct 24 09:02:48.922608 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1289/2522] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:48 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1475 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:48.937129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:48.937813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:48.947149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:48.947753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:48.948244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:48.948948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:48.949831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:48.950423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:48.960111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:48.974834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-210c1f8f-df3b-40c1-bbcd-e7fd2590976e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1467 microversion: 2.1 time: 0.860991 Oct 24 09:02:48.975706 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1234/2523] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:48 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1467 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:48.986939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-61441522-a81f-4ca2-b3f7-2597bfd91fff req-87286d11-9265-4a75-82de-4bb5cc0c785a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "255da1a7-934f-4ece-a56c-31921f9605c4", "tag": "5ed10a17-ef1d-4b63-899f-1b0af437546e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:49.008176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-61441522-a81f-4ca2-b3f7-2597bfd91fff req-87286d11-9265-4a75-82de-4bb5cc0c785a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:49.011706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-61441522-a81f-4ca2-b3f7-2597bfd91fff req-87286d11-9265-4a75-82de-4bb5cc0c785a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:49.014396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-61441522-a81f-4ca2-b3f7-2597bfd91fff req-87286d11-9265-4a75-82de-4bb5cc0c785a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:49.036759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-61441522-a81f-4ca2-b3f7-2597bfd91fff req-87286d11-9265-4a75-82de-4bb5cc0c785a service nova] Creating event network-changed:5ed10a17-ef1d-4b63-899f-1b0af437546e for instance 255da1a7-934f-4ece-a56c-31921f9605c4 on n-h2-master-1 Oct 24 09:02:49.041933 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-61441522-a81f-4ca2-b3f7-2597bfd91fff req-87286d11-9265-4a75-82de-4bb5cc0c785a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064161 Oct 24 09:02:49.043169 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1235/2524] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:49.048826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:49.050416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:49.058598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:49.060258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:49.060910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:49.061855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:49.063230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:49.064738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:49.256784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:49.266255 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0889bdb8-fd26-4fa4-92ec-229ab4938d85 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1281 microversion: 2.1 time: 0.221668 Oct 24 09:02:49.269008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1236/2525] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:49 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:49.367337 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:49.902066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:49.916277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8f0a19e-84e4-4a62-86f6-bba004c2f1f2 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.992598 Oct 24 09:02:49.916864 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1290/2526] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:48 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:49.953113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:49.955076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:49.960801 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:49.995375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:49.996719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.001723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.003751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:50.004296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.004512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:50.005157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.006018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.015630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.016138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.016582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.017331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.017783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.018211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.248396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:50.276158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b411bfa-1b5b-477d-90a9-e15489dc4360 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1433 microversion: 2.1 time: 0.323797 Oct 24 09:02:50.279060 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1237/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:49 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1433 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:50.303997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:50.308200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:50.330630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.332150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.332846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.337720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.339040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.339712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.387217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:50.401573 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef9f23c9-d64a-4b5e-bd74-7a44b25f9d28 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1467 microversion: 2.1 time: 0.399633 Oct 24 09:02:50.402878 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1291/2528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:49 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1467 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:50.951816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:50.952446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:50.989501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.990011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.990451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:50.994911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:50.995425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:50.995870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:51.736887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:51.768420 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25111bd9-e5a0-459c-bde0-8899dbda6c51 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 1.476753 Oct 24 09:02:51.785824 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1238/2529] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:50 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:51.804484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3fc6f554-4f3c-423e-90d2-cf43e6ff0b96 req-abf452ec-dcaf-4532-978c-e0c15180618b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b29b7f4-9358-4af1-b178-e162afc66477", "name": "network-vif-deleted", "tag": "fd188331-4d68-4f31-a4df-94ad724052d6"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:51.838582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3fc6f554-4f3c-423e-90d2-cf43e6ff0b96 req-abf452ec-dcaf-4532-978c-e0c15180618b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:51.840858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3fc6f554-4f3c-423e-90d2-cf43e6ff0b96 req-abf452ec-dcaf-4532-978c-e0c15180618b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:51.841500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3fc6f554-4f3c-423e-90d2-cf43e6ff0b96 req-abf452ec-dcaf-4532-978c-e0c15180618b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:51.866836 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3fc6f554-4f3c-423e-90d2-cf43e6ff0b96 req-abf452ec-dcaf-4532-978c-e0c15180618b service nova] Creating event network-vif-deleted:fd188331-4d68-4f31-a4df-94ad724052d6 for instance 1b29b7f4-9358-4af1-b178-e162afc66477 on n-h2-master-1 Oct 24 09:02:51.884008 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3fc6f554-4f3c-423e-90d2-cf43e6ff0b96 req-abf452ec-dcaf-4532-978c-e0c15180618b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095823 Oct 24 09:02:51.887450 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1239/2530] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:51.902309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:51.902905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:51.942828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:51.943512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:51.948236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:51.949003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:51.949501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:51.949926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:51.982013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:52.006359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2651cc18-b5f2-4b94-82f5-c23813086e46 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 1.066877 Oct 24 09:02:52.007981 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1292/2531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:50 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:52.026778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:52.029109 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:52.064549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.065023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.066023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.066727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.067396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.067850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lazy-loading 'fault' on Instance uuid 1b29b7f4-9358-4af1-b178-e162afc66477 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:52.068283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.071389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.073197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.075039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.250257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba0cbf327634abdb5a1be7d2ee31e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ae68ba2a584665992f3856fab416a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:52.258106 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de359bdb-b9f4-4c79-8565-72960821768e tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 200 len: 1309 microversion: 2.1 time: 0.369262 Oct 24 09:02:52.275340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1240/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:51 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:52.280311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-32ea9c65-5c20-4d02-8bb0-2499d4192c30 req-bb378719-667a-49d3-ba8a-d359cffba29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deeb9a97-651f-43b5-81f0-6aad105e27fe", "name": "network-vif-plugged", "status": "completed", "tag": "2fbcdccb-a78d-4e8d-8244-01295a54bd51"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:52.306894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-32ea9c65-5c20-4d02-8bb0-2499d4192c30 req-bb378719-667a-49d3-ba8a-d359cffba29d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.311702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-32ea9c65-5c20-4d02-8bb0-2499d4192c30 req-bb378719-667a-49d3-ba8a-d359cffba29d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.312420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-32ea9c65-5c20-4d02-8bb0-2499d4192c30 req-bb378719-667a-49d3-ba8a-d359cffba29d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.326905 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-32ea9c65-5c20-4d02-8bb0-2499d4192c30 req-bb378719-667a-49d3-ba8a-d359cffba29d service nova] Creating event network-vif-plugged:2fbcdccb-a78d-4e8d-8244-01295a54bd51 for instance deeb9a97-651f-43b5-81f0-6aad105e27fe on n-h1-master-1 Oct 24 09:02:52.333731 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-32ea9c65-5c20-4d02-8bb0-2499d4192c30 req-bb378719-667a-49d3-ba8a-d359cffba29d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056715 Oct 24 09:02:52.335587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1241/2533] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:52.608716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3db79b42-c83d-434a-b545-534ffc7f7206 req-bc7f214d-bb02-4aa4-a4e3-1cea29ec86ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a529fec-ad62-454b-abf3-10314e46fa99", "name": "network-vif-deleted", "tag": "39124742-b06d-4f0a-8184-6ebc6d71c4a0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:52.639993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3db79b42-c83d-434a-b545-534ffc7f7206 req-bc7f214d-bb02-4aa4-a4e3-1cea29ec86ac service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.640851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3db79b42-c83d-434a-b545-534ffc7f7206 req-bc7f214d-bb02-4aa4-a4e3-1cea29ec86ac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.641484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3db79b42-c83d-434a-b545-534ffc7f7206 req-bc7f214d-bb02-4aa4-a4e3-1cea29ec86ac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.657092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3db79b42-c83d-434a-b545-534ffc7f7206 req-bc7f214d-bb02-4aa4-a4e3-1cea29ec86ac service nova] Creating event network-vif-deleted:39124742-b06d-4f0a-8184-6ebc6d71c4a0 for instance 7a529fec-ad62-454b-abf3-10314e46fa99 on n-h1-master-1 Oct 24 09:02:52.665853 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3db79b42-c83d-434a-b545-534ffc7f7206 req-bc7f214d-bb02-4aa4-a4e3-1cea29ec86ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073329 Oct 24 09:02:52.666948 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1242/2534] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:02:52.796321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:52.797138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:52.810217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.811097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.812502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.813581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:52.815026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:52.816415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:52.917768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:52.931819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1236884-23f0-4083-8872-b3a3ec1671ae tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1467 microversion: 2.1 time: 0.922474 Oct 24 09:02:52.934785 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1293/2535] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:52 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1467 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:53.030156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:53.031123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:53.047280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:53.048042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:53.048349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:53.049082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:53.049931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:53.051684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:53.596997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:53.613212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3df695e-a20b-406c-8150-8fc4ee6582a6 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.823421 Oct 24 09:02:53.618402 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1243/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:52 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:53.627382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:53.631876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] [instance: 1b29b7f4-9358-4af1-b178-e162afc66477] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:53.651181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:53.652250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:53.652877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:53.653807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:53.654422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:53.655005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:53.662256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:53.678424 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd18a84b-f0f8-4d2f-93b2-4c5046c70ad4 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1308 microversion: 2.1 time: 0.651809 Oct 24 09:02:53.679638 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1294/2537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:53 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1308 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:53.700259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] HTTP exception thrown: Instance 1b29b7f4-9358-4af1-b178-e162afc66477 could not be found. Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Request method failure captured: Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 HTTP/1.1 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlRwItXOv58oKzHBklrT6aEQ8o5rfkwchjuuf7n6fmRdZr7tki7n19ACC0yVMnwcWXmfXDJZC5_q_X2TUwXdUUbvC2ftJKZZtWxACUyhvASzPiQxHkemYB1u9DEf4f56MADpeWiWSvcNfL3LEokD8WsKK4PkCH5XHT5SgRuMdoqrIaY Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 33ae68ba2a584665992f3856fab416a5 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-LiveMigrationNegativeTest-1520986018 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33ae68ba2a584665992f3856fab416a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33ae68ba2a584665992f3856fab416a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33ae68ba2a584665992f3856fab416a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33ae68ba2a584665992f3856fab416a5"}]}] Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-LiveMigrationNegativeTest-1520986018 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 33ae68ba2a584665992f3856fab416a5 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1520986018 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-LiveMigrationNegativeTest-1520986018-project Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0ba0cbf327634abdb5a1be7d2ee31e30 Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-LiveMigrationNegativeTest-1520986018-project Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1b29b7f4-9358-4af1-b178-e162afc66477 could not be found. Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1b29b7f4-9358-4af1-b178-e162afc66477'} Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b29b7f4-9358-4af1-b178-e162afc66477 could not be found. Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b29b7f4-9358-4af1-b178-e162afc66477 could not be found. Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:53.701991 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b29b7f4-9358-4af1-b178-e162afc66477 could not be found. Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] Returning 404 to user: Instance 1b29b7f4-9358-4af1-b178-e162afc66477 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:53.707487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65fd4c1c-9d89-40ec-b7aa-217dfb15dea1 tempest-LiveMigrationNegativeTest-1520986018 tempest-LiveMigrationNegativeTest-1520986018-project] 10.222.0.25 "GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477" status: 404 len: 111 microversion: 2.1 time: 0.083815 Oct 24 09:02:53.709121 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1244/2538] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:53 2022] GET /compute/v2.1/servers/1b29b7f4-9358-4af1-b178-e162afc66477 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:53.959852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:53.960848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:53.978034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:53.980872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:53.981352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:53.989219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:53.989786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:53.990229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:54.082788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:54.083475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:54.086358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:54.086956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lazy-loading 'fault' on Instance uuid 7a529fec-ad62-454b-abf3-10314e46fa99 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:02:54.269153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:54.284386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-521e773b-12d1-4473-863a-6bda16eb3953 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 200 len: 1302 microversion: 2.1 time: 0.329675 Oct 24 09:02:54.285359 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1295/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:53 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 1302 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:54.646335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:54.647062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:54.660828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:54.661531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:54.663318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:54.667551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:54.668213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:54.668811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:54.709451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:54.711887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:54.729734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:54.732705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:54.738405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:54.740614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:54.742405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:54.744641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.107600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:55.122837 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf90bfec-da30-40ae-8cfd-25ea65a38e35 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1487 microversion: 2.1 time: 0.419671 Oct 24 09:02:55.123746 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1296/2540] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:54 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1487 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:55.134086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-61db7d03-61f0-4256-a1b7-2a178a6e2e70 req-7a814a26-c748-473e-9405-40be6e5e7ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966f9941-3d19-4add-a960-7834fe8bb1b6", "tag": "023bef8e-6501-491a-846f-dabc23369379"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:55.185005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-61db7d03-61f0-4256-a1b7-2a178a6e2e70 req-7a814a26-c748-473e-9405-40be6e5e7ef6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.185535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-61db7d03-61f0-4256-a1b7-2a178a6e2e70 req-7a814a26-c748-473e-9405-40be6e5e7ef6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.187376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-61db7d03-61f0-4256-a1b7-2a178a6e2e70 req-7a814a26-c748-473e-9405-40be6e5e7ef6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.225959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-61db7d03-61f0-4256-a1b7-2a178a6e2e70 req-7a814a26-c748-473e-9405-40be6e5e7ef6 service nova] Creating event network-changed:023bef8e-6501-491a-846f-dabc23369379 for instance 966f9941-3d19-4add-a960-7834fe8bb1b6 on n-h1-master-1 Oct 24 09:02:55.232355 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-61db7d03-61f0-4256-a1b7-2a178a6e2e70 req-7a814a26-c748-473e-9405-40be6e5e7ef6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106375 Oct 24 09:02:55.237395 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1297/2541] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:55.242710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:55.248440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:55.262472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.263226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.265030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.265988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.266455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.266921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.335883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:55.604918 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a590a862-6ddf-434a-a72c-6711c933490c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 204 len: 0 microversion: 2.1 time: 0.366018 Oct 24 09:02:55.607011 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1298/2542] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:55 2022] DELETE /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:55.613857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:55.615544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 7a529fec-ad62-454b-abf3-10314e46fa99] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:55.624450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.625864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.626653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.628067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.629556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.630174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.665121 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] HTTP exception thrown: Instance 7a529fec-ad62-454b-abf3-10314e46fa99 could not be found. Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Request method failure captured: Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 HTTP/1.1 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlQu9jdUBhYpPYFBo6PEIyACXaB2ZSH7aiEKcCltwL8ql6aNfv8pHIjKMFVZM5P62i0VWvUD4X7zXg6x5kGCTg_N0qYAjSok0EEAdLQG3KZp9TUACrcoJcRns9WQN_-Hlhv3Mgsc0MIAeNx_otk4s8yQTiJcP4ky0aVAh6z4YfmDZDI Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 72bbfc5e1e574b689ef044341663b776 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminTestJSON-876361295 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72bbfc5e1e574b689ef044341663b776"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72bbfc5e1e574b689ef044341663b776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72bbfc5e1e574b689ef044341663b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72bbfc5e1e574b689ef044341663b776"}]}] Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminTestJSON-876361295 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 72bbfc5e1e574b689ef044341663b776 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminTestJSON-876361295 Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminTestJSON-876361295-project Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0fd6766aed02437eb254480dba23f9db Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminTestJSON-876361295-project Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 7a529fec-ad62-454b-abf3-10314e46fa99 could not be found. Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7a529fec-ad62-454b-abf3-10314e46fa99'} Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a529fec-ad62-454b-abf3-10314e46fa99 could not be found. Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a529fec-ad62-454b-abf3-10314e46fa99 could not be found. Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:02:55.672113 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a529fec-ad62-454b-abf3-10314e46fa99 could not be found. Oct 24 09:02:55.676651 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:02:55.678634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Returning 404 to user: Instance 7a529fec-ad62-454b-abf3-10314e46fa99 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:02:55.681646 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0a6658e-c617-487a-a403-3020fb39b6c7 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99" status: 404 len: 111 microversion: 2.1 time: 0.072536 Oct 24 09:02:55.683904 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1299/2543] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:55 2022] GET /compute/v2.1/servers/7a529fec-ad62-454b-abf3-10314e46fa99 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:55.697052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:55.698419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:55.706270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.715395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.720076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.721102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.722161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:55.722840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:55.954710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:55.965616 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4fa17ffd-8ecb-46bf-9d30-0fb6c3468518 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 1.325019 Oct 24 09:02:55.979103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1245/2544] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:54 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:55.987506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:55.987506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:55.995907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:55.996443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:55.998435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:56.000862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:56.001952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:56.003183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:56.003810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:56.012781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7aff374e-aa0e-4793-8e21-ce1e828fad83 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1493 microversion: 2.1 time: 0.325298 Oct 24 09:02:56.014417 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1300/2545] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:55 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1493 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:56.039099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:02:56.160557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab1dae8c-6c95-4fd7-876e-1d627b278fd5 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 204 len: 0 microversion: 2.1 time: 0.190238 Oct 24 09:02:56.161707 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1246/2546] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:02:55 2022] DELETE /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:02:56.170337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:56.170979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:56.183123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:56.184488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:56.187454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:56.188886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:56.189580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:56.192209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:56.464381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:56.466128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:56.489115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:56.491143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:56.492171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:56.494431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:56.496748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:56.497433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.032217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:57.063266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:57.064785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:57.074522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:57.075366 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-10e6b588-597d-469d-b413-e561d8916b67 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1468 microversion: 2.1 time: 0.909519 Oct 24 09:02:57.092916 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1301/2547] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:56 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1468 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:57.092916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:57.092916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:57.106184 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b963e87c-850e-4c58-bbd0-e1a36f09a9ec tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2951 microversion: 2.42 time: 0.653255 Oct 24 09:02:57.108223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.109417 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1247/2548] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:02:56 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2951 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:57.110104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.111504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.112375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.113513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.114050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.127868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:57.128760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:57.136270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.137007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.141897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.154087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.154590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.155043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.160561 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:57.811957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:57.829097 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a74987b-eb9c-4b7d-8977-58f42b9c01d9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.745323 Oct 24 09:02:57.832792 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1302/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:57 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:57.851632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:57.853224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:57.853753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:57.871283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-850870cb-e0a6-4af9-8568-9ebb77d15def tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1493 microversion: 2.1 time: 0.760265 Oct 24 09:02:57.880461 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1248/2550] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:57 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1493 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:57.881133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.882252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.882707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.884198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.884664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.887314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.891780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5a1c0747-3233-44ac-bf55-22167d269d2a req-3d3ee8b9-fe5e-4db6-a1bd-5c3fdf0aef24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42a681f-a7b8-4cad-9ab9-d7a75568a4e3", "tag": "7ba514f5-ce98-464e-b31f-7ec2425642e9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:57.929146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5a1c0747-3233-44ac-bf55-22167d269d2a req-3d3ee8b9-fe5e-4db6-a1bd-5c3fdf0aef24 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:57.930421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5a1c0747-3233-44ac-bf55-22167d269d2a req-3d3ee8b9-fe5e-4db6-a1bd-5c3fdf0aef24 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:57.935282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5a1c0747-3233-44ac-bf55-22167d269d2a req-3d3ee8b9-fe5e-4db6-a1bd-5c3fdf0aef24 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:57.957428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5a1c0747-3233-44ac-bf55-22167d269d2a req-3d3ee8b9-fe5e-4db6-a1bd-5c3fdf0aef24 service nova] Creating event network-changed:7ba514f5-ce98-464e-b31f-7ec2425642e9 for instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 on n-h1-master-1 Oct 24 09:02:57.982096 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5a1c0747-3233-44ac-bf55-22167d269d2a req-3d3ee8b9-fe5e-4db6-a1bd-5c3fdf0aef24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098729 Oct 24 09:02:57.984116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1249/2551] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:58.000443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8f213833-9ba3-46df-b715-892acd6579ab req-ad0444df-f278-4e75-b4df-7999dfe1ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255da1a7-934f-4ece-a56c-31921f9605c4", "name": "network-vif-plugged", "status": "completed", "tag": "5ed10a17-ef1d-4b63-899f-1b0af437546e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:02:58.015049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8f213833-9ba3-46df-b715-892acd6579ab req-ad0444df-f278-4e75-b4df-7999dfe1ae98 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.015934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8f213833-9ba3-46df-b715-892acd6579ab req-ad0444df-f278-4e75-b4df-7999dfe1ae98 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.016941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8f213833-9ba3-46df-b715-892acd6579ab req-ad0444df-f278-4e75-b4df-7999dfe1ae98 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.041378 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8f213833-9ba3-46df-b715-892acd6579ab req-ad0444df-f278-4e75-b4df-7999dfe1ae98 service nova] Creating event network-vif-plugged:5ed10a17-ef1d-4b63-899f-1b0af437546e for instance 255da1a7-934f-4ece-a56c-31921f9605c4 on n-h2-master-1 Oct 24 09:02:58.051240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8f213833-9ba3-46df-b715-892acd6579ab req-ad0444df-f278-4e75-b4df-7999dfe1ae98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064089 Oct 24 09:02:58.053623 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1250/2552] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:02:58.104658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:58.105904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:58.151853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.155309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.156227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.157558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.158279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.158902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.483262 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcbdbeac-5e66-49eb-a50a-5c0a4e4549ea tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.647174 Oct 24 09:02:58.494818 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1303/2553] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 09:02:57 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5/os-interface => generated 1832 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:02:58.577052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:58.597016 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53543d75-0e6d-4533-8536-7c5808ba0e17 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1468 microversion: 2.1 time: 0.493273 Oct 24 09:02:58.598041 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1251/2554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:58 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1468 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:58.859732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:58.860759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:58.872191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.875663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.878181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.879289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.880852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.883224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.910833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:58.911932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:58.958715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.961430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.962560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.967763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:58.969528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:58.970199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:58.983448 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:59.225497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:59.236866 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f850a641-0936-4062-b516-e29874864d01 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1493 microversion: 2.1 time: 0.332391 Oct 24 09:02:59.241938 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1252/2555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:58 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1493 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:02:59.274005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:02:59.287682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31925757-0362-4e5a-aa5e-f9e7759271c9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.432147 Oct 24 09:02:59.289078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1304/2556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:58 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:02:59.646462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:02:59.646462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:02:59.655092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:59.655855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:59.657352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:02:59.658439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:02:59.659739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:02:59.660383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:00.270229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:00.271582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:00.286559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:00.288861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:00.289551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:00.291994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:00.293998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:00.295058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:00.353972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:00.364046 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6c5c2c6-145a-4ed9-a907-c2848060ca3e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1468 microversion: 2.1 time: 0.733083 Oct 24 09:03:00.374944 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1253/2557] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:02:59 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1468 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:00.883757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1554455288", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:00.986392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] validate_networks() for [('65b21b22-ec29-4a51-8372-119e9b9fb46e', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:01.029762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:01.040789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-738bdd69-06e8-48a7-afb4-8318989df13b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1493 microversion: 2.1 time: 0.775707 Oct 24 09:03:01.047295 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1305/2558] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:00 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1493 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:01.069125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:01.078796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:01.102525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:01.105145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:01.107320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:01.108290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:01.109686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:01.113393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:01.739455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:01.752478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40fe5bd1-b6c4-42dc-bb57-05a1640584fc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.702717 Oct 24 09:03:01.755556 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1306/2559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:01 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:02.158613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-444122119", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:02.269472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:02.652649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:02.653275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:02.653734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:02.653946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:02.654510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:02.672326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:02.675719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:02.676433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:02.678330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:02.679029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:02.679675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:02.702388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Getting quotas for project 18d52fd8cbf748b881b4cd6f065381dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:02.709739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Getting quotas for user 136253a1592742219ad302722be1d5f2 and project 18d52fd8cbf748b881b4cd6f065381dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:02.727548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:02.733176 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:02.783415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:02.793569 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72001c96-c57d-4e02-bc87-d7fe34527ff5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.416304 Oct 24 09:03:02.796020 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1254/2560] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:03:02.806153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:02.807147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:02.808668 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:02.809448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:02.810035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:02.811365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:02.823489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:02.823981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:02.824413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:02.825117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:02.830267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:02.832881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:02.834099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:02.839234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:02.840746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:02.847442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:02.849623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:02.850183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:02.984591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:03.000659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for user 4dde4bb72f914457a633358837d178de and project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:03.036126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:03.039283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:03.086725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:03.102644 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b50475c4-c68f-4451-af1d-7a2ef79a7f13 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1426 microversion: 2.1 time: 0.305053 Oct 24 09:03:03.117378 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1255/2561] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:02 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1426 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:03.123419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ba60030e-545b-4254-8f75-4a5ed59560e7 req-02f4bdf1-03d1-41c9-8371-bc2e1d4657a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deeb9a97-651f-43b5-81f0-6aad105e27fe", "name": "network-vif-unplugged", "status": "completed", "tag": "2fbcdccb-a78d-4e8d-8244-01295a54bd51"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:03.136866 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8235449d-7e6d-49a6-8cd3-7e8d95e0c7e2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378886 Oct 24 09:03:03.161656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1307/2562] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:03:03.163188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ba60030e-545b-4254-8f75-4a5ed59560e7 req-02f4bdf1-03d1-41c9-8371-bc2e1d4657a5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:03.167121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:03.167814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:03.173858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ba60030e-545b-4254-8f75-4a5ed59560e7 req-02f4bdf1-03d1-41c9-8371-bc2e1d4657a5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:03.174302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ba60030e-545b-4254-8f75-4a5ed59560e7 req-02f4bdf1-03d1-41c9-8371-bc2e1d4657a5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:03.194600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:03.202529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:03.203258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:03.204228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:03.204855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:03.207091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:03.225591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ba60030e-545b-4254-8f75-4a5ed59560e7 req-02f4bdf1-03d1-41c9-8371-bc2e1d4657a5 service nova] Creating event network-vif-unplugged:2fbcdccb-a78d-4e8d-8244-01295a54bd51 for instance deeb9a97-651f-43b5-81f0-6aad105e27fe on n-h1-master-1 Oct 24 09:03:03.247535 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ba60030e-545b-4254-8f75-4a5ed59560e7 req-02f4bdf1-03d1-41c9-8371-bc2e1d4657a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138082 Oct 24 09:03:03.257255 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1256/2563] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:03.281483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f9d3d92a-42b9-4747-8bf0-26174c9adc10 req-c03ed297-8c7e-4383-a6e7-191fecc44e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deeb9a97-651f-43b5-81f0-6aad105e27fe", "name": "network-vif-deleted", "tag": "2fbcdccb-a78d-4e8d-8244-01295a54bd51"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:03.317884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9d3d92a-42b9-4747-8bf0-26174c9adc10 req-c03ed297-8c7e-4383-a6e7-191fecc44e1d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:03.318710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9d3d92a-42b9-4747-8bf0-26174c9adc10 req-c03ed297-8c7e-4383-a6e7-191fecc44e1d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:03.319326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9d3d92a-42b9-4747-8bf0-26174c9adc10 req-c03ed297-8c7e-4383-a6e7-191fecc44e1d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:03.338770 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f9d3d92a-42b9-4747-8bf0-26174c9adc10 req-c03ed297-8c7e-4383-a6e7-191fecc44e1d service nova] Creating event network-vif-deleted:2fbcdccb-a78d-4e8d-8244-01295a54bd51 for instance deeb9a97-651f-43b5-81f0-6aad105e27fe on n-h1-master-1 Oct 24 09:03:03.347811 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f9d3d92a-42b9-4747-8bf0-26174c9adc10 req-c03ed297-8c7e-4383-a6e7-191fecc44e1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085703 Oct 24 09:03:03.348896 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1257/2564] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:03.356349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:03.357792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:03.366359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:03.367400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:03.368186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:03.371021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:03.371803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:03.372239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:03.959981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:03.971792 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b36b7710-0304-4df8-8f19-0befddb7d972 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1451 microversion: 2.1 time: 0.805837 Oct 24 09:03:03.972986 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1308/2565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:03 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1451 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:03.973473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:03.989356 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b2aec4b-1093-4325-936a-02e4bdecf9d2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.636657 Oct 24 09:03:03.991498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ea2cdb4-bce7-4581-b0b9-74a3b36281a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:03.992544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ea2cdb4-bce7-4581-b0b9-74a3b36281a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:03.996858 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1258/2566] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:03 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:04.016625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7656d9b-c127-4cc9-82bc-350cb590f83f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:04.018122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7656d9b-c127-4cc9-82bc-350cb590f83f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:04.121759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ea2cdb4-bce7-4581-b0b9-74a3b36281a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:04.183950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f7656d9b-c127-4cc9-82bc-350cb590f83f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:04.190699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ea2cdb4-bce7-4581-b0b9-74a3b36281a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1217 microversion: 2.1 time: 0.215260 Oct 24 09:03:04.192668 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1309/2567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:03 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:04.194023 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7656d9b-c127-4cc9-82bc-350cb590f83f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1212 microversion: 2.1 time: 0.195615 Oct 24 09:03:04.199855 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1259/2568] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:03 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1212 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:04.235674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:04.241246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:04.271906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:04.273202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:04.274568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:04.275823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:04.278472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:04.279337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:04.416898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:04.418095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:04.424182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:04.425393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lazy-loading 'fault' on Instance uuid 3630dd52-81f8-4547-a032-4f3822744409 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:03:04.637273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:04.656760 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05e171c2-c7e2-4ea1-b7da-119e4e413482 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 200 len: 1303 microversion: 2.1 time: 0.457252 Oct 24 09:03:04.659745 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1310/2569] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:04 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 1303 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:05.005232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:05.006324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:05.015046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.015760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.021732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:05.022866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:05.028948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.030041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.032973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.034882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.035142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.037126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.037941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.042680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.043361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.044271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.129916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.132396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.133080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.134881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lazy-loading 'fault' on Instance uuid deeb9a97-651f-43b5-81f0-6aad105e27fe {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:03:05.229571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:05.240930 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86ca1689-67ad-46de-89f6-738d95933c14 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 200 len: 1298 microversion: 2.1 time: 0.239917 Oct 24 09:03:05.246421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1260/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:04 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 1298 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:05.251766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:05.259500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:05.282114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.282629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.283079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.287915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.288453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.288899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.359199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:05.385967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3eca9dcf-8b37-44bf-8113-c1893053e741 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.368591 Oct 24 09:03:05.402726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1311/2571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:05 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:05.423090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:05.424571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:05.442944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.443819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.445240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.446874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.448444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.449084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.562280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:05.590369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd88ddc2-afff-4d14-9c0e-8f0228a6c2fc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1208 microversion: 2.1 time: 0.181601 Oct 24 09:03:05.606165 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1312/2572] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:05 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1208 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:05.639613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f80b1dad-edc1-445a-9440-6cb44ff0d399 req-484fd193-14b7-451c-bf22-2537b9703854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3630dd52-81f8-4547-a032-4f3822744409", "name": "network-vif-deleted", "tag": "bca999fc-fbfc-4b81-bcf1-2d4e9a9a03d7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:05.667576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:05.682178 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4fd8b65-a63d-45c3-aadd-8e770ec40ce6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1269 microversion: 2.1 time: 0.434265 Oct 24 09:03:05.683972 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1261/2573] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:05 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1269 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:05.687367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f80b1dad-edc1-445a-9440-6cb44ff0d399 req-484fd193-14b7-451c-bf22-2537b9703854 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.688836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f80b1dad-edc1-445a-9440-6cb44ff0d399 req-484fd193-14b7-451c-bf22-2537b9703854 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.689864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f80b1dad-edc1-445a-9440-6cb44ff0d399 req-484fd193-14b7-451c-bf22-2537b9703854 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.703124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:05.704882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 3630dd52-81f8-4547-a032-4f3822744409] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:05.722151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.724710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.724852 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f80b1dad-edc1-445a-9440-6cb44ff0d399 req-484fd193-14b7-451c-bf22-2537b9703854 service nova] Creating event network-vif-deleted:bca999fc-fbfc-4b81-bcf1-2d4e9a9a03d7 for instance 3630dd52-81f8-4547-a032-4f3822744409 on n-h1-master-1 Oct 24 09:03:05.727842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.729782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.730444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.732132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.738238 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f80b1dad-edc1-445a-9440-6cb44ff0d399 req-484fd193-14b7-451c-bf22-2537b9703854 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123893 Oct 24 09:03:05.739982 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1313/2574] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:05.757492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1bf410b1-a829-4589-8018-61b48986dc70 req-52260ed5-ce2b-432e-94e8-f3f8c885e37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966f9941-3d19-4add-a960-7834fe8bb1b6", "name": "network-vif-plugged", "status": "completed", "tag": "023bef8e-6501-491a-846f-dabc23369379"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:05.764895 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] HTTP exception thrown: Instance 3630dd52-81f8-4547-a032-4f3822744409 could not be found. Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Request method failure captured: Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 HTTP/1.1 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlQu9jdUBhYpPYFBo6PEIyACXaB2ZSH7aiEKcCltwL8ql6aNfv8pHIjKMFVZM5P62i0VWvUD4X7zXg6x5kGCTg_N0qYAjSok0EEAdLQG3KZp9TUACrcoJcRns9WQN_-Hlhv3Mgsc0MIAeNx_otk4s8yQTiJcP4ky0aVAh6z4YfmDZDI Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 72bbfc5e1e574b689ef044341663b776 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersAdminTestJSON-876361295 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72bbfc5e1e574b689ef044341663b776"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72bbfc5e1e574b689ef044341663b776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72bbfc5e1e574b689ef044341663b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72bbfc5e1e574b689ef044341663b776"}]}] Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersAdminTestJSON-876361295 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 72bbfc5e1e574b689ef044341663b776 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersAdminTestJSON-876361295 Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersAdminTestJSON-876361295-project Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0fd6766aed02437eb254480dba23f9db Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersAdminTestJSON-876361295-project Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 3630dd52-81f8-4547-a032-4f3822744409 could not be found. Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3630dd52-81f8-4547-a032-4f3822744409'} Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3630dd52-81f8-4547-a032-4f3822744409 could not be found. Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3630dd52-81f8-4547-a032-4f3822744409 could not be found. Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:05.766606 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3630dd52-81f8-4547-a032-4f3822744409 could not be found. Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Returning 404 to user: Instance 3630dd52-81f8-4547-a032-4f3822744409 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62f74db7-0b4d-461a-a238-bf64a3dac83e tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409" status: 404 len: 111 microversion: 2.1 time: 0.081059 Oct 24 09:03:05.771012 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1262/2575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:05 2022] GET /compute/v2.1/servers/3630dd52-81f8-4547-a032-4f3822744409 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:05.791804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bf410b1-a829-4589-8018-61b48986dc70 req-52260ed5-ce2b-432e-94e8-f3f8c885e37f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.793324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bf410b1-a829-4589-8018-61b48986dc70 req-52260ed5-ce2b-432e-94e8-f3f8c885e37f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.794527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bf410b1-a829-4589-8018-61b48986dc70 req-52260ed5-ce2b-432e-94e8-f3f8c885e37f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.800755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:05.801433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:05.816803 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1bf410b1-a829-4589-8018-61b48986dc70 req-52260ed5-ce2b-432e-94e8-f3f8c885e37f service nova] Creating event network-vif-plugged:023bef8e-6501-491a-846f-dabc23369379 for instance 966f9941-3d19-4add-a960-7834fe8bb1b6 on n-h1-master-1 Oct 24 09:03:05.823362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1bf410b1-a829-4589-8018-61b48986dc70 req-52260ed5-ce2b-432e-94e8-f3f8c885e37f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078765 Oct 24 09:03:05.824564 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1314/2576] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:05.827609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.828396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.829673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.830733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:05.831915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:05.832556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:05.904964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:06.058245 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65ef864f-2424-4563-9252-4428c3ea1ae9 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 204 len: 0 microversion: 2.1 time: 0.282727 Oct 24 09:03:06.059941 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1263/2577] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:05 2022] DELETE /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:06.074848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:06.077059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:06.097079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:06.099195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:06.100263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:06.102310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:06.104443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:06.105983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:06.271400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:06.272402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:06.284361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:06.287625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:06.289825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:06.294119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:06.294842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:06.295730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:06.347323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe HTTP/1.1 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: exception: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'deeb9a97-651f-43b5-81f0-6aad105e27fe'} Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:06.350228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:06.355459 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:06.355459 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:06.355459 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:06.355459 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:06.355459 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:06.355459 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:06.358255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:06.372469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-669efe6e-c401-443c-b81f-e9f0f1de7d76 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 404 len: 111 microversion: 2.1 time: 0.106619 Oct 24 09:03:06.373426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1264/2578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:06 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:06.385044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5a33ca19-f811-4bb0-aac1-729a7a0d990b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daae524c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:06.940974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:06.955413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7db0774d-2c1d-4354-95ca-a00ed0354111 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1469 microversion: 2.1 time: 0.890110 Oct 24 09:03:06.956552 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1315/2579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:06 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1469 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:06.990905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:06.991538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:07.005537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.006610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.007402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.017247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.017986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.019197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.475118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:07.488280 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d92e5ee5-16f9-48cc-8d53-1f30eb709fff tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.501173 Oct 24 09:03:07.489109 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1316/2580] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:06 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:07.497029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:07.500983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:07.513875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.515881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.516496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.518122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.519881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.520486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.599291 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5a33ca19-f811-4bb0-aac1-729a7a0d990b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 204 len: 0 microversion: 2.1 time: 1.218485 Oct 24 09:03:07.600120 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1265/2581] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:06 2022] DELETE /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 0 bytes in 1220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:07.608270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:07.618471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:07.629763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.630259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.630904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.631773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.632231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.632694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.739194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:07.751371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:07.762654 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8a329ad-3fcb-4fd8-8cd9-58665f86a6b7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1275 microversion: 2.1 time: 0.160120 Oct 24 09:03:07.778026 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b109376-c501-466a-b057-b35abdd4e026 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1270 microversion: 2.1 time: 0.287215 Oct 24 09:03:07.779283 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1317/2582] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:07 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:07.787383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:07.788151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:07.792147 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1266/2583] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:07 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:07.816159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.816868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.817544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.818532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:07.819191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:07.819966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:07.869110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:07.984388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:07.986758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:08.011485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:08.012408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:08.015681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:08.016925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:08.019026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:08.020693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:08.033406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a58f9aad-c9d4-43a5-baed-e01768dd7173 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 204 len: 0 microversion: 2.1 time: 0.249093 Oct 24 09:03:08.034908 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1318/2584] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:07 2022] DELETE /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:08.178402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-810661788", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "62c56d9c-5126-43a0-b067-60873881adab"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:08.263030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] validate_networks() for [('62c56d9c-5126-43a0-b067-60873881adab', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:08.392936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:08.411541 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aaa89446-95ee-460e-9fb9-f417aea702a6 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1469 microversion: 2.1 time: 0.435273 Oct 24 09:03:08.412264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1267/2585] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:07 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1469 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:08.518898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:08.519553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:08.546311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:08.546835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:08.547284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:08.548008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:08.548472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:08.548901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:09.814588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:09.834428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d06cf2dc-d20d-447a-8d06-299ddd411616 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 1.322612 Oct 24 09:03:09.836050 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1268/2586] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:08 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:09.842350 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:09.843279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:09.854149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:09.854906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:09.856189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:09.857164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:09.859518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:09.860651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:10.218453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:10.218904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:10.219708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:10.220322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:10.220816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:10.236587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:10.238432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:10.239230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:10.240174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:10.241147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:10.243047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:10.279873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:10.286529 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:10.288584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Getting quotas for user ca932e5866274fc78b04689811e72746 and project af6b3d4f42c447a083ecf6d7b6618b92. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:10.324885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:10.340382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:10.406392 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d56e9413-5c64-4a64-a8d7-e04f07f9bac6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232572 Oct 24 09:03:10.415084 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1319/2587] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:03:10.422641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:10.423719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:10.430989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:10.442990 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-319a4917-aac5-4050-b500-08967697dec0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.605508 Oct 24 09:03:10.444860 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1269/2588] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:09 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:10.447020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:10.449524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:10.453518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:10.455414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:10.457054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:10.459016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:10.460685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:10.461701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:10.478844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:10.480768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:10.482697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:10.484947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:10.487029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:10.488742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:11.162357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:11.170787 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60c00ad6-c9e1-47e7-b8fb-bb08aee1ccb3 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1469 microversion: 2.1 time: 0.721954 Oct 24 09:03:11.171015 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1270/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:10 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1469 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:11.189270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e7d8a851-9707-4cdf-918c-6540bf67740e req-b6506dab-fd9b-4670-9eea-fbd889cfaee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42a681f-a7b8-4cad-9ab9-d7a75568a4e3", "name": "network-vif-plugged", "status": "completed", "tag": "7ba514f5-ce98-464e-b31f-7ec2425642e9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:11.222569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e7d8a851-9707-4cdf-918c-6540bf67740e req-b6506dab-fd9b-4670-9eea-fbd889cfaee8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:11.236852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e7d8a851-9707-4cdf-918c-6540bf67740e req-b6506dab-fd9b-4670-9eea-fbd889cfaee8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:11.237742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e7d8a851-9707-4cdf-918c-6540bf67740e req-b6506dab-fd9b-4670-9eea-fbd889cfaee8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:11.280378 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e7d8a851-9707-4cdf-918c-6540bf67740e req-b6506dab-fd9b-4670-9eea-fbd889cfaee8 service nova] Creating event network-vif-plugged:7ba514f5-ce98-464e-b31f-7ec2425642e9 for instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 on n-h1-master-1 Oct 24 09:03:11.303956 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e7d8a851-9707-4cdf-918c-6540bf67740e req-b6506dab-fd9b-4670-9eea-fbd889cfaee8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131716 Oct 24 09:03:11.304579 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1271/2590] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:11.321362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bab2d70b-0c28-4e91-a10b-26bdb4819559 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:11.322137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bab2d70b-0c28-4e91-a10b-26bdb4819559 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:11.347040 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:11.520708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bab2d70b-0c28-4e91-a10b-26bdb4819559 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:11.534572 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bab2d70b-0c28-4e91-a10b-26bdb4819559 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1207 microversion: 2.1 time: 0.226413 Oct 24 09:03:11.559296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1272/2591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:11 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1207 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:11.579641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:11.582163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:11.615630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:11.616877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:11.620492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:11.622257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:11.625810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:11.628409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.086699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:12.097340 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca3ce9c7-69fc-4414-95c1-23855994c025 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 1.680044 Oct 24 09:03:12.101706 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1320/2592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:10 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:12.115905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-6e20fdc5-aabe-427f-ad07-89df4cb52f82 req-f35fa1d9-45af-48c6-8b03-94368206b7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff77d2e-5b67-4660-b896-24a8716d0a8d", "name": "network-vif-deleted", "tag": "10900929-631b-4691-a506-b85041b5e5b0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:12.134239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6e20fdc5-aabe-427f-ad07-89df4cb52f82 req-f35fa1d9-45af-48c6-8b03-94368206b7aa service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.137961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6e20fdc5-aabe-427f-ad07-89df4cb52f82 req-f35fa1d9-45af-48c6-8b03-94368206b7aa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.138795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6e20fdc5-aabe-427f-ad07-89df4cb52f82 req-f35fa1d9-45af-48c6-8b03-94368206b7aa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.151985 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:12.169475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-6e20fdc5-aabe-427f-ad07-89df4cb52f82 req-f35fa1d9-45af-48c6-8b03-94368206b7aa service nova] Creating event network-vif-deleted:10900929-631b-4691-a506-b85041b5e5b0 for instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d on n-h1-master-1 Oct 24 09:03:12.195339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-6e20fdc5-aabe-427f-ad07-89df4cb52f82 req-f35fa1d9-45af-48c6-8b03-94368206b7aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090071 Oct 24 09:03:12.196966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1321/2593] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:12.207555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:12.208302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:12.239102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.239655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.240103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.240812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.241280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.250403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.323333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:12.327375 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:12.338884 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb39a389-28e2-4b8f-814f-cb6512c460bc tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1323 microversion: 2.1 time: 0.773778 Oct 24 09:03:12.340525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1273/2594] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:11 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:12.359427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:12.360882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:12.378847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.379793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.380896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.384665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.385486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.388797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.501150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.503305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.503776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.505770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lazy-loading 'fault' on Instance uuid 1ff77d2e-5b67-4660-b896-24a8716d0a8d {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:03:12.620743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd6766aed02437eb254480dba23f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bbfc5e1e574b689ef044341663b776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:12.633857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a307749f-1585-4b28-af55-6ed1522339dc tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 200 len: 1304 microversion: 2.1 time: 0.290580 Oct 24 09:03:12.650210 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1274/2595] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:12 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 1304 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:12.661774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:12.662637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:12.677123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.677969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.681747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.683112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:12.683792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:12.685061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:12.698049 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:12.824917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:12.844925 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-860064c2-4325-4e51-a333-017e709dfa44 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.637997 Oct 24 09:03:12.845954 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1322/2596] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:12 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:13.004810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d93b571a-01ba-4ec5-83ac-0bff0a74193f req-7635bc6f-c0d3-486f-9c2e-62b9fdefcce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92096759-c3f1-4279-abbe-5e823421740c", "tag": "80ad4d66-4f35-4cdb-8063-3147e1c2eab9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:13.022825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d93b571a-01ba-4ec5-83ac-0bff0a74193f req-7635bc6f-c0d3-486f-9c2e-62b9fdefcce5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:13.023805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d93b571a-01ba-4ec5-83ac-0bff0a74193f req-7635bc6f-c0d3-486f-9c2e-62b9fdefcce5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:13.025334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d93b571a-01ba-4ec5-83ac-0bff0a74193f req-7635bc6f-c0d3-486f-9c2e-62b9fdefcce5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:13.071268 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d93b571a-01ba-4ec5-83ac-0bff0a74193f req-7635bc6f-c0d3-486f-9c2e-62b9fdefcce5 service nova] Creating event network-changed:80ad4d66-4f35-4cdb-8063-3147e1c2eab9 for instance 92096759-c3f1-4279-abbe-5e823421740c on n-h2-master-1 Oct 24 09:03:13.078160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d93b571a-01ba-4ec5-83ac-0bff0a74193f req-7635bc6f-c0d3-486f-9c2e-62b9fdefcce5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076431 Oct 24 09:03:13.079213 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1323/2597] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:03:13.140828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:13.141762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:13.158856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:13.159372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:13.159821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:13.160539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:13.161006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:13.161468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:13.185241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:13.194758 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7274267-725f-4c89-bac5-0ec12f362b1b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1259 microversion: 2.1 time: 0.543296 Oct 24 09:03:13.195332 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1275/2598] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:12 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1259 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:13.368614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:13.370585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:13.378567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:13.379328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:13.380280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:13.381211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:13.382085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:13.383855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.007445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:14.009632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:14.017133 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa6e86a4-5f1a-4f35-8a57-682f50a030ad tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1516 microversion: 2.1 time: 0.652753 Oct 24 09:03:14.017768 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1276/2599] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:13 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1516 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:14.019089 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d8f1439-5caf-4271-b3c1-c8b3a1802741 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 0.891310 Oct 24 09:03:14.022185 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1324/2600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:13 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:14.026929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:14.028699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:14.031823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:14.035014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] [instance: 1ff77d2e-5b67-4660-b896-24a8716d0a8d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:14.048869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.050577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.051147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.051800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.052889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.053600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.053714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.054597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.055036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.066157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.066883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.068050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.088356 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] HTTP exception thrown: Instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d could not be found. Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Request method failure captured: Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d HTTP/1.1 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlQu9jdUBhYpPYFBo6PEIyACXaB2ZSH7aiEKcCltwL8ql6aNfv8pHIjKMFVZM5P62i0VWvUD4X7zXg6x5kGCTg_N0qYAjSok0EEAdLQG3KZp9TUACrcoJcRns9WQN_-Hlhv3Mgsc0MIAeNx_otk4s8yQTiJcP4ky0aVAh6z4YfmDZDI Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 72bbfc5e1e574b689ef044341663b776 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersAdminTestJSON-876361295 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72bbfc5e1e574b689ef044341663b776"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72bbfc5e1e574b689ef044341663b776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72bbfc5e1e574b689ef044341663b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72bbfc5e1e574b689ef044341663b776"}]}] Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersAdminTestJSON-876361295 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 72bbfc5e1e574b689ef044341663b776 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersAdminTestJSON-876361295 Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersAdminTestJSON-876361295-project Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0fd6766aed02437eb254480dba23f9db Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersAdminTestJSON-876361295-project Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d could not be found. Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1ff77d2e-5b67-4660-b896-24a8716d0a8d'} Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d could not be found. Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d could not be found. Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:14.092899 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d could not be found. Oct 24 09:03:14.098142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:14.106363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] Returning 404 to user: Instance 1ff77d2e-5b67-4660-b896-24a8716d0a8d could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:14.107403 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-732446a1-36c7-4856-a3a8-031a48506b65 tempest-ServersAdminTestJSON-876361295 tempest-ServersAdminTestJSON-876361295-project] 10.222.0.25 "GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d" status: 404 len: 111 microversion: 2.1 time: 0.084162 Oct 24 09:03:14.108322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1277/2601] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:14 2022] GET /compute/v2.1/servers/1ff77d2e-5b67-4660-b896-24a8716d0a8d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:14.115098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:14.116760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:14.128067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.129000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.129653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.133444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.134156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.135251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.399485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:14.418617 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b59e1e47-7b35-4fb5-b30e-511d8767b6b1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.394982 Oct 24 09:03:14.420156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1325/2602] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:14 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:14.428302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:14.429567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:14.453263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.456035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.461735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.463552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.464349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.465104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.614369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:14.632353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35c1c916-c062-4b18-838a-b9fb79960c56 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1265 microversion: 2.1 time: 0.210823 Oct 24 09:03:14.648514 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1326/2603] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:14 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:14.653541 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3989f182-d991-49d9-b28b-dbf329c8d70e req-428c6b09-6e8b-402f-97b4-730a6bb4c484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e5c236-d625-4c16-ba83-f805f400ec74", "name": "network-vif-deleted", "tag": "236f2595-87f6-4629-b0b5-b05acc3a91fe"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:14.663463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3989f182-d991-49d9-b28b-dbf329c8d70e req-428c6b09-6e8b-402f-97b4-730a6bb4c484 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:14.663959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3989f182-d991-49d9-b28b-dbf329c8d70e req-428c6b09-6e8b-402f-97b4-730a6bb4c484 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:14.664393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3989f182-d991-49d9-b28b-dbf329c8d70e req-428c6b09-6e8b-402f-97b4-730a6bb4c484 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:14.676929 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3989f182-d991-49d9-b28b-dbf329c8d70e req-428c6b09-6e8b-402f-97b4-730a6bb4c484 service nova] Creating event network-vif-deleted:236f2595-87f6-4629-b0b5-b05acc3a91fe for instance 20e5c236-d625-4c16-ba83-f805f400ec74 on n-h2-master-1 Oct 24 09:03:14.682377 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3989f182-d991-49d9-b28b-dbf329c8d70e req-428c6b09-6e8b-402f-97b4-730a6bb4c484 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032484 Oct 24 09:03:14.683068 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1327/2604] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:14.997570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:15.009691 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35f8ef2a-4175-463b-9b6f-bd6ffb64503e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4" status: 200 len: 1517 microversion: 2.1 time: 0.899899 Oct 24 09:03:15.010607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1278/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:14 2022] GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 => generated 1517 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:15.044246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:15.045091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:15.045221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:15.052396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:15.059502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.059696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.061013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.061560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.062460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.063398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.063992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.070047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.073929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.076806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.079354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.080225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.456408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:15.470556 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-480fb77f-9a43-4468-90ef-95f84c163807 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 200 len: 1516 microversion: 2.1 time: 0.437746 Oct 24 09:03:15.471681 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1328/2606] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:15 2022] GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:15.478984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e227e777-18d2-4446-aa31-9eb5359c48db req-67074493-d98c-4887-ba0b-5c0d1919a129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e958a9-578a-4eaf-b3c4-178f159b3e09", "tag": "50214b1c-6db3-4cff-b4e5-3537e025e23c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:15.499767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e227e777-18d2-4446-aa31-9eb5359c48db req-67074493-d98c-4887-ba0b-5c0d1919a129 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.500428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e227e777-18d2-4446-aa31-9eb5359c48db req-67074493-d98c-4887-ba0b-5c0d1919a129 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.501009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e227e777-18d2-4446-aa31-9eb5359c48db req-67074493-d98c-4887-ba0b-5c0d1919a129 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.514374 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e227e777-18d2-4446-aa31-9eb5359c48db req-67074493-d98c-4887-ba0b-5c0d1919a129 service nova] Creating event network-changed:50214b1c-6db3-4cff-b4e5-3537e025e23c for instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 on n-h2-master-1 Oct 24 09:03:15.523330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e227e777-18d2-4446-aa31-9eb5359c48db req-67074493-d98c-4887-ba0b-5c0d1919a129 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044866 Oct 24 09:03:15.524208 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1329/2607] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:15.536325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:15.538771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:15.552675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.553965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.554985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.557579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:15.571712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.574028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.574479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.575320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33d02988-4abb-4b87-8a90-8debcfd3d91e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 0.535488 Oct 24 09:03:15.597405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1279/2608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:15 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:15.604988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:15.605542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:15.621621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.625142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.625142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.625142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.625142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.625142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.671891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:15.814638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86da2bd5-b47f-4cc4-abd5-4c3097e92868 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 204 len: 0 microversion: 2.1 time: 0.215887 Oct 24 09:03:15.815640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1280/2609] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:15 2022] DELETE /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:15.836158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:15.836158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:15.858994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.859593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.862032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:15.872851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:15.873395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:15.874020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:16.015038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:16.034022 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0147ced-0398-4ce7-9187-0076e0614256 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1265 microversion: 2.1 time: 0.215102 Oct 24 09:03:16.034648 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1281/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:15 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:16.051130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:16.051770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:16.058277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:16.062008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:16.062468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:16.063209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:16.063670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:16.064103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:16.284846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:16.306472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2dd4211-9778-4d0e-9c26-9dd0a5edf0dd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.780706 Oct 24 09:03:16.321765 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1330/2611] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:15 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:16.492817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:16.506946 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0494f6c0-aaa2-48c2-937f-efb775f30e2e tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 200 len: 1522 microversion: 2.1 time: 0.468914 Oct 24 09:03:16.507745 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1282/2612] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:16 2022] GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:16.603608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:16.604230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:16.615426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:16.615929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:16.616373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:16.617094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:16.617577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:16.625743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:16.876122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8626ee96-885d-4079-8321-f7b472c2ba5d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8daadc0f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1266857524", "description": "tempest-description-1750756345"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:16.906093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:16.915077 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a57ad45-9047-4706-8fbd-5ffa26beb4f6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 0.315273 Oct 24 09:03:16.915668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1283/2613] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:16 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:17.067961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:17.068789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:17.086249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:17.087648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:17.090765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:17.093467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:17.096701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:17.097462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:17.216623 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8626ee96-885d-4079-8321-f7b472c2ba5d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.893601 Oct 24 09:03:17.217470 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1331/2614] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:17.233514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f199f1a-cfef-4a6a-a719-d80eba17216d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8dab10c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1404268470", "description": "tempest-description-1131166749"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:17.568330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:17.589622 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4cbb255-831c-4b08-9a5d-e8fd87133544 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 0.526644 Oct 24 09:03:17.590407 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1284/2615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:17 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:17.595159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:17.602221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:17.613016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:17.614979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:17.617009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:17.618709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:17.620093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:17.622407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:17.850342 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f199f1a-cfef-4a6a-a719-d80eba17216d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.622048 Oct 24 09:03:17.851694 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1332/2616] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:17 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:17.857420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:17.858372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:17.895401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:17.900556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:17.901106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:17.907858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:17.911935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:17.914151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:18.074916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:18.094034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22bb2864-ad4f-4198-b962-60906b6704e8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.502405 Oct 24 09:03:18.096597 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1285/2617] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:17 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:18.118168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:18.118996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:18.126607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:18.127242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:18.128625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:18.129622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:18.130443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:18.131075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:18.560950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:18.589868 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ef251eb2-ebf6-4a9e-877d-4ea35c66ad45 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 0.490961 Oct 24 09:03:18.607071 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1286/2618] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:18 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:18.615270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1039200135", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9c709590-a6a5-4e7d-bc04-8a23f860d075"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:18.697057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] validate_networks() for [('9c709590-a6a5-4e7d-bc04-8a23f860d075', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:18.728993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:18.745457 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e60a257-e542-48c1-ab57-612352b4b9c7 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 200 len: 1522 microversion: 2.1 time: 0.892043 Oct 24 09:03:18.749126 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1333/2619] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:17 2022] GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:18.768479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:18.769516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:18.785003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:18.786510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:18.787860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:18.791630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:18.792128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:18.792577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:19.890186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:19.903419 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efb761e3-54f9-4e2a-b5f4-63d3b76787d1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 1.147809 Oct 24 09:03:19.906084 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1334/2620] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:18 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:19.912898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:19.913560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:19.927627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:19.928278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:19.928734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:19.929516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:19.929981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:19.931165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.256026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:20.275241 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:20.278961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-237f5c83-35c7-46ed-8b05-cf0ca789a5dc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.371743 Oct 24 09:03:20.294329 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1335/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:19 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:20.311473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-68e5dca7-d9cb-4ee8-a920-7e3d3d98442f req-3ec5f735-c52c-476c-a171-78d22b7b3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966f9941-3d19-4add-a960-7834fe8bb1b6", "name": "network-vif-deleted", "tag": "023bef8e-6501-491a-846f-dabc23369379"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:20.339293 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:20.349755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68e5dca7-d9cb-4ee8-a920-7e3d3d98442f req-3ec5f735-c52c-476c-a171-78d22b7b3ea5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.354166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68e5dca7-d9cb-4ee8-a920-7e3d3d98442f req-3ec5f735-c52c-476c-a171-78d22b7b3ea5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.356429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68e5dca7-d9cb-4ee8-a920-7e3d3d98442f req-3ec5f735-c52c-476c-a171-78d22b7b3ea5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.380759 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-68e5dca7-d9cb-4ee8-a920-7e3d3d98442f req-3ec5f735-c52c-476c-a171-78d22b7b3ea5 service nova] Creating event network-vif-deleted:023bef8e-6501-491a-846f-dabc23369379 for instance 966f9941-3d19-4add-a960-7834fe8bb1b6 on n-h1-master-1 Oct 24 09:03:20.396160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-68e5dca7-d9cb-4ee8-a920-7e3d3d98442f req-3ec5f735-c52c-476c-a171-78d22b7b3ea5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099550 Oct 24 09:03:20.397162 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1336/2622] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:20.403375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:20.405226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:20.416796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.417481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.418035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.418978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.419549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.420193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.630267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:20.636872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:20.638133 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2d62e02-3ce1-42ac-8b5d-62a7ec75b067 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 0.239393 Oct 24 09:03:20.638778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:20.638894 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1337/2623] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:20 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:20.643695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:20.644543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:20.645178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:20.669583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.670309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.670718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:20.671904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:20.672573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.674615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.677515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.679850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.697567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.698841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.704536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.707867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.708656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.709836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.722510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Getting quotas for project 5297380773734f4ab82dbb83f1c855e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:20.739937 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] HTTP exception thrown: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 HTTP/1.1 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '966f9941-3d19-4add-a960-7834fe8bb1b6'} Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:20.742487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:20.746458 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:20.748168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Getting quotas for user 0faa202378cf499581a14f05c7cfa9c8 and project 5297380773734f4ab82dbb83f1c855e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:20.750210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 404 to user: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:20.751315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b76ce027-07f1-4787-a4a8-97e3e56e2879 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 404 len: 111 microversion: 2.1 time: 0.096254 Oct 24 09:03:20.753074 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1338/2624] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:20 2022] GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:20.779858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:20.782872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:20.906671 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4dcc3d3d-8e8f-4fcf-a59d-84f15fe09db4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.298229 Oct 24 09:03:20.907331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1287/2625] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:03:20.927222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-628e359c-e2ec-4f12-b59a-82a96a19944b req-701f5db8-1c51-4753-aa6f-2a15995c1288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e958a9-578a-4eaf-b3c4-178f159b3e09", "name": "network-vif-plugged", "status": "completed", "tag": "50214b1c-6db3-4cff-b4e5-3537e025e23c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:20.941733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-628e359c-e2ec-4f12-b59a-82a96a19944b req-701f5db8-1c51-4753-aa6f-2a15995c1288 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.942485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-628e359c-e2ec-4f12-b59a-82a96a19944b req-701f5db8-1c51-4753-aa6f-2a15995c1288 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:20.943137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-628e359c-e2ec-4f12-b59a-82a96a19944b req-701f5db8-1c51-4753-aa6f-2a15995c1288 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:20.955109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-628e359c-e2ec-4f12-b59a-82a96a19944b req-701f5db8-1c51-4753-aa6f-2a15995c1288 service nova] Creating event network-vif-plugged:50214b1c-6db3-4cff-b4e5-3537e025e23c for instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 on n-h2-master-1 Oct 24 09:03:20.964265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-628e359c-e2ec-4f12-b59a-82a96a19944b req-701f5db8-1c51-4753-aa6f-2a15995c1288 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045453 Oct 24 09:03:20.965120 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1288/2626] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:20.970296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:20.977578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:20.991085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:20.998687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:20.999408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.000298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.001263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.001998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.002698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.138760 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df9e4ad0-1441-4e88-9de1-3c28d48a7acd tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.172161 Oct 24 09:03:21.139861 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1289/2627] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:03:20 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:03:21.150503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-383686f8-7ffc-48e0-ba76-c2ca55033beb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.152060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-383686f8-7ffc-48e0-ba76-c2ca55033beb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:21.204142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-978209016", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:21.293786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:21.295832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-383686f8-7ffc-48e0-ba76-c2ca55033beb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:21.305813 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-383686f8-7ffc-48e0-ba76-c2ca55033beb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1216 microversion: 2.1 time: 0.162518 Oct 24 09:03:21.307514 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1290/2628] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:21.339982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.340761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:21.354111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.354636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.355930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.356640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.357232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.358045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.599984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:21.609959 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4bad1a02-b479-4cb4-88fb-d60b0e9d1d86 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 0.297941 Oct 24 09:03:21.610746 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1291/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:21.614376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:21.615052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:21.615641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:21.616152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:21.616802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:21.618066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6a5008e-8d74-4948-ba89-418b85d3c2ba tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6a5008e-8d74-4948-ba89-418b85d3c2ba tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: action_args: {} Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 24 09:03:21.622703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 24 09:03:21.627860 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:21.629795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6a5008e-8d74-4948-ba89-418b85d3c2ba tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:21.631329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6a5008e-8d74-4948-ba89-418b85d3c2ba tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018968 Oct 24 09:03:21.635738 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1292/2630] 10.222.0.25 () {58 vars in 1182 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:03:21.639268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.639923 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:21.646028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.646589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.647036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.647807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.648270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.648810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.649178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.649739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.650179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.650859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.651354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.651784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.657058 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:21.696508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:21.716413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:21.744047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:21.746837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:21.816843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:21.828081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c24a4b7-2f7c-4ffb-8f5f-e7bec9e7c146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.194114 Oct 24 09:03:21.829043 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1293/2631] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:21.829176 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfeb5ae6-aa46-4e45-97e4-fb56e8bbe031 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073372 Oct 24 09:03:21.834978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.837566 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1339/2632] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:03:21.841779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:21.842666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:21.849211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.849959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.851797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.852736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.853885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.854462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.858836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.859498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:21.866731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.867317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.867856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.868573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:21.869108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:21.869567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:21.890881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:03:21.928567 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ff3a8f2-3cac-4813-bb0e-576b660e14f2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.097980 Oct 24 09:03:21.929166 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1294/2633] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers => generated 683 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:21.933969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cfe2450-8737-433e-aff7-3acb1c5b4861 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:21.934920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cfe2450-8737-433e-aff7-3acb1c5b4861 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:22.006909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7cfe2450-8737-433e-aff7-3acb1c5b4861 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.014522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cfe2450-8737-433e-aff7-3acb1c5b4861 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1216 microversion: 2.1 time: 0.084056 Oct 24 09:03:22.015271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1295/2634] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:22.034113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.041530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.042013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.servers [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Removing options 'limit' from query {{(pid=126919) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 09:03:22.042979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:22.052088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.052900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.053870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.054607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.055490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.056117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.056483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.067977 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7e98bd7-91a5-496c-8b0b-beda49a74ed8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1312 microversion: 2.1 time: 0.228288 Oct 24 09:03:22.086289 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1340/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:21 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:22.097820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:03:22.131794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72337fd4-21d4-496f-b044-df24e2f5aaac tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.115322 Oct 24 09:03:22.132382 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1296/2636] 10.222.0.25 () {58 vars in 1144 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:22.151880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b66f9c98-1111-416e-bbe6-0f11277d6be2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b66f9c98-1111-416e-bbe6-0f11277d6be2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: action_args: {} Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '-1' Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 24 09:03:22.157721 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 24 09:03:22.163657 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.165235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b66f9c98-1111-416e-bbe6-0f11277d6be2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:22.166636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b66f9c98-1111-416e-bbe6-0f11277d6be2 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024138 Oct 24 09:03:22.169619 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1341/2637] 10.222.0.25 () {58 vars in 1142 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:03:22.178895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84333721-0694-4aec-9a6f-5b7f84dbe8f1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84333721-0694-4aec-9a6f-5b7f84dbe8f1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: action_args: {} Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'testing' Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 24 09:03:22.183863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 24 09:03:22.188754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:22.191549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84333721-0694-4aec-9a6f-5b7f84dbe8f1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:22.192552 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84333721-0694-4aec-9a6f-5b7f84dbe8f1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018453 Oct 24 09:03:22.193266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1297/2638] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:03:22.205209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93a205db-31d3-4f10-89ee-53c14cceb744 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.210856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-93a205db-31d3-4f10-89ee-53c14cceb744 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.211660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-93a205db-31d3-4f10-89ee-53c14cceb744 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:22.220268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.servers [None req-93a205db-31d3-4f10-89ee-53c14cceb744 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Flavor 'non_existing_flavor' could not be found {{(pid=126920) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 24 09:03:22.221674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93a205db-31d3-4f10-89ee-53c14cceb744 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019969 Oct 24 09:03:22.222984 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1342/2639] 10.222.0.25 () {58 vars in 1178 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:03:22.237586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.243158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.243838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:22.249062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.249575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.250279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.251003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.251447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.251878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.334831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.335467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:22.349254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.349867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.350208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.350903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.351463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.351778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.379438 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8fab88b2-fdd4-4ded-9a4a-65c675850e71 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.147265 Oct 24 09:03:22.380051 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1298/2640] 10.222.0.25 () {58 vars in 1174 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:03:22.394497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.400194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.401002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:22.407564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.408266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.409486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.410394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.411033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.412027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.476676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.489895 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f0f78944-e694-430b-93be-44c74223838b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1212 microversion: 2.1 time: 0.162885 Oct 24 09:03:22.502049 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1343/2641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1212 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:22.509382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3ab51d19-4a4f-4bf0-9cf2-5911fe8b95db req-13eb4cc5-4723-4ff3-8a4f-df919ba29527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061f7e76-191f-4d2b-af06-a3348cff03ba", "tag": "ea3de153-9029-44ef-8ece-e142e982bccf"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:22.519999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ab51d19-4a4f-4bf0-9cf2-5911fe8b95db req-13eb4cc5-4723-4ff3-8a4f-df919ba29527 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.520566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ab51d19-4a4f-4bf0-9cf2-5911fe8b95db req-13eb4cc5-4723-4ff3-8a4f-df919ba29527 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.521174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ab51d19-4a4f-4bf0-9cf2-5911fe8b95db req-13eb4cc5-4723-4ff3-8a4f-df919ba29527 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.532832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3ab51d19-4a4f-4bf0-9cf2-5911fe8b95db req-13eb4cc5-4723-4ff3-8a4f-df919ba29527 service nova] Creating event network-changed:ea3de153-9029-44ef-8ece-e142e982bccf for instance 061f7e76-191f-4d2b-af06-a3348cff03ba on n-h1-master-1 Oct 24 09:03:22.539100 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3ab51d19-4a4f-4bf0-9cf2-5911fe8b95db req-13eb4cc5-4723-4ff3-8a4f-df919ba29527 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034899 Oct 24 09:03:22.539805 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1344/2642] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:22.565977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b06e2073-f24b-4df8-bd24-0a3a04680ef9 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.176924 Oct 24 09:03:22.566581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1299/2643] 10.222.0.25 () {58 vars in 1184 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:03:22.581897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.587760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.588996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:22.594999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.595578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.596914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.597883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.598538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.599210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.633542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.634310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:22.644322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.647544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.648093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.649404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.653041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:03:22.653789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.655276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.799709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.808856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.809368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.809977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:22.957148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:22.972748 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b34ca185-1ff3-4a7f-a44a-b3d14bed0984 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 0.336241 Oct 24 09:03:22.973923 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1300/2644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:22.978673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:22.979744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:22.985260 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-466db78e-0335-4c47-8065-345f540f50cb tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.409426 Oct 24 09:03:22.985915 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1345/2645] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:22.998041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:22.998645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:22.999203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.000321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.000990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.001527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.008901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1e31ad30-40b0-4974-aca1-7079209e9813 req-927dc1f4-ed0f-49ca-9420-b6a8b12fceac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92096759-c3f1-4279-abbe-5e823421740c", "name": "network-vif-plugged", "status": "completed", "tag": "80ad4d66-4f35-4cdb-8063-3147e1c2eab9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:23.020535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e31ad30-40b0-4974-aca1-7079209e9813 req-927dc1f4-ed0f-49ca-9420-b6a8b12fceac service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.021012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e31ad30-40b0-4974-aca1-7079209e9813 req-927dc1f4-ed0f-49ca-9420-b6a8b12fceac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.021485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e31ad30-40b0-4974-aca1-7079209e9813 req-927dc1f4-ed0f-49ca-9420-b6a8b12fceac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.034332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1e31ad30-40b0-4974-aca1-7079209e9813 req-927dc1f4-ed0f-49ca-9420-b6a8b12fceac service nova] Creating event network-vif-plugged:80ad4d66-4f35-4cdb-8063-3147e1c2eab9 for instance 92096759-c3f1-4279-abbe-5e823421740c on n-h2-master-1 Oct 24 09:03:23.049668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1e31ad30-40b0-4974-aca1-7079209e9813 req-927dc1f4-ed0f-49ca-9420-b6a8b12fceac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044083 Oct 24 09:03:23.050671 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1346/2646] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:03:23.059532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23e98ed5-43aa-4487-ad53-a730efe76469 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.067297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-23e98ed5-43aa-4487-ad53-a730efe76469 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:23.068390 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23e98ed5-43aa-4487-ad53-a730efe76469 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.016563 Oct 24 09:03:23.069046 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1347/2647] 10.222.0.25 () {58 vars in 1178 bytes} [Mon Oct 24 09:03:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:03:23.074143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.075345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:23.084821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.085672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.086334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.087486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.088143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.088766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.094903 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:23.255104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:23.265592 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8485f698-7cdf-4513-82de-fe0bdccea12e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1212 microversion: 2.1 time: 0.195176 Oct 24 09:03:23.277625 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1348/2648] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:23 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1212 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:23.279294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.288433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:23.289844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Searching by: {'deleted': False, 'project_id': '30dbbc2d63444107b5518dbabd023d2f'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:23.320976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.321498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.321932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.322653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.323104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.323525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.385259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:03:23.443793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-925f0637-7550-4d58-9a79-016a04dadd1d tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.176044 Oct 24 09:03:23.449333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1349/2649] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:03:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:23.461345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.462138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:23.474027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.474522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.474965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.475673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.476133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.476566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.639678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:23.648466 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88cd611e-efc5-4f8c-a7ac-61600598a775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.673350 Oct 24 09:03:23.653785 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1301/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:22 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:23.659063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.662007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:23.680166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.681715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.682491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.683523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.684223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.684887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.701440 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] HTTP exception thrown: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 HTTP/1.1 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '966f9941-3d19-4add-a960-7834fe8bb1b6'} Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:23.703463 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:23.708103 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:23.710002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 404 to user: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:23.711118 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6d92277-ec96-4a8b-a6c3-c1b9f3c9700b tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 404 len: 111 microversion: 2.1 time: 0.055980 Oct 24 09:03:23.711922 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1302/2651] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:23 2022] DELETE /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:23.717562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.718519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:23.721254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:23.729555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.730366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.731338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.732361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.733057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.734384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.735154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0cfc935b-5903-4895-9988-6518a9f2f4b2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1462 microversion: 2.1 time: 0.283770 Oct 24 09:03:23.735784 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1350/2652] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:23 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1462 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:23.747235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.749485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:23.765752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.766289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.769608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.772051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.772784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.774869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.814221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:23.847597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:23.855834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2db632b-ad69-4a52-942c-fd4fb5348b6b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1274 microversion: 2.1 time: 0.142486 Oct 24 09:03:23.857190 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1303/2653] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:23 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:23.918539 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cede321-97b6-48a3-9ac8-2b06380089c1 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4" status: 204 len: 0 microversion: 2.1 time: 0.181329 Oct 24 09:03:23.919582 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1351/2654] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:23 2022] DELETE /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:23.935351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:23.936213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:23.960539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.961129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.962094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:23.963248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:23.964457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:23.964979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.003099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:24.072537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:24.073173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.081665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.082168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.088554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.089640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.090092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.090747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.167672 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1704fd2-3484-4249-be80-17461f819440 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 204 len: 0 microversion: 2.1 time: 0.243354 Oct 24 09:03:24.168557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1352/2655] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:23 2022] DELETE /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:03:24.177495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:24.178463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.189689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.191113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.191947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.192838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.193587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.193934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.353966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:24.362841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ed9519a-a75f-4760-a407-2a172785b44d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 0.192937 Oct 24 09:03:24.378442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1353/2656] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:24 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:24.386547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:24.387640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 966f9941-3d19-4add-a960-7834fe8bb1b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.393914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.394532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.395240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.396181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.396881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.397553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.413154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] HTTP exception thrown: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 HTTP/1.1 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '966f9941-3d19-4add-a960-7834fe8bb1b6'} Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:24.415190 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 404 to user: Instance 966f9941-3d19-4add-a960-7834fe8bb1b6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a950f7b4-ecf3-4479-afb6-bd0e91a53370 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6" status: 404 len: 111 microversion: 2.1 time: 0.036764 Oct 24 09:03:24.419016 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1354/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:24 2022] GET /compute/v2.1/servers/966f9941-3d19-4add-a960-7834fe8bb1b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:24.425890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:24.426515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.434173 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:24.444984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.445729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.446376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.447125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.447577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.448011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.522895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:24.535433 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-400424d9-5e9a-48ce-8801-e984c6da22a6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1286 microversion: 2.1 time: 0.113683 Oct 24 09:03:24.536140 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1355/2658] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:24 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:24.547769 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3956aef3-f022-417d-bdb9-56103e3cec1e tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1613 microversion: 2.1 time: 0.688979 Oct 24 09:03:24.548577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:24.550018 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1304/2659] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:23 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1613 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:24.558703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.561651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.562328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.564334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.567014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.567655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.568233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.575549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:24.576370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.584388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.585316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.585914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.587718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.588381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.589005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.716945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6a527b0a494f4fe59ebe528dad993e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1f02e88af4e77b8cc8c09da030d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:24.719187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] flavor_id is None. Assuming migration. {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 24 09:03:24.720200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:03:24.800658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:24.813949 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe3cec4f-1fe9-4ec5-813c-11f118f52cca tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4" status: 200 len: 1523 microversion: 2.1 time: 0.276202 Oct 24 09:03:24.815061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1356/2660] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:24 2022] GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:24.822980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:24.824399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:24.835899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.836990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.838240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:24.839370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:24.847137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:24.847137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.116031 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f704ecf5-129e-4c78-8c09-c563b29570f1 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09/action" status: 202 len: 0 microversion: 2.1 time: 0.545085 Oct 24 09:03:25.125436 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1305/2661] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:03:24 2022] POST /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:25.141219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:25.152964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:25.160427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:25.161962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.162696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.163651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.164650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.165595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.166246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.172203 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5ef06d9-4dc7-4125-b987-310f36680993 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1317 microversion: 2.1 time: 0.355502 Oct 24 09:03:25.172801 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1357/2662] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:24 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:25.180321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-abd3b89e-821a-4b65-aad1-0d2bb2fe939e req-ab2e411f-ec25-46f5-951e-66fe681048a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061f7e76-191f-4d2b-af06-a3348cff03ba", "name": "network-vif-plugged", "status": "completed", "tag": "ea3de153-9029-44ef-8ece-e142e982bccf"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:25.195580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-abd3b89e-821a-4b65-aad1-0d2bb2fe939e req-ab2e411f-ec25-46f5-951e-66fe681048a9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.196554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-abd3b89e-821a-4b65-aad1-0d2bb2fe939e req-ab2e411f-ec25-46f5-951e-66fe681048a9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.197002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-abd3b89e-821a-4b65-aad1-0d2bb2fe939e req-ab2e411f-ec25-46f5-951e-66fe681048a9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.216544 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-abd3b89e-821a-4b65-aad1-0d2bb2fe939e req-ab2e411f-ec25-46f5-951e-66fe681048a9 service nova] Creating event network-vif-plugged:ea3de153-9029-44ef-8ece-e142e982bccf for instance 061f7e76-191f-4d2b-af06-a3348cff03ba on n-h1-master-1 Oct 24 09:03:25.224540 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-abd3b89e-821a-4b65-aad1-0d2bb2fe939e req-ab2e411f-ec25-46f5-951e-66fe681048a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050486 Oct 24 09:03:25.226053 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1358/2663] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:25.242781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:25.244486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:25.259039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.260175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.260687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.261701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.262176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.262619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.413150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:25.421837 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49da380a-135f-4b37-bb2f-aca77727e90b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.294546 Oct 24 09:03:25.422413 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1306/2664] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:25 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:25.429040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:25.429983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:25.442633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.444734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.445184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.445941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.446401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.446832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.472377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:25.483891 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31172aaf-221f-4e7b-b953-f58e45624e31 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1471 microversion: 2.1 time: 0.254609 Oct 24 09:03:25.489404 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1359/2665] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:25 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:25.563544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:25.564909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:25.576617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.577166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.578045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.579244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.579873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.581131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.723444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:25.744609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-036b4327-d1b3-4505-90b2-869c5a34fb6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1274 microversion: 2.1 time: 0.187762 Oct 24 09:03:25.746562 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1360/2666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:25 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:25.841895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:25.842742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:25.850817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.851592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.852423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.853497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:25.854171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:25.855269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:25.964074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:25.978041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-95a055a6-2edd-4f81-9791-8d90f7fdd608 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 0.554188 Oct 24 09:03:25.979140 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1307/2667] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:25 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:26.213181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:26.214150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:26.221977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:26.222731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:26.223163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:26.223873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:26.224316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:26.224732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:26.251626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:26.262666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f13808b-42fd-4dbe-a5c6-9481eea51df0 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4" status: 200 len: 1523 microversion: 2.1 time: 0.425329 Oct 24 09:03:26.263559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1361/2668] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:25 2022] GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:26.450147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:26.451283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:26.484010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:26.485287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:26.486999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:26.490908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:26.494651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:26.496596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:26.542728 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:26.763311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:26.781287 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c04caac7-06c1-43b4-8f93-7b445e8b1ec3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.335584 Oct 24 09:03:26.782460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1362/2669] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:26 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:26.788338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:26.789133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:26.796687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:26.797465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:26.798083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:26.800620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:26.801048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:26.801603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.026772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:27.039842 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-910b3874-f00b-48de-a800-1c561af83926 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1471 microversion: 2.1 time: 0.255911 Oct 24 09:03:27.040852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1363/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:26 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:27.051590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9b3de638-889f-46a0-ad82-ca1bfbbdb534 req-f206ac1c-7c29-46c9-9150-38f8020a11c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255da1a7-934f-4ece-a56c-31921f9605c4", "name": "network-vif-deleted", "tag": "5ed10a17-ef1d-4b63-899f-1b0af437546e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:27.065033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:27.086217 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19608732-62b1-4fdf-bee1-b66060ec8e6f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.889898 Oct 24 09:03:27.086806 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1308/2671] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:26 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:27.092968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:27.096933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:27.100554 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:27.101672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b3de638-889f-46a0-ad82-ca1bfbbdb534 req-f206ac1c-7c29-46c9-9150-38f8020a11c2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.102307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b3de638-889f-46a0-ad82-ca1bfbbdb534 req-f206ac1c-7c29-46c9-9150-38f8020a11c2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.102878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9b3de638-889f-46a0-ad82-ca1bfbbdb534 req-f206ac1c-7c29-46c9-9150-38f8020a11c2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.113788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.114522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.124504 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9b3de638-889f-46a0-ad82-ca1bfbbdb534 req-f206ac1c-7c29-46c9-9150-38f8020a11c2 service nova] Creating event network-vif-deleted:5ed10a17-ef1d-4b63-899f-1b0af437546e for instance 255da1a7-934f-4ece-a56c-31921f9605c4 on n-h2-master-1 Oct 24 09:03:27.130233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.133507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.134488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.134709 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9b3de638-889f-46a0-ad82-ca1bfbbdb534 req-f206ac1c-7c29-46c9-9150-38f8020a11c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091190 Oct 24 09:03:27.136116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.136526 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1364/2672] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:27.161159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:27.165024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:27.178819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.179467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.180494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.182417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.183402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.183903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.353642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:27.364940 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d27fa558-a3d0-46c7-ab48-95df642aa6d9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1274 microversion: 2.1 time: 0.276844 Oct 24 09:03:27.365493 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1309/2673] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:27 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:27.397372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:27.397991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:27.414777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.417940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.423300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.424281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.424912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.429979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.508361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.512913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:27.522275 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6893c089-5cbd-416d-9ad1-a03c156e3415 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1307 microversion: 2.1 time: 0.382873 Oct 24 09:03:27.523187 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1365/2674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:27 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:27.528154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064637591", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:27.531090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.531706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.532184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lazy-loading 'fault' on Instance uuid 255da1a7-934f-4ece-a56c-31921f9605c4 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:03:27.594660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] validate_networks() for [('65b21b22-ec29-4a51-8372-119e9b9fb46e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:27.644906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:27.652834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28eeb28b-0fc6-436f-be10-a70a2d37cb12 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4" status: 200 len: 1313 microversion: 2.1 time: 0.286323 Oct 24 09:03:27.653455 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1310/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:27 2022] GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:27.806143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:27.806868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:27.818419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.819059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.820061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.822334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:27.823870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:27.825853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:27.835787 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:28.264714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:28.265731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:28.266674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:28.267162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:28.268354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:28.280200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.280898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.281482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.282298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.282877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.283921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.323534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Getting quotas for project 18d52fd8cbf748b881b4cd6f065381dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:28.330754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Getting quotas for user 136253a1592742219ad302722be1d5f2 and project 18d52fd8cbf748b881b4cd6f065381dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:28.350094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:28.356928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:28.363660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:28.422502 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cb95ed7-3c01-4070-840b-8f6188317e4b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.621349 Oct 24 09:03:28.427217 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1311/2676] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:27 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:28.432235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:28.432873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:28.443039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.443536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.444147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.445044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.445678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.446262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.476748 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f769c7ad-68e4-4d2c-9376-b11216b5e2b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952060 Oct 24 09:03:28.479969 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1366/2677] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:03:28.490858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-693760d2-7c3c-4396-a15e-a34a6e4bdc55 req-bb56fe69-63ae-44f5-b420-92bc24e9468b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42a681f-a7b8-4cad-9ab9-d7a75568a4e3", "name": "network-vif-deleted", "tag": "7ba514f5-ce98-464e-b31f-7ec2425642e9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:28.520519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-693760d2-7c3c-4396-a15e-a34a6e4bdc55 req-bb56fe69-63ae-44f5-b420-92bc24e9468b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.521138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-693760d2-7c3c-4396-a15e-a34a6e4bdc55 req-bb56fe69-63ae-44f5-b420-92bc24e9468b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.525869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-693760d2-7c3c-4396-a15e-a34a6e4bdc55 req-bb56fe69-63ae-44f5-b420-92bc24e9468b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.548842 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-693760d2-7c3c-4396-a15e-a34a6e4bdc55 req-bb56fe69-63ae-44f5-b420-92bc24e9468b service nova] Creating event network-vif-deleted:7ba514f5-ce98-464e-b31f-7ec2425642e9 for instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 on n-h1-master-1 Oct 24 09:03:28.556020 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-693760d2-7c3c-4396-a15e-a34a6e4bdc55 req-bb56fe69-63ae-44f5-b420-92bc24e9468b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074642 Oct 24 09:03:28.557226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1367/2678] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:28.563498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:28.564567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:28.588801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.589738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.590415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.591812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.598649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.599437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.771650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:28.781204 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-17cefc40-45df-42da-b91b-5f5ce7ffd81c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1274 microversion: 2.1 time: 0.221910 Oct 24 09:03:28.782172 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1368/2679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:28 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:28.788279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eae83731-7cd1-4107-9848-4417fd932c29 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:28.789151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eae83731-7cd1-4107-9848-4417fd932c29 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:28.873491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eae83731-7cd1-4107-9848-4417fd932c29 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:28.886464 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eae83731-7cd1-4107-9848-4417fd932c29 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1217 microversion: 2.1 time: 0.103011 Oct 24 09:03:28.887931 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1369/2680] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:28 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:28.893245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:28.894287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:28.900984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.901785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.903802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.905062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.906068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.906710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.918325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:28.928356 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d6cd3d0-4625-4c90-9827-8b3fd523b1b8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1471 microversion: 2.1 time: 0.499693 Oct 24 09:03:28.928938 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1312/2681] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:28 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1471 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:28.936783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:28.943496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: 255da1a7-934f-4ece-a56c-31921f9605c4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:28.956863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.957373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.957815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.964326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:28.964801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:28.965255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:28.992014 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] HTTP exception thrown: Instance 255da1a7-934f-4ece-a56c-31921f9605c4 could not be found. Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 HTTP/1.1 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 255da1a7-934f-4ece-a56c-31921f9605c4 could not be found. Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '255da1a7-934f-4ece-a56c-31921f9605c4'} Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255da1a7-934f-4ece-a56c-31921f9605c4 could not be found. Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255da1a7-934f-4ece-a56c-31921f9605c4 could not be found. Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:28.993989 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255da1a7-934f-4ece-a56c-31921f9605c4 could not be found. Oct 24 09:03:28.999023 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:29.000719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 404 to user: Instance 255da1a7-934f-4ece-a56c-31921f9605c4 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:29.001831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-286ba8d7-43b6-4cdb-b8b4-3eb0df7eda8a tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4" status: 404 len: 111 microversion: 2.1 time: 0.068613 Oct 24 09:03:29.003551 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1313/2682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:28 2022] GET /compute/v2.1/servers/255da1a7-934f-4ece-a56c-31921f9605c4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:29.011431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:29.012505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:29.020204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.021162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.021795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.022941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.023735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.024501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.100860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.101399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.101847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.102469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lazy-loading 'fault' on Instance uuid c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:03:29.211845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45d4c2ea4c46aabee199ebc7e9d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dbbc2d63444107b5518dbabd023d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:29.220759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5418179-14aa-4011-a8f2-db557c5851f3 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 200 len: 1313 microversion: 2.1 time: 0.213588 Oct 24 09:03:29.234467 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1314/2683] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:29 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:29.324423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:29.333441 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5587b01b-e273-49e6-a8f8-124052e3fda6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1487 microversion: 2.1 time: 0.444146 Oct 24 09:03:29.337836 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1370/2684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:28 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1487 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:29.362987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1063840823"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:29.366273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:29.383929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.387816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.388505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.389443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.401553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.402165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.453734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:29.454358 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:29.479227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.479725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.480163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.487275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.491879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.494604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.726793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:29.755578 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1401ab6-c32c-4113-97da-890a1375af8c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.305437 Oct 24 09:03:29.758310 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1371/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:29 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:29.809590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:29.810390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:29.825121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.825995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.826436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.828509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.829852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.830365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.852521 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad75da0f-725b-43c8-a94e-1fd5a30b6768 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "POST /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba/action" status: 202 len: 0 microversion: 2.1 time: 0.493664 Oct 24 09:03:29.853652 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1315/2686] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:03:29 2022] POST /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:03:29.867212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42e28fcf-c6fa-418c-94d5-14bd881c96c6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daa69cdc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:29.952776 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42e28fcf-c6fa-418c-94d5-14bd881c96c6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424" status: 200 len: 1414 microversion: 2.1 time: 0.092400 Oct 24 09:03:29.953914 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1316/2687] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:29 2022] GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:29.961913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:29.962973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:29.981925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.982596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:29.983195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:29.990574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:29.991785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.003261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.084111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:30.093910 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9c9f241-ccc6-4db4-b7c0-e22c61765365 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.292163 Oct 24 09:03:30.105770 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1372/2688] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:29 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:30.106299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:30.134212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22e039ef-a698-4f5e-87e4-92cd8c1743ce tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1269 microversion: 2.1 time: 0.177227 Oct 24 09:03:30.135058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.135693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:30.136010 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1317/2689] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:29 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:30.145778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb21e824-b255-404d-86d9-38f11fe5d4c0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daa68bee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.155762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.156579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.157159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.163007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.171701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.172616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.245456 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb21e824-b255-404d-86d9-38f11fe5d4c0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424" status: 200 len: 1414 microversion: 2.1 time: 0.106097 Oct 24 09:03:30.246116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1318/2690] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:30 2022] GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:30.259190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.260429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] [instance: c42a681f-a7b8-4cad-9ab9-d7a75568a4e3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:30.267591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.268900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.269531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.270392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.271152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.271730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.289032 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] HTTP exception thrown: Instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 could not be found. Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Request method failure captured: Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 HTTP/1.1 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlSoQQfJcL9djWuMgbNRHgOaaWH1_r5j83iafbEn5ZlRLjolf0nlCnoT4BtyguKCbJeeLj-ivZwgVowAPlJzuC9YF4_I4f11vdJrJkK4bkx8vSvPtWzTOGnlGdnSmPNDLz0auChnb7v77Fg8t_O6i7gZZ7sCYPkxSL95m0rZDctvadc Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30dbbc2d63444107b5518dbabd023d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30dbbc2d63444107b5518dbabd023d2f"}]}] Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 30dbbc2d63444107b5518dbabd023d2f Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-710523706 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ba45d4c2ea4c46aabee199ebc7e9d6f2 Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ListServersNegativeTestJSON-710523706-project Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 could not be found. Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c42a681f-a7b8-4cad-9ab9-d7a75568a4e3'} Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 could not be found. Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 could not be found. Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.291040 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 could not be found. Oct 24 09:03:30.295628 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.298334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] Returning 404 to user: Instance c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:30.300033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02cfa1a6-21bd-403f-b892-5ed0174b8d43 tempest-ListServersNegativeTestJSON-710523706 tempest-ListServersNegativeTestJSON-710523706-project] 10.222.0.25 "GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3" status: 404 len: 111 microversion: 2.1 time: 0.044052 Oct 24 09:03:30.300839 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1319/2691] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:30 2022] GET /compute/v2.1/servers/c42a681f-a7b8-4cad-9ab9-d7a75568a4e3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:03:30.305691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f051570e-cf86-458e-9693-b37af5a84116 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daa43bdc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.440563 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f051570e-cf86-458e-9693-b37af5a84116 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424" status: 204 len: 0 microversion: 2.1 time: 0.136025 Oct 24 09:03:30.442751 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1320/2692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:30 2022] DELETE /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:30.447383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:30.456826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e816f68a-4af3-4fba-a958-5155ddb273e8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daa4a94c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.460909 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fe24193-70b2-47c1-97fb-0519ff67767c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.363760 Oct 24 09:03:30.461551 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1373/2693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:30 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:30.496856 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e816f68a-4af3-4fba-a958-5155ddb273e8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Image not found. Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e816f68a-4af3-4fba-a958-5155ddb273e8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 HTTP/1.1 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '8bccc380-ad1a-4a55-99be-062f5f7d6424'} Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8bccc380-ad1a-4a55-99be-062f5f7d6424 Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 09:03:30.504450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8bccc380-ad1a-4a55-99be-062f5f7d6424 could not be found. Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e816f68a-4af3-4fba-a958-5155ddb273e8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:30.508449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e816f68a-4af3-4fba-a958-5155ddb273e8 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424" status: 404 len: 62 microversion: 2.1 time: 0.058470 Oct 24 09:03:30.514381 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1321/2694] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:30 2022] GET /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:03:30.519877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.520526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:30.534032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.534531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.538388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.539099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.539582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.540021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.629514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-969f1eb0-a444-4ed7-85f1-5d0b8db9512b req-adee9327-e1aa-4ac2-bbae-3e38a02330f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9da3411-ae51-4c68-a32b-b0b08bbbcf7a", "tag": "46e9dd19-1554-4d98-84e0-94aacf99bc1c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:30.652216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-969f1eb0-a444-4ed7-85f1-5d0b8db9512b req-adee9327-e1aa-4ac2-bbae-3e38a02330f2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.652776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-969f1eb0-a444-4ed7-85f1-5d0b8db9512b req-adee9327-e1aa-4ac2-bbae-3e38a02330f2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.653349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-969f1eb0-a444-4ed7-85f1-5d0b8db9512b req-adee9327-e1aa-4ac2-bbae-3e38a02330f2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.670306 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-969f1eb0-a444-4ed7-85f1-5d0b8db9512b req-adee9327-e1aa-4ac2-bbae-3e38a02330f2 service nova] Creating event network-changed:46e9dd19-1554-4d98-84e0-94aacf99bc1c for instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a on n-h1-master-1 Oct 24 09:03:30.678358 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-969f1eb0-a444-4ed7-85f1-5d0b8db9512b req-adee9327-e1aa-4ac2-bbae-3e38a02330f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059060 Oct 24 09:03:30.679675 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1322/2695] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:03:30.788728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:30.789907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:30.797800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.799657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.800169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.800970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:30.801699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:30.802259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:30.968257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:30.982096 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8723e54d-1843-4175-ac05-4497740a7922 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1499 microversion: 2.1 time: 0.466676 Oct 24 09:03:30.984933 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1374/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:30 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1499 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:31.121882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:31.122936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:31.133913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:31.134441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:31.135488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:31.138382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:31.139260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:31.139753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:31.194555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:31.202610 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2814a20-a672-42f9-8ef7-5dc23a6428e5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.420354 Oct 24 09:03:31.211181 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1323/2697] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:30 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:31.216631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:31.217636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:31.227640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:31.228130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:31.229671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:31.229671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:31.229839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:31.230139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:31.394042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:31.402695 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2dd6a53-a68a-4306-9131-9367c63350d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1275 microversion: 2.1 time: 0.190047 Oct 24 09:03:31.403629 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1324/2698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:31 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:31.486145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:31.487388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:31.493965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:31.494464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:31.494888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:31.495586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:31.496035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:31.496455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:31.805229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:31.816364 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a20d7d76-43a1-468e-8b08-fba4a38acb88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.700480 Oct 24 09:03:31.817422 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1375/2699] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:31 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:31.916820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:31.933134 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1cffab0c-11d3-4eaf-9fdb-c2b4a91f048b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.450651 Oct 24 09:03:31.945318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1325/2700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:31 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:32.009285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:32.011092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:32.018221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.019288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.020041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.021405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.022252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.023107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.233407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:32.234034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:32.236277 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=20 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:32.242980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.243625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.244088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.244800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.245650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.246582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.273878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:32.286376 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcafa0ff-3534-437d-bef0-005d0a675dec tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1505 microversion: 2.1 time: 0.282385 Oct 24 09:03:32.304333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1376/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:32 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:32.426759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:32.427629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:32.446873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.447384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.447826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.448630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.449101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.449571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.465204 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:32.730773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:32.743890 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39287b3a-49ab-48ed-9111-9b2f93c3e981 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.514796 Oct 24 09:03:32.754951 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1326/2702] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:32 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:32.845618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:32.847096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:32.855058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.855842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.857224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.858188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.858859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.859500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.861391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:32.878776 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-679eb18c-c2bc-4fa8-b2be-b5aa5f777a21 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.457185 Oct 24 09:03:32.879376 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1377/2703] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:32 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:32.959808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:32.960826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:32.979914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.980810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.981482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:32.982397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:32.983051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:32.983678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.245837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:33.255641 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a311ba37-8287-4602-9fa5-840b689cfe47 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.418899 Oct 24 09:03:33.258334 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1327/2704] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:32 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:33.265735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-86cdcaef-c8f3-4909-98c5-0995d85a6ea7 req-87b83090-7938-4c8f-9a3d-4dbfd0f371e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228b5e7e-bb4e-44b7-8d90-47945b4ae996", "tag": "a8c787ca-0d62-4982-ae2e-384b6a3d7e71"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:33.290035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-86cdcaef-c8f3-4909-98c5-0995d85a6ea7 req-87b83090-7938-4c8f-9a3d-4dbfd0f371e3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.290811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-86cdcaef-c8f3-4909-98c5-0995d85a6ea7 req-87b83090-7938-4c8f-9a3d-4dbfd0f371e3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.291824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-86cdcaef-c8f3-4909-98c5-0995d85a6ea7 req-87b83090-7938-4c8f-9a3d-4dbfd0f371e3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.327188 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-86cdcaef-c8f3-4909-98c5-0995d85a6ea7 req-87b83090-7938-4c8f-9a3d-4dbfd0f371e3 service nova] Creating event network-changed:a8c787ca-0d62-4982-ae2e-384b6a3d7e71 for instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 on n-h1-master-1 Oct 24 09:03:33.341654 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-86cdcaef-c8f3-4909-98c5-0995d85a6ea7 req-87b83090-7938-4c8f-9a3d-4dbfd0f371e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081471 Oct 24 09:03:33.343199 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1328/2705] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:33.350822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:33.351530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:33.363292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.363798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.364241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.365125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.365630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.366171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.540475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:33.579323 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aee66ba6-f7bc-4946-9951-d455ddf13af9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.624336 Oct 24 09:03:33.580335 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1378/2706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:32 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:33.769233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:33.770119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:33.777250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.778938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.779390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.780129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.782397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.785809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.891740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:33.907985 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d12ddac0-36f6-45d0-9b95-6439a9acc0f9 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1505 microversion: 2.1 time: 0.562936 Oct 24 09:03:33.908887 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1329/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:33 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:33.936088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:33.937168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:33.946389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.946930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.947367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:33.948071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:33.948520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:33.949088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.123439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:34.153818 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6f7fbd2-71b3-4a0a-8cd3-0d92bdd7f14c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.388788 Oct 24 09:03:34.173771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1379/2708] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:33 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:34.238202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:34.251984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6bb5a669-4da9-40af-af3c-f2cadebe4ddc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.325055 Oct 24 09:03:34.253787 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1330/2709] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:33 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:34.282815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:34.284506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:34.292715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.293485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.294258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.295657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.296290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.296884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.556975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:34.584670 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b1d2a54-cc60-43c4-ae0a-22fbeb44e7d1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.304429 Oct 24 09:03:34.586693 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1380/2710] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:34 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:34.606443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:34.607373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:34.625387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.626424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.627233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.629261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.630117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.630807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.685725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-32143b43-1c72-4239-8478-a83fce71c29d req-75bd4e7c-0595-42c7-9db8-c0ce53a8598f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac", "tag": "64eac5db-7562-4316-9962-2627c08f14dc"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:34.699932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-32143b43-1c72-4239-8478-a83fce71c29d req-75bd4e7c-0595-42c7-9db8-c0ce53a8598f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.700827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-32143b43-1c72-4239-8478-a83fce71c29d req-75bd4e7c-0595-42c7-9db8-c0ce53a8598f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.701489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-32143b43-1c72-4239-8478-a83fce71c29d req-75bd4e7c-0595-42c7-9db8-c0ce53a8598f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.719995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-32143b43-1c72-4239-8478-a83fce71c29d req-75bd4e7c-0595-42c7-9db8-c0ce53a8598f service nova] Creating event network-changed:64eac5db-7562-4316-9962-2627c08f14dc for instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac on n-h2-master-1 Oct 24 09:03:34.730137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-32143b43-1c72-4239-8478-a83fce71c29d req-75bd4e7c-0595-42c7-9db8-c0ce53a8598f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050727 Oct 24 09:03:34.731272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1381/2711] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:34.912823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:34.925586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8947c21-42c9-4e35-81f4-6fd30c59e6d9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.325403 Oct 24 09:03:34.930401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1331/2712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:34 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:34.941711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:34.944548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:34.959698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.960389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.965756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:34.966911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:34.967468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:34.967927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.187764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:35.188382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:35.194851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.195245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.195734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.197411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.198039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.198955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.436219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:35.440434 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:35.457676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5145cec-f5aa-4781-a8cd-d52eda4a3dde tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1487 microversion: 2.1 time: 0.518914 Oct 24 09:03:35.462173 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1382/2713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:34 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1487 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:35.474553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:35.475287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:35.491708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.493023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.497141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.498216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.498931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.499557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.709036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:35.714537 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:35.758591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-885adb72-5a7a-4ff6-878e-784e6786e0d0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.582863 Oct 24 09:03:35.760734 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1332/2714] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:35 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:35.778482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:35.780289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:35.795151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.796655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.797205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.798025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.798606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.799162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.817660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:35.828821 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a5f8936-e114-41a4-9147-23173830a545 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.365214 Oct 24 09:03:35.845865 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1383/2715] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:35 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:35.867374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:35.868024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:35.875101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.875612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.876051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.876958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:35.878271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:35.878888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:35.880366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:36.005039 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ad20f88-73e4-4571-9ca0-cce57454440b tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 204 len: 0 microversion: 2.1 time: 0.235307 Oct 24 09:03:36.005817 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1333/2716] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:35 2022] DELETE /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:36.011024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:36.012244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:36.019714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.020203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.020639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.021369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.022089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.022672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.084542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:36.097890 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f29cd026-258a-4a1b-9f33-a86787d5345b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.250508 Oct 24 09:03:36.098843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1384/2717] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:35 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:36.104452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf49fbfd-782a-4f49-aec2-e9f21552eadc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2d1c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:36.131040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-bf49fbfd-782a-4f49-aec2-e9f21552eadc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Image not found. Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf49fbfd-782a-4f49-aec2-e9f21552eadc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 HTTP/1.1 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8bccc380-ad1a-4a55-99be-062f5f7d6424'} Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8bccc380-ad1a-4a55-99be-062f5f7d6424 to delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8bccc380-ad1a-4a55-99be-062f5f7d6424 could not be found. Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.132937 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf49fbfd-782a-4f49-aec2-e9f21552eadc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf49fbfd-782a-4f49-aec2-e9f21552eadc tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424" status: 404 len: 62 microversion: 2.1 time: 0.034628 Oct 24 09:03:36.138121 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1385/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:36 2022] DELETE /compute/v2.1/images/8bccc380-ad1a-4a55-99be-062f5f7d6424 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:03:36.144562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:36.145139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:36.153416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.154096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.154790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.156498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.157164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.160514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.192834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:36.280495 n-d-master-1 devstack@n-api.service[126920]: INFO nova.compute.api [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Instance is already in deleting state, ignoring this request Oct 24 09:03:36.281372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c341ea8-ecd4-4b1e-9eff-cc4c99801ca1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 204 len: 0 microversion: 2.1 time: 0.141923 Oct 24 09:03:36.282131 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1386/2719] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:36 2022] DELETE /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:03:36.294036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:36.294662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:36.301749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.302242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.302731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.303671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.304285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.304870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.521628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:36.540944 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c99be251-2225-4645-8cf8-3f62c2e9ccec tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.533809 Oct 24 09:03:36.541781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1334/2720] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:36 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:36.542910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:36.553767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be5ca773-c27b-44a2-97a0-a9fe99f7dd6a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1493 microversion: 2.1 time: 0.266745 Oct 24 09:03:36.570122 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1387/2721] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:36 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1493 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:36.789131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:36.790784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:36.807481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.808905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.809746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.818838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.819688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.820407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.859826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:36.860463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:36.871398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.871896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.875608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:36.878207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:36.878891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:36.881434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.331964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:37.342831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1b41863-f43c-45b3-ac32-9470465542bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.561377 Oct 24 09:03:37.343992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1335/2722] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:36 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:37.360025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:37.362919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:37.363803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:37.371055 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b11fe1a-b24b-451e-8a69-ee4350d1840d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.515433 Oct 24 09:03:37.371471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.371950 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1388/2723] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:36 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:37.372421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.373191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.374142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.374812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.375719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.568116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:37.568836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:37.600731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.601249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.601732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.602450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.602905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.603330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.694803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:37.703644 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32d0ec2c-febd-4101-90f3-abb61e20b947 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.358321 Oct 24 09:03:37.704835 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1336/2724] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:37 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:37.709819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:37.710649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:37.716852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.717549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.718130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.718983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.719595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.720010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.932631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:37.944442 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e4a9eb23-1b04-4278-b06d-3c236ae452c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.381119 Oct 24 09:03:37.945619 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1389/2725] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:37 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:37.950472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-70cc2317-9ccc-4e3e-8ee3-68dfa2e711cb req-20a78c52-5a4e-4442-bef3-66d616322f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9da3411-ae51-4c68-a32b-b0b08bbbcf7a", "name": "network-vif-plugged", "status": "completed", "tag": "46e9dd19-1554-4d98-84e0-94aacf99bc1c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:37.966734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70cc2317-9ccc-4e3e-8ee3-68dfa2e711cb req-20a78c52-5a4e-4442-bef3-66d616322f0a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:37.967733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70cc2317-9ccc-4e3e-8ee3-68dfa2e711cb req-20a78c52-5a4e-4442-bef3-66d616322f0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:37.968323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70cc2317-9ccc-4e3e-8ee3-68dfa2e711cb req-20a78c52-5a4e-4442-bef3-66d616322f0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:37.986004 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-70cc2317-9ccc-4e3e-8ee3-68dfa2e711cb req-20a78c52-5a4e-4442-bef3-66d616322f0a service nova] Creating event network-vif-plugged:46e9dd19-1554-4d98-84e0-94aacf99bc1c for instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a on n-h1-master-1 Oct 24 09:03:37.994909 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-70cc2317-9ccc-4e3e-8ee3-68dfa2e711cb req-20a78c52-5a4e-4442-bef3-66d616322f0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046720 Oct 24 09:03:37.996305 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1390/2726] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:38.155628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:38.164225 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a33e4ad2-0be2-412e-9715-73fa215cb9a6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1493 microversion: 2.1 time: 0.457949 Oct 24 09:03:38.165038 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1337/2727] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:37 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1493 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:38.367460 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:38.372483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:38.374471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:38.389923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:38.391105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:38.394698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:38.395834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:38.396525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:38.397611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:38.401501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:38.403949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:38.414413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:38.416197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:38.417625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:38.419918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:38.422777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:38.423409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:38.766868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:38.779768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-088a6f88-f858-49af-a72c-fcf7bb9c336b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.388998 Oct 24 09:03:38.789120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:38.792969 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1338/2728] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:38 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:38.797710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f47f5e4d-1e8a-4c81-a566-eaf7c17811f3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1316 microversion: 2.1 time: 0.432054 Oct 24 09:03:38.804837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:38.805799 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1391/2729] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:38 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:38.806628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:38.815238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:38.815955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:38.816553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:38.817454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:38.820631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:38.821274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:38.971264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:38.971896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:38.974908 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:39.005146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.008339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.009427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.011995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.020705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.023543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.358339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:39.368890 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2483986-55a7-4734-8ed1-19c88838c448 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.568216 Oct 24 09:03:39.369814 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1339/2730] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:38 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:39.376951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:39.379102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:39.386931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.387697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.388647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.389748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.390432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.391335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.548385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:39.561500 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b5f58e3-9b29-47fc-81a4-f8d94eabe03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.594026 Oct 24 09:03:39.562506 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1392/2731] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:38 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:39.563033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca932e5866274fc78b04689811e72746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6b3d4f42c447a083ecf6d7b6618b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:39.571354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-38d8a111-91dc-48fe-a5b0-c52314dcb96a req-ab955a55-f980-4a0e-9db6-2ce9589a1fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061f7e76-191f-4d2b-af06-a3348cff03ba", "name": "network-vif-deleted", "tag": "ea3de153-9029-44ef-8ece-e142e982bccf"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:39.576492 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5f2c7cd-cd80-40d0-8e5d-b45f93ec6b84 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 200 len: 1292 microversion: 2.1 time: 0.205306 Oct 24 09:03:39.577668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1340/2732] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:39 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:39.595565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-38d8a111-91dc-48fe-a5b0-c52314dcb96a req-ab955a55-f980-4a0e-9db6-2ce9589a1fa9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.598366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-38d8a111-91dc-48fe-a5b0-c52314dcb96a req-ab955a55-f980-4a0e-9db6-2ce9589a1fa9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.599069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-38d8a111-91dc-48fe-a5b0-c52314dcb96a req-ab955a55-f980-4a0e-9db6-2ce9589a1fa9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.612621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-38d8a111-91dc-48fe-a5b0-c52314dcb96a req-ab955a55-f980-4a0e-9db6-2ce9589a1fa9 service nova] Creating event network-vif-deleted:ea3de153-9029-44ef-8ece-e142e982bccf for instance 061f7e76-191f-4d2b-af06-a3348cff03ba on n-h1-master-1 Oct 24 09:03:39.617624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-38d8a111-91dc-48fe-a5b0-c52314dcb96a req-ab955a55-f980-4a0e-9db6-2ce9589a1fa9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053054 Oct 24 09:03:39.618206 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1393/2733] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:39.811306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:39.811927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:39.830951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:39.832615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:39.837380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.840980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.841614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.842458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.850678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.853165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.854720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.855458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.858434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:39.859428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:39.860132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:39.862235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.160258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:40.167944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-717228a2-eb77-4c17-96e6-987de4dd7e7a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1505 microversion: 2.1 time: 0.342911 Oct 24 09:03:40.168545 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1394/2734] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:39 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:40.173061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0f03bc9b-f463-4905-b591-218d8399d4c6 req-74d98567-8bbf-4b66-a1b0-959c349c299a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b5e7e-bb4e-44b7-8d90-47945b4ae996", "name": "network-vif-plugged", "status": "completed", "tag": "a8c787ca-0d62-4982-ae2e-384b6a3d7e71"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:40.183456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0f03bc9b-f463-4905-b591-218d8399d4c6 req-74d98567-8bbf-4b66-a1b0-959c349c299a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.184059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0f03bc9b-f463-4905-b591-218d8399d4c6 req-74d98567-8bbf-4b66-a1b0-959c349c299a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.184380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0f03bc9b-f463-4905-b591-218d8399d4c6 req-74d98567-8bbf-4b66-a1b0-959c349c299a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.206023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0f03bc9b-f463-4905-b591-218d8399d4c6 req-74d98567-8bbf-4b66-a1b0-959c349c299a service nova] Creating event network-vif-plugged:a8c787ca-0d62-4982-ae2e-384b6a3d7e71 for instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 on n-h1-master-1 Oct 24 09:03:40.211353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0f03bc9b-f463-4905-b591-218d8399d4c6 req-74d98567-8bbf-4b66-a1b0-959c349c299a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041619 Oct 24 09:03:40.212271 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1395/2735] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:40.219592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1266857524"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:40.219592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:40.226499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.226989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.227438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.228250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.228888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.229530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.433237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.network.security_group_api [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Adding security group e4f16a9a-3632-4e52-9ee1-a5bc28b19ae0 to port 46e9dd19-1554-4d98-84e0-94aacf99bc1c Oct 24 09:03:40.542910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:40.555216 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85b203b3-94cb-4348-b217-387fb7c569b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.748549 Oct 24 09:03:40.574578 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1341/2736] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:39 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:40.587036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:40.590083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:40.600615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.601687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.602518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.604568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.605764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.606557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.897432 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e79f5c82-f17c-40c1-bb95-6b13044d5489 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a/action" status: 202 len: 0 microversion: 2.1 time: 0.683604 Oct 24 09:03:40.898404 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1396/2737] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:03:40 2022] POST /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:40.906324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:40.907210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 061f7e76-191f-4d2b-af06-a3348cff03ba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:40.922928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.928637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.929478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.930432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:40.932917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:40.934080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:40.969507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 061f7e76-191f-4d2b-af06-a3348cff03ba could not be found. Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba HTTP/1.1 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 061f7e76-191f-4d2b-af06-a3348cff03ba could not be found. Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '061f7e76-191f-4d2b-af06-a3348cff03ba'} Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061f7e76-191f-4d2b-af06-a3348cff03ba could not be found. Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061f7e76-191f-4d2b-af06-a3348cff03ba could not be found. Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:40.979082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:40.983760 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:40.983760 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:40.983760 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:40.983760 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:40.983760 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061f7e76-191f-4d2b-af06-a3348cff03ba could not be found. Oct 24 09:03:40.983760 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:40.989951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 061f7e76-191f-4d2b-af06-a3348cff03ba could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:40.994986 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3815cba7-f84d-469f-9037-6d55111b3b1d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba" status: 404 len: 111 microversion: 2.1 time: 0.094276 Oct 24 09:03:40.996288 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1397/2738] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:40 2022] GET /compute/v2.1/servers/061f7e76-191f-4d2b-af06-a3348cff03ba => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:41.003134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.003913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.033839 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:41.043850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:41.045345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.046242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.046911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.047857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.048467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.049659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.056498 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c057e353-da66-44b9-9675-d5db163bdb9e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1316 microversion: 2.1 time: 0.477256 Oct 24 09:03:41.057394 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1342/2739] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:40 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:41.066047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1404268470"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:41.068306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.084707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.085355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.086187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.087152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.087811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.092785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.336268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:41.349599 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74694056-e0c1-4915-9f84-1516b67bb181 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.351808 Oct 24 09:03:41.351593 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1398/2740] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:40 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:41.356822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3951e735-0706-4b76-a739-183736d76e93 req-d0237bb8-1e5d-4c19-ab16-2d9a046ccc94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9da3411-ae51-4c68-a32b-b0b08bbbcf7a", "tag": "46e9dd19-1554-4d98-84e0-94aacf99bc1c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:41.370185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3951e735-0706-4b76-a739-183736d76e93 req-d0237bb8-1e5d-4c19-ab16-2d9a046ccc94 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.370980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3951e735-0706-4b76-a739-183736d76e93 req-d0237bb8-1e5d-4c19-ab16-2d9a046ccc94 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.371584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3951e735-0706-4b76-a739-183736d76e93 req-d0237bb8-1e5d-4c19-ab16-2d9a046ccc94 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.385546 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Adding security group edc8b9fe-f443-4193-8e95-8b6bbc6ca762 to port 46e9dd19-1554-4d98-84e0-94aacf99bc1c Oct 24 09:03:41.387109 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3951e735-0706-4b76-a739-183736d76e93 req-d0237bb8-1e5d-4c19-ab16-2d9a046ccc94 service nova] Creating event network-changed:46e9dd19-1554-4d98-84e0-94aacf99bc1c for instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a on n-h1-master-1 Oct 24 09:03:41.394342 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3951e735-0706-4b76-a739-183736d76e93 req-d0237bb8-1e5d-4c19-ab16-2d9a046ccc94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041370 Oct 24 09:03:41.400108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1399/2741] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:41.407279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.407873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.417911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.418659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.419273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.420151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.420794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.421391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.440364 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe HTTP/1.1 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: exception: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'deeb9a97-651f-43b5-81f0-6aad105e27fe'} Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:41.442690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.447072 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.449153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:41.450190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bdab21c6-1a9c-4f8e-bb4d-7515e0b34800 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 404 len: 111 microversion: 2.1 time: 0.048664 Oct 24 09:03:41.451911 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1400/2742] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:41 2022] DELETE /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:41.459469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.460431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: deeb9a97-651f-43b5-81f0-6aad105e27fe] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.469525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.470267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.471049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.472072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.472744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.473408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.492846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe HTTP/1.1 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: exception: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'deeb9a97-651f-43b5-81f0-6aad105e27fe'} Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.494538 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance deeb9a97-651f-43b5-81f0-6aad105e27fe could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:41.499066 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2149cc19-2aaf-4f27-b996-ab76dd762a6c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe" status: 404 len: 111 microversion: 2.1 time: 0.040920 Oct 24 09:03:41.501167 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1401/2743] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:41 2022] GET /compute/v2.1/servers/deeb9a97-651f-43b5-81f0-6aad105e27fe => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:03:41.507799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e2fa175-c144-4dac-b631-9fccd627e5ae tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8dab408040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.577095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-7e2fa175-c144-4dac-b631-9fccd627e5ae tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Image not found. Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e2fa175-c144-4dac-b631-9fccd627e5ae tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc HTTP/1.1 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4c2e464b-e418-400c-8a59-f6e20757addc'} Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4c2e464b-e418-400c-8a59-f6e20757addc to delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c2e464b-e418-400c-8a59-f6e20757addc could not be found. Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.582710 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e2fa175-c144-4dac-b631-9fccd627e5ae tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:41.587707 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e2fa175-c144-4dac-b631-9fccd627e5ae tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc" status: 404 len: 62 microversion: 2.1 time: 0.082163 Oct 24 09:03:41.589061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1402/2744] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:41 2022] DELETE /compute/v2.1/images/4c2e464b-e418-400c-8a59-f6e20757addc => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:03:41.598102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.598850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.610588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.610588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.610795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.611762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.612551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.614361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.843497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:41.853196 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06f77b23-7ce5-478f-9447-42d341f96870 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.263630 Oct 24 09:03:41.854245 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1403/2745] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:41 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:41.859527 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.860134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.866884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.867673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.868116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.868799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.869246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.869871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.901759 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 HTTP/1.1 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '20e5c236-d625-4c16-ba83-f805f400ec74'} Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:41.903374 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-68c70fed-f23b-4a2d-b4d8-8e4ade4fc8a0 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 404 len: 111 microversion: 2.1 time: 0.049331 Oct 24 09:03:41.907117 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1404/2746] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:41 2022] DELETE /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:41.915476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:41.916248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 20e5c236-d625-4c16-ba83-f805f400ec74] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:41.924405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.925325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.925964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.926843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:41.927358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:41.927855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:41.944126 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 HTTP/1.1 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '20e5c236-d625-4c16-ba83-f805f400ec74'} Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.946168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 20e5c236-d625-4c16-ba83-f805f400ec74 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:41.950830 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bacef1d5-9e41-4b90-a793-5c26f072452a tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74" status: 404 len: 111 microversion: 2.1 time: 0.037600 Oct 24 09:03:41.951892 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1405/2747] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:41 2022] GET /compute/v2.1/servers/20e5c236-d625-4c16-ba83-f805f400ec74 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:03:41.961764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d54b8f09-20eb-42e2-8605-8c6edccec27c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2d14c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.000486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d54b8f09-20eb-42e2-8605-8c6edccec27c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Image not found. Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d54b8f09-20eb-42e2-8605-8c6edccec27c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f HTTP/1.1 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '807011a4-d95c-4e6f-86d2-296a22b2481f'} Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 807011a4-d95c-4e6f-86d2-296a22b2481f to delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 807011a4-d95c-4e6f-86d2-296a22b2481f could not be found. Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.002974 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d54b8f09-20eb-42e2-8605-8c6edccec27c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:42.007644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d54b8f09-20eb-42e2-8605-8c6edccec27c tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f" status: 404 len: 62 microversion: 2.1 time: 0.049274 Oct 24 09:03:42.010562 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1406/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:41 2022] DELETE /compute/v2.1/images/807011a4-d95c-4e6f-86d2-296a22b2481f => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 09:03:42.016202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.016830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:42.026142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.026886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.027527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.028380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.028985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.030361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.058117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb HTTP/1.1 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '55ecb5b4-493b-4afa-bd2f-237024e8eebb'} Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:42.060241 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:42.064987 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aab9561e-2162-4f9a-b507-9c84d92a29da tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 404 len: 111 microversion: 2.1 time: 0.052509 Oct 24 09:03:42.068081 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1407/2749] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:42 2022] DELETE /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:42.075287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.076148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 55ecb5b4-493b-4afa-bd2f-237024e8eebb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:42.086367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.087054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.087770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.088501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.088963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.089450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.094461 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:42.107106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb HTTP/1.1 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '55ecb5b4-493b-4afa-bd2f-237024e8eebb'} Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.108670 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 55ecb5b4-493b-4afa-bd2f-237024e8eebb could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:42.115467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6287755c-efe5-4069-8de3-bf17ef163b2d tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb" status: 404 len: 111 microversion: 2.1 time: 0.040997 Oct 24 09:03:42.117559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1408/2750] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:42 2022] GET /compute/v2.1/servers/55ecb5b4-493b-4afa-bd2f-237024e8eebb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:42.124653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.126257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:42.140759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.141254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.141884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.143504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.144107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.145149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.294113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:42.302013 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e293f874-1bb5-4b3c-a06d-454a1139a896 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1465 microversion: 2.1 time: 0.183030 Oct 24 09:03:42.302574 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1409/2751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:42 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:42.315900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6248c6c4-5aad-493d-aa43-dd28b9ade474 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daf2d1820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.352401 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-6248c6c4-5aad-493d-aa43-dd28b9ade474 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Image not found. Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6248c6c4-5aad-493d-aa43-dd28b9ade474 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 HTTP/1.1 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b81310e2-2a24-4cdd-9a4e-34672f503e25'} Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b81310e2-2a24-4cdd-9a4e-34672f503e25 to delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b81310e2-2a24-4cdd-9a4e-34672f503e25 could not be found. Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.355351 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6248c6c4-5aad-493d-aa43-dd28b9ade474 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6248c6c4-5aad-493d-aa43-dd28b9ade474 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25" status: 404 len: 62 microversion: 2.1 time: 0.053042 Oct 24 09:03:42.360008 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1410/2752] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:42 2022] DELETE /compute/v2.1/images/b81310e2-2a24-4cdd-9a4e-34672f503e25 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:03:42.367132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc67098e-6985-452e-8ae9-d3889d1196bf tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a/action" status: 202 len: 0 microversion: 2.1 time: 1.308144 Oct 24 09:03:42.369975 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1343/2753] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:03:41 2022] POST /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:42.376089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.376844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:42.394667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.396281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.397189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.398281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.399098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.399813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.432953 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a HTTP/1.1 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '6da9c88a-b3be-4eef-aa43-aa08d5f3a59a'} Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:42.436676 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:42.441200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:42.443485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:42.444582 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c4cb715-ea73-4e5d-b017-fefeb49eef6f tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 404 len: 111 microversion: 2.1 time: 0.073122 Oct 24 09:03:42.445421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1344/2754] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:42 2022] DELETE /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:42.454447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.456029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:42.463672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.464464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.465205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.466153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.466964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.467579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.816817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:42.817483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:42.828650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.830785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.831534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:42.832560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:42.833506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:42.834102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.010945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:43.019006 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d64f273-e393-4b80-9335-5a1cafbd8a69 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.568823 Oct 24 09:03:43.019587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1345/2755] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:42 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:43.038104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:43.039015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:43.045068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.045823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.046424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.047310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.047921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.048501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.330012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dec1f00f-5da7-4ac9-a30c-af844df679cd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.306329 Oct 24 09:03:43.330664 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1346/2756] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:03:43 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a/os-security-groups => generated 1159 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:43.337257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-bc45443b-f69e-4aeb-98ad-61849be895b2 req-6ad02d2d-688f-4f88-a207-7300bc977172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9da3411-ae51-4c68-a32b-b0b08bbbcf7a", "tag": "46e9dd19-1554-4d98-84e0-94aacf99bc1c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:43.354874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bc45443b-f69e-4aeb-98ad-61849be895b2 req-6ad02d2d-688f-4f88-a207-7300bc977172 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.355566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bc45443b-f69e-4aeb-98ad-61849be895b2 req-6ad02d2d-688f-4f88-a207-7300bc977172 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.356980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bc45443b-f69e-4aeb-98ad-61849be895b2 req-6ad02d2d-688f-4f88-a207-7300bc977172 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.375785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-bc45443b-f69e-4aeb-98ad-61849be895b2 req-6ad02d2d-688f-4f88-a207-7300bc977172 service nova] Creating event network-changed:46e9dd19-1554-4d98-84e0-94aacf99bc1c for instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a on n-h1-master-1 Oct 24 09:03:43.384204 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-bc45443b-f69e-4aeb-98ad-61849be895b2 req-6ad02d2d-688f-4f88-a207-7300bc977172 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052074 Oct 24 09:03:43.387863 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-624addb8-e703-441c-a02c-183366ad9717 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1616 microversion: 2.1 time: 1.023823 Oct 24 09:03:43.389549 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1347/2757] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:43.397371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:43.398295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:43.405860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.406540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.406974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.407675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.408135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.409149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.410466 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1411/2758] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:42 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1616 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:43.434535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:43.435455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:43.440192 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a HTTP/1.1 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '6da9c88a-b3be-4eef-aa43-aa08d5f3a59a'} Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:43.442243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:43.447094 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:43.447094 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:43.447094 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:43.447094 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:43.447094 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. Oct 24 09:03:43.447094 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:43.449041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance 6da9c88a-b3be-4eef-aa43-aa08d5f3a59a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:43.450100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d9524df-fd84-4f4d-b12b-634ce1f1b8e6 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a" status: 404 len: 111 microversion: 2.1 time: 0.059103 Oct 24 09:03:43.454457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1348/2759] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:43 2022] GET /compute/v2.1/servers/6da9c88a-b3be-4eef-aa43-aa08d5f3a59a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:43.456750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.457838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.459834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.461269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e7727576-fb74-432e-be14-f391f41c398b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8daa44fca0>, body: {"security_group": {"name": " tempest-securitygroup -1843238364 ", "description": "tempest-description-516829611"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:43.461711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:43.462229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:43.464264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:43.798721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:43.807697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05b33dcd-0930-452b-8b42-7a4988db49ec tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.393501 Oct 24 09:03:43.809792 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1412/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:43 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:43.815729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5734455d-3183-443b-842a-772923903add tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: .version_select at 0x7f8daf2963a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-484408482", "policies": ["affinity"]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:43.866328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5734455d-3183-443b-842a-772923903add tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:43.880548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5734455d-3183-443b-842a-772923903add tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:44.015436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5734455d-3183-443b-842a-772923903add tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:44.021142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5734455d-3183-443b-842a-772923903add tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:44.040369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5734455d-3183-443b-842a-772923903add tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.227754 Oct 24 09:03:44.053466 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1413/2761] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:03:43 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:44.059836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2ebab35-4ba0-4213-a765-02d0dabdae0e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '.version_select at 0x7f8daaef1b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:44.087480 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a2ebab35-4ba0-4213-a765-02d0dabdae0e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Image not found. Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2ebab35-4ba0-4213-a765-02d0dabdae0e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 HTTP/1.1 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '043c2554-0aad-4f65-a1eb-3b6e5fa6a283'} Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 043c2554-0aad-4f65-a1eb-3b6e5fa6a283 to delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 043c2554-0aad-4f65-a1eb-3b6e5fa6a283 could not be found. Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.089826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:03:44.094615 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.098032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2ebab35-4ba0-4213-a765-02d0dabdae0e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:44.099463 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2ebab35-4ba0-4213-a765-02d0dabdae0e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283" status: 404 len: 62 microversion: 2.1 time: 0.044031 Oct 24 09:03:44.100572 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1414/2762] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:44 2022] DELETE /compute/v2.1/images/043c2554-0aad-4f65-a1eb-3b6e5fa6a283 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:03:44.106413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:44.107485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:44.116187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.116917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.117671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.118587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.119271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.119941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.280623 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e7727576-fb74-432e-be14-f391f41c398b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.824131 Oct 24 09:03:44.282039 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1349/2763] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:43 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:44.288698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:44.289198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:44.306449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.309380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.309380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.309380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.309380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.309380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.333795 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 HTTP/1.1 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: exception: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7'} Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:44.335392 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:44.339749 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d75a9b3c-23cc-466e-b540-8de4f9f4681e tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 404 len: 111 microversion: 2.1 time: 0.053823 Oct 24 09:03:44.349722 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1350/2764] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:44 2022] DELETE /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:44.361673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-658712d4-e949-4058-b910-c9bf8433b7e6 req-1e8e6eed-783a-44f9-8ea2-8569dc5b7007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac", "name": "network-vif-plugged", "status": "completed", "tag": "64eac5db-7562-4316-9962-2627c08f14dc"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:44.375933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-658712d4-e949-4058-b910-c9bf8433b7e6 req-1e8e6eed-783a-44f9-8ea2-8569dc5b7007 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.377988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-658712d4-e949-4058-b910-c9bf8433b7e6 req-1e8e6eed-783a-44f9-8ea2-8569dc5b7007 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.378929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-658712d4-e949-4058-b910-c9bf8433b7e6 req-1e8e6eed-783a-44f9-8ea2-8569dc5b7007 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.398757 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-658712d4-e949-4058-b910-c9bf8433b7e6 req-1e8e6eed-783a-44f9-8ea2-8569dc5b7007 service nova] Creating event network-vif-plugged:64eac5db-7562-4316-9962-2627c08f14dc for instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac on n-h2-master-1 Oct 24 09:03:44.406547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-658712d4-e949-4058-b910-c9bf8433b7e6 req-1e8e6eed-783a-44f9-8ea2-8569dc5b7007 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053851 Oct 24 09:03:44.407535 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1351/2765] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:44.416094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1397865066", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "257ff34c-28ae-4aed-8a1b-02a66fc5667f"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:44.431710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:44.441436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b89767f-5dac-4085-aecd-5829354b8915 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.339236 Oct 24 09:03:44.443429 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1415/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:44 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:44.449830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-83574600-18d2-46d8-aab1-7e4dbd3cb1de tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daf0c4940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:44.516961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:03:44.658325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-83574600-18d2-46d8-aab1-7e4dbd3cb1de tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672" status: 200 len: 223 microversion: 2.1 time: 0.213524 Oct 24 09:03:44.666546 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1416/2767] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:03:44 2022] GET /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672 => generated 223 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:44.666546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:44.666546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] [instance: cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:44.676256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.679997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.680557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.681623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.683480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.684026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.708245 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] HTTP exception thrown: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Request method failure captured: Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 HTTP/1.1 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlOatvJkNo8IuCO0iU36A9GerH_xQN0M_8pObbv65nFZ1qjJcBrnIuebfj_zsW1PaQ-cmj0mxV8_tH8xHRJUOSNL5l4WTCRmqP7NgpzSBW7gl5RoULPa6uNkx8IHdlvBUGdG7aTWwSECldkf98Ei-5NNXVklreA-RFawQHxBRYvP7m4 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af6b3d4f42c447a083ecf6d7b6618b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af6b3d4f42c447a083ecf6d7b6618b92"}]}] Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: af6b3d4f42c447a083ecf6d7b6618b92 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesTestJSON-1504640828 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ca932e5866274fc78b04689811e72746 Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesTestJSON-1504640828-project Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: exception: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7'} Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.709833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] Returning 404 to user: Instance cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d150cab3-68b7-47ec-8500-2e5c3accd3c1 tempest-ImagesTestJSON-1504640828 tempest-ImagesTestJSON-1504640828-project] 10.222.0.25 "GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7" status: 404 len: 111 microversion: 2.1 time: 0.050835 Oct 24 09:03:44.714268 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1417/2768] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:44 2022] GET /compute/v2.1/servers/cd1e3fa7-8f4f-4dad-9a4d-4225cd8ebae7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:44.718757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63355cb6-d2be-47ae-a5dc-b2dc8ac77546 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daf0c49d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:44.801133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:03:44.808288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:03:44.809017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:03:44.809603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:03:44.811425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:03:44.846357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.847137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.847740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.848623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:44.849227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:44.849978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:44.922901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:44.931106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:44.962017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Going to run 2 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:03:44.965834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:45.006506 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:45.036644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126919) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 24 09:03:45.066778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:45.073663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:45.132660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:45.138741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:45.158342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=9974bbd3-693c-41a1-9181-98ebb7b7f2a3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:03:45.223412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:45.231986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:45.285913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:45.294127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:45.342213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86d14289-3f7e-4bd0-b590-bbe65005b540 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.931763 Oct 24 09:03:45.343453 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1352/2769] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 24 09:03:45.349463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:45.350441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:45.360982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:45.362299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:45.364799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:45.365788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:45.367042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:45.367688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:45.389428 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:45.691875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:45.700766 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69e7646c-52f4-487d-951f-f44c53dbf624 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.355994 Oct 24 09:03:45.703531 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1353/2770] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:45 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:45.711616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:45.719011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:45.719799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Searching by: {'deleted': False, 'project_id': '8469ec38031e46da9bfde167e0b6da15'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:03:45.778367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:45.778868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:45.779809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:45.780044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:45.780506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:45.780933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:45.880877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:03:45.977989 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8be0b731-99e2-4d19-90a5-04dfa92da433 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.256138 Oct 24 09:03:45.989846 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1354/2771] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:03:45 2022] GET /compute/v2.1/servers => generated 1003 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:45.997235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:45.997894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:46.031076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:46.033559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:46.034032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:46.035942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:46.037516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:46.037979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:46.542843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:46.554320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7f68557-d8c0-4354-a18e-cfcce31278cd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.559385 Oct 24 09:03:46.554889 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1355/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:45 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:46.567931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-263cc03e-d8a4-43f2-a392-72ba72ccd630 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:46.568880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-263cc03e-d8a4-43f2-a392-72ba72ccd630 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:46.729713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-263cc03e-d8a4-43f2-a392-72ba72ccd630 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:46.744984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-263cc03e-d8a4-43f2-a392-72ba72ccd630 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1219 microversion: 2.1 time: 0.184229 Oct 24 09:03:46.746456 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1356/2773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:46 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1219 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:46.773662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:46.774673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:46.782318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63355cb6-d2be-47ae-a5dc-b2dc8ac77546 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672" status: 202 len: 0 microversion: 2.1 time: 2.066195 Oct 24 09:03:46.783070 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1418/2774] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:03:44 2022] DELETE /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672 => generated 0 bytes in 2070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:46.793850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daf2bc550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:46.807164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:46.809045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:46.809739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:46.812091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:46.814245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:46.816628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:47.155594 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:03:47.156502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group e11bab26-4349-4a47-bf4e-7b48dee21672 not found {{(pid=126920) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:03:47.157098 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.157098 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672 HTTP/1.1 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: exception: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e11bab26-4349-4a47-bf4e-7b48dee21672'} Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:03:47.160473 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:03:47.164825 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-0a0a04a3-63c1-42d6-b792-2cdb30567c13'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:47.168303 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f436a835-c520-4cee-ac2c-2f87149236fd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672" status: 404 len: 194 microversion: 2.1 time: 0.373526 Oct 24 09:03:47.176931 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1419/2775] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:03:46 2022] GET /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672 => generated 194 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:47.194516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b871afb9-0113-45cb-85ac-cdad3d4bf36d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8daf0c49d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-747716831", "description": "tempest-description-54098871"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:47.447801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:47.462424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19d9989e-6020-4037-bb1f-050778cfe0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1317 microversion: 2.1 time: 0.698081 Oct 24 09:03:47.465532 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1357/2776] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:46 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:47.590370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:47.595844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:47.603794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:47.604278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:47.608538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:47.610171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:47.617330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:47.618022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:47.868670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:47.877029 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-465929ce-7437-47d0-b29c-da317b46ad55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1476 microversion: 2.1 time: 0.296614 Oct 24 09:03:47.880889 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1358/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:47 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:47.887904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:47.888802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:47.895569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:47.896251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:47.905610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:47.908225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:47.922091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:47.922814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:48.013324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:48.022975 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e695c6f-ccaf-454b-9af2-681016107c1b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1215 microversion: 2.1 time: 0.140696 Oct 24 09:03:48.041875 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1359/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:47 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:48.480043 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b871afb9-0113-45cb-85ac-cdad3d4bf36d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.301883 Oct 24 09:03:48.481542 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1420/2779] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:47 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:48.492661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:48.498273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:48.505738 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c826fc2-9334-4964-b637-7c3a15bfa493 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8daa619310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1047429331", "description": "tempest-description-1313133350"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:48.516061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:48.518082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:48.518894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:48.519986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:48.520764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:48.521540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:48.959515 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c826fc2-9334-4964-b637-7c3a15bfa493 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.460017 Oct 24 09:03:48.960760 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1421/2780] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:48 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:48.978779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:48.990241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:49.006050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:49.007535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:49.008090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:49.015084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:49.018513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:49.019222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:49.513786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:49.523309 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e20a7806-1e9c-42a0-80a0-e0116843acd7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1475 microversion: 2.1 time: 0.549216 Oct 24 09:03:49.526674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1422/2781] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:48 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1475 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:49.531684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32423d78-4e20-4765-bd6d-0d7b6dea0af0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8daa626d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-764814130", "description": "tempest-description-1690324188"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:49.859071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32423d78-4e20-4765-bd6d-0d7b6dea0af0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.331023 Oct 24 09:03:49.861961 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1423/2782] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:49.877645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:49.878427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:49.892321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:49.894206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:49.897724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:49.898988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:49.900200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:49.902147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:50.011390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:50.025478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90bbea91-cc6d-4566-a1ff-edfe386a2933 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1277 microversion: 2.1 time: 0.155515 Oct 24 09:03:50.026510 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1424/2783] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:49 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:50.034880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22c4afee-2fe8-4b3c-afec-a984338290e7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daf0c4940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:50.152124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:50.163379 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e26c87d6-abc1-4463-aa1f-3189a2fac43f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1507 microversion: 2.1 time: 1.674417 Oct 24 09:03:50.164790 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1360/2784] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:48 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1507 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:50.188360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:50.189145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:50.196355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:50.197171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:50.197801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:50.198869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:50.199485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:50.200063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:50.239478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:03:50.392649 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43042f6e-94aa-40f3-bdb8-d15deb376733 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 204 len: 0 microversion: 2.1 time: 0.206867 Oct 24 09:03:50.394269 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1361/2785] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:03:50 2022] DELETE /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:03:50.407722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:50.410044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:50.421005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:50.423088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:50.424583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:50.425651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:50.426349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:50.427932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:51.020525 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22c4afee-2fe8-4b3c-afec-a984338290e7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.987692 Oct 24 09:03:51.022691 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1425/2786] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 09:03:50 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:51.029455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:51.030835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:51.042858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:51.044223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:51.046009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:51.053586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:51.062458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:51.063271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:51.201025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:51.228198 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab894880-32e7-4695-81ca-85d0f5288653 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1513 microversion: 2.1 time: 0.829615 Oct 24 09:03:51.229203 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1362/2787] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:50 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1513 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:51.255156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e958a9-578a-4eaf-b3c4-178f159b3e09", "name": "network-vif-unplugged", "status": "completed", "tag": "50214b1c-6db3-4cff-b4e5-3537e025e23c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:51.281167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:51.282342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:51.283458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:51.299055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] Creating event network-vif-unplugged:50214b1c-6db3-4cff-b4e5-3537e025e23c for instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 on n-h1-master-1 Oct 24 09:03:51.309602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:03:51.339936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1ea955a0-5777-45b7-a59a-dca045e1cda2 req-67c3b7f0-8af2-4859-a2f6-2ad33d0140fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085512 Oct 24 09:03:51.340620 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1363/2788] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:51.360451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0a3f6bd-0eb0-4f48-9b3f-da88698f71dc tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daaedda60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:51.457732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:51.474766 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ae0c0eb-2dc6-42d9-b228-76cce62f22ff tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1475 microversion: 2.1 time: 0.450703 Oct 24 09:03:51.475505 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1426/2789] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:51 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1475 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:51.488828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:51.490193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:51.529247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:51.530396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:51.531009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:51.531891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:51.533747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:51.534479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:51.817789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:51.848207 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c574092f-57a0-45bd-9419-0645b18789be tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1277 microversion: 2.1 time: 0.369730 Oct 24 09:03:51.864345 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1427/2790] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:51 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:52.256370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:52.257136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:52.265645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:52.266165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:52.266613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:52.267513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:52.268528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:52.269142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:52.609050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0a3f6bd-0eb0-4f48-9b3f-da88698f71dc tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e" status: 202 len: 0 microversion: 2.1 time: 1.267026 Oct 24 09:03:52.609794 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1364/2791] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:03:51 2022] DELETE /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e => generated 0 bytes in 1269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:52.616132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:52.617445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:52.627840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:52.628473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:52.629181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:52.630134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:52.630762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:52.631200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:52.728019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:52.743790 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d177a9e-30b0-439b-8778-a4704d79335f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1513 microversion: 2.1 time: 0.492612 Oct 24 09:03:52.746705 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1428/2792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:52 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1513 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:52.762273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daf296d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:52.871854 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:03:52.873253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e not found {{(pid=126920) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:03:52.874202 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.874202 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e HTTP/1.1 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: exception: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e'} Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:03:52.877404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] Oct 24 09:03:52.881181 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:52.885368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:03:52.885368 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-b3956bd0-d4a1-4e20-af2e-5305ee8e5e71'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:52.887941 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b103ffcb-19f8-4b2a-8d8f-ba0eda4cb424 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e" status: 404 len: 194 microversion: 2.1 time: 0.138762 Oct 24 09:03:52.889166 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1429/2793] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:03:52 2022] GET /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:52.903826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:52.904629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:52.921177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:52.922482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:52.924686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:52.926117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:52.928557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:52.929557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:53.185057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:53.199550 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb2c6f1c-7297-4ee9-ae36-b77c63070621 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1277 microversion: 2.1 time: 0.307236 Oct 24 09:03:53.201909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1430/2794] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:52 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:53.207816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7590f3fd-3ac3-4e8e-92cf-fbd1e904eaed tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daf2d1a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:53.341801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:53.351436 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a22e4e53-9be0-4709-b55f-b377c57d2217 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1475 microversion: 2.1 time: 0.740320 Oct 24 09:03:53.354681 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1365/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:52 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1475 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:53.449613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e958a9-578a-4eaf-b3c4-178f159b3e09", "tag": "50214b1c-6db3-4cff-b4e5-3537e025e23c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:53.469313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:53.470101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:53.470782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:53.510044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] Creating event network-changed:50214b1c-6db3-4cff-b4e5-3537e025e23c for instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 on n-h1-master-1 Oct 24 09:03:53.521596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:03:53.590123 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-744f5f27-f4f2-4b1f-b737-f003000ffdd1 req-4670b840-0866-439a-9cbe-f9c6bef46456 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113169 Oct 24 09:03:53.590805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1366/2796] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:03:53.772975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:53.773866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:53.795564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:53.796335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:53.796934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:53.797855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:53.798470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:53.801916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:54.030848 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:54.045473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:54.066522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92d9ccb1-bee7-4735-86f5-77a70d2a2494 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 200 len: 1471 microversion: 2.1 time: 0.296943 Oct 24 09:03:54.073444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1367/2797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:53 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:54.083985 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d4403ae9-fdf0-4099-945c-3d20b1aa1ecc req-ed2a8e92-292b-41f3-9bc7-b5643f085ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac", "name": "network-vif-deleted", "tag": "64eac5db-7562-4316-9962-2627c08f14dc"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:54.107795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d4403ae9-fdf0-4099-945c-3d20b1aa1ecc req-ed2a8e92-292b-41f3-9bc7-b5643f085ddf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:54.108541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d4403ae9-fdf0-4099-945c-3d20b1aa1ecc req-ed2a8e92-292b-41f3-9bc7-b5643f085ddf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:54.109186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d4403ae9-fdf0-4099-945c-3d20b1aa1ecc req-ed2a8e92-292b-41f3-9bc7-b5643f085ddf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:54.129960 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d4403ae9-fdf0-4099-945c-3d20b1aa1ecc req-ed2a8e92-292b-41f3-9bc7-b5643f085ddf service nova] Creating event network-vif-deleted:64eac5db-7562-4316-9962-2627c08f14dc for instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac on n-h2-master-1 Oct 24 09:03:54.136733 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d4403ae9-fdf0-4099-945c-3d20b1aa1ecc req-ed2a8e92-292b-41f3-9bc7-b5643f085ddf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061347 Oct 24 09:03:54.138266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1368/2798] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:54.235307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:54.237387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:54.253599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:54.254277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:54.254902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:54.255875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:54.256697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:54.257142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:54.466936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:54.479061 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25522bb4-6356-4832-bfa7-60434810dae8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1277 microversion: 2.1 time: 0.252234 Oct 24 09:03:54.480102 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1369/2799] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:54 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:03:54.491782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:54.495892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:54.506277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:54.509471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:54.510215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:54.511161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:54.511853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:54.519731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:54.646608 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7590f3fd-3ac3-4e8e-92cf-fbd1e904eaed tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d" status: 202 len: 0 microversion: 2.1 time: 1.442314 Oct 24 09:03:54.647589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1431/2800] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:03:53 2022] DELETE /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d => generated 0 bytes in 1444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:54.660815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab0b7040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:54.782309 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:03:54.784210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d not found {{(pid=126920) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:03:54.785237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.785237 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d HTTP/1.1 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: exception: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d'} Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:03:54.790743 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] Oct 24 09:03:54.794577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:54.805313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:03:54.805313 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-178602aa-f190-4dd0-b88c-3e2fc6e8868a'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:54.807098 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b83a4c9-ba8e-4f99-b015-19e97a2d56b4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d" status: 404 len: 194 microversion: 2.1 time: 0.154405 Oct 24 09:03:54.811783 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1432/2801] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:03:54 2022] GET /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:54.832913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7501aed7-ca34-4b56-aab4-336e0f444bd7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa626c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:55.562739 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7501aed7-ca34-4b56-aab4-336e0f444bd7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9" status: 202 len: 0 microversion: 2.1 time: 0.749294 Oct 24 09:03:55.565218 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1433/2802] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:03:54 2022] DELETE /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9 => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:03:55.574834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:55.576395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:55.592530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:55.593552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:55.594398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:55.595389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:55.596636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:55.597752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:55.623705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac HTTP/1.1 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac'} Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:55.625920 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:03:55.630523 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:55.633584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:55.635124 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a845845c-fc6a-4f20-8340-008762d75195 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 404 len: 111 microversion: 2.1 time: 0.068633 Oct 24 09:03:55.636822 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1434/2803] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:55 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:55.645682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:55.646670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:55.674675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:55.675536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:55.676201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:55.677829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:55.678538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:55.679194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:55.836299 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:55.868493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:55.879276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cb8a7a0-52d3-41b1-8b47-7274859a6107 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1475 microversion: 2.1 time: 1.396291 Oct 24 09:03:55.881935 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1370/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:54 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1475 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:55.891125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa68baf0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:56.270928 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:03:56.271694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:03:56.272322 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.272322 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9 HTTP/1.1 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: exception: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ef971f01-b89b-4f8c-8c7d-3e4808f425c9'} Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:03:56.276850 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:03:56.281170 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-4f0781f6-e9ad-4c84-bf53-3a6fa1f1eed3'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:56.289249 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f158a64-b05e-4354-93d7-1afac7b212ba tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9" status: 404 len: 194 microversion: 2.1 time: 0.395392 Oct 24 09:03:56.294322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1371/2805] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:03:55 2022] GET /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9 => generated 194 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:56.307045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:56.307679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:56.329386 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:56.349497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:56.352607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:56.353265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:56.354380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:56.355012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:56.356061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:56.399537 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:56.592844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:56.608914 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d122a08-f04e-4644-a218-5a9f1781eb77 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.969244 Oct 24 09:03:56.613748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1435/2806] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:55 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:56.624771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8378d209-d6fe-47e2-b445-208c1b3f8587 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa5c3940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:56.735145 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=24 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:57.240255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:57.257332 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f5558b9-d52a-43e5-a638-9b9772a9621e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.960174 Oct 24 09:03:57.263358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1372/2807] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:56 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:57.270649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:57.271448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:57.278859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:57.279952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:57.280631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:57.281544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:57.282158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:57.282742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:57.649097 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8378d209-d6fe-47e2-b445-208c1b3f8587 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 1.032933 Oct 24 09:03:57.649741 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1436/2808] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 09:03:56 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:57.654597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f95c9af-a94c-4c92-81ad-ab3696c732c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f95c9af-a94c-4c92-81ad-ab3696c732c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 163 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": 12345, "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 12345 Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:03:57.663990 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:03:57.669014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f95c9af-a94c-4c92-81ad-ab3696c732c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:03:57.678509 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f95c9af-a94c-4c92-81ad-ab3696c732c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.027548 Oct 24 09:03:57.679408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1437/2809] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:03:57 2022] POST /compute/v2.1/servers => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:03:57.696904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:57.700002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:57.716722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:57.717554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:57.718180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:57.719057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:57.721166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:57.721639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:58.005814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:58.032767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:58.035738 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-006a90e0-187d-4cca-8392-920cb9ffef1d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1473 microversion: 2.1 time: 0.764648 Oct 24 09:03:58.036401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1373/2810] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:57 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1473 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:58.051133 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32787451-2cf8-484d-98fc-96915cb8e6ce tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.364962 Oct 24 09:03:58.065471 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1438/2811] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:57 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:58.071308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f994d02-db22-4206-8d1d-c2cac4559fcd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8dab017820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-616602324", "description": "tempest-description-752227684"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:58.078911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:58.084462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:58.100282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:58.100810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:58.101487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:58.102372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:58.103039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:58.103633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:58.387851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:58.397194 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-caa79e48-2512-4053-b409-75eb670057af tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.330302 Oct 24 09:03:58.404381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1439/2812] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:58 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:58.954309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f541d7b9-85ae-41e3-aa2a-2865a7d0a15d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'create', calling method: .version_select at 0x7f8daa5c3160>, body: {"keypair": {"name": "tempest-keypair-1108780880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOZmSJGXkUFSceXGMGz1ymjTlbuLwpbT0o1ZLmOTcaf6FOIvqnHMrTzDjBc7QO7HKRpHVGvYw4CRnmxON6Sqma03lDmhBfhFNxFg88zWBHWfdBJXd+KL69VwJ/EzK+ozQ=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:03:58.999746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f541d7b9-85ae-41e3-aa2a-2865a7d0a15d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for project be8fffe9b0994ded9f07301735105917. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:03:59.017558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f541d7b9-85ae-41e3-aa2a-2865a7d0a15d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for user c703cc73a22749858ffe05500e52aa03 and project be8fffe9b0994ded9f07301735105917. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:03:59.065768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f541d7b9-85ae-41e3-aa2a-2865a7d0a15d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.658612 Oct 24 09:03:59.067053 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1440/2813] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:03:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:59.090947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:59.092372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:59.112345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:59.123148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:59.127077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:59.130253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:59.131083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:59.134076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:59.453891 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f994d02-db22-4206-8d1d-c2cac4559fcd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.416407 Oct 24 09:03:59.455617 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1374/2814] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:03:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:03:59.460744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:59.461587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:59.489894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:59.490965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:59.493071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:59.494193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:59.494854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:59.495522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:59.709398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:03:59.727183 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7890d941-0c17-4cec-b0c1-0cf5360d6f5c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.657125 Oct 24 09:03:59.744106 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1441/2815] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:59 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:03:59.756652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:03:59.757332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:03:59.765771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:59.767053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:59.767793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:03:59.768794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:03:59.769451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:03:59.770045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:00.178913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:00.190742 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-45155501-1dc3-42e1-bab2-df5ed9bf3542 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.444362 Oct 24 09:04:00.209553 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1442/2816] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:59 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:00.238642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28f5741a-297e-4071-b9e6-abae7b8da116 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8daf2bcee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-250813647", "description": "tempest-description-364042416"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:00.454161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:00.464104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c03e66d-814a-4011-923d-2e96e80313b6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1470 microversion: 2.1 time: 1.007255 Oct 24 09:04:00.464697 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1375/2817] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:03:59 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1470 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:00.479131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1a883963-c958-46e9-aa80-c684c09eaf2b req-340d8548-1c93-4ebe-bb9b-bf38fc993d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9974bbd3-693c-41a1-9181-98ebb7b7f2a3", "tag": "826c0f4b-598f-4f5c-abba-c70b65dafd22"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:00.501209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a883963-c958-46e9-aa80-c684c09eaf2b req-340d8548-1c93-4ebe-bb9b-bf38fc993d43 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:00.505105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a883963-c958-46e9-aa80-c684c09eaf2b req-340d8548-1c93-4ebe-bb9b-bf38fc993d43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:00.505621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a883963-c958-46e9-aa80-c684c09eaf2b req-340d8548-1c93-4ebe-bb9b-bf38fc993d43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:00.542362 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1a883963-c958-46e9-aa80-c684c09eaf2b req-340d8548-1c93-4ebe-bb9b-bf38fc993d43 service nova] Creating event network-changed:826c0f4b-598f-4f5c-abba-c70b65dafd22 for instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 on n-h1-master-1 Oct 24 09:04:00.548055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1a883963-c958-46e9-aa80-c684c09eaf2b req-340d8548-1c93-4ebe-bb9b-bf38fc993d43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075135 Oct 24 09:04:00.548753 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1376/2818] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:00.717223 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28f5741a-297e-4071-b9e6-abae7b8da116 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.505074 Oct 24 09:04:00.719236 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1443/2819] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:04:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:00.725107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:00.725732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:00.732167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:00.732876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:00.733875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:00.745093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:00.748802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:00.755934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:00.811921 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-962ba784-2eac-486d-a7ef-5a4f9338eda6 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.260957 Oct 24 09:04:00.816314 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1377/2820] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 09:04:00 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 09:04:00.823338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7722e7f4-ea4b-4842-bd57-ea969ed72986 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Calling method '.version_select at 0x7f8daae604c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:00.839730 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:00.873810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7722e7f4-ea4b-4842-bd57-ea969ed72986 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] HTTP exception thrown: Image not found. Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7722e7f4-ea4b-4842-bd57-ea969ed72986 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Request method failure captured: Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlT_5GUj89IV4g9O4ka972u36HlkhBaKLeM9baFafMYouEIhTUDvKzg2HES-T-cy9IedbOIOg6uftox6m9gn8ISXcrfzX2LML8ghbeup2X_JERgkGFlL5SRo28ASmVTHTR4i5dXxCqyOTr_zb6npHZkluLp_wTC65cnpwDqqgfKz4Ps Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03c18ddbdf0c4e269192dffd770d144c"}]}] Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9807fb29a299419ba0f1331ce251edd4 Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '-1'} Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.879264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7722e7f4-ea4b-4842-bd57-ea969ed72986 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7722e7f4-ea4b-4842-bd57-ea969ed72986 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.063519 Oct 24 09:04:00.884328 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1378/2821] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:04:00 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 09:04:00.909044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d126d33-9951-43e5-9e17-ecb78a3e7f9b tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Calling method '.version_select at 0x7f8daaf458b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:00.911263 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae48f6fe-c2f2-41ea-864d-b68536127fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09/action" status: 204 len: 0 microversion: 2.1 time: 0.189569 Oct 24 09:04:00.913845 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1444/2822] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:00 2022] POST /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:04:00.924281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:00.926009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:00.944471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:00.945154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:00.945894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:00.946808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:00.947588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:00.948320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:00.954275 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1d126d33-9951-43e5-9e17-ecb78a3e7f9b tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] HTTP exception thrown: Image not found. Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d126d33-9951-43e5-9e17-ecb78a3e7f9b tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Request method failure captured: Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/images/0df31938-4077-4358-b407-47d939eacbcj HTTP/1.1 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlT_5GUj89IV4g9O4ka972u36HlkhBaKLeM9baFafMYouEIhTUDvKzg2HES-T-cy9IedbOIOg6uftox6m9gn8ISXcrfzX2LML8ghbeup2X_JERgkGFlL5SRo28ASmVTHTR4i5dXxCqyOTr_zb6npHZkluLp_wTC65cnpwDqqgfKz4Ps Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03c18ddbdf0c4e269192dffd770d144c"}]}] Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9807fb29a299419ba0f1331ce251edd4 Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '0df31938-4077-4358-b407-47d939eacbcj'} Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0df31938-4077-4358-b407-47d939eacbcj to delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0df31938-4077-4358-b407-47d939eacbcj could not be found. Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:00.957205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d126d33-9951-43e5-9e17-ecb78a3e7f9b tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:00.961093 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d126d33-9951-43e5-9e17-ecb78a3e7f9b tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] 10.222.0.25 "DELETE /compute/v2.1/images/0df31938-4077-4358-b407-47d939eacbcj" status: 404 len: 62 microversion: 2.1 time: 0.070125 Oct 24 09:04:00.965560 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1379/2823] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:00 2022] DELETE /compute/v2.1/images/0df31938-4077-4358-b407-47d939eacbcj => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:00.990531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1000686019", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9c709590-a6a5-4e7d-bc04-8a23f860d075"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:01.108694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] validate_networks() for [('9c709590-a6a5-4e7d-bc04-8a23f860d075', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:01.718343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:01.734889 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-33abdb15-b36a-48ed-abff-694f5a54d528 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1470 microversion: 2.1 time: 0.818090 Oct 24 09:04:01.749322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1445/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:00 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1470 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:01.750540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cd29555-84c5-421f-b0a5-690304b910d7 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Calling method '.version_select at 0x7f8daa619a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:01.780164 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0cd29555-84c5-421f-b0a5-690304b910d7 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] HTTP exception thrown: Image not found. Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cd29555-84c5-421f-b0a5-690304b910d7 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Request method failure captured: Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/7859e20a-012d-459f-a1d4-173d3f10b52f1 HTTP/1.1 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlT_5GUj89IV4g9O4ka972u36HlkhBaKLeM9baFafMYouEIhTUDvKzg2HES-T-cy9IedbOIOg6uftox6m9gn8ISXcrfzX2LML8ghbeup2X_JERgkGFlL5SRo28ASmVTHTR4i5dXxCqyOTr_zb6npHZkluLp_wTC65cnpwDqqgfKz4Ps Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03c18ddbdf0c4e269192dffd770d144c"}]}] Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9807fb29a299419ba0f1331ce251edd4 Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7859e20a-012d-459f-a1d4-173d3f10b52f1'} Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7859e20a-012d-459f-a1d4-173d3f10b52f1 to delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7859e20a-012d-459f-a1d4-173d3f10b52f1 could not be found. Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:01.783611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:04:01.788720 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:01.792859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cd29555-84c5-421f-b0a5-690304b910d7 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:01.794261 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0cd29555-84c5-421f-b0a5-690304b910d7 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] 10.222.0.25 "DELETE /compute/v2.1/images/7859e20a-012d-459f-a1d4-173d3f10b52f1" status: 404 len: 62 microversion: 2.1 time: 0.055645 Oct 24 09:04:01.795370 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1446/2825] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:04:01 2022] DELETE /compute/v2.1/images/7859e20a-012d-459f-a1d4-173d3f10b52f1 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:01.808329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:01.809720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:01.831233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:01.832048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:01.833452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:01.835080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:01.836186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:01.837090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:02.249166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:02.270745 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-198233df-7b39-457c-a4ee-19a5d6ee22dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.473773 Oct 24 09:04:02.274702 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1447/2826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:01 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:02.292145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e958a9-578a-4eaf-b3c4-178f159b3e09", "name": "network-vif-plugged", "status": "completed", "tag": "50214b1c-6db3-4cff-b4e5-3537e025e23c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:02.311247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:02.312362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:02.313781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:02.335757 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] Creating event network-vif-plugged:50214b1c-6db3-4cff-b4e5-3537e025e23c for instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 on n-h1-master-1 Oct 24 09:04:02.344002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:04:02.371582 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-242bde82-8f42-4d51-951f-1463f1085504 req-a704f964-05bb-4316-a326-e6c3657f1a87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094691 Oct 24 09:04:02.372650 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1448/2827] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:02.382693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98f9640e-846d-4d3d-ac6c-be31e0765b40 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Calling method '.version_select at 0x7f8daf2bc040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:02.428627 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-98f9640e-846d-4d3d-ac6c-be31e0765b40 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] HTTP exception thrown: Image not found. Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98f9640e-846d-4d3d-ac6c-be31e0765b40 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Request method failure captured: Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/tempest-invalid-389272232 HTTP/1.1 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlT_5GUj89IV4g9O4ka972u36HlkhBaKLeM9baFafMYouEIhTUDvKzg2HES-T-cy9IedbOIOg6uftox6m9gn8ISXcrfzX2LML8ghbeup2X_JERgkGFlL5SRo28ASmVTHTR4i5dXxCqyOTr_zb6npHZkluLp_wTC65cnpwDqqgfKz4Ps Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03c18ddbdf0c4e269192dffd770d144c"}]}] Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9807fb29a299419ba0f1331ce251edd4 Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'tempest-invalid-389272232'} Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-389272232 to delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-389272232 could not be found. Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.431239 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98f9640e-846d-4d3d-ac6c-be31e0765b40 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98f9640e-846d-4d3d-ac6c-be31e0765b40 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-389272232" status: 404 len: 62 microversion: 2.1 time: 0.058702 Oct 24 09:04:02.436428 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1449/2828] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 09:04:02 2022] DELETE /compute/v2.1/images/tempest-invalid-389272232 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:02.448563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa9b3708-7a8c-4f61-93fd-e0c6b563a7c1 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Calling method '.version_select at 0x7f8daa619790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:02.478249 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-fa9b3708-7a8c-4f61-93fd-e0c6b563a7c1 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] HTTP exception thrown: Image not found. Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa9b3708-7a8c-4f61-93fd-e0c6b563a7c1 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Request method failure captured: Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/e14ee42f-15c9-4c5d-94de-b8b326da39d3 HTTP/1.1 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlT_5GUj89IV4g9O4ka972u36HlkhBaKLeM9baFafMYouEIhTUDvKzg2HES-T-cy9IedbOIOg6uftox6m9gn8ISXcrfzX2LML8ghbeup2X_JERgkGFlL5SRo28ASmVTHTR4i5dXxCqyOTr_zb6npHZkluLp_wTC65cnpwDqqgfKz4Ps Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03c18ddbdf0c4e269192dffd770d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03c18ddbdf0c4e269192dffd770d144c"}]}] Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 03c18ddbdf0c4e269192dffd770d144c Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-312714967 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9807fb29a299419ba0f1331ce251edd4 Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-312714967-project Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e14ee42f-15c9-4c5d-94de-b8b326da39d3'} Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e14ee42f-15c9-4c5d-94de-b8b326da39d3 to delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e14ee42f-15c9-4c5d-94de-b8b326da39d3 could not be found. Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:02.481243 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:04:02.490012 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:02.499761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa9b3708-7a8c-4f61-93fd-e0c6b563a7c1 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:02.501186 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa9b3708-7a8c-4f61-93fd-e0c6b563a7c1 tempest-ImagesDeleteNegativeTestJSON-312714967 tempest-ImagesDeleteNegativeTestJSON-312714967-project] 10.222.0.25 "DELETE /compute/v2.1/images/e14ee42f-15c9-4c5d-94de-b8b326da39d3" status: 404 len: 62 microversion: 2.1 time: 0.060394 Oct 24 09:04:02.502882 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1450/2829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:02 2022] DELETE /compute/v2.1/images/e14ee42f-15c9-4c5d-94de-b8b326da39d3 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:02.669217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1bda1aef-6fff-4816-bd3d-a4a0e3096f94 req-ffbd5ca2-aa95-4e62-86fc-38bed488439c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bfde29-b507-464b-8e03-4b489e1c5022", "tag": "174f5f5c-67a6-419f-b87b-a93dc251186c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:02.682294 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:02.694920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bda1aef-6fff-4816-bd3d-a4a0e3096f94 req-ffbd5ca2-aa95-4e62-86fc-38bed488439c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:02.695475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bda1aef-6fff-4816-bd3d-a4a0e3096f94 req-ffbd5ca2-aa95-4e62-86fc-38bed488439c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:02.701078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bda1aef-6fff-4816-bd3d-a4a0e3096f94 req-ffbd5ca2-aa95-4e62-86fc-38bed488439c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:02.744964 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1bda1aef-6fff-4816-bd3d-a4a0e3096f94 req-ffbd5ca2-aa95-4e62-86fc-38bed488439c service nova] Creating event network-changed:174f5f5c-67a6-419f-b87b-a93dc251186c for instance 12bfde29-b507-464b-8e03-4b489e1c5022 on n-h1-master-1 Oct 24 09:04:02.766964 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1bda1aef-6fff-4816-bd3d-a4a0e3096f94 req-ffbd5ca2-aa95-4e62-86fc-38bed488439c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102840 Oct 24 09:04:02.770739 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1451/2830] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:02.784896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:02.786582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:02.806109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:02.806913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:02.808578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:02.809635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:02.811493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:02.813577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:02.982778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:02.994568 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2abe87df-819b-4f0e-b925-6696de576aaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1470 microversion: 2.1 time: 0.219269 Oct 24 09:04:02.996322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1452/2831] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:02 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:03.018507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-175700732", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbf671c7-9a45-4411-9bbb-7fbeb13e5538"}], "security_groups": [{"name": "tempest-securitygroup--1430410539"}], "key_name": "tempest-keypair-1108780880", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:03.188685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] validate_networks() for [('cbf671c7-9a45-4411-9bbb-7fbeb13e5538', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:03.815334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:03.815956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:03.816267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:03.816864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:03.817278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:03.834830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:03.835681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:03.836321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:03.837524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:03.838180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:03.839030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:03.867587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Getting quotas for project 5297380773734f4ab82dbb83f1c855e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:03.874638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Getting quotas for user 0faa202378cf499581a14f05c7cfa9c8 and project 5297380773734f4ab82dbb83f1c855e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:03.891839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:03.894475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:03.946523 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-610ac8a7-88a6-41f6-9401-806a804fcf4f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.967357 Oct 24 09:04:03.947772 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1380/2832] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:04:03.958179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9eb9ed74-dce5-495d-83bc-7b25184d4731 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-209507303", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f3f3a5c9-dc30-491a-90d5-1f3e34440945", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:04.047814 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9eb9ed74-dce5-495d-83bc-7b25184d4731 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Block Device f3f3a5c9-dc30-491a-90d5-1f3e34440945 is not bootable. Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9eb9ed74-dce5-495d-83bc-7b25184d4731 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 357 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-209507303", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f3f3a5c9-dc30-491a-90d5-1f3e34440945", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: exception: Block Device f3f3a5c9-dc30-491a-90d5-1f3e34440945 is not bootable. Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-209507303', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f3f3a5c9-dc30-491a-90d5-1f3e34440945'}], 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f3f3a5c9-dc30-491a-90d5-1f3e34440945 is not bootable. Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:04.055234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f3f3a5c9-dc30-491a-90d5-1f3e34440945 is not bootable. Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f3f3a5c9-dc30-491a-90d5-1f3e34440945 is not bootable. Oct 24 09:04:04.060580 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:04.064337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9eb9ed74-dce5-495d-83bc-7b25184d4731 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Block Device f3f3a5c9-dc30-491a-90d5-1f3e34440945 is not bootable. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:04.065764 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9eb9ed74-dce5-495d-83bc-7b25184d4731 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.116783 Oct 24 09:04:04.067708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1381/2833] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:04.071641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:04.072174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:04.072849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:04.074103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:04.074569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:04.074914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:04.075892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:04.085054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.086052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.086727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.087910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.088823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.089645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.098105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.098781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.102509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.104753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.105268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.105939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.132143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:04.138600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for user c703cc73a22749858ffe05500e52aa03 and project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:04.152615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:04.155083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:04.209225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4438034-6f50-4b0f-ab9d-74418fe87c70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.211376 Oct 24 09:04:04.210319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1453/2834] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:04:04.214823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b8a20e2-425e-46c8-a289-d844de370194 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:04.215698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b8a20e2-425e-46c8-a289-d844de370194 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:04.294619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b8a20e2-425e-46c8-a289-d844de370194 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:04.303313 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b8a20e2-425e-46c8-a289-d844de370194 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1216 microversion: 2.1 time: 0.092161 Oct 24 09:04:04.304108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1454/2835] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:04 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:04.308885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:04.309838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:04.317852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.318598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.319258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.320186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.320804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.321483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.503926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:04.518255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25dea8fa-a50f-43cf-b146-85771eb6c0dd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1470 microversion: 2.1 time: 0.212324 Oct 24 09:04:04.519544 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1455/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:04 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:04.526168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:04.527259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:04.537510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.539588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.540391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.546461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.548240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.549456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.835786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:04.857946 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-967be79f-39df-4432-a806-a650b7231571 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.327562 Oct 24 09:04:04.869572 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1456/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:04 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:04.869572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c69fb474-ac7f-4d21-865e-cceba4e5af79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:04.869572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c69fb474-ac7f-4d21-865e-cceba4e5af79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:04.900970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:04.909650 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6b033f10-ba01-484b-a529-e41d5fb31a15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.840515 Oct 24 09:04:04.912492 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1382/2838] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:04 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:04.925878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:04.934128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:04.954448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.956764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.965078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.966500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:04.967228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:04.967908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:04.988864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c69fb474-ac7f-4d21-865e-cceba4e5af79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:04.999238 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c69fb474-ac7f-4d21-865e-cceba4e5af79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1238 microversion: 2.1 time: 0.134770 Oct 24 09:04:05.002523 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1457/2839] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:04 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:05.333387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:05.334062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:05.367975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:05.370398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:05.370873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:05.381537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:05.382144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:05.382637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:05.522132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:05.538395 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bbadad95-0561-48f4-a842-a21159dd15f4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1268 microversion: 2.1 time: 0.206056 Oct 24 09:04:05.539771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1458/2840] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:05 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:05.557733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:05.558791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:05.572498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:05.574978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:05.575593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:05.577205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:05.579160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:05.581232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:05.631719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:05.646509 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d31f0e14-bab5-4cdb-8818-aba829f0f723 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.728671 Oct 24 09:04:05.662525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1383/2841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:04 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:05.883585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:05.896263 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e2beb188-1167-4cea-95d7-66b57c3a2cd0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1470 microversion: 2.1 time: 0.343097 Oct 24 09:04:05.897015 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1459/2842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:05 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:05.935138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:05.935836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:05.943782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:05.950811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:05.951791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:05.952715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:05.961122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:05.963541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:06.025372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:06.026417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:06.038924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:06.039430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:06.040191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:06.040925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:06.041236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:06.042250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:06.355089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:06.370887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c6cfe2e-29c2-443d-89d0-1b4f1256d9b6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1290 microversion: 2.1 time: 0.350089 Oct 24 09:04:06.371492 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1460/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:06 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1290 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:06.566683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:06.567693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:06.586671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:06.587933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:06.588553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:06.589694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:06.590341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:06.590780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:06.708634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:06.739835 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ceb4f556-426d-4568-854c-7a2b506bc301 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1274 microversion: 2.1 time: 0.178699 Oct 24 09:04:06.742648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1461/2844] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:06 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:06.879899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:06.918511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f31ce68-f7d1-4902-9a8d-6e779a673e5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.987149 Oct 24 09:04:06.921752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:06.922705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:06.934075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:06.935470 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1384/2845] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:05 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:06.936133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:06.936658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:06.940678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:06.943348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:06.944041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:07.398061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:07.398685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:07.405602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:07.406355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:07.407592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:07.409068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:07.410011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:07.410697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:07.483850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:07.509326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01e5220e-975c-46df-a9fb-2664ad41e593 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1470 microversion: 2.1 time: 0.589533 Oct 24 09:04:07.510303 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1462/2846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:06 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1470 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:07.775485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:07.776512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:07.789009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:07.789849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:07.790633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:07.791652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:07.792736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:07.795153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:07.948933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:07.960949 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8fbecb84-3153-4e9f-9368-92eb7d802579 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1274 microversion: 2.1 time: 0.190140 Oct 24 09:04:07.963528 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1463/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:07 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:07.983085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:07.983977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:07.993250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:07.994347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:07.995176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:07.996980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:07.997707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:07.998335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:08.113852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:08.134042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-377b9f1c-0eef-4d5a-b0b0-883284701ba3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1296 microversion: 2.1 time: 0.739740 Oct 24 09:04:08.136031 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1385/2848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:07 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1296 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:08.144616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-60ec500a-13da-4b3c-89f6-885e7ad70d77 req-8538bba9-3b5a-491c-82b7-3eae84a9ea10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9974bbd3-693c-41a1-9181-98ebb7b7f2a3", "name": "network-vif-plugged", "status": "completed", "tag": "826c0f4b-598f-4f5c-abba-c70b65dafd22"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:08.169740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60ec500a-13da-4b3c-89f6-885e7ad70d77 req-8538bba9-3b5a-491c-82b7-3eae84a9ea10 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:08.170513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60ec500a-13da-4b3c-89f6-885e7ad70d77 req-8538bba9-3b5a-491c-82b7-3eae84a9ea10 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:08.171351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60ec500a-13da-4b3c-89f6-885e7ad70d77 req-8538bba9-3b5a-491c-82b7-3eae84a9ea10 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:08.188516 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-60ec500a-13da-4b3c-89f6-885e7ad70d77 req-8538bba9-3b5a-491c-82b7-3eae84a9ea10 service nova] Creating event network-vif-plugged:826c0f4b-598f-4f5c-abba-c70b65dafd22 for instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 on n-h1-master-1 Oct 24 09:04:08.195549 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-60ec500a-13da-4b3c-89f6-885e7ad70d77 req-8538bba9-3b5a-491c-82b7-3eae84a9ea10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057958 Oct 24 09:04:08.197146 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1386/2849] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:08.411689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:08.422974 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca7c77cd-5d2f-4699-b582-1c10ee99e663 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.447745 Oct 24 09:04:08.425583 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1464/2850] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:07 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:08.496977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5b90947-997d-4b82-91ce-5221c1dc8251 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1977176891", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "destination_type": "local"}, {"source_type": "volume", "uuid": "84affe55-0509-4762-8499-5917b4698120", "destination_type": "invalid"}], "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5b90947-997d-4b82-91ce-5221c1dc8251 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 495 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1977176891", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "destination_type": "local"}, {"source_type": "volume", "uuid": "84affe55-0509-4762-8499-5917b4698120", "destination_type": "invalid"}], "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1977176891', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '84affe55-0509-4762-8499-5917b4698120', 'destination_type': 'invalid'}], 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:08.512039 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 24 09:04:08.516068 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:08.519468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5b90947-997d-4b82-91ce-5221c1dc8251 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:08.520788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5b90947-997d-4b82-91ce-5221c1dc8251 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030005 Oct 24 09:04:08.522287 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1387/2851] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:08 2022] POST /compute/v2.1/servers => generated 155 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:08.535236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:08.536596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:08.556825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:08.558545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:08.559824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:08.562344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:08.563160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:08.563931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:08.570951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:08.571714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:08.590536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:08.591034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:08.591480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:08.592198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:08.592662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:08.593164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:08.994543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:09.005452 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2977fc66-5acc-496f-9173-6e0056ddf591 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1462 microversion: 2.1 time: 0.463843 Oct 24 09:04:09.006695 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1388/2852] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:08 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1462 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:09.013314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:09.014497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:09.022300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.023257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.024064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.025000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.026034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.026777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.089912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:09.098481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bea8995a-ab49-4c69-8c42-f5212427f927 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.571459 Oct 24 09:04:09.099173 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1465/2853] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:08 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:09.103899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:09.104689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:09.112552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.113262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.113892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.114763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.115545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.116164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.147963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:09.158302 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c24f077d-e620-422e-87c7-95d73acf0e4c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1274 microversion: 2.1 time: 0.149650 Oct 24 09:04:09.160885 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1389/2854] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:09 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:09.179159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:09.180935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:09.188160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.189791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.190142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.191105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.191729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.192563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.568088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:09.597246 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c953282-a501-4af3-8cb7-d860cf40b775 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.434939 Oct 24 09:04:09.609319 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1390/2855] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:09 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:09.622426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:09.627640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:09.638777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.639703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.640547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.641606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.643003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.643832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.926644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7a9e992-92b0-485b-9ea9-d5a3028ea68c tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1613 microversion: 2.1 time: 0.826086 Oct 24 09:04:09.928170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1466/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:09 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1613 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:09.945104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:09.950637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:09.962864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.965201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.965911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.966972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:09.967703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:09.968343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:09.997276 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:10.041931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:10.061261 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56f34cd6-35d7-4bf5-82a1-39a5651b417c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.459533 Oct 24 09:04:10.062628 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1391/2857] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:09 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:10.071168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62e35078-80df-407a-b852-4c1465ad501e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-666684039", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62e35078-80df-407a-b852-4c1465ad501e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 491 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-666684039", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-666684039', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.079677 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 09:04:10.083254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:10.087177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62e35078-80df-407a-b852-4c1465ad501e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:10.088319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62e35078-80df-407a-b852-4c1465ad501e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.024464 Oct 24 09:04:10.089476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1392/2858] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:10 2022] POST /compute/v2.1/servers => generated 624 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:10.096161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6dfaef6c-12f2-42c2-bb59-4b6369262023 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '.version_select at 0x7f8dab087d30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:10.101339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dfaef6c-12f2-42c2-bb59-4b6369262023 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.102167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dfaef6c-12f2-42c2-bb59-4b6369262023 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.102713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dfaef6c-12f2-42c2-bb59-4b6369262023 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:10.112521 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6dfaef6c-12f2-42c2-bb59-4b6369262023 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.021799 Oct 24 09:04:10.113314 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1393/2859] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 09:04:10 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:10.118233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:10.119097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:10.127583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.128344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.129003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:10.129975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.130707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.131368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:10.480421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:10.499373 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-510b9ea6-46da-457f-bbb2-46ddda06c9fb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.568871 Oct 24 09:04:10.501645 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1467/2860] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:09 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:10.503924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:10.513721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:10.515172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:10.521253 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ff82a4a4-fd5a-46d2-8c12-bf17fb0ee406 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.406508 Oct 24 09:04:10.522090 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1394/2861] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:10 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:10.532216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.532710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.533183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:10.533911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.534376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.534803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:10.538821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1529663073", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:10.633741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:10.948110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:10.961937 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f0c9423-ef11-4491-b5d8-080f07240987 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.456355 Oct 24 09:04:10.962535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1468/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:10 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:10.982753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:10.983645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:10.991245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.992073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.992679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:10.993691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:10.994314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:10.994913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:11.341518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:11.351770 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcd36879-8f69-4e51-b1e2-1026e5c0c0f9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.377039 Oct 24 09:04:11.413994 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1469/2863] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:10 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:11.437133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-11f4a2f5-23a9-4e88-8c13-bba85866f2a0 req-c22f35cb-0326-41bb-bebf-d87e6f1cfbbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bfde29-b507-464b-8e03-4b489e1c5022", "name": "network-vif-plugged", "status": "completed", "tag": "174f5f5c-67a6-419f-b87b-a93dc251186c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:11.473756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-11f4a2f5-23a9-4e88-8c13-bba85866f2a0 req-c22f35cb-0326-41bb-bebf-d87e6f1cfbbc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:11.475575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-11f4a2f5-23a9-4e88-8c13-bba85866f2a0 req-c22f35cb-0326-41bb-bebf-d87e6f1cfbbc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:11.476015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-11f4a2f5-23a9-4e88-8c13-bba85866f2a0 req-c22f35cb-0326-41bb-bebf-d87e6f1cfbbc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:11.495296 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-11f4a2f5-23a9-4e88-8c13-bba85866f2a0 req-c22f35cb-0326-41bb-bebf-d87e6f1cfbbc service nova] Creating event network-vif-plugged:174f5f5c-67a6-419f-b87b-a93dc251186c for instance 12bfde29-b507-464b-8e03-4b489e1c5022 on n-h1-master-1 Oct 24 09:04:11.505692 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-11f4a2f5-23a9-4e88-8c13-bba85866f2a0 req-c22f35cb-0326-41bb-bebf-d87e6f1cfbbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090002 Oct 24 09:04:11.509445 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1470/2864] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:11.526192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:11.527258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:11.546479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:11.546976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:11.547415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:11.548139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:11.548614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:11.549047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:11.925005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:11.945406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c57a84b-c8b7-4670-b6b7-939a19aad004 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.434585 Oct 24 09:04:11.958122 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1471/2865] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:11 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:11.968145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae8f6689-16fa-41de-bf30-ba5db061411f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae8f6689-16fa-41de-bf30-ba5db061411f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 416 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.979952 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:11.985266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:11.995115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae8f6689-16fa-41de-bf30-ba5db061411f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:11.995996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae8f6689-16fa-41de-bf30-ba5db061411f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.036264 Oct 24 09:04:11.996597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1472/2866] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:11 2022] POST /compute/v2.1/servers => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:12.006348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:12.006972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:12.016159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.016658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.017103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.018038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.018519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.018946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.196880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:12.198123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:12.198123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:12.198363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:12.198960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:12.213140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.213666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.214239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.214847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.215334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.215768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.247389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:12.258339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for user 4dde4bb72f914457a633358837d178de and project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:12.271993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:12.275009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:12.338718 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25f3ef28-ddf7-4863-b403-274f96931a93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815522 Oct 24 09:04:12.339789 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1395/2867] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:04:12.342473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:12.346095 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-99e0635b-6f1b-4d16-9ad0-64cebfbe25b0 req-3d86f2e0-24d1-43ea-901d-2c76f9ea9c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:12.355374 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e22e9209-7bdd-4b1d-91dd-d00bf926792d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.357661 Oct 24 09:04:12.356287 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1473/2868] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:11 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:12.360491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-99e0635b-6f1b-4d16-9ad0-64cebfbe25b0 req-3d86f2e0-24d1-43ea-901d-2c76f9ea9c7e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.361104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:12.361442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-99e0635b-6f1b-4d16-9ad0-64cebfbe25b0 req-3d86f2e0-24d1-43ea-901d-2c76f9ea9c7e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.361749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:12.362231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-99e0635b-6f1b-4d16-9ad0-64cebfbe25b0 req-3d86f2e0-24d1-43ea-901d-2c76f9ea9c7e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.377964 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-99e0635b-6f1b-4d16-9ad0-64cebfbe25b0 req-3d86f2e0-24d1-43ea-901d-2c76f9ea9c7e service nova] Creating event network-changed:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:04:12.381635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.382137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.382586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.383292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.383752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.384069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-99e0635b-6f1b-4d16-9ad0-64cebfbe25b0 req-3d86f2e0-24d1-43ea-901d-2c76f9ea9c7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042633 Oct 24 09:04:12.384192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.385270 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1396/2869] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:12.390624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:12.391760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:12.399735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.400665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.401391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.402246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.402905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.403510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.683974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:12.707496 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9bfd0aa-eb4c-46ed-998f-1ef7256887b2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.349260 Oct 24 09:04:12.708843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1474/2870] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:12 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:12.726969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11dbb36b-3d4d-45db-9b5e-7bac31381f96 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:12.728367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-11dbb36b-3d4d-45db-9b5e-7bac31381f96 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:12.844933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-11dbb36b-3d4d-45db-9b5e-7bac31381f96 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:12.857871 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11dbb36b-3d4d-45db-9b5e-7bac31381f96 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1213 microversion: 2.1 time: 0.135604 Oct 24 09:04:12.858469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1475/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:12 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:12.886556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-063ab76d-f3da-4332-b6a5-1cc98c9aee7d req-3d675076-9901-4d22-8876-ebd9540e6ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c928430-9084-40d4-aaf7-d03af06c10b4", "tag": "3274e9dc-be01-4391-846a-7e43b44f7eb7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:12.901260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-063ab76d-f3da-4332-b6a5-1cc98c9aee7d req-3d675076-9901-4d22-8876-ebd9540e6ef7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:12.901808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-063ab76d-f3da-4332-b6a5-1cc98c9aee7d req-3d675076-9901-4d22-8876-ebd9540e6ef7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:12.902272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-063ab76d-f3da-4332-b6a5-1cc98c9aee7d req-3d675076-9901-4d22-8876-ebd9540e6ef7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:12.939397 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-063ab76d-f3da-4332-b6a5-1cc98c9aee7d req-3d675076-9901-4d22-8876-ebd9540e6ef7 service nova] Creating event network-changed:3274e9dc-be01-4391-846a-7e43b44f7eb7 for instance 4c928430-9084-40d4-aaf7-d03af06c10b4 on n-h2-master-1 Oct 24 09:04:12.947855 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-063ab76d-f3da-4332-b6a5-1cc98c9aee7d req-3d675076-9901-4d22-8876-ebd9540e6ef7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069436 Oct 24 09:04:12.950399 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1476/2872] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:12.983771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:12.985377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:12.997643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.000886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.004942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.006244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.007237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.008473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.110450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:13.120547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c67dc15e-5406-4a8c-bc36-f8c890ce116f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.733875 Oct 24 09:04:13.124637 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1397/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:12 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:13.156243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:13.157278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:13.165939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.166916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.167519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.168436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.169256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.169932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.272916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:13.281063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41642543-e941-4db3-a248-c048ca26562b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.302637 Oct 24 09:04:13.295431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1477/2874] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:12 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:13.384027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:13.385330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:13.398664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.399624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.400873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.402002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.402781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.403582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.530887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:13.544510 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3b3e6d00-af2a-4352-b1a7-4b23cdbe11a8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.394693 Oct 24 09:04:13.546583 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1398/2875] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:13 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:13.625168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:13.638352 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91b453be-2ecf-472c-a994-0bbeb22e5b0f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1319 microversion: 2.1 time: 0.259565 Oct 24 09:04:13.639336 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1478/2876] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:13 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:13.662391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2a2b9b0-6fb0-4dba-99a3-06ee1d6a0270 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-828821819", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": -1, "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:13.685045 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a2a2b9b0-6fb0-4dba-99a3-06ee1d6a0270 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Flavor -1 could not be found. Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2a2b9b0-6fb0-4dba-99a3-06ee1d6a0270 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 205 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-828821819", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": -1, "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: exception: Flavor -1 could not be found. Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-828821819', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': -1, 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:13.695932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 24 09:04:13.701027 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:13.705199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2a2b9b0-6fb0-4dba-99a3-06ee1d6a0270 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:13.706333 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2a2b9b0-6fb0-4dba-99a3-06ee1d6a0270 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.055544 Oct 24 09:04:13.707487 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1399/2877] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:13 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:13.715632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:13.716347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:13.724181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.725078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.725749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.726704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.732399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:13.733890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:13.739249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.741813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.746328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.748085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.750835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:13.752380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:13.753852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:13.756250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.119019 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:14.182280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:14.193272 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd0f206c-1eb9-494d-9481-81d028ec903a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.464878 Oct 24 09:04:14.202303 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1400/2878] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:13 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:14.207395 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:14.208201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:14.217172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:14.224943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.225473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.225912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.226620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.227075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.227506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.234609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-904abe1d-a58e-4c00-9a36-433f9e350e27 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.522923 Oct 24 09:04:14.235480 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1479/2879] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:13 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:14.236811 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:14.261073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:14.261718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:14.271911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.273219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.274266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.278625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.279465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.280279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.396212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:14.412266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6aae0d51-8ae0-4a20-9d09-a95c81a6f131 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1209 microversion: 2.1 time: 0.208422 Oct 24 09:04:14.412869 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1401/2880] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:14 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:14.423077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:14.423077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:14.447219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.450191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.452566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.453603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.455360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.457080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.746390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:14.758044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d70e9df7-20bd-4c76-b2d1-85b92503350d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.341923 Oct 24 09:04:14.759625 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1402/2881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:14 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:14.777950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:14.779142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:14.786663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.787516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.788794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.791199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:14.791915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:14.792571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:14.924343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:14.940369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28865b14-bee7-4d60-b3c2-6b31435013da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.683357 Oct 24 09:04:14.941554 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1480/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:14 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:15.035500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e24e8885-8f62-41c7-9009-39a9408bc254 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1257911974", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e24e8885-8f62-41c7-9009-39a9408bc254 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 173 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1257911974", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1257911974', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi -1 Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:15.041752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 24 09:04:15.046491 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:15.050079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e24e8885-8f62-41c7-9009-39a9408bc254 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:15.051116 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e24e8885-8f62-41c7-9009-39a9408bc254 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.021517 Oct 24 09:04:15.054479 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1481/2883] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:15 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:04:15.064135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:15.070230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:15.098065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.098571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.099022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.099765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.100214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.100644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.469501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:15.489157 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc7a96fc-a0ac-4f77-ac28-d50a325481ff tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1468 microversion: 2.1 time: 0.717741 Oct 24 09:04:15.490279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1403/2884] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:14 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:15.526329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:15.527346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:15.542278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.544805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.545534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.550886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:15.556372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.565224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.566087 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4dcfbe6b-2b2b-4e2a-836b-62aa71efcc3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.505925 Oct 24 09:04:15.566774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.568447 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1482/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:15 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:15.585713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:15.587292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:15.618714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.620288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.625130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.629263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.630289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.630934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.762037 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:15.773661 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f9037d3-211c-48f7-878d-036ed567f2e9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1271 microversion: 2.1 time: 0.200687 Oct 24 09:04:15.777578 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1483/2886] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:15 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:15.797943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:15.799046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:15.806732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.807490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.808411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:15.810202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:15.811425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:15.812056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.005457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:16.021734 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a436c0a-80aa-412b-a76d-ffe353bc399d tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.510382 Oct 24 09:04:16.025580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1404/2887] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:15 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:16.037558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:16.045042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:16.063232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.066290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.066878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.067627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.068189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.068632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.298420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:16.318850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f0cf1a09-e45b-4aed-8993-4dd98eb86b93 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 200 len: 1468 microversion: 2.1 time: 0.524897 Oct 24 09:04:16.319869 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1484/2888] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:15 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 1468 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:16.339900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:16.342408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:16.358677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.359465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.374772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.376350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.377618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.378252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.409096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:16.424786 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a4c0ae5-e4bb-4eb7-a121-c166f7457cdb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.388400 Oct 24 09:04:16.425842 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1405/2889] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:16 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:16.430508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:16.444270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:16.445391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Searching by: {'reservation_id': 'r-tj5vfvhn', 'deleted': False, 'project_id': '8469ec38031e46da9bfde167e0b6da15'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:04:16.463492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.464309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.464917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.466085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.466698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.471771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:16.629110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:04:16.713219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:16.722056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:16.722794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:16.723245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.001550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:17.010754 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c0fbd80-4846-4569-a8bb-43a8319e6f90 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-tj5vfvhn" status: 200 len: 2929 microversion: 2.1 time: 0.583725 Oct 24 09:04:17.011397 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1406/2890] 10.222.0.25 () {58 vars in 1197 bytes} [Mon Oct 24 09:04:16 2022] GET /compute/v2.1/servers/detail?reservation_id=r-tj5vfvhn => generated 2929 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:17.011751 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8bad2583-b469-41c9-a1d1-9c3b5d5d1166 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.689794 Oct 24 09:04:17.012516 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1485/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:16 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:17.016032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c4b0c47-5e6b-4956-980a-6e2c4e752fff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260364335", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:17.017595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.018440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:17.021035 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-2c4b0c47-5e6b-4956-980a-6e2c4e752fff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c4b0c47-5e6b-4956-980a-6e2c4e752fff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 216 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260364335", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1260364335', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:17.022666 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c4b0c47-5e6b-4956-980a-6e2c4e752fff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:17.026713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c4b0c47-5e6b-4956-980a-6e2c4e752fff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011676 Oct 24 09:04:17.034355 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1407/2892] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:17 2022] POST /compute/v2.1/servers => generated 123 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:17.042898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.043821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.044306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.044714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.045017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:17.046019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.046797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.047449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.061682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.062181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.062636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.063317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.063775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.064237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.145045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:17.157057 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ab14275-98e9-45b4-b8ad-552cfefc64b9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1271 microversion: 2.1 time: 0.143295 Oct 24 09:04:17.166164 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1486/2893] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:17.171196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.171818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:17.186619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.187137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.187576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.188289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.188749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.189221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.460887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:17.479417 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43cf7b35-122f-4546-bfc2-15e3779b10ab tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.311869 Oct 24 09:04:17.481178 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1487/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:17.486330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbcfc020-7b1f-4fb3-8b0c-2ce5feb27ab4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.522211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_groups [None req-fbcfc020-7b1f-4fb3-8b0c-2ce5feb27ab4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Querying cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) for 2 instances {{(pid=126920) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 09:04:17.523194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbcfc020-7b1f-4fb3-8b0c-2ce5feb27ab4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.523833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbcfc020-7b1f-4fb3-8b0c-2ce5feb27ab4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.524447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbcfc020-7b1f-4fb3-8b0c-2ce5feb27ab4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.552518 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:17.574247 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbcfc020-7b1f-4fb3-8b0c-2ce5feb27ab4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/257ff34c-28ae-4aed-8a1b-02a66fc5667f" status: 200 len: 265 microversion: 2.1 time: 0.091616 Oct 24 09:04:17.575395 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1488/2895] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/os-server-groups/257ff34c-28ae-4aed-8a1b-02a66fc5667f => generated 265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:17.593272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.594002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:17.604709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.609902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.610401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.611211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.611691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.615100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.777543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:17.788424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fbc6d9d9-1590-4869-90d8-412bd172b86e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.751749 Oct 24 09:04:17.790272 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1408/2896] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:17.820243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.821667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:17.829798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.831165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.832181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.833913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:17.834614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:17.835211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:17.968215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d99d0e46-92cf-4ffb-a442-00eba925c8cb tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 200 len: 1619 microversion: 2.1 time: 0.385154 Oct 24 09:04:17.969337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1489/2897] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 1619 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:17.997941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:17.998850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:18.016723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:18.017914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:18.018239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:18.018982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:18.020029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:18.020029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:18.262341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:18.291594 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a7b7c72c-13d1-4fc0-bfbe-99d3332ac71c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.476017 Oct 24 09:04:18.334252 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1409/2898] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:18.347423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:18.348349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:18.359714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:18.361459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:18.362176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:18.364340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:18.365069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:18.365930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:18.437206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f36712d-ae3b-43c4-a613-4d11a0b9bfbd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 200 len: 1619 microversion: 2.1 time: 0.443353 Oct 24 09:04:18.440439 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1490/2899] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:17 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 1619 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:18.447345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:18.454269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:18.464314 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:18.479764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:18.480271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:18.486789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:18.487403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:18.487892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:18.488327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:19.051430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:19.060591 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-750d9afe-c51c-420d-ac4e-67750e27bf80 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.619040 Oct 24 09:04:19.061811 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1491/2900] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:18 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:19.066766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fe4b0b1-47d9-48fe-ba9c-0438d24f22be tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-409213700", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-key-1943905994", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:19.152293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-2fe4b0b1-47d9-48fe-ba9c-0438d24f22be tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] validate_networks() for [('65b21b22-ec29-4a51-8372-119e9b9fb46e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:19.152445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:19.163673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10391a54-6086-4436-a74a-24085e009bfb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.828503 Oct 24 09:04:19.167119 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1410/2901] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:18 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:19.176461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8174698f-001f-497a-9241-b066300f030d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: .version_select at 0x7f8dab088d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-200372855", "policies": ["anti-affinity"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:19.237702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8174698f-001f-497a-9241-b066300f030d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:19.258220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8174698f-001f-497a-9241-b066300f030d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:19.267320 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:19.349437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8174698f-001f-497a-9241-b066300f030d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:19.356837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8174698f-001f-497a-9241-b066300f030d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:19.375983 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8174698f-001f-497a-9241-b066300f030d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.207238 Oct 24 09:04:19.390257 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1411/2902] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:04:19 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:19.399084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:19.400247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:19.412343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:19.414125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:19.414866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:19.415829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:19.416544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:19.417217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:19.808036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:19.817024 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d21f072b-f2bc-4c41-802f-c619f326b8bd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.425208 Oct 24 09:04:19.837896 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1412/2903] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:19 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:19.843124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-530eb477-117f-4dbf-baf4-18e1bfda114a req-ab5a2d75-3704-4fd6-9076-c6d13db97c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-plugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:19.853177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-530eb477-117f-4dbf-baf4-18e1bfda114a req-ab5a2d75-3704-4fd6-9076-c6d13db97c68 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:19.853818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-530eb477-117f-4dbf-baf4-18e1bfda114a req-ab5a2d75-3704-4fd6-9076-c6d13db97c68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:19.854187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-530eb477-117f-4dbf-baf4-18e1bfda114a req-ab5a2d75-3704-4fd6-9076-c6d13db97c68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:19.867642 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-530eb477-117f-4dbf-baf4-18e1bfda114a req-ab5a2d75-3704-4fd6-9076-c6d13db97c68 service nova] Creating event network-vif-plugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:04:19.872831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-530eb477-117f-4dbf-baf4-18e1bfda114a req-ab5a2d75-3704-4fd6-9076-c6d13db97c68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Oct 24 09:04:19.873646 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1413/2904] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:19.878841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1970639452", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e4467b06-108a-4f75-a4d0-5f365d110411"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:19.970032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:20.209739 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2fe4b0b1-47d9-48fe-ba9c-0438d24f22be tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Invalid key_name provided. Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fe4b0b1-47d9-48fe-ba9c-0438d24f22be tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 246 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-409213700", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-key-1943905994", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid key_name provided. Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-409213700', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'key_name': 'tempest-key-1943905994', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1943905994 not found for user 136253a1592742219ad302722be1d5f2 Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:20.211850 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fe4b0b1-47d9-48fe-ba9c-0438d24f22be tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid key_name provided. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fe4b0b1-47d9-48fe-ba9c-0438d24f22be tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.150246 Oct 24 09:04:20.216160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1492/2905] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 1151 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:20.346807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:20.347368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:20.347676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:20.348174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:20.349584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:20.367306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:20.367873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:20.368230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:20.368946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:20.369426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:20.370034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:20.388828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:20.396249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:20.414043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Going to run 2 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:20.416365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:20.421094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-713549613", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "a99780c5-0a2c-42de-b031-d9ba98da98c0"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:20.480531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:20.487501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:20.494521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] validate_networks() for [('a99780c5-0a2c-42de-b031-d9ba98da98c0', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:20.528419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:20.534056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:20.547974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=79880949-0db7-4d94-ad5a-b089feeb6b12,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:20.608665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:20.615356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:20.653950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:20.661543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:20.700329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-767053a2-5c6b-4284-8305-2191e90990f7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.825583 Oct 24 09:04:20.700937 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1414/2906] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 24 09:04:20.710150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:20.710941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:20.722258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:20.723005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:20.723688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:20.724607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:20.725272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:20.725926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:20.961615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:20.974035 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c906e30-5581-4d18-9560-92997fc54a2c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.268049 Oct 24 09:04:20.979534 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1415/2907] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:20 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:20.989959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:20.992930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:21.005038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.011936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.012415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.013173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.013673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.014109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.264614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:21.274340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d3444f7-d45b-4c10-b7a2-c441ac6c4155 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1364 microversion: 2.1 time: 0.293596 Oct 24 09:04:21.276072 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1416/2908] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:20 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:21.280739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:21.281387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:21.298120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.299175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.300145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.300876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.301364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.301803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.521934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:21.535252 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97774e68-6ed2-4fc8-b66e-df2430a616fd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.258073 Oct 24 09:04:21.549321 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1417/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:21 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:21.551795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:21.558520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:21.559606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Searching by: {'deleted': False, 'project_id': '8469ec38031e46da9bfde167e0b6da15'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:04:21.562783 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:21.590182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.590868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.591532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.592850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.593867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.594590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.602167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:21.603337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:21.603924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:21.604413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:21.605068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:21.631049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.632496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.636379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.638294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.638999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.641564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.646122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:04:21.685436 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9361f9e1-f21a-4524-bc15-7cb51538f989 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.138994 Oct 24 09:04:21.686369 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1418/2910] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:04:21 2022] GET /compute/v2.1/servers => generated 1665 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:21.691371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for project 175a13a281b24a6289e68a76402eb470. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:21.693974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-87b78745-08a7-4143-9549-160095f4a50b req-88c19021-ea27-413e-a73c-13e3d590cf5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1aa993-e737-4665-8cf7-131a2664698e", "tag": "33302f1a-e11a-4309-ab6f-81766769c0ea"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:21.705927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-87b78745-08a7-4143-9549-160095f4a50b req-88c19021-ea27-413e-a73c-13e3d590cf5e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.706564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-87b78745-08a7-4143-9549-160095f4a50b req-88c19021-ea27-413e-a73c-13e3d590cf5e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.707105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-87b78745-08a7-4143-9549-160095f4a50b req-88c19021-ea27-413e-a73c-13e3d590cf5e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.712217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for user 09b32a47b2874040a560e3f3776fdff9 and project 175a13a281b24a6289e68a76402eb470. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:21.721659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-87b78745-08a7-4143-9549-160095f4a50b req-88c19021-ea27-413e-a73c-13e3d590cf5e service nova] Creating event network-changed:33302f1a-e11a-4309-ab6f-81766769c0ea for instance ea1aa993-e737-4665-8cf7-131a2664698e on n-h2-master-1 Oct 24 09:04:21.727285 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-87b78745-08a7-4143-9549-160095f4a50b req-88c19021-ea27-413e-a73c-13e3d590cf5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039791 Oct 24 09:04:21.728453 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1419/2911] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:21.734615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:21.735462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:21.743616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.744818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.745485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.746367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.746987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:21.747370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.747906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.751336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:21.852798 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ea3f7481-d62e-420e-90d3-6d6659968a66 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630656 Oct 24 09:04:21.855107 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1493/2912] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:04:21.865010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:21.866920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:21.878826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.881176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.882733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:21.884394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:21.885802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:21.886943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.060030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:22.069819 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:22.081585 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7154a462-dae8-4179-a6fc-f55085c14d10 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.351475 Oct 24 09:04:22.083990 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1420/2913] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:21 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:22.089669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:22.092755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:22.116855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.117498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.117695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.118474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.118825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.119244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.241801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:22.253337 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37ed73a3-73ab-4682-832b-58911c2f5b53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1223 microversion: 2.1 time: 0.164879 Oct 24 09:04:22.269504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1421/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:22 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1223 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:22.274690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c56b5bed-952a-423f-be40-de765e748052 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:22.275490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c56b5bed-952a-423f-be40-de765e748052 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:22.408321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c56b5bed-952a-423f-be40-de765e748052 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:22.424176 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c56b5bed-952a-423f-be40-de765e748052 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1224 microversion: 2.1 time: 0.152632 Oct 24 09:04:22.424783 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1422/2915] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:22 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:22.428587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:22.446231 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae0fdf5f-276f-472f-9327-cd6ec380add4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.583836 Oct 24 09:04:22.462145 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1494/2916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:21 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:22.462958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ad6f53dd-b8f9-4917-b16d-234deb6ce612 req-c0a23ee2-fd35-49bd-8642-35166c3f934d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c928430-9084-40d4-aaf7-d03af06c10b4", "name": "network-vif-plugged", "status": "completed", "tag": "3274e9dc-be01-4391-846a-7e43b44f7eb7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:22.466464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:22.467309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:22.474842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.487918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.488702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.488832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ad6f53dd-b8f9-4917-b16d-234deb6ce612 req-c0a23ee2-fd35-49bd-8642-35166c3f934d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.491286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.492625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ad6f53dd-b8f9-4917-b16d-234deb6ce612 req-c0a23ee2-fd35-49bd-8642-35166c3f934d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.492753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.493103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ad6f53dd-b8f9-4917-b16d-234deb6ce612 req-c0a23ee2-fd35-49bd-8642-35166c3f934d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.494089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.515586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ad6f53dd-b8f9-4917-b16d-234deb6ce612 req-c0a23ee2-fd35-49bd-8642-35166c3f934d service nova] Creating event network-vif-plugged:3274e9dc-be01-4391-846a-7e43b44f7eb7 for instance 4c928430-9084-40d4-aaf7-d03af06c10b4 on n-h2-master-1 Oct 24 09:04:22.538254 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ad6f53dd-b8f9-4917-b16d-234deb6ce612 req-c0a23ee2-fd35-49bd-8642-35166c3f934d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092825 Oct 24 09:04:22.539936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1423/2917] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:22.552143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:22.552856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:22.571055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.571646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.571992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.572689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.573142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.573600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.762436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:22.766428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:22.771747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb760c0b-b025-467b-bd9e-efd0c591de87 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1550 microversion: 2.1 time: 0.230421 Oct 24 09:04:22.772946 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1424/2918] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:22 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1550 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:22.775092 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1b13e91-ae2f-4072-8617-782f9ef021c6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.325009 Oct 24 09:04:22.775668 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1495/2919] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:22 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:22.778022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97e4577e-c3f3-4247-b1b6-104f6bb36d66 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1075486660", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:22.807409 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:22.808213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:22.815004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.815591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.816091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.816851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.817408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.817914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.887230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-97e4577e-c3f3-4247-b1b6-104f6bb36d66 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Neutron security group does_not_exist not found {{(pid=126919) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 24 09:04:22.887813 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-97e4577e-c3f3-4247-b1b6-104f6bb36d66 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97e4577e-c3f3-4247-b1b6-104f6bb36d66 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 258 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1075486660", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1075486660', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 24 09:04:22.893283 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:22.898617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97e4577e-c3f3-4247-b1b6-104f6bb36d66 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:22.903528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97e4577e-c3f3-4247-b1b6-104f6bb36d66 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.120669 Oct 24 09:04:22.903528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1425/2920] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:22 2022] POST /compute/v2.1/servers => generated 106 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:22.908193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:22.909566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:22.917250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.917954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.918566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.919342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:22.919815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:22.920235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:22.948479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-084bb701-af1c-436b-86a6-ba9efdd8e669 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144783 Oct 24 09:04:22.949721 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1496/2921] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:04:22 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:23.119752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:23.122272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:23.136986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.137565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.151635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.163088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.163781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.164389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.523193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:23.537019 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac1b6d08-33a2-47ad-a63e-c2b94a566c87 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.635409 Oct 24 09:04:23.538238 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1426/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:22 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:23.544680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:23.546242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:23.569105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.571115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.571848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.572887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.573996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.575518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.682225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:23.710940 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95efde7f-a668-49f8-98b9-d0d51613291c tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.604365 Oct 24 09:04:23.718653 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1497/2923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:23 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:23.728768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:23.729338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:23.740158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:23.752826 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f9228b63-cc1b-4f0e-a2f2-5f9697c402bc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1271 microversion: 2.1 time: 0.211927 Oct 24 09:04:23.753183 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1427/2924] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:23 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:23.763818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.770531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.771827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.772572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.773033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.774202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:23.774995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:23.779702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.783742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.784470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.785083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.785981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.786594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.787239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.919374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:23.929396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4512c3a9-3d98-44d1-bfaa-5f74d5171138 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1276 microversion: 2.1 time: 0.209329 Oct 24 09:04:23.930378 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1498/2925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:23 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:23.948063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:23.963194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:23.969879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.971124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.971634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:23.972599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:23.973282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:23.973938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:24.322491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:24.331893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91047d57-dd50-44c1-9178-36b68ca0f0f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.398813 Oct 24 09:04:24.332452 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1499/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:23 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:24.529614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:24.540036 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71638dc8-2265-46bb-a143-a452bf2aef13 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.779898 Oct 24 09:04:24.559150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1428/2927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:23 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:24.572111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd336f8d-9f71-4230-b675-c78245a3cc22 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:24.572984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd336f8d-9f71-4230-b675-c78245a3cc22 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: ad031c3d-d576-4bec-b85d-4a35d4dbd9e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:24.585034 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dd336f8d-9f71-4230-b675-c78245a3cc22 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 could not be found. Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd336f8d-9f71-4230-b675-c78245a3cc22 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 HTTP/1.1 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: exception: Instance ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 could not be found. Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ad031c3d-d576-4bec-b85d-4a35d4dbd9e9'} Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 could not be found. Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 could not be found. Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:24.586941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 could not be found. Oct 24 09:04:24.590872 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:24.595325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd336f8d-9f71-4230-b675-c78245a3cc22 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:24.596675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd336f8d-9f71-4230-b675-c78245a3cc22 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad031c3d-d576-4bec-b85d-4a35d4dbd9e9" status: 404 len: 111 microversion: 2.1 time: 0.028738 Oct 24 09:04:24.599191 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1500/2928] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:04:24 2022] DELETE /compute/v2.1/servers/ad031c3d-d576-4bec-b85d-4a35d4dbd9e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:04:24.607184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:24.608313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:24.625974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:24.627418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:24.628293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:24.629492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:24.635598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:24.636229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:24.735051 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:24.736486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:24.748957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:24.749908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:24.750373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:24.751481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:24.752617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:24.753088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.395268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:25.404787 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a03d4c50-0687-46ef-899d-4f3ef8522179 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.800722 Oct 24 09:04:25.412866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1429/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:24 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:25.418788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:25.428299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:25.429175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:25.432717 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f429377-612c-4f80-b6dd-bdf92f577fcb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1316 microversion: 2.1 time: 0.701793 Oct 24 09:04:25.449457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1501/2930] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:24 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:25.451768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.452873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.453656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.454585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:25.455193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.455602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:25.455839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.456453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.462367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.464417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.465104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.466124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.466753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.467350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.577184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:25.586655 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8dbbfeb-7368-485a-8956-3ada93ada781 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1282 microversion: 2.1 time: 0.135897 Oct 24 09:04:25.587451 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1502/2931] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:25 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:25.592667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:25.593879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:25.600078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.600846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.601576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.605604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.606156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.606609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.653077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:25.664426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1eb7357e-e730-4b49-bd88-f2b2c0149243 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1277 microversion: 2.1 time: 0.257187 Oct 24 09:04:25.665400 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1430/2932] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:25 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:25.680988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:25.682114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:25.693124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.693736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.694254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.695306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:25.695851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:25.696465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:25.925269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:25.934552 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bf0dba3-e487-4021-9cf8-8e0cdcd21e20 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.345756 Oct 24 09:04:25.949466 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1503/2933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:25 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:26.093235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:26.105003 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d484c155-2d67-4ae9-9054-3bf22f4339d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.437531 Oct 24 09:04:26.120928 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1431/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:25 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:26.131087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f03e908-a534-4e59-a561-2858f75ed437 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:26.132771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f03e908-a534-4e59-a561-2858f75ed437 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 09:04:26.133669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0f03e908-a534-4e59-a561-2858f75ed437 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f03e908-a534-4e59-a561-2858f75ed437 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9223372036854775808 could not be found. Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9223372036854775808'} Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:26.135445 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:26.139379 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:26.139379 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:26.139379 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:26.139379 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 24 09:04:26.139379 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:26.153256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f03e908-a534-4e59-a561-2858f75ed437 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:26.154472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f03e908-a534-4e59-a561-2858f75ed437 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.027345 Oct 24 09:04:26.159905 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1504/2935] 10.222.0.25 () {58 vars in 1188 bytes} [Mon Oct 24 09:04:26 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:26.164773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:26.165423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:26.171925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.172413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.172982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:26.173630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.174085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.174509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:26.455972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:26.457199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:26.463636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:26.469759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.470865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.473495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:26.474972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.477204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.477494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ce44c34-e188-4ec0-818f-f5ec1deda8a3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.316484 Oct 24 09:04:26.478239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:26.486380 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1432/2936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:26 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:26.498813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-716c6954-772d-4803-993a-dd32d358eb26 req-fdc2b1b6-efb8-46f8-b676-8d9c065ffb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:26.521629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-716c6954-772d-4803-993a-dd32d358eb26 req-fdc2b1b6-efb8-46f8-b676-8d9c065ffb64 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.522021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-716c6954-772d-4803-993a-dd32d358eb26 req-fdc2b1b6-efb8-46f8-b676-8d9c065ffb64 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.522451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-716c6954-772d-4803-993a-dd32d358eb26 req-fdc2b1b6-efb8-46f8-b676-8d9c065ffb64 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:26.551341 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-716c6954-772d-4803-993a-dd32d358eb26 req-fdc2b1b6-efb8-46f8-b676-8d9c065ffb64 service nova] Creating event network-changed:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:04:26.561402 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-716c6954-772d-4803-993a-dd32d358eb26 req-fdc2b1b6-efb8-46f8-b676-8d9c065ffb64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069280 Oct 24 09:04:26.563598 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1433/2937] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:26.568976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:26.569708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:26.583153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.584086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.584744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:26.585726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:26.586354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:26.587751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.099993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:27.114802 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d8728bd-4687-47da-a443-5fc77a5ca3c0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.549443 Oct 24 09:04:27.116055 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1434/2938] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:26 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:27.133498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:27.134893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:27.143646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:27.147710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:27.149232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.150767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:27.154096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:27.155110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.318802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:27.338969 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d740af1d-1307-4b13-91f6-012c0f72b64f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1504 microversion: 2.1 time: 0.886670 Oct 24 09:04:27.341001 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1505/2939] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:26 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1504 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:27.349641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:27.350510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:27.360028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:27.361382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:27.362571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.364913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:27.365882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:27.367376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.555627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:27.611602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b313563-6898-4cf0-b1b7-e8cde71bd075 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.488200 Oct 24 09:04:27.628826 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1435/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:27 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:27.634211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:27.635047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:27.649829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:27.650997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:27.651452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.652173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:27.652642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:27.653079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:27.958681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:27.975533 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f11b5d57-91ef-46ff-b9ab-4ca0adf3eb48 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.345198 Oct 24 09:04:27.977277 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1436/2941] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:27 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:27.982291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62bb40a1-8c40-4a90-84ed-c3ac3bb8a8c6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:27.982896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-62bb40a1-8c40-4a90-84ed-c3ac3bb8a8c6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Failed to fetch instance by id -1 {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 09:04:27.983725 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-62bb40a1-8c40-4a90-84ed-c3ac3bb8a8c6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance -1 could not be found. Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62bb40a1-8c40-4a90-84ed-c3ac3bb8a8c6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: exception: Instance -1 could not be found. Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '-1'} Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:27.987949 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:27.992954 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:27.992954 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:27.992954 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 24 09:04:27.992954 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:27.994349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62bb40a1-8c40-4a90-84ed-c3ac3bb8a8c6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:27.995400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62bb40a1-8c40-4a90-84ed-c3ac3bb8a8c6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017052 Oct 24 09:04:27.999537 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1437/2942] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:04:27 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:28.005736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-616602324"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:28.006477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:28.014155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:28.015067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:28.015664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:28.016756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:28.017420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:28.017989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:28.037993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:28.049217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ee89009-05a9-463d-a9a2-707b2183a762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.704302 Oct 24 09:04:28.061346 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1506/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:27 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:28.070670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:28.071883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:28.084037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:28.084544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:28.084986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:28.085743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:28.086206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:28.086637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:28.757795 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Adding security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 to port 3274e9dc-be01-4391-846a-7e43b44f7eb7 Oct 24 09:04:28.883342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:28.908171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a834df5-b302-46ab-97b1-c9cadf9801b4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.856091 Oct 24 09:04:28.910390 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1507/2944] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:28 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:28.921341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e522b6ef-07a7-4cc2-9746-18274a728ecd req-4b192f8d-978f-4c96-81bc-ff0cdd218fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1aa993-e737-4665-8cf7-131a2664698e", "name": "network-vif-plugged", "status": "completed", "tag": "33302f1a-e11a-4309-ab6f-81766769c0ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:28.979743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e522b6ef-07a7-4cc2-9746-18274a728ecd req-4b192f8d-978f-4c96-81bc-ff0cdd218fa7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:28.981358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e522b6ef-07a7-4cc2-9746-18274a728ecd req-4b192f8d-978f-4c96-81bc-ff0cdd218fa7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:28.981842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e522b6ef-07a7-4cc2-9746-18274a728ecd req-4b192f8d-978f-4c96-81bc-ff0cdd218fa7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.018714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e522b6ef-07a7-4cc2-9746-18274a728ecd req-4b192f8d-978f-4c96-81bc-ff0cdd218fa7 service nova] Creating event network-vif-plugged:33302f1a-e11a-4309-ab6f-81766769c0ea for instance ea1aa993-e737-4665-8cf7-131a2664698e on n-h2-master-1 Oct 24 09:04:29.026359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e522b6ef-07a7-4cc2-9746-18274a728ecd req-4b192f8d-978f-4c96-81bc-ff0cdd218fa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113878 Oct 24 09:04:29.028667 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1508/2945] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:29.035888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:29.037166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:29.051957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.053441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.054163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.055704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.056423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.057092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.535685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:29.538019 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:29.545786 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08b9ee74-8a32-4c7a-8a39-51455f43d07d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.515625 Oct 24 09:04:29.546973 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1509/2946] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:29 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:29.553016 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:29.553819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:29.559962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.560700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.561336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.562185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.562794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.563374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.803526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:29.812706 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d4b31f6-5285-4b6f-99f0-4207e2e0c1b8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.264529 Oct 24 09:04:29.813306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1510/2947] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:29 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:29.820565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:29.821420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:29.829236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.830515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.831129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.832079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.834032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.835171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.907030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c18c7586-e5fd-4077-9848-bf2b912ec9b7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4/action" status: 202 len: 0 microversion: 2.1 time: 1.906159 Oct 24 09:04:29.908560 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1438/2948] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:27 2022] POST /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4/action => generated 0 bytes in 1908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:29.913761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:29.914627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:29.924946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.925719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.926405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:29.927299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:29.927912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:29.928557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.149945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:30.172478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13f148e6-13ea-4b6a-a5e8-beb90c7b2ba7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1313 microversion: 2.1 time: 0.357224 Oct 24 09:04:30.174493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1511/2949] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:29 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:30.186242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e35f3a27-980e-4a5e-bd90-6ddb2aa9624c req-478cdd67-5830-46bc-b0b7-a366fb5d85b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79880949-0db7-4d94-ad5a-b089feeb6b12", "tag": "d0aa76ce-106c-4a84-b277-1b2116ea94fa"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:30.210312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e35f3a27-980e-4a5e-bd90-6ddb2aa9624c req-478cdd67-5830-46bc-b0b7-a366fb5d85b9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.211031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e35f3a27-980e-4a5e-bd90-6ddb2aa9624c req-478cdd67-5830-46bc-b0b7-a366fb5d85b9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.212106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e35f3a27-980e-4a5e-bd90-6ddb2aa9624c req-478cdd67-5830-46bc-b0b7-a366fb5d85b9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.228285 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e35f3a27-980e-4a5e-bd90-6ddb2aa9624c req-478cdd67-5830-46bc-b0b7-a366fb5d85b9 service nova] Creating event network-changed:d0aa76ce-106c-4a84-b277-1b2116ea94fa for instance 79880949-0db7-4d94-ad5a-b089feeb6b12 on n-h1-master-1 Oct 24 09:04:30.235933 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e35f3a27-980e-4a5e-bd90-6ddb2aa9624c req-478cdd67-5830-46bc-b0b7-a366fb5d85b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058572 Oct 24 09:04:30.238605 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1512/2950] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:30.246679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6ffc886-27d0-4a93-adfe-f3c0e5a9f8ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:30.247477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6ffc886-27d0-4a93-adfe-f3c0e5a9f8ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: e8fa664e-8398-427f-936e-703d48929b52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:30.255985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d6ffc886-27d0-4a93-adfe-f3c0e5a9f8ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance e8fa664e-8398-427f-936e-703d48929b52 could not be found. Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6ffc886-27d0-4a93-adfe-f3c0e5a9f8ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/e8fa664e-8398-427f-936e-703d48929b52/action HTTP/1.1 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 19 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: {"forceDelete": {}} Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: exception: Instance e8fa664e-8398-427f-936e-703d48929b52 could not be found. Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e8fa664e-8398-427f-936e-703d48929b52', 'body': {'forceDelete': {}}} Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8fa664e-8398-427f-936e-703d48929b52 could not be found. Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fa664e-8398-427f-936e-703d48929b52 could not be found. Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:30.261867 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:30.266717 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:30.266717 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:30.266717 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fa664e-8398-427f-936e-703d48929b52 could not be found. Oct 24 09:04:30.266717 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.268813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6ffc886-27d0-4a93-adfe-f3c0e5a9f8ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance e8fa664e-8398-427f-936e-703d48929b52 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:30.269850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6ffc886-27d0-4a93-adfe-f3c0e5a9f8ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/e8fa664e-8398-427f-936e-703d48929b52/action" status: 404 len: 111 microversion: 2.1 time: 0.029948 Oct 24 09:04:30.270779 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1513/2951] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:30 2022] POST /compute/v2.1/servers/e8fa664e-8398-427f-936e-703d48929b52/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:30.276194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1bc3a8d1-9b81-4917-9ee8-d2f0f5d8b7d2 req-26d298db-3027-493c-8a8a-cb28345859fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c30cbd-eeaa-47e8-80a6-6b54432918bf", "tag": "149996fe-e248-44cf-8a07-10ff4f0650ae"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:30.292614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bc3a8d1-9b81-4917-9ee8-d2f0f5d8b7d2 req-26d298db-3027-493c-8a8a-cb28345859fe service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.293434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bc3a8d1-9b81-4917-9ee8-d2f0f5d8b7d2 req-26d298db-3027-493c-8a8a-cb28345859fe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.294056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1bc3a8d1-9b81-4917-9ee8-d2f0f5d8b7d2 req-26d298db-3027-493c-8a8a-cb28345859fe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.309237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1bc3a8d1-9b81-4917-9ee8-d2f0f5d8b7d2 req-26d298db-3027-493c-8a8a-cb28345859fe service nova] Creating event network-changed:149996fe-e248-44cf-8a07-10ff4f0650ae for instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf on n-h1-master-1 Oct 24 09:04:30.317423 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1bc3a8d1-9b81-4917-9ee8-d2f0f5d8b7d2 req-26d298db-3027-493c-8a8a-cb28345859fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044436 Oct 24 09:04:30.318599 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1514/2952] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:30.325905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dbf6b9e-1514-48e4-8867-fadf15f78e3b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa54f700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:30.364760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:30.379902 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e377e60-09d6-4260-aa0a-1a29153c60c9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.470059 Oct 24 09:04:30.380962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1439/2953] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:29 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:30.402948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:30.418711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:30.428672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.434269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.435966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.437496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.438739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.440503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.528929 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-3dbf6b9e-1514-48e4-8867-fadf15f78e3b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use.", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:30.532320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3dbf6b9e-1514-48e4-8867-fadf15f78e3b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.532320 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dbf6b9e-1514-48e4-8867-fadf15f78e3b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 HTTP/1.1 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: exception: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5e7b1808-3050-4f0b-8ded-576e4a8ce7a8'} Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:30.537175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dbf6b9e-1514-48e4-8867-fadf15f78e3b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 400 to user: Security Group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 in use. Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-419d90ae-b709-43b4-8460-4a8456f6d2af'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:30.541782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3dbf6b9e-1514-48e4-8867-fadf15f78e3b tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8" status: 400 len: 185 microversion: 2.1 time: 0.219962 Oct 24 09:04:30.544999 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1515/2954] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:30 2022] DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 => generated 185 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:30.553177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:30.566052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:30.573483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.574075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.574733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.575630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.576263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.576741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.681375 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8c74d0f-0286-430c-a911-d14ae05053d2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4/action" status: 202 len: 0 microversion: 2.1 time: 0.134493 Oct 24 09:04:30.682436 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1516/2955] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:30 2022] POST /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:04:30.687956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:30.689695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:30.697368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.697887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.698382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.699303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.700437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.700813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.936958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:30.944453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:30.945642 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7224b041-db27-44e6-95a6-0812497d54a1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.563126 Oct 24 09:04:30.958564 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1440/2956] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:30 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:30.968312 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2463738b-18df-4a68-9e5a-a73d13d204d4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.279131 Oct 24 09:04:30.968312 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1517/2957] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:30 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:30.971451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:30.972244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:30.981997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:30.982732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:30.984450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.985110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.985758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.986621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.987250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.987830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.991500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.992086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.992607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:30.996857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:30.997463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:30.997979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.270946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:31.281751 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f385c062-7167-468d-8c59-56d3936040d3 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1574 microversion: 2.1 time: 0.321810 Oct 24 09:04:31.282990 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1441/2958] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:30 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1574 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:31.290001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:31.290884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.304651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.307783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.308233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.309565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.310430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.311105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.316306 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:31.333455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:31.343301 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-51edaea2-3300-4174-80a3-4685974226ef tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.364853 Oct 24 09:04:31.344906 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1518/2959] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:30 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:31.367639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67931d2a-3d8c-49a0-8dd8-715653dce126 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:31.370163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67931d2a-3d8c-49a0-8dd8-715653dce126 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 181c2d8b-b0a9-498a-9de7-f20955f2b72f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.376291 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-67931d2a-3d8c-49a0-8dd8-715653dce126 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 181c2d8b-b0a9-498a-9de7-f20955f2b72f could not be found. Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67931d2a-3d8c-49a0-8dd8-715653dce126 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/181c2d8b-b0a9-498a-9de7-f20955f2b72f/action HTTP/1.1 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 39 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: {"os-getConsoleOutput": {"length": 10}} Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 181c2d8b-b0a9-498a-9de7-f20955f2b72f could not be found. Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '181c2d8b-b0a9-498a-9de7-f20955f2b72f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181c2d8b-b0a9-498a-9de7-f20955f2b72f could not be found. Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181c2d8b-b0a9-498a-9de7-f20955f2b72f could not be found. Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:31.379759 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181c2d8b-b0a9-498a-9de7-f20955f2b72f could not be found. Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67931d2a-3d8c-49a0-8dd8-715653dce126 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 181c2d8b-b0a9-498a-9de7-f20955f2b72f could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67931d2a-3d8c-49a0-8dd8-715653dce126 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/181c2d8b-b0a9-498a-9de7-f20955f2b72f/action" status: 404 len: 111 microversion: 2.1 time: 0.017819 Oct 24 09:04:31.383896 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1519/2960] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:31 2022] POST /compute/v2.1/servers/181c2d8b-b0a9-498a-9de7-f20955f2b72f/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:31.390064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:31.391169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.398293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.398738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.399177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.399880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.400338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.400792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.464383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:31.473053 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c5cd161-e801-45b5-af3d-3b397b9d5d86 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1463 microversion: 2.1 time: 0.188732 Oct 24 09:04:31.490914 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1442/2961] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:31 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:31.493491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:31.494132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.500443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.501888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.502463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.503363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.504019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.504652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.612830 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:31.651876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:31.660744 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-343dfac1-819f-426a-98a9-01a7c3333c37 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.171224 Oct 24 09:04:31.663246 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:31.666192 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1443/2962] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:31 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:31.678756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:31.681260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.691572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.692303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.692740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.693510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.694602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.694729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.708297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:31.716591 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7ecdcc5-2262-4032-b3fc-e52033195cf9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.330410 Oct 24 09:04:31.721710 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1520/2963] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:31 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:31.745591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:31.746628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.752761 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=22 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:31.755064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.755672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.756233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.757038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.757768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.758299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.792585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:31.802791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Old instance type m1.heat2, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:04:31.810768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:31.811189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:31.812208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:31.812208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:31.812510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:31.938419 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f39f9ce3-ba58-4f19-af02-93ae4f6a59d4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e/action" status: 202 len: 0 microversion: 2.1 time: 0.267222 Oct 24 09:04:31.942988 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1444/2964] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:31 2022] POST /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:31.949160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:31.950582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:31.957617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.958081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.959048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:31.959919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:31.960531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:31.961112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.103585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:32.128197 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04d7f190-8aba-4463-a7f3-d44a5e14e73e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.387346 Oct 24 09:04:32.129455 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1521/2965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:31 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:32.135078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:32.135717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:32.150857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.152243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.152910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.153983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.154668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.155286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.413580 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=46 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:32.525743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:32.529535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:32.534702 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb49df35-9ab5-41db-af53-7e457e382ee3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1472 microversion: 2.1 time: 0.589916 Oct 24 09:04:32.549821 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e33ebc38-d73e-4f8f-8e6c-15a06e07f569 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.408244 Oct 24 09:04:32.550157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1445/2966] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:31 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1472 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:32.550157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75797ba9-0c95-4347-afe9-6e6e1071b729 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:32.550157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-75797ba9-0c95-4347-afe9-6e6e1071b729 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: b5316a8f-cbc4-4848-a350-e9ffa639e642] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:32.551040 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-75797ba9-0c95-4347-afe9-6e6e1071b729 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance b5316a8f-cbc4-4848-a350-e9ffa639e642 could not be found. Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75797ba9-0c95-4347-afe9-6e6e1071b729 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b5316a8f-cbc4-4848-a350-e9ffa639e642 HTTP/1.1 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b5316a8f-cbc4-4848-a350-e9ffa639e642 could not be found. Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b5316a8f-cbc4-4848-a350-e9ffa639e642'} Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5316a8f-cbc4-4848-a350-e9ffa639e642 could not be found. Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5316a8f-cbc4-4848-a350-e9ffa639e642 could not be found. Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:32.552814 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:32.557449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:32.557449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:32.557449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:32.557449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5316a8f-cbc4-4848-a350-e9ffa639e642 could not be found. Oct 24 09:04:32.557449 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:32.557925 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1522/2967] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:32 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:32.558976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75797ba9-0c95-4347-afe9-6e6e1071b729 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance b5316a8f-cbc4-4848-a350-e9ffa639e642 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:32.560042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-75797ba9-0c95-4347-afe9-6e6e1071b729 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/b5316a8f-cbc4-4848-a350-e9ffa639e642" status: 404 len: 111 microversion: 2.1 time: 0.019816 Oct 24 09:04:32.560251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:32.560877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:32.561457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1446/2968] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:32 2022] GET /compute/v2.1/servers/b5316a8f-cbc4-4848-a350-e9ffa639e642 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:32.566919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c928430-9084-40d4-aaf7-d03af06c10b4", "tag": "3274e9dc-be01-4391-846a-7e43b44f7eb7"}, {"name": "network-changed", "server_uuid": "57931b05-1825-48c4-b9a7-6a6428f90265", "tag": "a877f774-d630-4f0a-994f-ce1ddcbd0fac"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:32.568552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.569056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.569532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.570245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.570761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.571201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.584871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.585437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.585870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.607832 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] Creating event network-changed:3274e9dc-be01-4391-846a-7e43b44f7eb7 for instance 4c928430-9084-40d4-aaf7-d03af06c10b4 on n-h2-master-1 Oct 24 09:04:32.608788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] Creating event network-changed:a877f774-d630-4f0a-994f-ce1ddcbd0fac for instance 57931b05-1825-48c4-b9a7-6a6428f90265 on n-h2-master-1 Oct 24 09:04:32.615862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1210c78e-922d-4713-9e0a-b5463a1bb369 req-2100fc26-3fda-4854-8c7e-ef90f87bca23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053016 Oct 24 09:04:32.617247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1447/2969] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:32.623572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:32.624394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:32.634117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.634784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.635294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.636090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.636623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.637122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.793280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:32.802219 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38d99ef1-bcec-46c5-bb0d-d5023830d6a6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.183346 Oct 24 09:04:32.803275 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1448/2970] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:32 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:32.808449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:32.809281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:32.817237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.818222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.818991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:32.819909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:32.820548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:32.821155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.023570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:33.034126 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe5632af-54f8-4ea2-83de-a444a7e5cf53 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.229728 Oct 24 09:04:33.035796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1449/2971] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:32 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:33.041214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:33.041942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:33.053187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.053838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.054308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.054952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.055560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.056125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.077213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:33.087813 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e2709d0f-32c5-4611-b155-af9ab0aca5e4 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1574 microversion: 2.1 time: 0.531142 Oct 24 09:04:33.092337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1523/2972] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:32 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1574 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:33.244384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:33.253247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd14a558-e13f-47bb-a2b1-088cd00cf0e6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.215790 Oct 24 09:04:33.253847 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1450/2973] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:33 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:33.321764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37af0b62-d3ed-4eef-8be4-1808fb7cb52e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1733872319", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37af0b62-d3ed-4eef-8be4-1808fb7cb52e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 238 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1733872319", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1733872319', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.340083 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 24 09:04:33.344887 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:33.347691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37af0b62-d3ed-4eef-8be4-1808fb7cb52e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:33.348720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37af0b62-d3ed-4eef-8be4-1808fb7cb52e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031039 Oct 24 09:04:33.349377 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1524/2974] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:33.357791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:33.358403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:33.365048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.365561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.365990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.366676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.367298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.367885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.567404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:33.568576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:33.577050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.577883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.578630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.580485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.581634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.582130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.601775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:33.609788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67bea040-a9b3-428f-a1ef-55f36963df1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.255888 Oct 24 09:04:33.618878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1451/2975] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:33 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:33.623723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:33.627191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:33.638978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.642052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.642731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.643925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.649871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.650648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.897028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:33.912270 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed0f35f3-55b9-4753-a3c1-7dba07d4620f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1472 microversion: 2.1 time: 0.291983 Oct 24 09:04:33.914195 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1452/2976] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:33 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:33.921531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:33.922407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:33.930805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.931665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.932310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.934781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:33.935495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:33.936131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:33.996232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:34.007541 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9750eb55-4867-4a6f-86e3-9bf4235581e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.446768 Oct 24 09:04:34.024926 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1525/2977] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:33 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:34.056511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:34.057391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:34.087779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.097928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.098402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.099334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.099970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.100668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.274781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:34.282646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3dbbc7a6-2e9f-48d2-95cc-c824ca1bdc39 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.367097 Oct 24 09:04:34.286236 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1453/2978] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:33 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:34.302292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:34.303239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:34.319370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.320124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.320729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.321669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.322280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.322863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.503212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:34.512443 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7ace808-9910-4165-a970-567b60e89e3e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.459847 Oct 24 09:04:34.513400 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1526/2979] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:34 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:34.518474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05869048-1917-4c57-8c7e-1d687189621f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1156064775", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05869048-1917-4c57-8c7e-1d687189621f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 235 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1156064775", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1156064775', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.523331 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 24 09:04:34.528205 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:34.530873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05869048-1917-4c57-8c7e-1d687189621f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:34.531927 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05869048-1917-4c57-8c7e-1d687189621f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.017375 Oct 24 09:04:34.533026 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1527/2980] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:34 2022] POST /compute/v2.1/servers => generated 133 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:34.541831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:34.542696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:34.551306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.552091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.552697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.553666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.554330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.555023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.640316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:34.652121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b56e760a-1a3b-4641-a815-c707473d1671 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1572 microversion: 2.1 time: 0.353564 Oct 24 09:04:34.654797 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1454/2981] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:34 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1572 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:34.682133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-250813647"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:34.684276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:34.693892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.694412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.694855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.698376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.698869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.699311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.932045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:34.942681 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Adding security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe to port 3274e9dc-be01-4391-846a-7e43b44f7eb7 Oct 24 09:04:34.948216 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5da47ab7-b26d-4d90-96e1-dc5e0912b8b9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.410129 Oct 24 09:04:34.949847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1528/2982] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:34 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:34.954665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:34.955479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:34.985373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.986946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.987673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:34.992055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:34.992914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:34.993659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.354364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:35.370905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7ad7863-1e11-4f61-a0cb-46641b0da294 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1472 microversion: 2.1 time: 0.419557 Oct 24 09:04:35.373475 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1529/2983] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:34 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:35.383421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:35.385145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:35.395834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.396536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.397274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.398305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.398964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.399587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.474520 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f414662e-1986-48b4-994b-c4cbefde22ac tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4/action" status: 202 len: 0 microversion: 2.1 time: 0.799249 Oct 24 09:04:35.476723 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1455/2984] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:34 2022] POST /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:35.482462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:35.484001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:35.491627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.492419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.493095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.494031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.494698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.495334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.696625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:35.706926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f8ffa0a0-dea7-4b47-a1dc-a589dcc1d30f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.228853 Oct 24 09:04:35.707507 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1456/2985] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:35 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:35.713161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adeac4c9-2fcb-4149-b372-1523e5e67601 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab462f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:35.754226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:35.777731 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d4a2f70-870e-48c1-a960-2f0e6f3a1148 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.402509 Oct 24 09:04:35.778585 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1530/2986] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:35 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:35.786320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-55402ed4-6826-4ba3-a733-d43a2ab71c85 req-c523c431-0f3b-4c54-a344-852052c02f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c928430-9084-40d4-aaf7-d03af06c10b4", "tag": "3274e9dc-be01-4391-846a-7e43b44f7eb7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:35.799136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55402ed4-6826-4ba3-a733-d43a2ab71c85 req-c523c431-0f3b-4c54-a344-852052c02f80 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.800067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55402ed4-6826-4ba3-a733-d43a2ab71c85 req-c523c431-0f3b-4c54-a344-852052c02f80 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.800718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55402ed4-6826-4ba3-a733-d43a2ab71c85 req-c523c431-0f3b-4c54-a344-852052c02f80 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.815805 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-55402ed4-6826-4ba3-a733-d43a2ab71c85 req-c523c431-0f3b-4c54-a344-852052c02f80 service nova] Creating event network-changed:3274e9dc-be01-4391-846a-7e43b44f7eb7 for instance 4c928430-9084-40d4-aaf7-d03af06c10b4 on n-h2-master-1 Oct 24 09:04:35.822514 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-55402ed4-6826-4ba3-a733-d43a2ab71c85 req-c523c431-0f3b-4c54-a344-852052c02f80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041601 Oct 24 09:04:35.823985 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1531/2987] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:35.832304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:35.833447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:35.843021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.843910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.844562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.846563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.847255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.848018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.870370 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:35.912283 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-adeac4c9-2fcb-4149-b372-1523e5e67601 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use.", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:35.913524 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-adeac4c9-2fcb-4149-b372-1523e5e67601 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.913524 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adeac4c9-2fcb-4149-b372-1523e5e67601 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe HTTP/1.1 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: exception: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3de74e57-eef0-41bf-90e5-4cccf26a64fe'} Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:35.919185 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] Oct 24 09:04:35.922999 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.931459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adeac4c9-2fcb-4149-b372-1523e5e67601 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 400 to user: Security Group 3de74e57-eef0-41bf-90e5-4cccf26a64fe in use. Oct 24 09:04:35.931459 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-cfcf9dcd-33b8-4015-b95a-8818831b2ad0'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:35.934531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-adeac4c9-2fcb-4149-b372-1523e5e67601 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe" status: 400 len: 185 microversion: 2.1 time: 0.225391 Oct 24 09:04:35.935520 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1457/2988] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:35 2022] DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe => generated 185 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:35.942412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-327b2ef8-af18-4ab1-8301-792d254b1836 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:35.949799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-327b2ef8-af18-4ab1-8301-792d254b1836 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: bc110645-f4db-43a5-9952-669dec6d2d04] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:35.962072 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-327b2ef8-af18-4ab1-8301-792d254b1836 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance bc110645-f4db-43a5-9952-669dec6d2d04 could not be found. Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-327b2ef8-af18-4ab1-8301-792d254b1836 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/bc110645-f4db-43a5-9952-669dec6d2d04/action HTTP/1.1 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 13 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: {"pause": {}} Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: exception: Instance bc110645-f4db-43a5-9952-669dec6d2d04 could not be found. Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'bc110645-f4db-43a5-9952-669dec6d2d04', 'body': {'pause': {}}} Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc110645-f4db-43a5-9952-669dec6d2d04 could not be found. Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc110645-f4db-43a5-9952-669dec6d2d04 could not be found. Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:35.968626 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:35.973132 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:35.973132 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:35.973132 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc110645-f4db-43a5-9952-669dec6d2d04 could not be found. Oct 24 09:04:35.973132 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:35.973132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-327b2ef8-af18-4ab1-8301-792d254b1836 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance bc110645-f4db-43a5-9952-669dec6d2d04 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:35.973132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-327b2ef8-af18-4ab1-8301-792d254b1836 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/bc110645-f4db-43a5-9952-669dec6d2d04/action" status: 404 len: 111 microversion: 2.1 time: 0.033657 Oct 24 09:04:35.974580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1458/2989] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:35 2022] POST /compute/v2.1/servers/bc110645-f4db-43a5-9952-669dec6d2d04/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:35.979308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:35.980240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:35.987955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.988849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.989513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:35.990588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:35.991266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:35.991911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.022893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:04:36.117775 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:36.162041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cfc9179-8ca6-46f0-83fb-f75141a6ae6f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 204 len: 0 microversion: 2.1 time: 0.185807 Oct 24 09:04:36.163559 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1459/2990] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:04:35 2022] DELETE /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:04:36.171117 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:36.171917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:36.182786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.183279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.183718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.185234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.185723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.186199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.363959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:36.381417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8cbc4993-53c7-4618-8795-3a8e03e68a32 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.216151 Oct 24 09:04:36.382157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1460/2991] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:36 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:36.386930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:36.397021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:36.433840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.434461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.434914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.438414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.438930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.439530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.468185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:36.480339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6edfb2c-3188-458b-b974-f1f77c6b318a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.652352 Oct 24 09:04:36.481574 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1532/2992] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:35 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:36.488297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:36.489431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:36.502002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.502743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.503360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.504215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.504827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.505906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.671189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:36.680459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e777f5e-d121-433a-ac49-35484f85a7c4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.196794 Oct 24 09:04:36.693884 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1533/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:36 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:36.706652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:36.707493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:36.718175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.719310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.721128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.721973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.722638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.723271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.802946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:36.812262 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dac8769d-6af1-49c1-a8d8-e29332a7d4ae tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1646 microversion: 2.1 time: 0.428742 Oct 24 09:04:36.813515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1461/2994] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:36 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1646 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:36.818555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fb0a29bc-6465-426e-a642-65eaac4fc4d3 req-2eb1b353-5825-4ea1-ad1d-f6fd92adfd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57931b05-1825-48c4-b9a7-6a6428f90265", "name": "network-vif-plugged", "status": "completed", "tag": "a877f774-d630-4f0a-994f-ce1ddcbd0fac"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:36.829951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fb0a29bc-6465-426e-a642-65eaac4fc4d3 req-2eb1b353-5825-4ea1-ad1d-f6fd92adfd43 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.830662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fb0a29bc-6465-426e-a642-65eaac4fc4d3 req-2eb1b353-5825-4ea1-ad1d-f6fd92adfd43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.831593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fb0a29bc-6465-426e-a642-65eaac4fc4d3 req-2eb1b353-5825-4ea1-ad1d-f6fd92adfd43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.848498 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fb0a29bc-6465-426e-a642-65eaac4fc4d3 req-2eb1b353-5825-4ea1-ad1d-f6fd92adfd43 service nova] Creating event network-vif-plugged:a877f774-d630-4f0a-994f-ce1ddcbd0fac for instance 57931b05-1825-48c4-b9a7-6a6428f90265 on n-h2-master-1 Oct 24 09:04:36.854468 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fb0a29bc-6465-426e-a642-65eaac4fc4d3 req-2eb1b353-5825-4ea1-ad1d-f6fd92adfd43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038952 Oct 24 09:04:36.855390 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1462/2995] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:36.861446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:36.862511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:36.869257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.870111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.870658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.872274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.872885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.873441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.898560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:36.910319 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e95c07e-ddc1-43fa-9444-d0645e672792 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.208762 Oct 24 09:04:36.910919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1534/2996] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:36 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:36.936981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:36.937724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:36.944125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.944930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.945684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:36.946660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:36.947857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:36.948526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.029247 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efb9654e-6085-4ebe-b292-cdc990a346f2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 202 len: 0 microversion: 2.1 time: 0.093016 Oct 24 09:04:37.033715 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1535/2997] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:36 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:04:37.039129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:37.048144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:37.057381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.057381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.057381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.057381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.057745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.058201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.102364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:37.112288 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d649cda9-acb6-405f-bca5-0e1aac909564 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.254937 Oct 24 09:04:37.117202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1463/2998] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:36 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:37.256775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:37.266455 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44194305-af90-4f9b-abed-2623f364b7f4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1511 microversion: 2.1 time: 0.231535 Oct 24 09:04:37.267345 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1536/2999] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:37 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:37.509766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:37.510401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:37.519422 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:37.539602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.541811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.542869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.545431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.548806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.551681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.708251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:37.708871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:37.713021 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:37.716541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.717027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.717498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.718197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.718649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.719069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.858052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:37.870497 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0af5e6e4-810a-4352-bbe0-01133651d840 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.365669 Oct 24 09:04:37.871229 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1464/3000] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:37 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:37.877223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:37.878045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:37.885247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.886063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.887136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:37.888094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:37.888657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:37.889187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.013565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:38.026888 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3400edb8-b707-4916-947f-468048044810 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.322504 Oct 24 09:04:38.047011 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1537/3001] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:37 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:38.140382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:38.145591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:38.156926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.156926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.157221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.158494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.158985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.159419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.206059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:38.216246 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b180617e-1675-4555-b22a-f63127b170bb tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1646 microversion: 2.1 time: 0.343031 Oct 24 09:04:38.217572 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1465/3002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:37 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1646 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:38.289661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:38.290286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:38.296319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.296816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.297255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.298314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.298484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.298917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.421592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:38.432082 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-78857884-0bb1-4cf6-98f5-3991155da89f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.295564 Oct 24 09:04:38.432812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1538/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:38 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:38.604994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-56275ced-d17b-46cc-b744-26d323b4e58f req-5d965fa4-f3cb-43d1-bead-05dbd0081c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c928430-9084-40d4-aaf7-d03af06c10b4", "name": "network-vif-deleted", "tag": "3274e9dc-be01-4391-846a-7e43b44f7eb7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:38.621180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56275ced-d17b-46cc-b744-26d323b4e58f req-5d965fa4-f3cb-43d1-bead-05dbd0081c32 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.625552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56275ced-d17b-46cc-b744-26d323b4e58f req-5d965fa4-f3cb-43d1-bead-05dbd0081c32 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.637663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56275ced-d17b-46cc-b744-26d323b4e58f req-5d965fa4-f3cb-43d1-bead-05dbd0081c32 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.651907 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-56275ced-d17b-46cc-b744-26d323b4e58f req-5d965fa4-f3cb-43d1-bead-05dbd0081c32 service nova] Creating event network-vif-deleted:3274e9dc-be01-4391-846a-7e43b44f7eb7 for instance 4c928430-9084-40d4-aaf7-d03af06c10b4 on n-h2-master-1 Oct 24 09:04:38.659014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-56275ced-d17b-46cc-b744-26d323b4e58f req-5d965fa4-f3cb-43d1-bead-05dbd0081c32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057703 Oct 24 09:04:38.662671 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1539/3004] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:38.896641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:38.897397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:38.906107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.906726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.907429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.909228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:38.910703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:38.911420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:38.989542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:39.012475 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dde813f2-8c51-4a68-9143-ad53be764ac0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1491 microversion: 2.1 time: 0.726389 Oct 24 09:04:39.013101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1466/3005] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:38 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1491 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:39.022700 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2bd07bd1-ca98-4b05-bd84-d372a97f0e8f req-d0bba43a-d6e6-4ff8-99f7-9b11d71caa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c30cbd-eeaa-47e8-80a6-6b54432918bf", "name": "network-vif-plugged", "status": "completed", "tag": "149996fe-e248-44cf-8a07-10ff4f0650ae"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:39.039085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bd07bd1-ca98-4b05-bd84-d372a97f0e8f req-d0bba43a-d6e6-4ff8-99f7-9b11d71caa7b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.039891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bd07bd1-ca98-4b05-bd84-d372a97f0e8f req-d0bba43a-d6e6-4ff8-99f7-9b11d71caa7b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.040475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bd07bd1-ca98-4b05-bd84-d372a97f0e8f req-d0bba43a-d6e6-4ff8-99f7-9b11d71caa7b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.063410 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2bd07bd1-ca98-4b05-bd84-d372a97f0e8f req-d0bba43a-d6e6-4ff8-99f7-9b11d71caa7b service nova] Creating event network-vif-plugged:149996fe-e248-44cf-8a07-10ff4f0650ae for instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf on n-h1-master-1 Oct 24 09:04:39.072824 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2bd07bd1-ca98-4b05-bd84-d372a97f0e8f req-d0bba43a-d6e6-4ff8-99f7-9b11d71caa7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058479 Oct 24 09:04:39.073615 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1467/3006] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:39.082463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:39.083081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:39.090149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.090612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.091042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.091733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.092179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.092596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.106520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:39.120372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e464d213-0bea-4ffb-a3c7-35a17911e0ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1319 microversion: 2.1 time: 0.228638 Oct 24 09:04:39.133927 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'pause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state paused Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 13 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: {"pause": {}} Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'pause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state paused Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'pause': {}}} Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state paused. Cannot pause while the instance is in this state. Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state paused Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:39.137542 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:39.142644 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:39.142644 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:39.142644 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:39.142644 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state paused Oct 24 09:04:39.142644 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:39.143906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'pause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state paused {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:39.145019 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df57d04e-3d61-41fe-a352-2a5c3c56e850 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 143 microversion: 2.1 time: 0.067551 Oct 24 09:04:39.146082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1468/3007] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:39 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 143 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:39.151073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:39.151880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:39.155163 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1540/3008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:38 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:39.160138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.160817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.161472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.162321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:39.162500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.162786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.162918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:39.163213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.182071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.182680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.183120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.183910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.184366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.184807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.346472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-598d047b-1447-4caa-9011-5023c4706a23 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 202 len: 0 microversion: 2.1 time: 0.180700 Oct 24 09:04:39.351628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1541/3009] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:39 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:39.367768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:39.368485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:39.386564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.387166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.387613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.388316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.388773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.389207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.429882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.430609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.431218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.431673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lazy-loading 'fault' on Instance uuid 4c928430-9084-40d4-aaf7-d03af06c10b4 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:04:39.492543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:39.500545 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00917d47-ed04-4fc1-a4b5-2bc86e6d3aa0 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 200 len: 1306 microversion: 2.1 time: 0.145208 Oct 24 09:04:39.501949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1542/3010] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:39 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 1306 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:39.507820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:39.508944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:39.515093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.515671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.516242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.517863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.518398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.518896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.532549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:39.541230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67b7bcc4-78e8-4fb7-8430-e5c08a1a9c70 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.393970 Oct 24 09:04:39.541832 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1469/3011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:39 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:39.546745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:39.547558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:39.555421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.556473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.557144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.558187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:39.558902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:39.559584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:39.688715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:39.699953 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f974865c-5359-452e-a88a-aebee48c1507 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1498 microversion: 2.1 time: 0.195887 Oct 24 09:04:39.700632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1543/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:39 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:39.867128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:39.881185 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64854e27-7ac2-4a59-9abf-9b23d8d5bd99 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.338092 Oct 24 09:04:39.882495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1470/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:39 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:40.163244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.164662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:40.172095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.172692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.173939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.174647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.175103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.175526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.312664 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:40.320537 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79728615-2fc9-4f8f-bdb5-c5a473e38417 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1467 microversion: 2.1 time: 0.161116 Oct 24 09:04:40.333495 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1544/3014] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:40 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1467 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:40.342375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.342984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:40.349377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.349857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.350285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.351043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.351394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.351881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.497239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:40.508055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17e9c325-a126-4bdb-8af3-dee8f9d68d0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1319 microversion: 2.1 time: 0.168967 Oct 24 09:04:40.508821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1471/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:40 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:40.524440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.525059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:40.531910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.533178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.533646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.534691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.535249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.535795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.552242 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 HTTP/1.1 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4c928430-9084-40d4-aaf7-d03af06c10b4'} Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:40.553914 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64a442e7-e229-419d-b27c-1e86714e08a2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 404 len: 111 microversion: 2.1 time: 0.034849 Oct 24 09:04:40.557966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1545/3016] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:40 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:40.565833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e6fe331-af3c-4791-b33e-9382b89ed8a7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab3ee040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.570669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.571292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:40.578288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.579823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.580595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.581598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.582292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.582920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.759146 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e6fe331-af3c-4791-b33e-9382b89ed8a7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8" status: 202 len: 0 microversion: 2.1 time: 0.198431 Oct 24 09:04:40.759748 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1472/3017] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:40 2022] DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:04:40.767343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.767953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:40.774024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.774785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.775219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.776150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.776827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.777480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.796183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:40.807501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e88b8d14-e44d-447a-b8c5-4c67e5db1573 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.240787 Oct 24 09:04:40.809383 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1546/3018] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:40 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:40.814760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-920a5b0d-a8dc-4549-ae9c-6b47d32356f7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa54f550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.938008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:40.947581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5bb1a0c-e7d8-4d21-b836-e3d985097d53 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.183811 Oct 24 09:04:40.948174 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1473/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:40 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:40.953543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:40.954109 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:40.963038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.963671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.964230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:40.965170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:40.965874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:40.966570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.067878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-920a5b0d-a8dc-4549-ae9c-6b47d32356f7 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe" status: 202 len: 0 microversion: 2.1 time: 0.257156 Oct 24 09:04:41.068531 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1547/3020] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:40 2022] DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:41.076814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.077690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:41.104564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.105277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.105750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.108853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.109358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.109802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.130255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:41.139641 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee06c663-5b67-48a1-bffa-00153ccc703a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1324 microversion: 2.1 time: 0.190069 Oct 24 09:04:41.140222 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1474/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:40 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1324 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:41.154199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3296ea4b-f436-445c-81bd-ecc0e93af6ad tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'create', calling method: .version_select at 0x7f8dab11e940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-724064879", "description": "tempest-description-381505609"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:41.298056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:41.306063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09385820-c676-4e5c-85ed-0c7a392342d3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.236213 Oct 24 09:04:41.306646 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1548/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:41 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:41.311879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a39da4d0-cbc5-4aaf-8ea5-52f8f6199752 req-601b57a8-86ef-4495-8ad7-55ea116d5733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79880949-0db7-4d94-ad5a-b089feeb6b12", "name": "network-vif-plugged", "status": "completed", "tag": "d0aa76ce-106c-4a84-b277-1b2116ea94fa"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:41.321607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a39da4d0-cbc5-4aaf-8ea5-52f8f6199752 req-601b57a8-86ef-4495-8ad7-55ea116d5733 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.322405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a39da4d0-cbc5-4aaf-8ea5-52f8f6199752 req-601b57a8-86ef-4495-8ad7-55ea116d5733 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.322840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a39da4d0-cbc5-4aaf-8ea5-52f8f6199752 req-601b57a8-86ef-4495-8ad7-55ea116d5733 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.327052 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:41.334411 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3296ea4b-f436-445c-81bd-ecc0e93af6ad tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.192703 Oct 24 09:04:41.335057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1475/3023] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:04:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:41.335570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a39da4d0-cbc5-4aaf-8ea5-52f8f6199752 req-601b57a8-86ef-4495-8ad7-55ea116d5733 service nova] Creating event network-vif-plugged:d0aa76ce-106c-4a84-b277-1b2116ea94fa for instance 79880949-0db7-4d94-ad5a-b089feeb6b12 on n-h1-master-1 Oct 24 09:04:41.340699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a39da4d0-cbc5-4aaf-8ea5-52f8f6199752 req-601b57a8-86ef-4495-8ad7-55ea116d5733 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032860 Oct 24 09:04:41.341286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1549/3024] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:41.350784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da0abab2-4438-4c5d-bc12-f0adadf4ffb2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Action: 'update', calling method: .version_select at 0x7f8daa4f0550>, body: {"security_group": {"name": "tempest-sg-hth-17378905", "description": "tempest-description-hth-1264023125"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:41.352057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:41.355800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:41.363147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.364045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.365034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.365836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.366289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.366710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.382834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac/action HTTP/1.1 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 28 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: {"reboot": {"type": "SOFT"}} Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac', 'body': {'reboot': {'type': 'SOFT'}}} Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:41.384512 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6b097b67-8c37-4695-a96e-7cd819bda2a4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac/action" status: 404 len: 111 microversion: 2.1 time: 0.049839 Oct 24 09:04:41.389232 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1476/3025] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:41 2022] POST /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:41.396434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.397276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:41.405490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.406895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.408871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.409770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.410974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.411904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.637474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da0abab2-4438-4c5d-bc12-f0adadf4ffb2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/20783c3c-cf4d-4fe9-a73b-d32c87481095" status: 200 len: 216 microversion: 2.1 time: 0.292470 Oct 24 09:04:41.638651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1550/3026] 10.222.0.25 () {60 vars in 1290 bytes} [Mon Oct 24 09:04:41 2022] PUT /compute/v2.1/os-security-groups/20783c3c-cf4d-4fe9-a73b-d32c87481095 => generated 216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:41.644399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.645439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:41.658545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.659045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.664653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.665860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.666552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.667180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.702655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:41.713068 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a89f7b9-159a-42d4-b249-f9543bb01de2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.322081 Oct 24 09:04:41.713669 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1477/3027] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:41 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:41.727834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0f9470d-d647-438d-86a7-9d2a1b9694d5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dabaa7700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.777909 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0f9470d-d647-438d-86a7-9d2a1b9694d5 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/20783c3c-cf4d-4fe9-a73b-d32c87481095" status: 200 len: 216 microversion: 2.1 time: 0.054781 Oct 24 09:04:41.778612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1478/3028] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:04:41 2022] GET /compute/v2.1/os-security-groups/20783c3c-cf4d-4fe9-a73b-d32c87481095 => generated 216 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:41.788763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.790407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:41.795901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.796480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.797037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.797833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.798365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.798982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.895102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:41.903642 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6938d4bb-9ccc-44f1-971a-82e2f5c4984b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1319 microversion: 2.1 time: 0.263672 Oct 24 09:04:41.904221 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1551/3029] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:41 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:41.910513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd7fd52f-c82d-4e0d-a310-7c51dc1ce955 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa4f08b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.949994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:41.958921 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afddcca9-4763-4789-a81c-a5335619c783 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.179018 Oct 24 09:04:41.959506 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1479/3030] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:41 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:41.965020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:41.966110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:41.980937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.981592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.982042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:41.982759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:41.983248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:41.983779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.112813 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd7fd52f-c82d-4e0d-a310-7c51dc1ce955 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/20783c3c-cf4d-4fe9-a73b-d32c87481095" status: 202 len: 0 microversion: 2.1 time: 0.207176 Oct 24 09:04:42.116820 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1552/3031] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:41 2022] DELETE /compute/v2.1/os-security-groups/20783c3c-cf4d-4fe9-a73b-d32c87481095 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:42.122862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9869222b-c01a-4c8a-b8c8-f9b7ab20b42c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:42.125402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9869222b-c01a-4c8a-b8c8-f9b7ab20b42c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 35312d15-06af-4390-bc11-a9f77da55eb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.132225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9869222b-c01a-4c8a-b8c8-f9b7ab20b42c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 35312d15-06af-4390-bc11-a9f77da55eb2 could not be found. Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9869222b-c01a-4c8a-b8c8-f9b7ab20b42c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/35312d15-06af-4390-bc11-a9f77da55eb2/action HTTP/1.1 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 28 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: {"reboot": {"type": "SOFT"}} Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 35312d15-06af-4390-bc11-a9f77da55eb2 could not be found. Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '35312d15-06af-4390-bc11-a9f77da55eb2', 'body': {'reboot': {'type': 'SOFT'}}} Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35312d15-06af-4390-bc11-a9f77da55eb2 could not be found. Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35312d15-06af-4390-bc11-a9f77da55eb2 could not be found. Oct 24 09:04:42.134078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35312d15-06af-4390-bc11-a9f77da55eb2 could not be found. Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9869222b-c01a-4c8a-b8c8-f9b7ab20b42c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 35312d15-06af-4390-bc11-a9f77da55eb2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9869222b-c01a-4c8a-b8c8-f9b7ab20b42c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/35312d15-06af-4390-bc11-a9f77da55eb2/action" status: 404 len: 111 microversion: 2.1 time: 0.017450 Oct 24 09:04:42.139308 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1553/3032] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:42 2022] POST /compute/v2.1/servers/35312d15-06af-4390-bc11-a9f77da55eb2/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.145135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.145757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.155763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.156252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.156681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.159354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.159821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.160284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.163377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.175286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d5e109f-4f4f-42fd-a381-77624a90563b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.213881 Oct 24 09:04:42.176831 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 HTTP/1.1 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4c928430-9084-40d4-aaf7-d03af06c10b4'} Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:42.178485 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dcfd8ce1-0362-4a58-8d3f-52917f612317 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 404 len: 111 microversion: 2.1 time: 0.039658 Oct 24 09:04:42.183852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1554/3033] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:04:42 2022] DELETE /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.190181 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1480/3034] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:41 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:42.194595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.195358 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.198278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.199085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.202115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.202861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.203395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.204720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.205263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.205910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.206093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.206395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.206826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.207517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.207971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.208394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.347455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.355846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-695dc5a8-9cdd-476e-8e7e-835f1841a884 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.171348 Oct 24 09:04:42.356411 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1555/3035] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:42.361070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.361705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: 4c928430-9084-40d4-aaf7-d03af06c10b4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.367385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.367862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.368464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.369144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.369620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.370042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.386296 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 HTTP/1.1 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4c928430-9084-40d4-aaf7-d03af06c10b4'} Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.388096 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. Oct 24 09:04:42.393325 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.394417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Instance 4c928430-9084-40d4-aaf7-d03af06c10b4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.395614 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e166a6ed-f908-4f1d-8d57-7f1209819162 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4" status: 404 len: 111 microversion: 2.1 time: 0.037995 Oct 24 09:04:42.396463 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1556/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/4c928430-9084-40d4-aaf7-d03af06c10b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.401089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.401955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.406487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.408082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.408919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.409458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.410273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.410619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.411077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.411409 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:42.416901 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f8a797b5-8839-41ea-92fc-ff68effb6868 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.224576 Oct 24 09:04:42.417876 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1481/3037] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:42.422525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daaf34940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.467488 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:42.468280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:04:42.468805 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.468805 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe HTTP/1.1 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: exception: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3de74e57-eef0-41bf-90e5-4cccf26a64fe'} Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:42.470739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group 3de74e57-eef0-41bf-90e5-4cccf26a64fe does not exist Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-a4c5f482-b0fe-420a-93b1-84977b03eaea'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f03e256c-0b28-461a-8f30-edf1ea6756aa tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe" status: 404 len: 194 microversion: 2.1 time: 0.053283 Oct 24 09:04:42.478066 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1482/3038] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:42 2022] DELETE /compute/v2.1/os-security-groups/3de74e57-eef0-41bf-90e5-4cccf26a64fe => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.481060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.481060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.486985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.487478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.487913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.488961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.489147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.489515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.556369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.566094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f19a002-5021-4fca-a5a1-208d4f60f3f6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.168558 Oct 24 09:04:42.566665 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1557/3039] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:42.572496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa470dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.609049 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:42.609757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 not found {{(pid=126920) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:04:42.610287 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.610287 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 HTTP/1.1 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: exception: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5e7b1808-3050-4f0b-8ded-576e4a8ce7a8'} Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:42.613054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] Oct 24 09:04:42.616998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.620402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group 5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 does not exist Oct 24 09:04:42.620402 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-bad5c5d5-97dc-4c86-a9f9-730a4170f324'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.621483 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72e23b88-d5f4-40f9-9485-b0b9c34de0ca tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8" status: 404 len: 194 microversion: 2.1 time: 0.052706 Oct 24 09:04:42.622051 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1558/3040] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:42 2022] DELETE /compute/v2.1/os-security-groups/5e7b1808-3050-4f0b-8ded-576e4a8ce7a8 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.627779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:42.632178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.640162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.640659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.641089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.642118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.642588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.643022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.643563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.652984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6680314b-c760-4d80-a4be-5f1766634473 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.178783 Oct 24 09:04:42.663102 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1483/3041] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac/action HTTP/1.1 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 65 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac', 'body': {'rebuild': {'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2'}}} Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:42.663285 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:04:42.669482 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.670609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab229670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.670700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.670700 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cccbb823-a5e3-441f-a0a5-d29364d6174d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac/action" status: 404 len: 111 microversion: 2.1 time: 0.036516 Oct 24 09:04:42.670700 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1559/3042] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:42 2022] POST /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.670700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.670700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.675094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.675594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.676039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.676740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.677397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.677991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.682804 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:42.683402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:04:42.683920 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.683920 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9 HTTP/1.1 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: exception: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ef971f01-b89b-4f8c-8c7d-3e4808f425c9'} Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:42.685764 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group ef971f01-b89b-4f8c-8c7d-3e4808f425c9 does not exist Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-1838c627-bbe7-4f44-aaac-d57558160638'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a4fd966-a300-4dfe-9d62-b993385ffee2 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9" status: 404 len: 194 microversion: 2.1 time: 0.032638 Oct 24 09:04:42.692044 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1484/3043] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:42 2022] DELETE /compute/v2.1/os-security-groups/ef971f01-b89b-4f8c-8c7d-3e4808f425c9 => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7b4fd6d-9947-4225-a0b2-403b1a486fba tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1203539270", "metadata": {"": ""}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7b4fd6d-9947-4225-a0b2-403b1a486fba tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action HTTP/1.1 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 107 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1203539270", "metadata": {"": ""}}} Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1203539270', 'metadata': {'': ''}}}} Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'': ''} Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.698877 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7b4fd6d-9947-4225-a0b2-403b1a486fba tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7b4fd6d-9947-4225-a0b2-403b1a486fba tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action" status: 400 len: 170 microversion: 2.1 time: 0.010238 Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1485/3044] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Oct 24 09:04:42 2022] POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action => generated 170 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:42.708348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daba1e430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.731882 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:42.732511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:04:42.733057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.733057 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d HTTP/1.1 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: exception: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d'} Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:42.735109 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group 1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d does not exist Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-e3410b47-4a37-40dd-b84b-416cff9e2ff7'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d438993-11fe-43e3-bb2d-ae4d68371723 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d" status: 404 len: 194 microversion: 2.1 time: 0.033383 Oct 24 09:04:42.740030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1486/3045] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:42 2022] DELETE /compute/v2.1/os-security-groups/1ed93dc9-6da8-4f4c-a6a6-9d8f3e264a1d => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.744900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.744900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.752287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.752287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.752805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.754033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.754033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.754545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.864321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.874230 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf1bf242-c65b-4339-97b4-1adc9d5f8e8c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.209797 Oct 24 09:04:42.875671 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1560/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:42.881670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8daa54f700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.916186 n-d-master-1 devstack@n-api.service[126920]: DEBUG neutronclient.v2_0.client [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist", "detail": ""}} {{(pid=126920) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:42.916790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.security_group_api [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e not found {{(pid=126920) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:04:42.917362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.917362 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e HTTP/1.1 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: exception: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e'} Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:42.919942 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group 370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e does not exist Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: Neutron server returns request_ids: ['req-650e3aad-cdea-4430-89af-09253b63e294'] {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dec1e043-6fc3-4cfa-bda9-746a10860e45 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e" status: 404 len: 194 microversion: 2.1 time: 0.043854 Oct 24 09:04:42.925695 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1561/3047] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:42 2022] DELETE /compute/v2.1/os-security-groups/370dab3e-3d0d-45c9-a13b-7ac0c0bcc78e => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:42.930151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.930151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.935531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.936018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.936161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:42.936452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.937274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.937761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.938187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.944031 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b05f457-9e9a-4598-8223-70f0983a2b5e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.205147 Oct 24 09:04:42.944610 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1487/3048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:42.949169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:42.949869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:42.956570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.956732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.957162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:42.957923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:42.958366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:42.958798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.111710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.115802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.120510 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e96c196-983c-46b9-a51f-41c65da7563b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1319 microversion: 2.1 time: 0.174895 Oct 24 09:04:43.121086 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1488/3049] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.125911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab138d30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.139222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-819e3283-d0e5-45c2-9797-79ac3a613c96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.214854 Oct 24 09:04:43.139955 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1562/3050] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:42 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.145155 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.146017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.153062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.153582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.154328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.155041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.155500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.156005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.169577 n-d-master-1 devstack@n-api.service[126919]: DEBUG neutronclient.v2_0.client [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist", "detail": ""}} {{(pid=126919) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.security_group_api [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Neutron security group e11bab26-4349-4a47-bf4e-7b48dee21672 not found {{(pid=126919) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672 HTTP/1.1 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: exception: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e11bab26-4349-4a47-bf4e-7b48dee21672'} Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 09:04:43.173739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Security group e11bab26-4349-4a47-bf4e-7b48dee21672 does not exist Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: Neutron server returns request_ids: ['req-48db6cdd-157d-4d45-ab9b-36c520d74e10'] {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3a56c1a-d51c-4ce8-9ff1-e34f5541e779 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672" status: 404 len: 194 microversion: 2.1 time: 0.054109 Oct 24 09:04:43.178579 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1489/3051] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:43 2022] DELETE /compute/v2.1/os-security-groups/e11bab26-4349-4a47-bf4e-7b48dee21672 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:43.182473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42faf03c-c033-4a80-aeaf-4e9aa7baec48 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:43.184579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42faf03c-c033-4a80-aeaf-4e9aa7baec48 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: da8c9063-1a31-47f4-b28a-ea6c602dd924] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.201073 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-42faf03c-c033-4a80-aeaf-4e9aa7baec48 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance da8c9063-1a31-47f4-b28a-ea6c602dd924 could not be found. Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42faf03c-c033-4a80-aeaf-4e9aa7baec48 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/da8c9063-1a31-47f4-b28a-ea6c602dd924/action HTTP/1.1 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 65 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: exception: Instance da8c9063-1a31-47f4-b28a-ea6c602dd924 could not be found. Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'da8c9063-1a31-47f4-b28a-ea6c602dd924', 'body': {'rebuild': {'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2'}}} Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8c9063-1a31-47f4-b28a-ea6c602dd924 could not be found. Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 09:04:43.202901 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8c9063-1a31-47f4-b28a-ea6c602dd924 could not be found. Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8c9063-1a31-47f4-b28a-ea6c602dd924 could not be found. Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42faf03c-c033-4a80-aeaf-4e9aa7baec48 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance da8c9063-1a31-47f4-b28a-ea6c602dd924 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42faf03c-c033-4a80-aeaf-4e9aa7baec48 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/da8c9063-1a31-47f4-b28a-ea6c602dd924/action" status: 404 len: 111 microversion: 2.1 time: 0.026001 Oct 24 09:04:43.208290 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1490/3052] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:43 2022] POST /compute/v2.1/servers/da8c9063-1a31-47f4-b28a-ea6c602dd924/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:43.213621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.214188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.221390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.221786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.222223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.222916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.223368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.223793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.251821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:04:43.343717 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b16c9c1-243c-46ef-8f56-436fc2f6af5f tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 204 len: 0 microversion: 2.1 time: 0.133430 Oct 24 09:04:43.344242 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1491/3053] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:04:43 2022] DELETE /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:04:43.351173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.352135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.356881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.358142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.358625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.359061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.359786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.360236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.361272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.368216 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00c9af16-1e81-4da3-8570-7ae9cce87326 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.227161 Oct 24 09:04:43.368888 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1563/3054] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.374406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.375191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.383289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.383974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.384844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.385760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.386367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.387231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.515300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.523879 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0dc3ed2d-103d-407e-87f9-fcbb527b7b08 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.177392 Oct 24 09:04:43.524329 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1492/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.528763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.529564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.533914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.536439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.537913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.538612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.539632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.540084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.540662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.542153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-caba4e29-d99e-460d-86cf-30611b36b083 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.171359 Oct 24 09:04:43.542749 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1564/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.550275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dcd42d5-bf80-4a03-b386-14ae8eee3ead tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-742356688", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dcd42d5-bf80-4a03-b386-14ae8eee3ead tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action HTTP/1.1 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 618 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-742356688", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-742356688', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:43.554770 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:04:43.557799 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:43.560284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4dcd42d5-bf80-4a03-b386-14ae8eee3ead tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:43.560284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4dcd42d5-bf80-4a03-b386-14ae8eee3ead tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action" status: 400 len: 938 microversion: 2.1 time: 0.011910 Oct 24 09:04:43.560581 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1565/3057] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Oct 24 09:04:43 2022] POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action => generated 938 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:43.566782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.567393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.574581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.575074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.575644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.576338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.576807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.577356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.750440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.760938 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d349b44-5907-4c96-bb42-4157257f475e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.199266 Oct 24 09:04:43.761544 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1566/3058] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.766539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.768127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.781221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.782162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.782637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.783373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.783805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.784233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.797547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.807589 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b80282ba-70aa-4fe3-ac4c-afdac1624d06 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1649 microversion: 2.1 time: 0.282229 Oct 24 09:04:43.809231 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1493/3059] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1649 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:43.816542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:43.817354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:43.823641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.824123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.824739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.825775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:43.826390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:43.826816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:43.987728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:43.995507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7615672-0a5d-4112-859e-501b94f5009e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.232826 Oct 24 09:04:43.996342 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1567/3060] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.003165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.011315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82347821-6809-4ff4-90cc-3c13c68f1c0a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.202193 Oct 24 09:04:44.012004 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1494/3061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:43 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.019274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-411ef94e-f90c-4e2d-8166-0647fb27c173 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:44.019900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-411ef94e-f90c-4e2d-8166-0647fb27c173 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 217bac34-fe3e-4f14-a388-0165e6ce8a21] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.025669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-411ef94e-f90c-4e2d-8166-0647fb27c173 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 217bac34-fe3e-4f14-a388-0165e6ce8a21 could not be found. Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-411ef94e-f90c-4e2d-8166-0647fb27c173 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/217bac34-fe3e-4f14-a388-0165e6ce8a21/action HTTP/1.1 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: {"restore": {}} Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 217bac34-fe3e-4f14-a388-0165e6ce8a21 could not be found. Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '217bac34-fe3e-4f14-a388-0165e6ce8a21', 'body': {'restore': {}}} Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217bac34-fe3e-4f14-a388-0165e6ce8a21 could not be found. Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217bac34-fe3e-4f14-a388-0165e6ce8a21 could not be found. Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:44.027730 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217bac34-fe3e-4f14-a388-0165e6ce8a21 could not be found. Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-411ef94e-f90c-4e2d-8166-0647fb27c173 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 217bac34-fe3e-4f14-a388-0165e6ce8a21 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-411ef94e-f90c-4e2d-8166-0647fb27c173 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/217bac34-fe3e-4f14-a388-0165e6ce8a21/action" status: 404 len: 111 microversion: 2.1 time: 0.014961 Oct 24 09:04:44.035675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1568/3062] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:44 2022] POST /compute/v2.1/servers/217bac34-fe3e-4f14-a388-0165e6ce8a21/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:04:44.040745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.041392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.041688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52eaf2db-50e7-48e2-a1b0-04f6defa4242 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52eaf2db-50e7-48e2-a1b0-04f6defa4242 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action HTTP/1.1 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 285 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.045951 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.050530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52eaf2db-50e7-48e2-a1b0-04f6defa4242 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:44.052498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.052498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.052498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.052725 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52eaf2db-50e7-48e2-a1b0-04f6defa4242 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action" status: 400 len: 619 microversion: 2.1 time: 0.013905 Oct 24 09:04:44.052802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.052802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.052948 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1495/3063] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Oct 24 09:04:44 2022] POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:04:44.053025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.060502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.061881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.069926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.070679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.071346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.072100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.072943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.073504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.206148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.214090 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c60bcc60-fed1-4c33-97a9-4b2b279da558 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.177089 Oct 24 09:04:44.215151 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1569/3064] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.221090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.222255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.224240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.228816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.229627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.230719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.231886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.233036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.233667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.235988 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17c5a4fc-6219-4b9a-8e39-8f85daa59b32 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.179156 Oct 24 09:04:44.236926 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1496/3065] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.242343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.244637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.252026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.252688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.253118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.254147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.254604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.256656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.386151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.394596 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29f51110-2492-4cd1-82de-05061f54fc5f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1469 microversion: 2.1 time: 0.178159 Oct 24 09:04:44.395717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1570/3066] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.400406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.401021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.401759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.407978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.408358 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cea75f05-4b20-4f8d-9e9c-ac32638e4fc4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.170633 Oct 24 09:04:44.408681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.408929 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1497/3067] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.409325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.410118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.410796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.411441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.421568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.429432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.430606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Searching by: {'reservation_id': 'r-8i650v0y', 'deleted': False, 'project_id': '8469ec38031e46da9bfde167e0b6da15'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:04:44.440579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.441060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.441519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.442239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.442695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.443116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.546981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:04:44.617128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.623515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.623998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.624436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.634901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:44.643891 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e35ea56d-5a04-4073-8835-570255c9c055 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.246789 Oct 24 09:04:44.645146 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1571/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.651191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:44.655638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.663183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.663892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.664577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.665654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.666257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.666835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.766360 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-75abbdba-864b-4d6c-83df-88be357ee7b1 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-8i650v0y" status: 200 len: 2929 microversion: 2.1 time: 0.349670 Oct 24 09:04:44.766360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1498/3069] 10.222.0.25 () {58 vars in 1197 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8i650v0y => generated 2929 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:44.772650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:44.773522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.796831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.797718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.798249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.799071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.799616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.800112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.913760 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'restore' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: {"restore": {}} Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'restore' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'restore': {}}} Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state active. Cannot restore while the instance is in this state. Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:44.915318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'restore' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67619014-d5c5-41f4-a948-0152d65fc48f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 145 microversion: 2.1 time: 0.270167 Oct 24 09:04:44.919779 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1572/3070] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:44 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 145 bytes in 271 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:44.921862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-938487014"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:44.924230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:44.930224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.930713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.931149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:44.931830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:44.932275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:44.932697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.092666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:45.102026 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1bb8ea2-a019-4a34-bf52-43b2395621b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.335530 Oct 24 09:04:45.102296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1499/3071] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:44 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:45.106738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-725c8ebc-3df0-4d18-92f3-1708ab013a2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.121982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.server_groups [None req-725c8ebc-3df0-4d18-92f3-1708ab013a2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Querying cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) for 2 instances {{(pid=126919) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 09:04:45.122834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725c8ebc-3df0-4d18-92f3-1708ab013a2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.123407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725c8ebc-3df0-4d18-92f3-1708ab013a2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.123937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-725c8ebc-3df0-4d18-92f3-1708ab013a2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.156015 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-725c8ebc-3df0-4d18-92f3-1708ab013a2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/e4467b06-108a-4f75-a4d0-5f365d110411" status: 200 len: 270 microversion: 2.1 time: 0.052650 Oct 24 09:04:45.156680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1500/3072] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/os-server-groups/e4467b06-108a-4f75-a4d0-5f365d110411 => generated 270 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:45.161419 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7beb3cd-f17e-4238-9aa0-f8200e2406d8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action" status: 202 len: 0 microversion: 2.1 time: 0.242964 Oct 24 09:04:45.162052 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1573/3073] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:44 2022] POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:04:45.162426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.163481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.168378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.169584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.169908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.170390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.170820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.171570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.171977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.172379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.177495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.178072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.178553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.179264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.179749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.180188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.196434 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:45.451295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:45.460290 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:45.460778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bebab19-965d-4fff-90bc-4645f93acecd tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1649 microversion: 2.1 time: 0.302024 Oct 24 09:04:45.474827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1501/3074] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1649 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:45.482738 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9a96361-2085-4411-a003-9b54d267f7da tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.319360 Oct 24 09:04:45.492390 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1574/3075] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:45.492593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.492593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.495344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.495344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.495344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.504760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.504760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.504760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.505122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1255515943"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:45.506685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.529628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.530133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.530594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.531365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.531832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.532786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.572994 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Cannot 'createImage' instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf while it is in task_state image_snapshot Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action HTTP/1.1 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 85 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1255515943"}} Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'createImage' instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf while it is in task_state image_snapshot Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1255515943'}}} Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:04:45.575197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf while it is in task_state image_snapshot Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf while it is in task_state image_snapshot Oct 24 09:04:45.580510 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.583256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 409 to user: Cannot 'createImage' instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf while it is in task_state image_snapshot {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:45.584509 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-38477ae1-27ba-4645-8bb9-3bd20d0f60cb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action" status: 409 len: 159 microversion: 2.1 time: 0.099961 Oct 24 09:04:45.585668 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1575/3076] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:45 2022] POST /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf/action => generated 159 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:45.592725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.593752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.600662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.601484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.602436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.603338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.604062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.604673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.745562 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af1ed63a-7c97-45ba-ad7f-d356bb559f45 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 200 len: 1618 microversion: 2.1 time: 0.269108 Oct 24 09:04:45.761327 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1502/3077] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 1618 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:45.777720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6fbe980-898d-483b-a985-3068359af5bd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '.version_select at 0x7f8daaf14e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.874133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:45.884071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab39aa77-c2f4-46ed-88d4-deef55a7d7ea tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.297087 Oct 24 09:04:45.884648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1576/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:45.894968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.905834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.917777 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6fbe980-898d-483b-a985-3068359af5bd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/images/818c9df6-7014-429a-96bd-dd542098b847" status: 204 len: 0 microversion: 2.1 time: 0.163160 Oct 24 09:04:45.918550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.919178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1503/3079] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] DELETE /compute/v2.1/images/818c9df6-7014-429a-96bd-dd542098b847 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:04:45.919413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.920010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.920949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.921592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.922666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.927297 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-828746f4-9f66-4126-b1ee-7564dbdccb08 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:45.927965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-828746f4-9f66-4126-b1ee-7564dbdccb08 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: cc773d2b-c593-4850-acfa-9cc66c97e135] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.934788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-828746f4-9f66-4126-b1ee-7564dbdccb08 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance cc773d2b-c593-4850-acfa-9cc66c97e135 could not be found. Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-828746f4-9f66-4126-b1ee-7564dbdccb08 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/cc773d2b-c593-4850-acfa-9cc66c97e135/action HTTP/1.1 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 14 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: {"resume": {}} Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: exception: Instance cc773d2b-c593-4850-acfa-9cc66c97e135 could not be found. Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'cc773d2b-c593-4850-acfa-9cc66c97e135', 'body': {'resume': {}}} Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc773d2b-c593-4850-acfa-9cc66c97e135 could not be found. Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc773d2b-c593-4850-acfa-9cc66c97e135 could not be found. Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:45.946227 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:45.950541 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:45.950541 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:45.950541 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc773d2b-c593-4850-acfa-9cc66c97e135 could not be found. Oct 24 09:04:45.950541 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:45.950541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-828746f4-9f66-4126-b1ee-7564dbdccb08 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance cc773d2b-c593-4850-acfa-9cc66c97e135 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:45.950541 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-828746f4-9f66-4126-b1ee-7564dbdccb08 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/cc773d2b-c593-4850-acfa-9cc66c97e135/action" status: 404 len: 111 microversion: 2.1 time: 0.026983 Oct 24 09:04:45.955493 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1504/3080] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:45 2022] POST /compute/v2.1/servers/cc773d2b-c593-4850-acfa-9cc66c97e135/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:45.965287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:45.966359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:45.984402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.985241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.985899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:45.986773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:45.987397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:45.988016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.010182 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:46.270422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:46.279319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0ae3efe-c940-42fa-8f40-d396b3813ed6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1531 microversion: 2.1 time: 0.322443 Oct 24 09:04:46.280804 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1505/3081] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1531 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:46.286048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:46.286662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:46.318991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.321424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.321886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.324877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.328636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.329121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.343913 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5eb8b75a-5993-47b6-930c-103af1c6151b tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1620 microversion: 2.1 time: 0.452756 Oct 24 09:04:46.346457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1577/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:45 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1620 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:46.351331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:46.352251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:46.360432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.361924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.362553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.363415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.364038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.364689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.602479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:46.633159 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f01f381-b163-46cc-8e5e-2750a47e08f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.349833 Oct 24 09:04:46.634281 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1506/3083] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:46 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:46.650540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:46.656310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9f025aa9-2bbd-4633-a2ae-afae10055c51 req-0c5fb4cf-2fd0-45db-9606-c73a5acb54cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9da3411-ae51-4c68-a32b-b0b08bbbcf7a", "name": "network-vif-deleted", "tag": "46e9dd19-1554-4d98-84e0-94aacf99bc1c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:46.671102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9f025aa9-2bbd-4633-a2ae-afae10055c51 req-0c5fb4cf-2fd0-45db-9606-c73a5acb54cc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.672403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9f025aa9-2bbd-4633-a2ae-afae10055c51 req-0c5fb4cf-2fd0-45db-9606-c73a5acb54cc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.673876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9f025aa9-2bbd-4633-a2ae-afae10055c51 req-0c5fb4cf-2fd0-45db-9606-c73a5acb54cc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.676924 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b118307-0f49-4f04-a2c8-90290cb6f70c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.329146 Oct 24 09:04:46.677547 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1578/3084] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:46 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:46.700009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:46.700647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:46.725876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.726682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.727866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.728073 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9f025aa9-2bbd-4633-a2ae-afae10055c51 req-0c5fb4cf-2fd0-45db-9606-c73a5acb54cc service nova] Creating event network-vif-deleted:46e9dd19-1554-4d98-84e0-94aacf99bc1c for instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a on n-h1-master-1 Oct 24 09:04:46.728987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.732489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.733177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.738873 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9f025aa9-2bbd-4633-a2ae-afae10055c51 req-0c5fb4cf-2fd0-45db-9606-c73a5acb54cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102977 Oct 24 09:04:46.739869 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1507/3085] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:46.750248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1401497764", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "228b5e7e-bb4e-44b7-8d90-47945b4ae996"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:46.801337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.802120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.802864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.805258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lazy-loading 'fault' on Instance uuid c9da3411-ae51-4c68-a32b-b0b08bbbcf7a {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:04:46.838415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:46.901844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0faa202378cf499581a14f05c7cfa9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5297380773734f4ab82dbb83f1c855e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:46.912081 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9945f85-02d4-4a36-83b2-9c9d314d7f3e tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 200 len: 1306 microversion: 2.1 time: 0.228851 Oct 24 09:04:46.912666 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1579/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:46 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:46.929219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:46.929878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:46.937256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.937792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.938228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:46.939289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:46.939916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:46.940502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.086751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:47.087356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:47.088130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:47.088881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:47.089317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:47.099298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.099767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.100495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.101212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.101685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.102101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.120412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:47.125719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:47.129538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:47.138309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:47.138491 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e424565d-829e-48ae-8821-3cab15cfa095 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.224823 Oct 24 09:04:47.139389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1580/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:46 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:47.140870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:04:47.163701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:47.164468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.172590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.173534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.174656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.176277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.177142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.177580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.194422 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-705dba3f-58fb-4eca-a907-cf494dfeff92 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449141 Oct 24 09:04:47.195763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1508/3088] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:04:47.205887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'resume' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 14 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: {"resume": {}} Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'resume' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'resume': {}}} Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state active. Cannot resume while the instance is in this state. Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:47.207753 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'resume' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abf6244e-c3cb-41b8-9e40-0d9f45f5127e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 144 microversion: 2.1 time: 0.050461 Oct 24 09:04:47.212022 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1581/3089] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:47 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 144 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:04:47.217651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:47.217888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d289743-5961-474c-95d9-d263a6c76f5b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:47.218271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.218847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d289743-5961-474c-95d9-d263a6c76f5b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.225588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.226095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.226540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.227237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.227807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.228247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.301550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d289743-5961-474c-95d9-d263a6c76f5b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:47.314933 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d289743-5961-474c-95d9-d263a6c76f5b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1217 microversion: 2.1 time: 0.111606 Oct 24 09:04:47.321382 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1509/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:47 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:47.322241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:47.323054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.330622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.331200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.331748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.332651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.333203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.334085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.436925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:47.450337 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94da934d-813c-4614-83cd-16c5177b46bd tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.236086 Oct 24 09:04:47.457348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1582/3091] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:47 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:47.478954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:47.479572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.493599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.494250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.494960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.495990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.497193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.497965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.559952 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:47.572993 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-405d0b07-7cd4-4a26-87de-8c638d5f29bb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1537 microversion: 2.1 time: 0.255159 Oct 24 09:04:47.573942 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1510/3092] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:47 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:47.709665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:47.711134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.718312 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:47.733519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.734208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.734900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.736474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.737393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.738019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.928080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:47.941938 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-641c1b51-62c6-49b1-a15a-657e3a4d0aa0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.240650 Oct 24 09:04:47.955242 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1511/3093] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:47 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:47.981969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:47.982876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] [instance: c9da3411-ae51-4c68-a32b-b0b08bbbcf7a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:47.992990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.993613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.994972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:47.995782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:47.996902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:47.997437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.015205 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] HTTP exception thrown: Instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a could not be found. Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Request method failure captured: Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a HTTP/1.1 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTTzX2fnkD6FHqDWkICs25NgsxYeBD01oyTfxGrsUQymJq_z1_1UETi-D5ICPgrvWv1UEhhDvppeezGU359G0Dn8nr3_f9O4Qv4U7duBACbpntXfzLBRxugd8Bo1vrnjkXBQb5U_AKuYPdUCTid4iNCD7qlJ1B_xw8J1iVhi00kMl0 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5297380773734f4ab82dbb83f1c855e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5297380773734f4ab82dbb83f1c855e0"}]}] Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5297380773734f4ab82dbb83f1c855e0 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1707545043 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 0faa202378cf499581a14f05c7cfa9c8 Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-SecurityGroupsTestJSON-1707545043-project Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a could not be found. Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c9da3411-ae51-4c68-a32b-b0b08bbbcf7a'} Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a could not be found. Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a could not be found. Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:48.018503 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a could not be found. Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Returning 404 to user: Instance c9da3411-ae51-4c68-a32b-b0b08bbbcf7a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:48.023066 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3451ddc1-ca8f-478a-8eb9-04e6676ac30a tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a" status: 404 len: 111 microversion: 2.1 time: 0.058432 Oct 24 09:04:48.024334 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1512/3094] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:47 2022] GET /compute/v2.1/servers/c9da3411-ae51-4c68-a32b-b0b08bbbcf7a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:48.028524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67730ef3-e10a-471b-bb9e-847549144f61 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab361ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.039485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:48.064188 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3abbc534-16da-4951-b4a4-10c067eba59d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.589207 Oct 24 09:04:48.067642 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1583/3095] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:47 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:48.244935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97071370-4dea-4f65-bed4-e465be0bb82e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97071370-4dea-4f65-bed4-e465be0bb82e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 160 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "65b21b22-ec29-4a51-8372-119e9b9fb46e"}]}} Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'networks': [{'uuid': '65b21b22-ec29-4a51-8372-119e9b9fb46e'}]}}} Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '' Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:04:48.249875 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 09:04:48.255388 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.257548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97071370-4dea-4f65-bed4-e465be0bb82e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:48.258533 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97071370-4dea-4f65-bed4-e465be0bb82e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017604 Oct 24 09:04:48.261113 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1584/3096] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:48 2022] POST /compute/v2.1/servers => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:04:48.273475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.274508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:48.283388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.284249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.285035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.285905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.286600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.287288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.368729 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67730ef3-e10a-471b-bb9e-847549144f61 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/edc8b9fe-f443-4193-8e95-8b6bbc6ca762" status: 202 len: 0 microversion: 2.1 time: 0.343962 Oct 24 09:04:48.369551 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1513/3097] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:48 2022] DELETE /compute/v2.1/os-security-groups/edc8b9fe-f443-4193-8e95-8b6bbc6ca762 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:48.380191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.380948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:48.397105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.401937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.402392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.403440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.404366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.404934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.500173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:48.512130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13c053b3-b609-4103-8167-8546dfeb49a5 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1269 microversion: 2.1 time: 0.136095 Oct 24 09:04:48.513289 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1514/3098] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:48 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:48.520853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-138423bb-d7d5-4139-90de-af38a5f43047 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] Calling method '.version_select at 0x7f8dab361790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.539894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:48.552140 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4136c1d-8855-4251-aa31-7275b3264146 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.287042 Oct 24 09:04:48.559377 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1585/3099] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:48 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:48.581076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.582140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:48.597603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.598203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.598537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.599515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.599983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.600413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.803640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-138423bb-d7d5-4139-90de-af38a5f43047 tempest-SecurityGroupsTestJSON-1707545043 tempest-SecurityGroupsTestJSON-1707545043-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e4f16a9a-3632-4e52-9ee1-a5bc28b19ae0" status: 202 len: 0 microversion: 2.1 time: 0.289080 Oct 24 09:04:48.805147 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1515/3100] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:04:48 2022] DELETE /compute/v2.1/os-security-groups/e4f16a9a-3632-4e52-9ee1-a5bc28b19ae0 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:48.811107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.814448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:48.828751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.856294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.862268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.863602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.865179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.865784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.893710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:48.903831 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05e2b45c-954e-4dc2-b664-732d56c2f757 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.330348 Oct 24 09:04:48.908786 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1586/3101] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:48 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:48.936218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c154d74-7c12-44f4-a81f-ad1342be5d90 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:48.936974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c154d74-7c12-44f4-a81f-ad1342be5d90 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 353d45d3-8358-4d3a-921b-45687adce89a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:48.944885 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0c154d74-7c12-44f4-a81f-ad1342be5d90 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 353d45d3-8358-4d3a-921b-45687adce89a could not be found. Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c154d74-7c12-44f4-a81f-ad1342be5d90 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/353d45d3-8358-4d3a-921b-45687adce89a/action HTTP/1.1 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 14 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: {"shelve": {}} Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 353d45d3-8358-4d3a-921b-45687adce89a could not be found. Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '353d45d3-8358-4d3a-921b-45687adce89a', 'body': {'shelve': {}}} Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353d45d3-8358-4d3a-921b-45687adce89a could not be found. Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353d45d3-8358-4d3a-921b-45687adce89a could not be found. Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:48.947976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:48.952941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:48.952941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:48.952941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353d45d3-8358-4d3a-921b-45687adce89a could not be found. Oct 24 09:04:48.952941 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:04:48.952941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c154d74-7c12-44f4-a81f-ad1342be5d90 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 353d45d3-8358-4d3a-921b-45687adce89a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:48.957497 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c154d74-7c12-44f4-a81f-ad1342be5d90 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/353d45d3-8358-4d3a-921b-45687adce89a/action" status: 404 len: 111 microversion: 2.1 time: 0.022038 Oct 24 09:04:48.957497 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1587/3102] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:48 2022] POST /compute/v2.1/servers/353d45d3-8358-4d3a-921b-45687adce89a/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:04:48.972280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:48.978590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:48.994307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.996786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.997241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:48.998006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:48.998468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:48.998909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.140519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:49.151444 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba9f0cc9-8e4e-4be3-9cca-18ad8dfe6646 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1537 microversion: 2.1 time: 0.344940 Oct 24 09:04:49.153093 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1516/3103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:48 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1537 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:49.160400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:49.161242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:49.172287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.172987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.173652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.174733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.175347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.176565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.354080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:49.366051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c705308b-ded2-4c11-a351-86acaa247b6a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.402189 Oct 24 09:04:49.366683 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1588/3104] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:48 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:49.392522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:49.393478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:49.400613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.401389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.402033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.402908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.403517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.404323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.418565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:49.428389 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2199ff07-e30e-4af4-a1d0-4a7731c80d16 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.273049 Oct 24 09:04:49.449332 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1517/3105] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:49 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:49.536948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:49.537588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:49.543903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.544395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.544848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.545598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.546052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.546477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.691547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:49.701551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da17777e-2d38-4f3d-aa16-f2e73d796818 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.313233 Oct 24 09:04:49.713794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1589/3106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:49 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:49.727578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:49.727951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:49.734536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.735357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.735970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.736856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:49.737498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:49.738081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:49.763797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lazy-loading 'flavor' on Instance uuid 92096759-c3f1-4279-abbe-5e823421740c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:04:49.861676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:49.873832 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63f06f53-3b04-4233-b22c-d03b36947d9a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1275 microversion: 2.1 time: 0.341211 Oct 24 09:04:49.889509 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1518/3107] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:49 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1275 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:50.014140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ea0e86a2-cb7f-4630-87d3-9ad3f18d182c req-86741605-7d4e-4d5e-b1e9-53d62189c921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c30cbd-eeaa-47e8-80a6-6b54432918bf", "name": "network-vif-plugged", "status": "completed", "tag": "149996fe-e248-44cf-8a07-10ff4f0650ae"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:50.035573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea0e86a2-cb7f-4630-87d3-9ad3f18d182c req-86741605-7d4e-4d5e-b1e9-53d62189c921 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.037416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea0e86a2-cb7f-4630-87d3-9ad3f18d182c req-86741605-7d4e-4d5e-b1e9-53d62189c921 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.039498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea0e86a2-cb7f-4630-87d3-9ad3f18d182c req-86741605-7d4e-4d5e-b1e9-53d62189c921 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.077079 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ea0e86a2-cb7f-4630-87d3-9ad3f18d182c req-86741605-7d4e-4d5e-b1e9-53d62189c921 service nova] Creating event network-vif-plugged:149996fe-e248-44cf-8a07-10ff4f0650ae for instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf on n-h1-master-1 Oct 24 09:04:50.091753 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ea0e86a2-cb7f-4630-87d3-9ad3f18d182c req-86741605-7d4e-4d5e-b1e9-53d62189c921 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083113 Oct 24 09:04:50.093851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1519/3108] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:50.142583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58919718-e1e0-4796-9d2e-cfcee8e59167 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 202 len: 0 microversion: 2.1 time: 0.418891 Oct 24 09:04:50.146786 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1590/3109] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:04:49 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:04:50.152835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:50.153763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:50.166213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.167036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.167711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.168712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.169264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.169934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.177605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:50.179402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:50.194520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.195010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.196639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.203554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.204723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.206522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.216997 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:50.523581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:50.539910 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86ce5218-967d-46fb-9493-547d47ebbd70 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.391730 Oct 24 09:04:50.540515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1520/3110] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:50 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:50.558749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:50.559376 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:50.570635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.571133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.571578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.572285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.572740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.573168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.589049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:50.607983 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfce33c2-60a6-4668-a96a-516eb47a8fbd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1519 microversion: 2.1 time: 0.433711 Oct 24 09:04:50.608985 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1591/3111] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:50 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1519 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:50.638525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:50.639405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:50.655308 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:50.657200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.661587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.662546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.663819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.664755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.665832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.769172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:04:50.833942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:50.842900 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c161612b-4931-4ae2-a169-b4799f2ac55c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.301339 Oct 24 09:04:50.846718 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1521/3112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:50 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:50.900535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:50.901159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:50.912369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.914531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.914975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.917017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:50.918798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:50.919156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:50.962577 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc4197cf-b309-47e6-9aea-608c558a4338 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 204 len: 0 microversion: 2.1 time: 0.327815 Oct 24 09:04:50.963533 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1592/3113] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:04:50 2022] DELETE /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:04:50.989148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:50.991678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:51.009951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:51.014572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:51.015213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:51.016216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:51.019184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:51.019859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:51.283700 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:51.296143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d99ea27-c630-4efa-bda5-d7db72896c6c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.399907 Oct 24 09:04:51.297026 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1522/3114] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:50 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:51.523166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:51.534965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6fbdd117-30b8-4c35-abb5-c03ebee1cf35 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1525 microversion: 2.1 time: 0.560426 Oct 24 09:04:51.537227 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1593/3115] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:50 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1525 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:51.568837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:51.569788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:51.576709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:51.577529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:51.578317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:51.581561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:51.582433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:51.584120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:51.867599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:51.868832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:51.878444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:51.883684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:51.884602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:51.885548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:51.886166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:51.886776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:51.998834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:52.012899 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-137d9a65-fceb-4aa6-bffe-0b2b79a4dc09 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.450197 Oct 24 09:04:52.013936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1523/3116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:51 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:52.167977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:52.178571 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cfff80ee-4b98-4e78-b19a-7b0313e218d1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.313552 Oct 24 09:04:52.181865 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1594/3117] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:51 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:52.317134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fc2fb6e5-80e1-4c5a-9398-144529ac7073 req-a48bfade-7430-4d69-8734-08b6e977671f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1939b26-efff-4eec-81ef-e38a049a0a01", "tag": "52e53c3b-b2cd-4671-9036-ed8f3f9b049c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:52.340584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fc2fb6e5-80e1-4c5a-9398-144529ac7073 req-a48bfade-7430-4d69-8734-08b6e977671f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:52.341563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fc2fb6e5-80e1-4c5a-9398-144529ac7073 req-a48bfade-7430-4d69-8734-08b6e977671f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:52.342428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fc2fb6e5-80e1-4c5a-9398-144529ac7073 req-a48bfade-7430-4d69-8734-08b6e977671f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:52.352484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:52.353389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:52.372648 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fc2fb6e5-80e1-4c5a-9398-144529ac7073 req-a48bfade-7430-4d69-8734-08b6e977671f service nova] Creating event network-changed:52e53c3b-b2cd-4671-9036-ed8f3f9b049c for instance c1939b26-efff-4eec-81ef-e38a049a0a01 on n-h2-master-1 Oct 24 09:04:52.372862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:52.373213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:52.374576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:52.375509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:52.377071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:52.383179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:52.386543 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fc2fb6e5-80e1-4c5a-9398-144529ac7073 req-a48bfade-7430-4d69-8734-08b6e977671f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073276 Oct 24 09:04:52.390012 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1524/3118] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:52.560141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:52.560847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:52.580149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:52.580632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:52.581090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:52.581833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:52.582292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:52.583622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:52.759921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:52.769231 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0eb1a08c-dff1-4b10-958a-9e497efa3409 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.445885 Oct 24 09:04:52.769843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1595/3119] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:52 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:53.037518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:53.038924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:53.045979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.046649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.047246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.048160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.048775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.049399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.159311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:53.170872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e070db4c-aa55-4587-bb83-a2f2c26adeeb tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1525 microversion: 2.1 time: 0.614818 Oct 24 09:04:53.187167 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1525/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:52 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1525 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:53.208512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:53.209048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:53.216159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.216645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.217221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.218269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.218730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.219158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.341418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:53.351770 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-881c06e0-780b-44df-95f9-bcd8acf92089 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.317983 Oct 24 09:04:53.352369 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1596/3121] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:53 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:53.643835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:53.655191 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6db3754-c5c4-437c-8fa3-94a61ed6be7f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.450602 Oct 24 09:04:53.658237 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1526/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:53 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:53.801813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:53.805193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:53.819537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.820154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.823866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.826270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.827063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.827763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.956763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c091d741-1280-4c97-9d15-f3aaab315434 req-6f1befe9-700a-4915-be90-651b04ddef51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c30cbd-eeaa-47e8-80a6-6b54432918bf", "name": "network-vif-unplugged", "status": "completed", "tag": "149996fe-e248-44cf-8a07-10ff4f0650ae"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:53.966496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c091d741-1280-4c97-9d15-f3aaab315434 req-6f1befe9-700a-4915-be90-651b04ddef51 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:53.967365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c091d741-1280-4c97-9d15-f3aaab315434 req-6f1befe9-700a-4915-be90-651b04ddef51 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:53.968042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c091d741-1280-4c97-9d15-f3aaab315434 req-6f1befe9-700a-4915-be90-651b04ddef51 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:53.981502 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c091d741-1280-4c97-9d15-f3aaab315434 req-6f1befe9-700a-4915-be90-651b04ddef51 service nova] Creating event network-vif-unplugged:149996fe-e248-44cf-8a07-10ff4f0650ae for instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf on n-h1-master-1 Oct 24 09:04:53.989063 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c091d741-1280-4c97-9d15-f3aaab315434 req-6f1befe9-700a-4915-be90-651b04ddef51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036824 Oct 24 09:04:53.990103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1527/3123] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:54.166042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:54.175992 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9e614e4-e345-4696-9e0d-b9b5d704da1c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.387752 Oct 24 09:04:54.186648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1597/3124] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:53 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:54.201070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:54.202435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:54.208608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.209086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.209588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.210270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.210720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.211143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.376034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:54.377072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:54.383296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:54.384550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.385359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.386026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.387125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.387955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.388498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.392633 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df76c448-c20a-4f09-aaa9-4cedeff2d532 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1483 microversion: 2.1 time: 0.196416 Oct 24 09:04:54.394777 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1528/3125] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:54 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1483 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:54.532712 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:54.541076 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2430dfe-4c7f-4ac1-9bab-b016f4ad2e01 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.168818 Oct 24 09:04:54.541699 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1598/3126] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:54 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:54.684187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:54.684826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:54.691476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.691964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.692403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.693098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.693575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.694021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.698369 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:54.800036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c6bd0c0b-c45b-41b3-89de-8ccf8f43284d req-6f693ef7-0846-4e98-8e9a-0354b1c7b5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c30cbd-eeaa-47e8-80a6-6b54432918bf", "name": "network-vif-deleted", "tag": "149996fe-e248-44cf-8a07-10ff4f0650ae"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:54.810547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c6bd0c0b-c45b-41b3-89de-8ccf8f43284d req-6f693ef7-0846-4e98-8e9a-0354b1c7b5db service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:54.811050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c6bd0c0b-c45b-41b3-89de-8ccf8f43284d req-6f693ef7-0846-4e98-8e9a-0354b1c7b5db service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:54.811461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c6bd0c0b-c45b-41b3-89de-8ccf8f43284d req-6f693ef7-0846-4e98-8e9a-0354b1c7b5db service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:54.824553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c6bd0c0b-c45b-41b3-89de-8ccf8f43284d req-6f693ef7-0846-4e98-8e9a-0354b1c7b5db service nova] Creating event network-vif-deleted:149996fe-e248-44cf-8a07-10ff4f0650ae for instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf on n-h1-master-1 Oct 24 09:04:54.831332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c6bd0c0b-c45b-41b3-89de-8ccf8f43284d req-6f693ef7-0846-4e98-8e9a-0354b1c7b5db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035478 Oct 24 09:04:54.831945 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1599/3127] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:55.077643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:55.088361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e318e742-6194-4fad-98aa-61a12ca9ce91 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.408032 Oct 24 09:04:55.089049 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1529/3128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:54 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:55.207150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:55.207941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:55.218220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.218723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.219166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.220416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.220877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.221357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.421765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:55.422535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:55.432485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.433546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.434188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.435136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.435787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.436409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.482409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.483426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.483902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.485079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lazy-loading 'fault' on Instance uuid e1c30cbd-eeaa-47e8-80a6-6b54432918bf {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:04:55.615061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:55.629174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04e69dda-883d-4a76-9792-a2c8fc24658e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.427739 Oct 24 09:04:55.633375 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1600/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:55 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:55.643142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:55.644199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:55.661067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.666862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.667397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.668226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:55.668834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:55.669360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:55.717220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:55.733966 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a846de2-3c96-46eb-9ded-0f866c549c6b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 200 len: 1314 microversion: 2.1 time: 0.314811 Oct 24 09:04:55.735581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1530/3130] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:55 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:55.993091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:56.009422 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6663abb1-0d93-4d20-9716-43da259d3773 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.373094 Oct 24 09:04:56.011723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1601/3131] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:55 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:56.117573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:56.119359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:56.141428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:56.142842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:56.143304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:56.144044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:56.144510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:56.145875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:56.392718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:56.409124 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87bed536-e388-4d32-8cb2-05218b4f804e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.299697 Oct 24 09:04:56.411029 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1531/3132] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:56 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:56.673397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:56.674023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:56.681372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:56.681861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:56.682295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:56.682990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:56.683428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:56.683854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:56.759363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:56.760620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:56.769732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:56.770394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:56.771137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:56.772107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:56.772567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:56.772982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:56.789394 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf HTTP/1.1 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf'} Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:56.792589 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:04:56.798153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:04:56.800280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:04:56.802202 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1be576e-3cfa-4115-909f-62fd614eaa72 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 404 len: 111 microversion: 2.1 time: 0.047756 Oct 24 09:04:56.805340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1532/3133] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:56 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:04:56.826460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-628723a5-fa2a-44ee-8d30-ce0684fb408e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'create', calling method: .version_select at 0x7f8dab3e23a0>, body: {"keypair": {"name": "tempest-keypair-1105342967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm72AglsiDgSCPzAWoVdkuAFc5vKhIjrVuCvlPjnP3TMWVMSooKdXvFTlFjbY4DOc8y/2dmzBxhIWxqtU89HohYbYgPp1Up/LCw4d2JSJWpPRmL4j9uyjS3TQ5I6+B+0w=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:56.885565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-628723a5-fa2a-44ee-8d30-ce0684fb408e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for project 175a13a281b24a6289e68a76402eb470. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:56.893507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-628723a5-fa2a-44ee-8d30-ce0684fb408e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for user 09b32a47b2874040a560e3f3776fdff9 and project 175a13a281b24a6289e68a76402eb470. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:56.914168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:56.955555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a43e684-9c02-49dc-a6c9-e50075b8260d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.293492 Oct 24 09:04:56.956636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-628723a5-fa2a-44ee-8d30-ce0684fb408e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141408 Oct 24 09:04:56.957518 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1602/3134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:56 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:56.958570 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1533/3135] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:04:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:04:57.038698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:57.044260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:57.068232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.068767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:57.069226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:57.074043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.075949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:57.078621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:57.333219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:57.342378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25cf23d5-ed5c-4a52-8e6d-3cfe739f78bb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.311530 Oct 24 09:04:57.343809 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1603/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:57 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:57.436021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:57.436634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:57.445553 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:57.447985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.448785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:57.449570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:57.450464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.451091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:57.451685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:57.686659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:57.697961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72e8b76a-9781-4fde-b291-00af71085ed9 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.265818 Oct 24 09:04:57.706395 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1534/3137] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:57 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:57.974991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:57.977474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.978040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:57.978833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:57.979806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.980478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:57.981129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:57.988637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:57.990047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:57.998716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:57.999477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.000096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:58.001874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:58.002519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.003130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:58.007958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87fbc4af-d6f1-4008-930a-6b77b13feaf4 tempest-AZV2TestJSON-1418566999 tempest-AZV2TestJSON-1418566999-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.159016 Oct 24 09:04:58.009003 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1604/3138] 10.222.0.25 () {58 vars in 1164 bytes} [Mon Oct 24 09:04:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:04:58.182040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:58.191394 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f275f7f9-d390-49d3-9306-583951ce249b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.206714 Oct 24 09:04:58.192281 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1535/3139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:57 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:58.369633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:58.370330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:58.388204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:58.389471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.390833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:58.393728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:58.395095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.396365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:58.582572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b6d4ddaa-a2cb-4a43-874d-06bd9490e8db req-929e19dc-611f-4a19-b8d2-a391a446b316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1939b26-efff-4eec-81ef-e38a049a0a01", "name": "network-vif-plugged", "status": "completed", "tag": "52e53c3b-b2cd-4671-9036-ed8f3f9b049c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:58.596640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b6d4ddaa-a2cb-4a43-874d-06bd9490e8db req-929e19dc-611f-4a19-b8d2-a391a446b316 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:58.597529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b6d4ddaa-a2cb-4a43-874d-06bd9490e8db req-929e19dc-611f-4a19-b8d2-a391a446b316 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.598242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b6d4ddaa-a2cb-4a43-874d-06bd9490e8db req-929e19dc-611f-4a19-b8d2-a391a446b316 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:58.617547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b6d4ddaa-a2cb-4a43-874d-06bd9490e8db req-929e19dc-611f-4a19-b8d2-a391a446b316 service nova] Creating event network-vif-plugged:52e53c3b-b2cd-4671-9036-ed8f3f9b049c for instance c1939b26-efff-4eec-81ef-e38a049a0a01 on n-h2-master-1 Oct 24 09:04:58.635598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b6d4ddaa-a2cb-4a43-874d-06bd9490e8db req-929e19dc-611f-4a19-b8d2-a391a446b316 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057353 Oct 24 09:04:58.636692 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1536/3140] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:04:58.693975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:58.703012 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9102dd38-cb14-483b-8633-8d067869fec6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.339876 Oct 24 09:04:58.706496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1605/3141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:58 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:58.723547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:58.724877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:58.732072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:58.732844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.733627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:58.734589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:58.735863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:58.736516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.049003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:59.060267 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b218be47-48fc-4c01-9956-d6bdd333e149 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.341406 Oct 24 09:04:59.060862 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1537/3142] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:58 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:59.151682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1102685401", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:04:59.209337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] validate_networks() for [('a99780c5-0a2c-42de-b031-d9ba98da98c0', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:04:59.214590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:59.215205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:59.222010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:59.222554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:59.223000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.223694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:59.224145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:59.224746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.454424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:59.470316 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-301fd493-84ef-407e-a778-664ffd905968 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1317 microversion: 2.1 time: 0.258607 Oct 24 09:04:59.471156 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1538/3143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:59 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:04:59.730318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:04:59.731275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:04:59.739071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:59.739644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:59.740155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.741070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:59.741948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:59.742763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.892300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:04:59.902375 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-692fc9e8-a64a-4ecb-b238-01302a8bdb8d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.177310 Oct 24 09:04:59.903059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1539/3144] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:04:59 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:04:59.917421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:04:59.918228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:04:59.918727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:04:59.922458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:04:59.922966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:04:59.933121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:59.939238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:59.939817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.940762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:04:59.942010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:04:59.942286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:04:59.963613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for project 175a13a281b24a6289e68a76402eb470. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:04:59.970401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for user 09b32a47b2874040a560e3f3776fdff9 and project 175a13a281b24a6289e68a76402eb470. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:04:59.985933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:04:59.988303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:05:00.055787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-255787f1-12b7-40aa-97fb-b3b28bd75743 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.908865 Oct 24 09:05:00.058011 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1606/3145] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:04:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:05:00.069825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12ff326a-6823-4232-b8a1-edffe250abd7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:00.072246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12ff326a-6823-4232-b8a1-edffe250abd7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:00.085231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:00.086179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:00.094451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.096037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.096642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.097589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.098207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.098796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.167248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-12ff326a-6823-4232-b8a1-edffe250abd7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:00.176639 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12ff326a-6823-4232-b8a1-edffe250abd7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1225 microversion: 2.1 time: 0.111588 Oct 24 09:05:00.178250 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1540/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:00 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:00.390964 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:00.401179 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-626ed149-949c-4897-9e16-c13dfcb40dcb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.318815 Oct 24 09:05:00.403445 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1607/3147] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:00 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:00.493849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:00.494523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:00.502880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.503378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.503815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.511469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.513409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.514072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.807892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:00.843067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8758e060-b0ce-43b2-a622-b723d4b3b4b7 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1467 microversion: 2.1 time: 0.352807 Oct 24 09:05:00.843822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1541/3148] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:00 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1467 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:00.869392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:00.870354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:00.881645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.882377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.884244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.885128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.887221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.887853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.895640 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:00.932061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:00.934463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:00.963052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.963550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.964156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:00.965061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:00.965777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:00.966204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.254199 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e80c939-25e5-49ce-8dec-8c8909eccebd tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1618 microversion: 2.1 time: 0.381322 Oct 24 09:05:01.255632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1608/3149] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:00 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1618 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:01.263784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:01.264549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:01.277842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:01.285522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:01.286607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.289274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:01.290828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:01.296121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.496363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:01.504500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-50ef3bcb-6540-4282-b0ae-22f9e5b777c4 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.578270 Oct 24 09:05:01.505079 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1542/3150] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:00 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:01.542093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:01.542729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:01.560504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:01.561701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:01.562658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.563745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:01.564360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:01.564989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.660495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:01.676327 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-09918b87-c9c0-4049-aac8-ba10ab83cacd tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1277 microversion: 2.1 time: 0.159380 Oct 24 09:05:01.677887 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1543/3151] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:01 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:01.686093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-977387277", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["228b5e7e-bb4e-44b7-8d90-47945b4ae996"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:01.700393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:01.711370 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ae7b835-fc6b-4083-a605-00f4d8297785 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.451651 Oct 24 09:05:01.725831 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1609/3152] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:01 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:01.738568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:01.739193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:01.746288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:01.747359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:01.747970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.748843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:01.749500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:01.750095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:01.801795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:05:02.491704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:05:02.497438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:05:02.498698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:05:02.500266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:05:02.501706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:05:02.538442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:02.539087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:02.539636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:02.540538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:02.551502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:02.552496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:02.603194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:05:02.609913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:05:02.629645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:02.653048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64bfdc83-5801-4f2e-9012-1ab23e51c46c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.923931 Oct 24 09:05:02.655864 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1610/3153] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:01 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:02.667221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:05:02.671264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:02.673336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:05:02.674502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:02.689821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:02.692640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:02.695600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:02.698848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:02.699529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:02.702005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:02.789719 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e61a774d-61e6-42fe-a09b-93e1d8e49cc0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110492 Oct 24 09:05:02.791163 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1544/3154] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:05:02.805135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:02.832991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:02.851893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:02.855681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:02.856150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:02.856897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:02.857389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:02.857828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:03.191005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:03.200411 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c34fc3b-daf5-4fa4-aecc-96e30e97e1ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.408034 Oct 24 09:05:03.204664 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1545/3155] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:02 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:03.234584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:03.236066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:03.273329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:03.275386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:03.275838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:03.281331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:03.282356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:03.285050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:03.499423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:03.508683 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b175b15a-541c-4c43-9555-4f87990498cf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.850408 Oct 24 09:05:03.509276 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1611/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:02 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:03.525882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4bf25d6-e7c7-4d4b-8ca6-670cf5d409de tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:03.527070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b4bf25d6-e7c7-4d4b-8ca6-670cf5d409de tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:03.572888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:03.583750 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fedbe702-8fd8-4700-8151-f98befdcda5d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1283 microversion: 2.1 time: 0.376275 Oct 24 09:05:03.587623 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1546/3157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:03 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:03.592795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:03.593648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:03.617286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:03.617842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:03.618276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:03.619011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:03.619475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:03.619898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:03.761019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b4bf25d6-e7c7-4d4b-8ca6-670cf5d409de tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:03.768839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4bf25d6-e7c7-4d4b-8ca6-670cf5d409de tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1216 microversion: 2.1 time: 0.254863 Oct 24 09:05:03.772043 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1612/3158] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:03 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:03.785716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:03.786481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:03.792901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:03.793568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:03.794282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:03.795199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:03.795868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:03.796526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.087524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:04.098321 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6cb113f7-f204-4c0e-a267-f14e08e60018 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.509074 Oct 24 09:05:04.101340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1547/3159] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:03 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:04.128250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-147280418"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:04.135072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:04.159349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.159851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.160291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.161009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.161494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.161926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.504379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:04.509589 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:04.514941 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ecc21ae-00da-4702-b54b-0fab0b2077e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.741711 Oct 24 09:05:04.516481 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1613/3160] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:03 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:04.521439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:04.522425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:04.532764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.533504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.534136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.535160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.535988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.536644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.587463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3753f44-f3d7-4512-8c63-a9cc49326707 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.467306 Oct 24 09:05:04.591872 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1548/3161] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:04 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 24 09:05:04.622691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:04.623431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:04.634409 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:04.641787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.642876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.643561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.644539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.645215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.645896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.846763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:04.859322 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2323d011-2113-4cd0-b6cc-794d65f4f142 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.341288 Oct 24 09:05:04.860714 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1614/3162] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:04 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:04.868814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:04.870711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:04.898876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.899629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.900507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:04.901539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:04.902272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:04.903066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:05.068646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:05.083433 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87e48e7c-3cc6-4f32-83c6-8c52265124fa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1268 microversion: 2.1 time: 0.219111 Oct 24 09:05:05.084809 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1615/3163] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:04 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1268 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:05.541814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:05.542502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:05.551921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:05.552810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:05.553704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:05.555123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:05.555835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:05.556607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:05.666096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:05.673784 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df9b858b-ad16-49b4-8218-9576189a890e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 1.057551 Oct 24 09:05:05.681224 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1549/3164] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:04 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:05.853479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:05.870372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-631f2605-419e-4165-9786-3c1febdf4efc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.333609 Oct 24 09:05:05.871305 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1616/3165] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:05 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:05.889080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:05.890114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:05.896898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:05.897730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:05.898240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:05.899019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:05.899549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:05.900071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:05.973322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-12899cc5-2cc0-4607-82d2-0a9dd0cc1185 req-a235c7f3-4adc-4e09-b849-bf6d4e327729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77df50d-86f7-446e-9419-c9e4658fb7e4", "tag": "79ea8144-d26b-4fdc-9532-e633f756549c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:05.983274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-12899cc5-2cc0-4607-82d2-0a9dd0cc1185 req-a235c7f3-4adc-4e09-b849-bf6d4e327729 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:05.983894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-12899cc5-2cc0-4607-82d2-0a9dd0cc1185 req-a235c7f3-4adc-4e09-b849-bf6d4e327729 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:05.985278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-12899cc5-2cc0-4607-82d2-0a9dd0cc1185 req-a235c7f3-4adc-4e09-b849-bf6d4e327729 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:05.999128 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-12899cc5-2cc0-4607-82d2-0a9dd0cc1185 req-a235c7f3-4adc-4e09-b849-bf6d4e327729 service nova] Creating event network-changed:79ea8144-d26b-4fdc-9532-e633f756549c for instance b77df50d-86f7-446e-9419-c9e4658fb7e4 on n-h2-master-1 Oct 24 09:05:06.004892 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-12899cc5-2cc0-4607-82d2-0a9dd0cc1185 req-a235c7f3-4adc-4e09-b849-bf6d4e327729 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037383 Oct 24 09:05:06.005612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1617/3166] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:06.113778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:06.114963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:06.122395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:06.122865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:06.123304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:06.124270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:06.125052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:06.125831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:06.242637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:06.253643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:06.256759 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70b3ef63-c4ae-4ce7-8d08-71b069de6109 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1274 microversion: 2.1 time: 0.148720 Oct 24 09:05:06.265500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79ed9fed-21a5-42a4-b124-14a6f5d63240 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.382859 Oct 24 09:05:06.266680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1550/3167] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:05 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:06.271374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1618/3168] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:06 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:06.698910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:06.699517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:06.706295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:06.707101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:06.707771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:06.708683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:06.709385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:06.710005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:06.898927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:06.900245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:06.911285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:06.912151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:06.913164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:06.914241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:06.914924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:06.916974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:06.945573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:06.956858 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17e190f3-d1a1-4684-ad33-b4139b6d9ca6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.263314 Oct 24 09:05:06.971977 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1551/3169] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:06 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:07.280833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:07.281928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:07.297186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:07.297897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:07.299657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:07.300490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:07.301378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:07.302335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:07.428320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:07.445341 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79ede4b2-f0ca-4b33-9629-ad6b8f0acc14 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1274 microversion: 2.1 time: 0.168951 Oct 24 09:05:07.469247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1552/3170] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:07 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:07.477184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:07.478336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:07.490620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:07.491496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:07.492168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:07.493607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:07.494933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:07.496282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:07.550068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:07.565640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01ef2ef1-4a4b-40fd-a36f-80030f2180ac tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1477 microversion: 2.1 time: 0.671000 Oct 24 09:05:07.567714 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1619/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:06 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1477 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:07.881454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:07.905189 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6bcdfc0-2cb0-4939-828a-7a3d854edee9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.432470 Oct 24 09:05:07.908030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1553/3172] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:07 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:07.983473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:07.984703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:07.997194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:07.998264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:07.998975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:08.000143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:08.000897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:08.002249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:08.477607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:08.478730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:08.489772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:08.490509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:08.491280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:08.495128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:08.495959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:08.497632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:08.576838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:08.591940 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a6f82aa-3f0a-46a7-8c46-3ee97fea36c1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.613418 Oct 24 09:05:08.593148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1620/3173] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:07 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:08.606609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:08.607483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:08.614226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:08.615007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:08.615687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:08.616620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:08.617310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:08.617952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:09.298677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:09.318588 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-608cb28b-05fb-43a7-baeb-050a39e6dde7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1476 microversion: 2.1 time: 0.722965 Oct 24 09:05:09.321407 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1621/3174] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:08 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1476 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:09.344963 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:09.345994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:09.367699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:09.368742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:09.369523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:09.370510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:09.371196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:09.371839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:09.460549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:09.476712 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-135e3d3b-49a8-4492-ba19-a5fc656def15 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 1.002114 Oct 24 09:05:09.489997 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1554/3175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:08 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:09.619346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:09.619346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:09.635382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:09.635764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:09.636212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:09.636930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:09.640300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:09.643453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:09.952898 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:10.191251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:10.211018 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7594c396-4918-416c-a8a5-0be6953b8c4b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.598528 Oct 24 09:05:10.212257 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1555/3176] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:09 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:10.354202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:10.355115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:10.371119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:10.372891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:10.373850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:10.377944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:10.378767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:10.380188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:10.544542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:10.570748 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93464253-f4b4-42f4-935b-d3a57b7b7337 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 1.247996 Oct 24 09:05:10.571675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1622/3177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:09 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:10.586476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:10.587105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:10.603863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:10.608555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:10.611951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:10.612809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:10.614923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:10.615690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:11.269071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:11.282533 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c3ba74b-833b-43d1-bb17-248606ea8650 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1476 microversion: 2.1 time: 0.940446 Oct 24 09:05:11.283950 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1556/3178] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:10 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1476 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:11.290466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:11.292439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:11.304024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:11.305042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:11.306737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:11.309176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:11.310091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:11.310753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:11.994232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:12.002746 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b9a6e8e-4870-43b3-bb91-0894e7675bd1 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.716320 Oct 24 09:05:12.008037 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1557/3179] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:11 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:12.029419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:12.030926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:12.045320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:12.046089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:12.046726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:12.048165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:12.048794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:12.049417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:12.271283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:12.280681 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f6f8752-9104-4eed-ad1c-e9c5f4148de4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 1.707845 Oct 24 09:05:12.284701 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1623/3180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:10 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:12.310354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1aa993-e737-4665-8cf7-131a2664698e", "name": "network-vif-unplugged", "status": "completed", "tag": "33302f1a-e11a-4309-ab6f-81766769c0ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:12.343704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:12.344197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:12.344659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:12.357194 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] Creating event network-vif-unplugged:33302f1a-e11a-4309-ab6f-81766769c0ea for instance ea1aa993-e737-4665-8cf7-131a2664698e on n-h2-master-1 Oct 24 09:05:12.372936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] Instance ea1aa993-e737-4665-8cf7-131a2664698e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:05:12.393368 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-75c6ae00-8afe-44b7-bd41-07ee294240bd req-92a59fb5-dd80-4ff0-94f9-74179df3c31a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086524 Oct 24 09:05:12.394299 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1624/3181] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:12.399544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:12.400254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:12.422693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:12.423106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:12.423456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:12.424164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:12.424625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:12.425054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:12.570823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:12.627361 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:12.645582 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d035b9a0-f78c-4c2f-b4cb-74d04ea51840 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.634916 Oct 24 09:05:12.676252 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1558/3182] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:12 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:12.698978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a31732c1-13b8-4974-b6de-7a62fdff0a33 req-ee86f1a0-a3b1-4ed3-95ab-34dcef506a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77fcda88-86f5-41dd-8878-0bedd83bb019", "tag": "5a7d4c49-3041-4726-ab81-f62443247379"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:12.768512 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=22 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:12.777446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a31732c1-13b8-4974-b6de-7a62fdff0a33 req-ee86f1a0-a3b1-4ed3-95ab-34dcef506a55 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:12.782636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a31732c1-13b8-4974-b6de-7a62fdff0a33 req-ee86f1a0-a3b1-4ed3-95ab-34dcef506a55 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:12.783283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a31732c1-13b8-4974-b6de-7a62fdff0a33 req-ee86f1a0-a3b1-4ed3-95ab-34dcef506a55 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:12.807464 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a31732c1-13b8-4974-b6de-7a62fdff0a33 req-ee86f1a0-a3b1-4ed3-95ab-34dcef506a55 service nova] Creating event network-changed:5a7d4c49-3041-4726-ab81-f62443247379 for instance 77fcda88-86f5-41dd-8878-0bedd83bb019 on n-h2-master-1 Oct 24 09:05:12.815757 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a31732c1-13b8-4974-b6de-7a62fdff0a33 req-ee86f1a0-a3b1-4ed3-95ab-34dcef506a55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131987 Oct 24 09:05:12.816932 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1559/3183] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:12.865638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:12.880776 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a90a0da9-f10b-4819-8743-3c86de65aeef tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1474 microversion: 2.1 time: 0.485147 Oct 24 09:05:12.881920 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1625/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:12 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1474 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:13.026925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:13.028213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:13.045228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.045759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.049386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.051522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.052010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.054476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.310698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:13.312214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:13.339735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.349719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.350736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.352152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.352807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.355501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.433519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:13.443137 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-26c7042e-68ae-4d3b-b562-304a7237bd48 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.420550 Oct 24 09:05:13.449992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1560/3185] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:13 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:13.768186 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:13.792888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-945f2a37-7647-4a42-aab0-4aee4cc84235 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Action: 'create', calling method: .version_select at 0x7f8dab48d280>, body: {"keypair": {"name": "tempest-keypair-866606457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjN/S1SDmZiKtyTUL8hfzgi/M6Po5Avo4ucthgPXUcG9GHOc5s6YJUJ4fyeUI5j6Fe7MQ8T7oxBVEADZWIRke8UtDBsJJq42CrVljp42uglHQ7Gf6QaVeuO6FzX8mpWuw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:13.828998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-945f2a37-7647-4a42-aab0-4aee4cc84235 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Getting quotas for project 62a15639dcb743da88acbde43c90e3a9. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:05:13.846362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-945f2a37-7647-4a42-aab0-4aee4cc84235 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Getting quotas for user 1e38267e38654eadbefc711d55365c91 and project 62a15639dcb743da88acbde43c90e3a9. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:05:13.850482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:13.857791 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:13.866054 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ce806dc-6d26-4a16-b0f7-640959805283 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.562183 Oct 24 09:05:13.866666 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1626/3186] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:13 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:13.894682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:13.901557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-945f2a37-7647-4a42-aab0-4aee4cc84235 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.388637 Oct 24 09:05:13.904164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1561/3187] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:05:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:05:13.913950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:13.924365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:13.925014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:13.936880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.938502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.940438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.941070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.941729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.942398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.944404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.944766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.945639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:13.945844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:13.946552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:13.947634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:14.220585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:14.232885 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05fb32d7-722e-48cd-a18e-94b1fa2e6de5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.343465 Oct 24 09:05:14.233864 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1627/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:13 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:14.346334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:14.355975 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bded2c4b-1e23-41ed-9190-3e9c4f2bd17f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1474 microversion: 2.1 time: 0.448941 Oct 24 09:05:14.361084 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1562/3189] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:13 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1474 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:14.530341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0c739a6d-83bf-4cca-a8e4-30ff09d96c1f req-8d23c08e-366b-4d58-a80c-3f0a464f6b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-plugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:14.570351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:14.574630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c739a6d-83bf-4cca-a8e4-30ff09d96c1f req-8d23c08e-366b-4d58-a80c-3f0a464f6b2a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:14.575173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c739a6d-83bf-4cca-a8e4-30ff09d96c1f req-8d23c08e-366b-4d58-a80c-3f0a464f6b2a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:14.575811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:14.576282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c739a6d-83bf-4cca-a8e4-30ff09d96c1f req-8d23c08e-366b-4d58-a80c-3f0a464f6b2a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:14.600485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:14.601098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:14.601581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:14.602319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:14.602785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:14.603220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:14.638715 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0c739a6d-83bf-4cca-a8e4-30ff09d96c1f req-8d23c08e-366b-4d58-a80c-3f0a464f6b2a service nova] Creating event network-vif-plugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:05:14.655132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0c739a6d-83bf-4cca-a8e4-30ff09d96c1f req-8d23c08e-366b-4d58-a80c-3f0a464f6b2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131588 Oct 24 09:05:14.657319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1628/3190] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:14.901609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:14.902697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:14.923084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:14.925155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:14.927604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:14.930820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:14.933616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:14.934410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:15.073749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:15.087940 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9c4d10c-1b21-4dde-9205-aeffd9086053 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.519986 Oct 24 09:05:15.089075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1563/3191] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:14 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:15.268277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:15.268893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:15.283181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:15.284450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:15.284910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:15.288170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:15.288902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:15.289603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:15.464908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:15.481204 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce6df981-7ce5-4105-9afb-c3051426c762 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.586002 Oct 24 09:05:15.482104 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1629/3192] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:14 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:15.488366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:15.489192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:15.502736 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:15.516116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:15.521008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:15.522390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:15.523614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:15.525874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:15.527773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:15.894635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:15.906237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59d988a4-ef15-46fd-b67e-42fe3703bcb1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.643028 Oct 24 09:05:15.923229 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1564/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:15 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:16.115680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:16.118070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:16.130186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.130710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.131162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.131902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.132362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.132799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.195127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:16.210725 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d055d39e-a502-4bcf-aa15-793bf9f08465 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1471 microversion: 2.1 time: 0.727157 Oct 24 09:05:16.212132 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1630/3194] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:15 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1471 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:16.234554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:16.235627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:16.247259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.253215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.258886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.262478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.265171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.267776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.466921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d440e3f7-84df-4bdb-bc72-2f8ec4b6cf0d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e/action" status: 204 len: 0 microversion: 2.1 time: 0.235319 Oct 24 09:05:16.472192 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1631/3195] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:16 2022] POST /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e/action => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:05:16.495995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:16.497235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:16.507596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.508499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.509454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.510429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.512478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.513423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.613963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:16.628656 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73133fa5-1e64-4a7f-95b8-c0e57455c4e4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.517867 Oct 24 09:05:16.635109 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1565/3196] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:16 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:16.641600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:16.648282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:16.667473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.670947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.671652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.673146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:16.673795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:16.674419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:16.713515 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:17.453252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:17.469057 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a45ac061-b3ec-43cc-8013-4fe257d0693b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1471 microversion: 2.1 time: 0.995257 Oct 24 09:05:17.484477 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1632/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:16 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1471 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:17.501881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:17.505988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:17.525827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:17.526747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:17.527413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:17.531208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:17.532472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:17.534451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:17.830725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:17.844371 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-211b1879-5e7e-4acb-9a3c-7c09a413a7d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1533 microversion: 2.1 time: 0.357536 Oct 24 09:05:17.851390 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1633/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:17 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1533 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:17.865503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:17.882485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:17.907543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:17.913810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:17.915737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:17.919431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:17.925441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:17.927049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:18.062820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:18.080604 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78c38733-6bed-4765-b5d2-44ea23c09c88 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 1.439570 Oct 24 09:05:18.084680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1566/3199] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:16 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:18.374838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:18.386081 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-129d68d7-062c-4028-b4d9-44514af82d28 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.532832 Oct 24 09:05:18.386683 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1634/3200] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:17 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:18.506907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:18.519084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:18.539518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:18.540025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:18.540471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:18.541184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:18.541772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:18.542203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:18.875985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:18.876893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:18.895643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:18.903727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:18.908383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:18.910606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:18.913497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:18.917230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:19.273428 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:19.290586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-489c79e8-620e-4604-b278-c17c4544c326 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1471 microversion: 2.1 time: 0.793402 Oct 24 09:05:19.292818 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1567/3201] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:18 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1471 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:19.308819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:19.311149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:19.328385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:19.329998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:19.331505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:19.332403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:19.334403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:19.336372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:19.483512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:19.497759 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9dda2013-0663-40a6-ad50-9aeaa8c77788 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1533 microversion: 2.1 time: 0.624690 Oct 24 09:05:19.499969 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1635/3202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:18 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1533 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:19.514860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1aa993-e737-4665-8cf7-131a2664698e", "name": "network-vif-plugged", "status": "completed", "tag": "33302f1a-e11a-4309-ab6f-81766769c0ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:19.527279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:19.528622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:19.529520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:19.554122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] Creating event network-vif-plugged:33302f1a-e11a-4309-ab6f-81766769c0ea for instance ea1aa993-e737-4665-8cf7-131a2664698e on n-h2-master-1 Oct 24 09:05:19.562961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] Instance ea1aa993-e737-4665-8cf7-131a2664698e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:05:19.573215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-91498324-a6f2-44bc-9250-d18959d9679d req-61194495-8833-4a82-b184-4b017db0fad8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070138 Oct 24 09:05:19.574343 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1636/3203] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:19.586005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:19.594265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:19.644052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:19.644791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:19.645581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:19.646471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:19.647560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:19.649095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:19.949610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:19.959974 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2d26d72-c6e6-41dd-9119-a10677aee27d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.384043 Oct 24 09:05:19.979559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1637/3204] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:19 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:20.066214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:20.088076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc968eba-5624-467e-89fc-620c31476b98 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.789616 Oct 24 09:05:20.090617 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1568/3205] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:19 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:20.318775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:20.319758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:20.330371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:20.330882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:20.331341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:20.332070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:20.332535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:20.332970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:20.540053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:20.540792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:20.568090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:20.568938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:20.573178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:20.574137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:20.584832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:20.585573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:20.916100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:20.928865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c526a553-9834-41ff-88e1-1a28ff7c2943 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1471 microversion: 2.1 time: 0.614202 Oct 24 09:05:20.934540 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1638/3206] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:20 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1471 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:20.988038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:21.001255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:21.002181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:21.006778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a84370b-57a5-4fe8-9d59-be4b724feba9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.470693 Oct 24 09:05:21.014269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:21.014775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:21.015221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:21.015949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:21.016947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:21.017457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:21.017861 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1569/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:20 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:21.115958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:21.117013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:21.128537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:21.132739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:21.133516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:21.134492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:21.135178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:21.135836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:21.558086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:21.575929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b77f3b7-f540-4e59-a171-f1825a14dd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.461684 Oct 24 09:05:21.591067 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1570/3208] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:21 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:21.641202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:21.652611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c03d6f13-4a52-4144-baa3-5267a8931703 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.653327 Oct 24 09:05:21.652889 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1639/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:20 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:21.963878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:21.964414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:21.980106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:21.986775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:21.987327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:21.988093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:21.988574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:21.989007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.044607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:22.045229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:22.058851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.067408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.067901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.071197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.074521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.079114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.454179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:22.471983 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d47d926-032b-4689-b44b-43bc16ecbef2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1463 microversion: 2.1 time: 0.509567 Oct 24 09:05:22.473601 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1571/3210] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:21 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1463 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:22.499272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:22.500144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:22.508373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.509165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.509799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.517691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.518494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.519281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.530962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:22.545268 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f348ad1-dc11-402c-be93-439f2c41b7f7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.504816 Oct 24 09:05:22.548346 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1640/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:22 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:22.605214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:22.606681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:22.621162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.625929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.627638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.628637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.629325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.629949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.905519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:22.920789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c89297ae-2dd5-47c2-8baa-fc7b3b0002e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1463 microversion: 2.1 time: 0.425886 Oct 24 09:05:22.937323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1572/3212] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:22 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1463 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:22.951462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:22.956039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:22.973061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.973877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.974514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:22.975413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:22.976035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:22.976630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:23.346452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:23.355637 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68528d66-d93f-4f2e-82bb-2ee65f953762 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.419805 Oct 24 09:05:23.364783 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1573/3213] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:22 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:23.372826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e01ead8-e17c-4168-9da9-55972d4f0479 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'create', calling method: .version_select at 0x7f8daf2413a0>, body: {"keypair": {"name": "tempest-keypair-260237284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+bGakEcSo5Edww5HinzAuuZVFpAIUVhyVU38eqpmpxEjBd5LcG0MQc4bJnM4fhp7mwf+vsoG0XmqixmnBWaplVv+gcbs5PidInvbhb8OZ10GZsPL0Zk4kN8MJPTJXi3w=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:23.400568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:23.409219 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bdb4e407-0d00-4375-a417-0393c589b13e tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.809740 Oct 24 09:05:23.421597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6e01ead8-e17c-4168-9da9-55972d4f0479 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for project 72b5d3aef4214073b745477d3d48442b. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:05:23.426357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1641/3214] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:22 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:23.431398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6e01ead8-e17c-4168-9da9-55972d4f0479 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for user 4dde4bb72f914457a633358837d178de and project 72b5d3aef4214073b745477d3d48442b. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:05:23.504158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e01ead8-e17c-4168-9da9-55972d4f0479 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137587 Oct 24 09:05:23.506017 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1574/3215] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:05:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:23.575607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:23.576727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:23.592650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:23.601751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:23.602234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:23.603002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:23.603527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:23.611683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:23.747035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0b2689f5-e893-4e8e-988f-5ea215299c0f req-882e666f-6c1c-47d5-8bf2-22bc98e06010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77df50d-86f7-446e-9419-c9e4658fb7e4", "name": "network-vif-plugged", "status": "completed", "tag": "79ea8144-d26b-4fdc-9532-e633f756549c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:23.783507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0b2689f5-e893-4e8e-988f-5ea215299c0f req-882e666f-6c1c-47d5-8bf2-22bc98e06010 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:23.787379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0b2689f5-e893-4e8e-988f-5ea215299c0f req-882e666f-6c1c-47d5-8bf2-22bc98e06010 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:23.788173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0b2689f5-e893-4e8e-988f-5ea215299c0f req-882e666f-6c1c-47d5-8bf2-22bc98e06010 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:23.818261 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0b2689f5-e893-4e8e-988f-5ea215299c0f req-882e666f-6c1c-47d5-8bf2-22bc98e06010 service nova] Creating event network-vif-plugged:79ea8144-d26b-4fdc-9532-e633f756549c for instance b77df50d-86f7-446e-9419-c9e4658fb7e4 on n-h2-master-1 Oct 24 09:05:23.831748 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0b2689f5-e893-4e8e-988f-5ea215299c0f req-882e666f-6c1c-47d5-8bf2-22bc98e06010 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088331 Oct 24 09:05:23.835025 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1575/3216] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:24.390936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:24.393087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:24.403316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:24.404049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:24.404663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:24.405699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:24.406322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:24.406953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:24.483639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:24.493587 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ac999c2-187a-401d-b3b1-be13088ff749 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.923601 Oct 24 09:05:24.494731 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1642/3217] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:23 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:24.503378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:24.504837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:24.521244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:24.523147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:24.524807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:24.528311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:24.531731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:24.532467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:24.598197 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:24.804209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:24.821818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17e685a5-cb90-4ac6-9632-158aaffc0559 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1325 microversion: 2.1 time: 0.435294 Oct 24 09:05:24.823140 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1576/3218] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:24 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:25.524165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:25.529549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:25.552116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:25.553075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:25.553543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:25.556432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:25.557185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:25.565436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:25.566543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:25.594614 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e69c6dec-e8ea-4349-8be1-30a5f943baab tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 1.098024 Oct 24 09:05:25.617089 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1643/3219] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:24 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:25.852463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:25.854099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:25.867233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:25.877915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:25.878641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:25.881825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:25.882514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:25.883132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:25.890422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:25.908109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9661416f-dc1c-420f-aeaa-e8355c44136b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.392239 Oct 24 09:05:25.911419 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1577/3220] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:25 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:26.198030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5fc84ef6-043d-4e53-98d6-53b9b58dfbaa req-1668a608-e956-4a9b-ba82-e2a5425b509c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92096759-c3f1-4279-abbe-5e823421740c", "name": "network-vif-plugged", "status": "completed", "tag": "80ad4d66-4f35-4cdb-8063-3147e1c2eab9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:26.216682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5fc84ef6-043d-4e53-98d6-53b9b58dfbaa req-1668a608-e956-4a9b-ba82-e2a5425b509c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.218474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5fc84ef6-043d-4e53-98d6-53b9b58dfbaa req-1668a608-e956-4a9b-ba82-e2a5425b509c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:26.219111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5fc84ef6-043d-4e53-98d6-53b9b58dfbaa req-1668a608-e956-4a9b-ba82-e2a5425b509c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:26.274993 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5fc84ef6-043d-4e53-98d6-53b9b58dfbaa req-1668a608-e956-4a9b-ba82-e2a5425b509c service nova] Creating event network-vif-plugged:80ad4d66-4f35-4cdb-8063-3147e1c2eab9 for instance 92096759-c3f1-4279-abbe-5e823421740c on n-h2-master-1 Oct 24 09:05:26.283066 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5fc84ef6-043d-4e53-98d6-53b9b58dfbaa req-1668a608-e956-4a9b-ba82-e2a5425b509c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091879 Oct 24 09:05:26.285519 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1578/3221] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:05:26.343452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:26.356887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd81f36c-54df-4822-b11b-5e71549d6ede tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1521 microversion: 2.1 time: 0.511127 Oct 24 09:05:26.358612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1644/3222] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:25 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:26.404339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:26.405567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:26.412983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.426421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:26.427266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:26.428281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.428973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:26.429652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:26.623479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:26.624088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:26.641439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.646564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:26.653321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:26.654645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.655329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:26.656232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:26.881840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:26.897395 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0da65800-61ab-47aa-8e47-763a46c602be tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1521 microversion: 2.1 time: 0.503274 Oct 24 09:05:26.899310 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1579/3223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:26 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:26.913856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b78b822-5307-4148-85cb-534bc0cdb8c5 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '.version_select at 0x7f8dab56a310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:26.921011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78b822-5307-4148-85cb-534bc0cdb8c5 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.925127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78b822-5307-4148-85cb-534bc0cdb8c5 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:26.928826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78b822-5307-4148-85cb-534bc0cdb8c5 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:26.947495 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b78b822-5307-4148-85cb-534bc0cdb8c5 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.046688 Oct 24 09:05:26.964077 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1580/3224] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 09:05:26 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:26.977525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1663926025"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:26.980241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:26.996034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:26.996829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:27.002457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:27.003438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:27.004092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:27.004811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:27.213876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:27.226732 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c739714-3fb8-47e9-9191-d592e5f4a797 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.607753 Oct 24 09:05:27.231803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1645/3225] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:26 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:27.236912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:27.237603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:27.271703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:27.272214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:27.272889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:27.273808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:27.274493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:27.275081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:27.581397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:27.591574 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1825f397-1cc3-4c82-87e5-0a956046fd25 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.358362 Oct 24 09:05:27.594371 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1646/3226] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:27 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:27.604973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd94c465-395b-46ca-a01e-6c2191f12fa3 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:27.633770 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd94c465-395b-46ca-a01e-6c2191f12fa3 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038051 Oct 24 09:05:27.642417 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1647/3227] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:05:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:27.647284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e80f9cc-9663-4dc8-ac81-7e5c32f1dcde tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1941380031", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:27.700873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e80f9cc-9663-4dc8-ac81-7e5c32f1dcde tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.057036 Oct 24 09:05:27.710268 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1648/3228] 10.222.0.25 () {60 vars in 1146 bytes} [Mon Oct 24 09:05:27 2022] POST /compute/v2.1/flavors => generated 499 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:27.718403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a5831b8a-6348-40a0-81e5-988fe34b4d1b tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:27.737721 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a5831b8a-6348-40a0-81e5-988fe34b4d1b tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025851 Oct 24 09:05:27.741289 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1649/3229] 10.222.0.25 () {58 vars in 1182 bytes} [Mon Oct 24 09:05:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:05:28.099769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-924871001", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "a47b1aef-e06d-4b9a-bd63-b853b468df48"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:32.495490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:05:32.852857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3505baa7-f46c-4296-bcba-df3fbf886ec8 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4/action" status: 202 len: 0 microversion: 2.1 time: 5.884870 Oct 24 09:05:32.875649 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1581/3230] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:26 2022] POST /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4/action => generated 0 bytes in 5911 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:05:32.902988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:32.905264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:32.929601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:32.930492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:32.931174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:32.939796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:32.941578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:32.945935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.217229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:05:33.219819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:05:33.220581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:05:33.220999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:05:33.221461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:05:33.245949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.246705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.248175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.249431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.250090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.253163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.297892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:05:33.304366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for user 4dde4bb72f914457a633358837d178de and project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:05:33.315539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:33.322972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:05:33.326329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:05:33.326543 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4570ea3d-4055-46f8-88a8-0838bc203794 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1316 microversion: 2.1 time: 0.443426 Oct 24 09:05:33.327090 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1582/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:32 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:33.348092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-51b542c4-5376-4749-bec4-d8b3b8704fdf req-7fc1b7e0-96c3-4c03-8b11-a41cff794a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77fcda88-86f5-41dd-8878-0bedd83bb019", "name": "network-vif-plugged", "status": "completed", "tag": "5a7d4c49-3041-4726-ab81-f62443247379"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:33.360112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-51b542c4-5376-4749-bec4-d8b3b8704fdf req-7fc1b7e0-96c3-4c03-8b11-a41cff794a0a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.361339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-51b542c4-5376-4749-bec4-d8b3b8704fdf req-7fc1b7e0-96c3-4c03-8b11-a41cff794a0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.362368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-51b542c4-5376-4749-bec4-d8b3b8704fdf req-7fc1b7e0-96c3-4c03-8b11-a41cff794a0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.381847 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-51b542c4-5376-4749-bec4-d8b3b8704fdf req-7fc1b7e0-96c3-4c03-8b11-a41cff794a0a service nova] Creating event network-vif-plugged:5a7d4c49-3041-4726-ab81-f62443247379 for instance 77fcda88-86f5-41dd-8878-0bedd83bb019 on n-h2-master-1 Oct 24 09:05:33.389102 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-51b542c4-5376-4749-bec4-d8b3b8704fdf req-7fc1b7e0-96c3-4c03-8b11-a41cff794a0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043983 Oct 24 09:05:33.390555 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1583/3232] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:33.396945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:33.398618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:33.406104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.407145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.407749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.408686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.409582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.411348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.420660 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abb15294-a259-464f-a12c-b54a151979e3 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.323159 Oct 24 09:05:33.425609 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1650/3233] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:05:33.448008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:33.451059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:33.461882 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:33.490071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.491012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.492191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.493153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:33.493881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:33.494523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:33.975017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:33.984087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-530bdc9d-d6c4-4ee0-80f2-8e16df60e490 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.591174 Oct 24 09:05:33.984977 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1584/3234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:33 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:33.990034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-579eefee-a777-43d4-8493-d48c52bee857 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '.version_select at 0x7f8daaf1ab80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:34.195445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:34.206418 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9dc312ad-b234-4b97-9176-0555704e7116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.779359 Oct 24 09:05:34.222026 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1651/3235] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:33 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:34.235629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e91f3ae-62fe-471d-b67c-e159cd0db26a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:34.236542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e91f3ae-62fe-471d-b67c-e159cd0db26a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:34.328348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e91f3ae-62fe-471d-b67c-e159cd0db26a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:34.347565 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e91f3ae-62fe-471d-b67c-e159cd0db26a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1278 microversion: 2.1 time: 0.123178 Oct 24 09:05:34.349437 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1652/3236] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:34 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:34.355660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-609185606"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:34.359459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:34.392526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:34.394143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:34.398670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:34.399756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:34.402336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:34.403864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.234009 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-579eefee-a777-43d4-8493-d48c52bee857 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f" status: 204 len: 0 microversion: 2.1 time: 5.247374 Oct 24 09:05:39.235928 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1585/3237] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:33 2022] DELETE /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f => generated 0 bytes in 5250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:05:39.252261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:39.252839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:39.254877 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:39.266763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.267653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.268095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.268806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.269265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.269985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.291062 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:39.435267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:39.447151 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dae2d2c6-ff86-4c71-a35f-b90066943b61 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1466 microversion: 2.1 time: 0.209841 Oct 24 09:05:39.448816 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1586/3238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:39 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1466 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:39.458031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:39.461524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:39.477236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.478993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.480525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.484087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.485426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.488913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.538822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d9028b5-70cb-40b0-91f9-ffe5d352ae75 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 5.187643 Oct 24 09:05:39.541188 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1653/3239] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:34 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 5191 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 24 09:05:39.561544 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:39.568372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:39.587495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.588016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.588767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.589634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.590100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.590812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.756562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:39.764464 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-167904aa-6aa4-4c83-ab70-10fe25bf2584 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1528 microversion: 2.1 time: 0.314163 Oct 24 09:05:39.766945 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1587/3240] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:39 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1528 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:39.773831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ba6cea5d-d865-4566-9ff4-48a982aba279 req-bcf3b75f-2988-4cbe-9749-5cc464105f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-unplugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:39.783989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ba6cea5d-d865-4566-9ff4-48a982aba279 req-bcf3b75f-2988-4cbe-9749-5cc464105f0d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.784707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ba6cea5d-d865-4566-9ff4-48a982aba279 req-bcf3b75f-2988-4cbe-9749-5cc464105f0d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.785459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ba6cea5d-d865-4566-9ff4-48a982aba279 req-bcf3b75f-2988-4cbe-9749-5cc464105f0d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.818356 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ba6cea5d-d865-4566-9ff4-48a982aba279 req-bcf3b75f-2988-4cbe-9749-5cc464105f0d service nova] Creating event network-vif-unplugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:05:39.827600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ba6cea5d-d865-4566-9ff4-48a982aba279 req-bcf3b75f-2988-4cbe-9749-5cc464105f0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056975 Oct 24 09:05:39.829978 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1588/3241] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:39.842878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6c04aa12-6736-4462-a165-b7416db97537 req-9e6048c5-2c3c-44c5-b99e-dfd8af7bf849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:39.857180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6c04aa12-6736-4462-a165-b7416db97537 req-9e6048c5-2c3c-44c5-b99e-dfd8af7bf849 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.858328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6c04aa12-6736-4462-a165-b7416db97537 req-9e6048c5-2c3c-44c5-b99e-dfd8af7bf849 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.861790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6c04aa12-6736-4462-a165-b7416db97537 req-9e6048c5-2c3c-44c5-b99e-dfd8af7bf849 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.881438 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6c04aa12-6736-4462-a165-b7416db97537 req-9e6048c5-2c3c-44c5-b99e-dfd8af7bf849 service nova] Creating event network-changed:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:05:39.889082 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6c04aa12-6736-4462-a165-b7416db97537 req-9e6048c5-2c3c-44c5-b99e-dfd8af7bf849 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056473 Oct 24 09:05:39.890287 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1589/3242] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:39.894035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:39.899863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a7edf54-84c6-403c-a748-a50d40bf184a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '.version_select at 0x7f8dab3e2af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:39.903997 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c55016c3-2b62-475d-b1d8-294e516dc758 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.361233 Oct 24 09:05:39.905207 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1654/3243] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:39 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:39.918546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:39.919325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:39.930397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8a7edf54-84c6-403c-a748-a50d40bf184a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Image not found. Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a7edf54-84c6-403c-a748-a50d40bf184a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f HTTP/1.1 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: exception: Image not found. Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1f7c8c5a-69f3-4b61-bab3-fe0778360d8f'} Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1f7c8c5a-69f3-4b61-bab3-fe0778360d8f Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 09:05:39.932863 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f7c8c5a-69f3-4b61-bab3-fe0778360d8f could not be found. Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a7edf54-84c6-403c-a748-a50d40bf184a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Image not found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a7edf54-84c6-403c-a748-a50d40bf184a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f" status: 404 len: 62 microversion: 2.1 time: 0.042187 Oct 24 09:05:39.938418 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1590/3244] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:05:39 2022] GET /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:05:39.944933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.944933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.944933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.945279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:39.945995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.948013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.948474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.950057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:39.961112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.961634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.962069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:39.963701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:39.965928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:39.967665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:40.233538 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e059ad3b-cafd-4670-8d26-96815ea2c2ae tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1617 microversion: 2.1 time: 0.326830 Oct 24 09:05:40.234135 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1655/3245] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:39 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1617 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:40.313802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-966164931", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "228b5e7e-bb4e-44b7-8d90-47945b4ae996"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:40.407629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:05:40.753571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:40.766234 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1172cb7-7672-4f56-9dfd-ab15c86b7227 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1521 microversion: 2.1 time: 0.824636 Oct 24 09:05:40.783182 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1591/3246] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:39 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1521 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:40.789732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:40.793080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:40.800941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:40.801628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:40.802267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:40.803492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:40.804111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:40.804699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.175594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:41.194787 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-48dd3f18-914c-42df-9a17-2551f6747ade tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1510 microversion: 2.1 time: 0.402189 Oct 24 09:05:41.194787 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1592/3247] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:40 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:41.209125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:41.213574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:41.235156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.235647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.241892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.242997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.244559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.245009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.309754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:05:41.464956 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a01b6215-4acd-46ba-bff6-cb8ff1d890a7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 204 len: 0 microversion: 2.1 time: 0.274757 Oct 24 09:05:41.465527 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1593/3248] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:05:41 2022] DELETE /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:05:41.477515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:41.483246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:41.499576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.500910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.504726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.505729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.506364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.507844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.574248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:05:41.575030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:05:41.575819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:05:41.576766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:05:41.577695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:05:41.601625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.603386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.606049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.607983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.610442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.613017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.681779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:05:41.703183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Getting quotas for user e20476ff91b34c24b84e67e4416b13b0 and project 8469ec38031e46da9bfde167e0b6da15. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:05:41.744360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:05:41.748639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:05:41.841287 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8511eac-6132-430d-9236-8e8e5741d8b8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531788 Oct 24 09:05:41.849110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1656/3249] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:05:41.857175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:41.858292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:41.869814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.870495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.870954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:41.871833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:41.872299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:41.872910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:42.031447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:42.049533 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a697690a-da80-4662-bd8d-26408628aace tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.582288 Oct 24 09:05:42.050711 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1594/3250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:41 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:42.056782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0679c8d-bae4-41b2-8636-814f7e3b9a04 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:42.058639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0679c8d-bae4-41b2-8636-814f7e3b9a04 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:42.165740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0679c8d-bae4-41b2-8636-814f7e3b9a04 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:42.173264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0679c8d-bae4-41b2-8636-814f7e3b9a04 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1216 microversion: 2.1 time: 0.121110 Oct 24 09:05:42.179440 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1595/3251] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:42 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:42.214099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:42.214716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:42.233118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:42.236734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:42.237204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:42.238579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:42.239051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:42.239916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:42.362332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:42.377477 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f352c27-cf88-405b-bd59-d1c16aee885c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1527 microversion: 2.1 time: 0.525274 Oct 24 09:05:42.393709 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1657/3252] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:41 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1527 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:42.546916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:42.562746 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e0a7eb4-17a6-49c8-b03f-75380bafb93f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1510 microversion: 2.1 time: 0.352750 Oct 24 09:05:42.564685 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1596/3253] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:42 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:43.075500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:43.076659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:43.085781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.087474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.088988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.090666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.091693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.092525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.202326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:43.203058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:43.214557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.217242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.217807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.220007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.221391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.222348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.373731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:43.383907 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1803e26f-290a-4469-8ae2-95c8960d0742 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1268 microversion: 2.1 time: 0.186089 Oct 24 09:05:43.385254 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1597/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:43 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:43.418072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:43.419240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:43.431850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:43.442304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.447206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.447979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.449204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.454435 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86c2eb76-ec9a-4fb9-927b-91471ab7ad8c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.385131 Oct 24 09:05:43.456352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.457358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1658/3255] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:43 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:43.458044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.592732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:43.595103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:43.610179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.611070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.612162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.613359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:43.614862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:43.615589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:43.756902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:43.775269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0aeb23e6-0986-4af2-a097-64b599e26ccf tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1527 microversion: 2.1 time: 0.369556 Oct 24 09:05:43.777908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1598/3256] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:43 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1527 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:43.971978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:43.989206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-329b85c3-72b6-4eb6-834b-8e96639edc64 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1510 microversion: 2.1 time: 0.402493 Oct 24 09:05:44.006510 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1659/3257] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:43 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:44.414194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:44.414829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:44.416564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7b7b100e-aeae-44c2-a09f-935a9e8bf19b req-87d62825-2986-4a96-88df-9a3892f3b52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-plugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:44.425355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.427545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.430123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.431725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.433175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7b7b100e-aeae-44c2-a09f-935a9e8bf19b req-87d62825-2986-4a96-88df-9a3892f3b52d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.434275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.435568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.441957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7b7b100e-aeae-44c2-a09f-935a9e8bf19b req-87d62825-2986-4a96-88df-9a3892f3b52d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.442439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7b7b100e-aeae-44c2-a09f-935a9e8bf19b req-87d62825-2986-4a96-88df-9a3892f3b52d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.457114 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7b7b100e-aeae-44c2-a09f-935a9e8bf19b req-87d62825-2986-4a96-88df-9a3892f3b52d service nova] Creating event network-vif-plugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:05:44.474808 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7b7b100e-aeae-44c2-a09f-935a9e8bf19b req-87d62825-2986-4a96-88df-9a3892f3b52d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060764 Oct 24 09:05:44.476659 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1660/3258] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:05:44.488328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:44.491642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:44.508738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.513969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.514622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.518378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.519035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.519758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.591634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:44.600998 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1cf275be-8638-4291-b2da-75e1775dfcf6 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1274 microversion: 2.1 time: 0.192348 Oct 24 09:05:44.614238 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1599/3259] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:44 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:44.800420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:44.800960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:44.812402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.815701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.817153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.818771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:44.821263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:44.822864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:44.902956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:44.916303 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a5dbf7b1-e16e-46c6-b9c3-3f89185e3e1c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.437216 Oct 24 09:05:44.918023 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1661/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:44 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:45.012380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:45.012995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:45.022225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:45.022711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:45.027605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:45.037114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:45.037811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:45.043567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:45.067324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:45.077508 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11736941-d105-451a-a58b-11afeebf4260 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1527 microversion: 2.1 time: 0.279481 Oct 24 09:05:45.078966 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1600/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:44 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1527 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:45.408063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:45.417262 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2448bb5-91d1-429f-84af-88209c9e6f68 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1510 microversion: 2.1 time: 0.409102 Oct 24 09:05:45.422837 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1662/3262] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:45 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:45.626678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:45.628244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:45.648889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:45.654563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:45.657735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:45.658769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:45.661156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:45.661801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:45.940294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:45.940916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:45.945649 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:45.956968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:45.957546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:45.970282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:45.971054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:45.971542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:45.971981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:46.497154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:46.510101 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e047fd8e-788e-4e8b-a712-a09430fb60d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.573738 Oct 24 09:05:46.521339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1663/3263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:45 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:46.528573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:46.529258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:46.545183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:46.549615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:46.556009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:46.565722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:46.569572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:46.570622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:46.610851 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:46.674872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:46.687932 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e732ff4f-e058-4afa-8424-541e97663291 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 1.064224 Oct 24 09:05:46.692641 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1601/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:45 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:46.699537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:46.704533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:46.721315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:46.722145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:46.722820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:46.723751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:46.724508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:46.725798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:46.981996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:47.008776 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e03e907-94d9-4ef1-85a8-d02c880fa941 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1527 microversion: 2.1 time: 0.490368 Oct 24 09:05:47.010045 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1664/3265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:46 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1527 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:47.017851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1482adec-bb04-4eda-afe0-a619f2d1a0ec req-da9c26da-7cff-4624-bc40-1e6248f05f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92096759-c3f1-4279-abbe-5e823421740c", "name": "network-vif-unplugged", "status": "completed", "tag": "80ad4d66-4f35-4cdb-8063-3147e1c2eab9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:47.038635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1482adec-bb04-4eda-afe0-a619f2d1a0ec req-da9c26da-7cff-4624-bc40-1e6248f05f49 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.039748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1482adec-bb04-4eda-afe0-a619f2d1a0ec req-da9c26da-7cff-4624-bc40-1e6248f05f49 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.040405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1482adec-bb04-4eda-afe0-a619f2d1a0ec req-da9c26da-7cff-4624-bc40-1e6248f05f49 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:47.059982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_external_events [req-1482adec-bb04-4eda-afe0-a619f2d1a0ec req-da9c26da-7cff-4624-bc40-1e6248f05f49 service nova] Unable to find a host for instance 92096759-c3f1-4279-abbe-5e823421740c. Dropping event network-vif-unplugged {{(pid=126920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 09:05:47.070117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1482adec-bb04-4eda-afe0-a619f2d1a0ec req-da9c26da-7cff-4624-bc40-1e6248f05f49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057846 Oct 24 09:05:47.071474 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1665/3266] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 09:05:47.438976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:47.450322 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e2f6901-7c55-4ad4-86c2-d649ad768064 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1453 microversion: 2.1 time: 0.756185 Oct 24 09:05:47.451327 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1602/3267] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:46 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1453 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:47.480931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:47.501624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:47.521609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.522706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.523588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:47.524849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.525976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.526639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:47.535627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:47.536824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:47.549278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.549811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.550244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:47.564858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.567803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.569573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:47.854900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:47.866699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c5e3070-1091-4aa7-8821-f49d3e314e96 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1453 microversion: 2.1 time: 0.394811 Oct 24 09:05:47.883079 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1666/3268] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:47 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1453 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:47.904099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:47.908700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:47.920669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.921550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.930395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:47.931276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:47.931783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:47.932233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.159752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:48.178202 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ffcfd837-4563-4bfa-b023-6e226ba66881 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.637392 Oct 24 09:05:48.188688 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1603/3269] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:47 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:05:48.215846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:48.216385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:48.241055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.245453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.248368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.252446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.260519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.261284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.262800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:48.280568 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73a62398-08ef-42ee-9c76-79f691b20928 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 0.395939 Oct 24 09:05:48.284917 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1667/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:47 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:48.298469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:48.301226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:48.311278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lazy-loading 'flavor' on Instance uuid 92096759-c3f1-4279-abbe-5e823421740c {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:05:48.318761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.319268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.320494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.321563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.322187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.322791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.332251 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:48.336288 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'shelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state shelved_offloaded Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 14 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: {"shelve": {}} Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'shelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state shelved_offloaded Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'shelve': {}}} Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:05:48.338747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state shelved_offloaded Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state shelved_offloaded Oct 24 09:05:48.343240 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:05:48.346818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'shelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state shelved_offloaded {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:05:48.348068 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1804a8b-3681-4545-9a58-989b41b43485 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 155 microversion: 2.1 time: 0.158318 Oct 24 09:05:48.353688 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1604/3271] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:48 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 155 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:05:48.359187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f4d212ca-54bf-4b5b-9942-ffaf66214218 req-fff3c464-30c5-4852-bcf8-7e2aa2376935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77df50d-86f7-446e-9419-c9e4658fb7e4", "name": "network-vif-deleted", "tag": "79ea8144-d26b-4fdc-9532-e633f756549c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:48.371143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4d212ca-54bf-4b5b-9942-ffaf66214218 req-fff3c464-30c5-4852-bcf8-7e2aa2376935 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.378151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4d212ca-54bf-4b5b-9942-ffaf66214218 req-fff3c464-30c5-4852-bcf8-7e2aa2376935 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.379358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4d212ca-54bf-4b5b-9942-ffaf66214218 req-fff3c464-30c5-4852-bcf8-7e2aa2376935 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.402259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f4d212ca-54bf-4b5b-9942-ffaf66214218 req-fff3c464-30c5-4852-bcf8-7e2aa2376935 service nova] Creating event network-vif-deleted:79ea8144-d26b-4fdc-9532-e633f756549c for instance b77df50d-86f7-446e-9419-c9e4658fb7e4 on n-h2-master-1 Oct 24 09:05:48.410025 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f4d212ca-54bf-4b5b-9942-ffaf66214218 req-fff3c464-30c5-4852-bcf8-7e2aa2376935 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054572 Oct 24 09:05:48.411615 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1605/3272] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:48.444205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:48.445921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:48.463877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.466298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.467532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.468037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.468476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.469507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lazy-loading 'fault' on Instance uuid b77df50d-86f7-446e-9419-c9e4658fb7e4 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:05:48.469764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.470517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:48.470986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:48.471946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:48.553571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:48.563953 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb9d67f4-8873-43e9-8039-687c69b065d5 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 200 len: 1315 microversion: 2.1 time: 0.277072 Oct 24 09:05:48.565115 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1668/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:48 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:48.828648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 09:05:48.988431 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-acec8593-3903-4958-8568-29e526a8da37 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 202 len: 0 microversion: 2.1 time: 0.574926 Oct 24 09:05:48.992170 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1606/3274] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:48 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:05:48.999568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:49.001537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:49.012054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.012920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.024674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.025806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.026716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.028047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.154911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4e9cf2a8-325b-4276-af3a-a8f1324aa2e1 req-e955fdca-a7a0-4339-82d1-3bab39c4992c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "name": "network-vif-plugged", "status": "completed", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:49.171517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e9cf2a8-325b-4276-af3a-a8f1324aa2e1 req-e955fdca-a7a0-4339-82d1-3bab39c4992c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.177063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e9cf2a8-325b-4276-af3a-a8f1324aa2e1 req-e955fdca-a7a0-4339-82d1-3bab39c4992c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.181652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e9cf2a8-325b-4276-af3a-a8f1324aa2e1 req-e955fdca-a7a0-4339-82d1-3bab39c4992c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.211334 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4e9cf2a8-325b-4276-af3a-a8f1324aa2e1 req-e955fdca-a7a0-4339-82d1-3bab39c4992c service nova] Creating event network-vif-plugged:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:05:49.229812 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4e9cf2a8-325b-4276-af3a-a8f1324aa2e1 req-e955fdca-a7a0-4339-82d1-3bab39c4992c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078644 Oct 24 09:05:49.234125 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1607/3275] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:49.249385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:49.251153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:49.265872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.268115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.268587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.269345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.269819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.270253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.374052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:49.388356 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-293d63fe-5d98-48af-8d0b-d914109168eb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1461 microversion: 2.1 time: 0.392980 Oct 24 09:05:49.410401 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1669/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:48 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1461 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:49.438136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:49.439110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:49.448230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.449981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.452242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.453769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.456701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.458016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.892242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:49.900183 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d553d271-268b-46c7-aa27-51136d8d916d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 0.488344 Oct 24 09:05:49.903348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1670/3277] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:49 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:49.910054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:49.913353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:49.930408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.931210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.932563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:49.935605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.936799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:49.938194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:49.939486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:49.946436 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67b2143e-57c4-447d-862d-b46fc147f92b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.705273 Oct 24 09:05:49.947474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1608/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:49 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:49.971137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 HTTP/1.1 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b77df50d-86f7-446e-9419-c9e4658fb7e4'} Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:05:49.975704 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:05:49.982472 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:05:49.988116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:05:49.994339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa0622b4-2b14-4ef7-8531-b57eac191316 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 404 len: 111 microversion: 2.1 time: 0.088944 Oct 24 09:05:49.996878 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1671/3279] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:49 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:05:50.236708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-287285282", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:50.416490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:50.417116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:50.424631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:50.425399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:50.428603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:50.433499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:50.434651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:50.435500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:50.672670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:50.688859 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cc3d240-bf79-45ed-bc8c-04b8637f8dad tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1461 microversion: 2.1 time: 0.275872 Oct 24 09:05:50.705323 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1672/3280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:50 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1461 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:50.823364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c52e950d-5455-4146-b40d-ae18241e770e req-a4a26711-50e2-4290-9907-4f212cd57842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1effd989-7383-4cb1-bc43-a0d425e94773", "tag": "bca849c8-1eee-4d71-8748-4fc038017e52"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:50.843479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c52e950d-5455-4146-b40d-ae18241e770e req-a4a26711-50e2-4290-9907-4f212cd57842 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:50.844522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c52e950d-5455-4146-b40d-ae18241e770e req-a4a26711-50e2-4290-9907-4f212cd57842 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:50.844969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c52e950d-5455-4146-b40d-ae18241e770e req-a4a26711-50e2-4290-9907-4f212cd57842 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:50.875722 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c52e950d-5455-4146-b40d-ae18241e770e req-a4a26711-50e2-4290-9907-4f212cd57842 service nova] Creating event network-changed:bca849c8-1eee-4d71-8748-4fc038017e52 for instance 1effd989-7383-4cb1-bc43-a0d425e94773 on n-h1-master-1 Oct 24 09:05:50.881674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c52e950d-5455-4146-b40d-ae18241e770e req-a4a26711-50e2-4290-9907-4f212cd57842 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062010 Oct 24 09:05:50.885189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1673/3281] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:05:50.925978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:50.927733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:50.938635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:50.939139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:50.942343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:50.943352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:50.946605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:50.947273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:51.198456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:51.213598 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-489e0912-92a7-43c7-8ab1-d4cd401eec79 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 0.291951 Oct 24 09:05:51.221356 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1674/3282] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:50 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:51.225465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:51.229880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:51.244451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:51.244970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:51.250970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:51.253602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:51.253602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:51.253861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:51.503134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:51.516934 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c120f929-46ab-4681-8171-0e575805e35a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1378 microversion: 2.1 time: 0.296544 Oct 24 09:05:51.517795 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1675/3283] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:51 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1378 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:51.716065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:51.716998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:51.724734 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:51.731885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:51.732820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:51.733503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:51.734937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:51.751766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:51.752844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:51.754647 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:52.173351 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:52.471224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:52.485116 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8e68b89-1a8d-4ccc-9449-1ce9bdecdd34 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1461 microversion: 2.1 time: 0.772889 Oct 24 09:05:52.490966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1676/3284] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:51 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1461 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:52.502722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:52.503604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:52.539546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:52.546415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:52.547220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:52.549485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:52.550291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:52.552189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:52.635890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] validate_networks() for [('a99780c5-0a2c-42de-b031-d9ba98da98c0', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:05:53.677397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:05:53.678001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:05:53.678532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:05:53.679017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:05:53.679925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:05:53.704514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:53.716577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:53.719047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:53.721841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:53.724526 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95201c99-3cc9-4e9f-9851-4600c4a28601 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 1.222014 Oct 24 09:05:53.725973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:53.726355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:53.726800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:53.730757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1677/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:52 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:53.745129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:53.746181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:53.772838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:53.773320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:53.773772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:53.774509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:53.774978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:53.781420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:53.807409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for project 175a13a281b24a6289e68a76402eb470. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:05:53.830753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Getting quotas for user 09b32a47b2874040a560e3f3776fdff9 and project 175a13a281b24a6289e68a76402eb470. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:05:53.879414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:05:53.891941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:05:54.046433 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05402888-8c95-44a7-a9cb-84614c15c20c tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.814298 Oct 24 09:05:54.057984 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1609/3286] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:05:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:05:54.080244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:54.080887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:54.098174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:54.103482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:54.104021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:54.108095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:54.108603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:54.109052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:54.493048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:54.505639 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-00c6ef6b-0e27-42ca-b2a5-d60659183e31 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1461 microversion: 2.1 time: 0.449100 Oct 24 09:05:54.506451 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1610/3287] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:54 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1461 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:54.512155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-50517705-1c14-4400-a268-e633b3b7631a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:54.513449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-50517705-1c14-4400-a268-e633b3b7631a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:54.586541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-50517705-1c14-4400-a268-e633b3b7631a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:54.598054 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-50517705-1c14-4400-a268-e633b3b7631a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1224 microversion: 2.1 time: 0.087819 Oct 24 09:05:54.599878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1611/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:54 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:54.758229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:54.758862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:54.786020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:54.788799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:54.789494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:54.790393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:54.791730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:54.794921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.318080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:55.343343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0db49539-f0ab-4edc-83fc-35ce20d56157 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 0.593140 Oct 24 09:05:55.344684 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1612/3289] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:54 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:55.506547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:55.514959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65bf6d54-6c0e-4603-b597-ef6e3086b3f5 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1528 microversion: 2.1 time: 1.783231 Oct 24 09:05:55.517679 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1678/3290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:53 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1528 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:55.544914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:55.545847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:55.548069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:55.548964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:55.557205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:55.558003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:55.558798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.559122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:55.559629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:55.560078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.560481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:55.560800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:55.561256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:55.561711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.562216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:55.562913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.812988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:55.821104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5552117-f34d-4c64-b09a-b7bb20613ca2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.289856 Oct 24 09:05:55.829120 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1613/3291] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:55 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:55.834161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:55.839818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:55.849219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:55.849739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:55.850173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.850874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:55.851327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:55.851751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:55.885238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:55.903653 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-75216a71-83a3-4e7d-857d-24daa0708f74 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1528 microversion: 2.1 time: 0.362170 Oct 24 09:05:55.905675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1679/3292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:55 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1528 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:55.931047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15d96f41-f406-49e9-8677-806276033775 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:55.970977 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15d96f41-f406-49e9-8677-806276033775 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/a47b1aef-e06d-4b9a-bd63-b853b468df48" status: 202 len: 0 microversion: 2.1 time: 0.043509 Oct 24 09:05:55.972349 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1680/3293] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:05:55 2022] DELETE /compute/v2.1/flavors/a47b1aef-e06d-4b9a-bd63-b853b468df48 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:05:55.988812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4c0f2c1-e83a-4993-85cc-07ee76f8d088 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:56.051756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:56.065735 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62518b80-18fb-4d69-b287-88d3ea57fc1f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1220 microversion: 2.1 time: 0.235222 Oct 24 09:05:56.066331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1614/3294] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:55 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:56.143549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e4c0f2c1-e83a-4993-85cc-07ee76f8d088 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.150101 Oct 24 09:05:56.144937 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1681/3295] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:05:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:56.185250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:56.191828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:56.231440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.233775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.237525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:56.244842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.247003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.251019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:56.369933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:56.370309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:56.414113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:56.417033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.428523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.429130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:56.433236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.433769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.441723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:56.456467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Old instance type tempest-test_resize_flavor_-1941380031, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:05:56.477826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:05:56.491476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:05:56.492944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:05:56.495421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:05:56.496046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:05:56.644651 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-304b55ad-ebdd-49ff-9d18-eb1e325c905a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a/action" status: 202 len: 0 microversion: 2.1 time: 0.481572 Oct 24 09:05:56.648321 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1615/3296] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:05:56 2022] POST /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:05:56.666396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:56.669565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:56.683612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.684977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.685647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:56.689950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.690674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.691725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:56.928347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:56.938575 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-947231e6-b01b-49eb-9205-ff4e65b0b281 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 0.573525 Oct 24 09:05:56.944657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1682/3297] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:56 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:56.951592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:56.966801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:56.991366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:56.991888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:56.992359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:57.006663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:57.006663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:57.006663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:57.779935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:57.792322 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-00c09a6d-a1c4-44b0-ac3f-2bff27f73352 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1537 microversion: 2.1 time: 1.142350 Oct 24 09:05:57.812704 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1616/3298] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:56 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1537 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:57.824718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:57.831021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:57.846759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:57.847531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:57.849892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:57.851891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:57.853849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:57.855479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:57.938628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:57.959835 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfe8ebef-ea16-465e-b420-0025d65e4a3e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 1.009687 Oct 24 09:05:57.960730 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1683/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:56 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:57.982583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:57.983238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:58.015620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:58.016133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:58.016587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:58.017346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:58.017803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:58.018238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:58.416427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:58.430347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5f87f58-ec64-4e13-a02d-e66d7ff2bb42 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1282 microversion: 2.1 time: 0.615557 Oct 24 09:05:58.433116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1617/3300] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:57 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1282 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:58.819129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:58.819801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:58.840605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:58.841972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:58.842661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:58.843580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:58.844205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:58.844785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:58.961587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:58.966803 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:58.972910 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-223f6c88-cd46-4f99-ad6a-5fc38b6fe52b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 1.007521 Oct 24 09:05:58.985839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1684/3301] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:57 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:58.993217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9dc0c84e-6494-45e6-9d23-c493c9590d14 req-b00a55c2-f874-4aca-945e-c2932c0cf1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1effd989-7383-4cb1-bc43-a0d425e94773", "name": "network-vif-plugged", "status": "completed", "tag": "bca849c8-1eee-4d71-8748-4fc038017e52"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:05:59.014894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9dc0c84e-6494-45e6-9d23-c493c9590d14 req-b00a55c2-f874-4aca-945e-c2932c0cf1f1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:59.017353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9dc0c84e-6494-45e6-9d23-c493c9590d14 req-b00a55c2-f874-4aca-945e-c2932c0cf1f1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:59.018005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9dc0c84e-6494-45e6-9d23-c493c9590d14 req-b00a55c2-f874-4aca-945e-c2932c0cf1f1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:59.045369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9dc0c84e-6494-45e6-9d23-c493c9590d14 req-b00a55c2-f874-4aca-945e-c2932c0cf1f1 service nova] Creating event network-vif-plugged:bca849c8-1eee-4d71-8748-4fc038017e52 for instance 1effd989-7383-4cb1-bc43-a0d425e94773 on n-h1-master-1 Oct 24 09:05:59.070790 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9dc0c84e-6494-45e6-9d23-c493c9590d14 req-b00a55c2-f874-4aca-945e-c2932c0cf1f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082971 Oct 24 09:05:59.071415 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1685/3302] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:05:59.076843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:59.083595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:59.095790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:59.102564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:59.117397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:59.118452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:59.118953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:59.119400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:59.541615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:59.550224 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac787b08-65c4-4fe9-b7ec-5f1cd648575b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.477346 Oct 24 09:05:59.566503 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1686/3303] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:59 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:05:59.588332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:05:59.589222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:05:59.598637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:59.599430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:59.600055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:59.601624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:05:59.602447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:05:59.603148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:05:59.861261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:05:59.878479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37e18a0c-7fb7-4bf0-b2a0-cfa54f692d6a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1282 microversion: 2.1 time: 0.303727 Oct 24 09:05:59.883369 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1687/3304] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:59 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:00.011956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:00.012619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:00.025053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:00.026284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:00.026744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:00.043885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:00.044431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:00.047306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:00.236755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:00.247400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7baf574-b30a-485c-81f3-e07adce07769 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1537 microversion: 2.1 time: 1.429943 Oct 24 09:06:00.257328 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1618/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:05:58 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1537 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:00.579726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:00.580563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:00.600205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:00.603642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:00.605092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:00.624146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:00.626814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:00.629884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:00.820296 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:00.830084 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b5c07b2-7e09-40f0-9304-17502b6fdb3f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1316 microversion: 2.1 time: 0.822286 Oct 24 09:06:00.835315 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1688/3306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:00 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1316 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:00.911886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:00.912804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:00.925986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:00.930192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:00.930893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:00.934043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:00.936264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:00.936911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:01.274892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:01.295902 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e61b9ed4-53d9-4880-a342-b3c30d2fc04f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.715260 Oct 24 09:06:01.298077 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1619/3307] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:00 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:01.312724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:01.313780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:01.327306 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:01.353201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:01.353839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:01.354296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:01.355036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:01.355488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:01.355908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:01.386799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:01.403193 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-218e8d86-a42e-4f58-800d-a12fef8da40b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1282 microversion: 2.1 time: 0.494363 Oct 24 09:06:01.419125 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1689/3308] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:00 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1282 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:01.870884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:01.873001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:01.907780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:01.908354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:01.908821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:01.909669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:01.930000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:01.932488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:02.407949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:02.424943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-667cb861-aacc-43c3-a69c-764777504ef0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1537 microversion: 2.1 time: 1.124726 Oct 24 09:06:02.425857 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1620/3309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:01 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1537 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:02.433705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:02.440878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:02.456441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:02.456937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:02.457408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:02.458133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:02.458588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:02.459010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:02.723938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:02.737336 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29d708b9-96a3-471e-8445-7fae8c64e647 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1466 microversion: 2.1 time: 0.884847 Oct 24 09:06:02.745830 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1690/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:01 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1466 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:02.757368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:02.758369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:02.783623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:02.785418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:02.787390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:02.788257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:02.790447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:02.795211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:03.641071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:03.666619 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48e72175-4f72-47fb-af4e-e8b014d0f780 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.919114 Oct 24 09:06:03.667286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1691/3311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:02 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:03.672637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:03.673200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:03.705650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:03.706168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:03.706615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:03.707386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:03.707874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:03.708317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:03.776840 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:03.954705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:04.017076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24ab8fc5-074a-4033-97ce-4f5320138b9c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 1.585690 Oct 24 09:06:04.021629 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1621/3312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:02 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:04.042871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:04.043519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:04.062988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:04.063612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:04.064072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:04.078614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:04.080099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:04.080966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:04.123710 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:04.167391 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5a0eaea-608b-47b2-9fff-ca1b60b10576 tempest-ServersOnMultiNodesTest-445758292 tempest-ServersOnMultiNodesTest-445758292-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1617 microversion: 2.1 time: 0.498801 Oct 24 09:06:04.168915 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1692/3313] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:03 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1617 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:04.198088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:04.198925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:04.231614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:04.233210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:04.236403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:04.237676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:04.241044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:04.241809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:04.291050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:04.496955 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-26a0f6ab-0d7f-4730-a95f-4d36b1634410 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 204 len: 0 microversion: 2.1 time: 0.303969 Oct 24 09:06:04.513447 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1693/3314] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:04 2022] DELETE /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:04.521281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:04.522302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:04.533662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:04.534556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:04.535227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:04.536176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:04.536851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:04.538215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:04.596013 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:04.963214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:04.982005 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c40ef17f-1876-4d08-952a-a1ccd817f63e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 0.958472 Oct 24 09:06:05.013807 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1622/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:04 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:05.023187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:05.026075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:05.073992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:05.074910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:05.077043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:05.084151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:05.088703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:05.089567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:05.449067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:05.458758 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2d7d27e-663c-42bf-aba6-ced5f0713768 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1472 microversion: 2.1 time: 0.943607 Oct 24 09:06:05.459351 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1694/3316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:04 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1472 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:05.496722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:05.497560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:05.524877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:05.525650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:05.526112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:05.527366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:05.527834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:05.528263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:05.850278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:05.863311 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ed936f8-7348-45aa-87a8-e8a39ab34ee2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.377071 Oct 24 09:06:05.874470 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1695/3317] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:05 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:06.012517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:06.013601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:06.028809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:06.035898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:06.036667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:06.037860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:06.038357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:06.041531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:06.042124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:06.059043 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-015b165f-6d48-4478-a6b4-bcd1454737a3 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 1.043555 Oct 24 09:06:06.060334 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1623/3318] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:05 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:06.486660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:06.487474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:06.504198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:06.527777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:06.528354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:06.529226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:06.529835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:06.537370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:07.412651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:07.426042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d80d30b0-bd17-4e45-a27d-d15eb471d573 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1472 microversion: 2.1 time: 0.943221 Oct 24 09:06:07.433394 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1624/3319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:06 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1472 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:07.443934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:07.463591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:07.477596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:07.487366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:07.489517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:07.490535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:07.497651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:07.498467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:07.547340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:07.559787 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed7be50f-3a6e-41b0-97d2-2ae1313aa521 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 1.550979 Oct 24 09:06:07.565109 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1696/3320] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:06 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:07.591254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:07.592002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:07.638039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:07.639923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:07.641641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:07.642537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:07.653695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:07.654264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:08.001444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:08.024977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd94e9f8-d9b1-4599-9e9b-ffa76fcfac84 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.585553 Oct 24 09:06:08.037113 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1625/3321] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:07 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:08.057125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-803315860", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "98a261a5-a561-4067-a109-92eaf0fa2a16"}], "security_groups": [{"name": "tempest-securitygroup--2015605381"}], "key_name": "tempest-keypair-866606457", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a1d27e75-556b-4b5a-a911-0baf83234fe1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:08.352654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] validate_networks() for [('98a261a5-a561-4067-a109-92eaf0fa2a16', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:06:08.758810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:08.797873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3bd57cce-f2da-405d-91b8-aae5032de469 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 1.230290 Oct 24 09:06:08.803239 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1697/3322] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:07 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:08.831238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1389a0da-fd1a-4b9d-9b49-9a32ec74ea5c req-e273bd66-1902-4e1b-bc0c-c715a97d2f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8f90cb-0de8-40d5-babf-9e0b0f0afee2", "tag": "8c6cd823-6d29-4622-8232-cbe4886b8090"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:08.852875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1389a0da-fd1a-4b9d-9b49-9a32ec74ea5c req-e273bd66-1902-4e1b-bc0c-c715a97d2f5e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:08.869024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1389a0da-fd1a-4b9d-9b49-9a32ec74ea5c req-e273bd66-1902-4e1b-bc0c-c715a97d2f5e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:08.869755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1389a0da-fd1a-4b9d-9b49-9a32ec74ea5c req-e273bd66-1902-4e1b-bc0c-c715a97d2f5e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:08.897629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1389a0da-fd1a-4b9d-9b49-9a32ec74ea5c req-e273bd66-1902-4e1b-bc0c-c715a97d2f5e service nova] Creating event network-changed:8c6cd823-6d29-4622-8232-cbe4886b8090 for instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 on n-h2-master-1 Oct 24 09:06:08.913992 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1389a0da-fd1a-4b9d-9b49-9a32ec74ea5c req-e273bd66-1902-4e1b-bc0c-c715a97d2f5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104923 Oct 24 09:06:08.915355 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1698/3323] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:08.926484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:08.927676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:08.958504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:08.959385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:08.960516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:08.965619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:08.966441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:08.967147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:09.556365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:09.569971 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89500230-b95d-45d7-b64f-85ed78135172 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1472 microversion: 2.1 time: 0.652553 Oct 24 09:06:09.573159 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1699/3324] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:08 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1472 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:09.581386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:09.586232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:09.599446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:09.601906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:09.602618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:09.604692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:09.606365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:09.608117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:10.355452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:10.369339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3b897bd-d57d-4d41-a8c5-c06e380b6bfe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 0.794579 Oct 24 09:06:10.370148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1700/3325] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:09 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:10.374879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:10.375559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:10.412398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:10.413028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:10.420669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:10.421629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:10.422155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:10.422646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:10.508163 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:10.557956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Getting quotas for project 62a15639dcb743da88acbde43c90e3a9. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:06:10.572946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Getting quotas for user 1e38267e38654eadbefc711d55365c91 and project 62a15639dcb743da88acbde43c90e3a9. Resources: dict_keys(['metadata_items']) {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:06:10.637856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:06:10.642969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:06:10.643737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:06:10.645240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:06:10.645889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:06:10.673169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:10.673958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:10.674422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:10.675225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:10.675755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:10.676181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:10.726347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Getting quotas for project 62a15639dcb743da88acbde43c90e3a9. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:06:10.741620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Getting quotas for user 1e38267e38654eadbefc711d55365c91 and project 62a15639dcb743da88acbde43c90e3a9. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:06:10.877790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:06:10.880274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1d27e75-556b-4b5a-a911-0baf83234fe1',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:06:11.046009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:11.070568 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a614448f-be1d-47e2-b5d4-b7b7b8fa9db2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.696409 Oct 24 09:06:11.072194 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1701/3326] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:10 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:11.084761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:11.087139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:11.102999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.105665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.106417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.108526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.111168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.112861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.263373 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9065cd9c-4629-4cd8-ac30-cad06cab633d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.222637 Oct 24 09:06:11.264050 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1626/3327] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:06:08 2022] POST /compute/v2.1/servers => generated 407 bytes in 3226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:06:11.275041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:11.276294 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:11.288117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.288575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.305134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.315335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.316208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.317899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.369612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.370381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.371793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.372386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lazy-loading 'fault' on Instance uuid 1effd989-7383-4cb1-bc43-a0d425e94773 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:11.483626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:11.497729 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-139e30d7-6ab6-44de-b014-893a395b8ca9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 200 len: 1306 microversion: 2.1 time: 0.229162 Oct 24 09:06:11.525197 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1627/3328] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:11 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 1306 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:11.533023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:11.556250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3dd940ad-5726-4d29-a17a-862b74ba4802 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.474371 Oct 24 09:06:11.557907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c201b3a9-b9be-4b34-8911-61d3d6a67833 req-aad9b73b-5c3e-42ca-b4c3-e3c43cf6751a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1effd989-7383-4cb1-bc43-a0d425e94773", "name": "network-vif-deleted", "tag": "bca849c8-1eee-4d71-8748-4fc038017e52"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:11.559059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1702/3329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:11 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:11.567864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f0b86224-a944-4811-8a78-b85c3d7a5086 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:11.582224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f0b86224-a944-4811-8a78-b85c3d7a5086 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:11.592505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c201b3a9-b9be-4b34-8911-61d3d6a67833 req-aad9b73b-5c3e-42ca-b4c3-e3c43cf6751a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.600109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c201b3a9-b9be-4b34-8911-61d3d6a67833 req-aad9b73b-5c3e-42ca-b4c3-e3c43cf6751a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.603492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c201b3a9-b9be-4b34-8911-61d3d6a67833 req-aad9b73b-5c3e-42ca-b4c3-e3c43cf6751a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.664875 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c201b3a9-b9be-4b34-8911-61d3d6a67833 req-aad9b73b-5c3e-42ca-b4c3-e3c43cf6751a service nova] Creating event network-vif-deleted:bca849c8-1eee-4d71-8748-4fc038017e52 for instance 1effd989-7383-4cb1-bc43-a0d425e94773 on n-h1-master-1 Oct 24 09:06:11.692680 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c201b3a9-b9be-4b34-8911-61d3d6a67833 req-aad9b73b-5c3e-42ca-b4c3-e3c43cf6751a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164613 Oct 24 09:06:11.695881 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1628/3330] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:11.705755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:11.707488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:11.716081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.721597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.722718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.723713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:11.725060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:11.725744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:11.748844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f0b86224-a944-4811-8a78-b85c3d7a5086 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:11.769726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f0b86224-a944-4811-8a78-b85c3d7a5086 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1120 microversion: 2.1 time: 0.205243 Oct 24 09:06:11.772554 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1703/3331] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:11 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1120 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:12.053812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:12.088141 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5fb5c1a7-9230-4aaf-b0e7-358bddff1166 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 0.390799 Oct 24 09:06:12.091082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1629/3332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:11 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:12.099714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:12.100860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:12.123220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.124210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.125466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.128413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.131315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.131967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.528365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:12.529052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 1effd989-7383-4cb1-bc43-a0d425e94773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:12.542708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.543092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.544521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.545239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.551364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.552985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.614341 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 1effd989-7383-4cb1-bc43-a0d425e94773 could not be found. Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 HTTP/1.1 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1effd989-7383-4cb1-bc43-a0d425e94773 could not be found. Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1effd989-7383-4cb1-bc43-a0d425e94773'} Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1effd989-7383-4cb1-bc43-a0d425e94773 could not be found. Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1effd989-7383-4cb1-bc43-a0d425e94773 could not be found. Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:12.627837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1effd989-7383-4cb1-bc43-a0d425e94773 could not be found. Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 1effd989-7383-4cb1-bc43-a0d425e94773 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:12.632813 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3db4c0fe-fd94-4453-8e9a-df64abfcf8e8 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773" status: 404 len: 111 microversion: 2.1 time: 0.105277 Oct 24 09:06:12.639591 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1630/3333] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:12 2022] GET /compute/v2.1/servers/1effd989-7383-4cb1-bc43-a0d425e94773 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:06:12.648001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:12.652909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:12.677628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.682406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.684885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.691149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.694146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.698128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.784160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:12.801050 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a974bf84-8972-4b1d-af01-76644823224a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.707206 Oct 24 09:06:12.835092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1704/3334] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:12 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:12.859223 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:12.859877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:12.873399 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:12.882258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.883029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.883653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.885613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:12.886397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:12.887048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:12.960111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:13.200782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3e5a9d6-d92d-4f8b-9217-e68619392a6d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 204 len: 0 microversion: 2.1 time: 0.362315 Oct 24 09:06:13.201942 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1705/3335] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:12 2022] DELETE /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:13.223501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:13.224423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:13.244270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.245012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.245829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.247514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.249369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.251095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.376878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:13.386557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3ed9160-3795-4a22-ab4e-bf8acb65fee9 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.749913 Oct 24 09:06:13.388033 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1631/3336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:12 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:13.393930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:13.395544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:13.406142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.407142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.408024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.409263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.409962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.410721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.430811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:13.456149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3131ed92-61c7-4e3d-82ac-525258c5f29a tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1162 microversion: 2.1 time: 0.247152 Oct 24 09:06:13.470203 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1706/3337] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:13 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1162 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:13.477132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:13.477788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:13.490622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.491250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.491797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.492796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.493899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.494453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.666372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:13.677409 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbe469c1-31d2-4d5d-b9a1-990ac6415cd9 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1472 microversion: 2.1 time: 0.205871 Oct 24 09:06:13.711676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1707/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:13 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:13.731831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:13.732538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:13.740109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.740745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.741288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.742136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.742698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.743254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.773464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:13.782315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa421d05-f5ed-408d-b604-675145f8acc1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 0.392749 Oct 24 09:06:13.782900 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1632/3339] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:13 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:13.833389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:13.835045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:13.841173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.841972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.842618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.843880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:13.844649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:13.845252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:13.923644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:13.932504 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb72dad1-420a-4188-ac87-80987325a60e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.204409 Oct 24 09:06:13.933838 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1708/3340] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:13 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:14.103290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:14.112259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab7f90e4-7df9-4c5a-b033-5716fa17c2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.284058 Oct 24 09:06:14.126100 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1633/3341] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:13 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:14.424672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:14.425594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:14.435670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:14.437085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:14.438620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:14.439747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:14.440383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:14.440989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:14.484978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:14.486036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:14.494229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:14.498660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:14.499343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:14.505853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:14.506654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:14.507260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:14.602147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:14.619484 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-561db20d-6332-4a55-b70a-96575903448e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1162 microversion: 2.1 time: 0.140085 Oct 24 09:06:14.620256 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1634/3342] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:14 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1162 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:14.717951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:14.721650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:14.747265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:14.752672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:14.758702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:14.763572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:14.764106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:14.764560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.207845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:15.214847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:15.219202 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db9a326e-f9cb-420f-8777-7ba3e6aa001d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1472 microversion: 2.1 time: 0.517969 Oct 24 09:06:15.227167 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41ca1ea6-2734-4cbe-8204-452c9e46a404 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.814119 Oct 24 09:06:15.232586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1709/3343] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:14 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:15.240505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:15.241354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:15.248378 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1635/3344] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:14 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:15.262396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.274595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.276679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.277481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:15.281377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.282116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.282349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:15.295356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.313330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.319380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.323348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.333445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.337757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.341044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.781015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:15.792820 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb7cf897-f66a-4ad6-a940-02508296010c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 0.558816 Oct 24 09:06:15.793984 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1710/3345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:15 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:15.799891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:15.800798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:15.807604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.808358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.809170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.810272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.810960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.811552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.837716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:15.846895 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2127424f-3549-4971-b00e-376951baeb5c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.589478 Oct 24 09:06:15.854901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1636/3346] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:15 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:15.863568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:15.864556 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:15.875763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.880305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.881023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:15.881963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:15.885055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:15.885722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.001349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:16.019626 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-688feca7-42e1-4f42-a98c-3440c0de9328 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.224318 Oct 24 09:06:16.020721 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1711/3347] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:15 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:16.262524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:16.263838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:16.273917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:16.274825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:16.277591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:16.286289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.289429 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c6f8939-6f1b-41db-b6c6-a12b423267e2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1218 microversion: 2.1 time: 0.433048 Oct 24 09:06:16.290154 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1637/3348] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:15 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:16.293034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:16.294714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:16.298615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:16.298833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.299238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:16.315171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:16.316234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:16.319000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.319942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:16.320745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:16.323438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.567112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:16.592968 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05cf0818-5e36-4dbe-9265-a26588d6926d tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1472 microversion: 2.1 time: 0.337294 Oct 24 09:06:16.596664 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1712/3349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:16 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:16.831245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:16.836180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:16.871295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:16.872788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:16.877487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.885158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:16.888712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:16.898354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:16.964679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:16.979343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c3d06c1-a7fa-41cf-879b-2c54336bada4 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.687565 Oct 24 09:06:16.983057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1638/3350] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:16 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:17.014657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:17.018783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:17.045773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.046588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.048637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.055808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.056580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.057225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.516441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:17.520521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:17.526567 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a829dab7-c6ed-4c2c-b8e9-aceeb5c5190f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.538763 Oct 24 09:06:17.527154 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1639/3351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:16 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:17.529846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2586126-e1bf-4bba-9385-fde6116e01fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 0.716668 Oct 24 09:06:17.537706 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1713/3352] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:16 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:17.548210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:17.557258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:17.557500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:17.558708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:17.573581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.574932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.580281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.581329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.581818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.582746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.584118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.584647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.584818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.586555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.587792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.588266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.626881 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:17.717755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:17.726742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-da846cdd-0d08-4785-94f8-554c85986845 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1218 microversion: 2.1 time: 0.178697 Oct 24 09:06:17.729992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1640/3353] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:17 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:17.739839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1312819531"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:17.744962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:17.758894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.762481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.763565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:17.764591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:17.767953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:17.768787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.041375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:18.053537 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06b63229-32c2-409a-b24a-703087d0f754 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.518462 Oct 24 09:06:18.054843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1714/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:17 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:18.067491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:18.068418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:18.091688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.092207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.095035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.097134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.098244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.099628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.270117 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4433eb39-7727-47e1-87d0-43db058052fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.538376 Oct 24 09:06:18.271793 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1641/3355] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:17 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 24 09:06:18.282325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-35489d1c-29fa-4e77-b8fd-d2832e47d50c req-bf07b0ad-1ae3-4cab-9e53-1e9fce24cd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8f90cb-0de8-40d5-babf-9e0b0f0afee2", "name": "network-vif-plugged", "status": "completed", "tag": "8c6cd823-6d29-4622-8232-cbe4886b8090"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:18.302260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-35489d1c-29fa-4e77-b8fd-d2832e47d50c req-bf07b0ad-1ae3-4cab-9e53-1e9fce24cd29 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.303240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-35489d1c-29fa-4e77-b8fd-d2832e47d50c req-bf07b0ad-1ae3-4cab-9e53-1e9fce24cd29 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.304990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-35489d1c-29fa-4e77-b8fd-d2832e47d50c req-bf07b0ad-1ae3-4cab-9e53-1e9fce24cd29 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.321397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-35489d1c-29fa-4e77-b8fd-d2832e47d50c req-bf07b0ad-1ae3-4cab-9e53-1e9fce24cd29 service nova] Creating event network-vif-plugged:8c6cd823-6d29-4622-8232-cbe4886b8090 for instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 on n-h2-master-1 Oct 24 09:06:18.329410 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-35489d1c-29fa-4e77-b8fd-d2832e47d50c req-bf07b0ad-1ae3-4cab-9e53-1e9fce24cd29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054864 Oct 24 09:06:18.330803 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1642/3356] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:18.339292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:18.341284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:18.349392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.350400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.351154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.352095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.352916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.353706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.583854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:18.598712 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6785089-b3f7-41a1-aeb8-352825b2b5d6 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.265854 Oct 24 09:06:18.600056 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1643/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:18 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:18.606876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:18.607808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:18.616068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.618791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.620112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.621822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.623441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.624417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.884718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:18.896725 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30e6b931-7137-4530-ad4a-b70799c1a4a0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1472 microversion: 2.1 time: 0.840612 Oct 24 09:06:18.913657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1715/3358] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:18 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1472 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:18.923847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:18.925678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:18.937364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.941198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.941697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:18.942640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:18.943119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:18.943547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.081382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:19.098598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d711777-6413-44fa-9e1b-0af68d7bfbf1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.496800 Oct 24 09:06:19.099495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1644/3359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:18 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:19.117441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:19.119202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:19.141261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.141813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.142252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.143151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.144828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.147860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.322627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:19.336079 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d50be121-eb2e-4328-97f5-52142411d5b4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1236 microversion: 2.1 time: 0.234613 Oct 24 09:06:19.336680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1645/3360] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:19 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1236 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:19.474962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-60eb9679-04bd-4ce2-b76a-af639a737687 req-53656616-e15b-45e5-a836-124eaeed4b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77fcda88-86f5-41dd-8878-0bedd83bb019", "name": "network-vif-deleted", "tag": "5a7d4c49-3041-4726-ab81-f62443247379"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:19.487977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60eb9679-04bd-4ce2-b76a-af639a737687 req-53656616-e15b-45e5-a836-124eaeed4b6b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.488760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60eb9679-04bd-4ce2-b76a-af639a737687 req-53656616-e15b-45e5-a836-124eaeed4b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.489551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60eb9679-04bd-4ce2-b76a-af639a737687 req-53656616-e15b-45e5-a836-124eaeed4b6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.502525 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-60eb9679-04bd-4ce2-b76a-af639a737687 req-53656616-e15b-45e5-a836-124eaeed4b6b service nova] Creating event network-vif-deleted:5a7d4c49-3041-4726-ab81-f62443247379 for instance 77fcda88-86f5-41dd-8878-0bedd83bb019 on n-h2-master-1 Oct 24 09:06:19.508610 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-60eb9679-04bd-4ce2-b76a-af639a737687 req-53656616-e15b-45e5-a836-124eaeed4b6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155007 Oct 24 09:06:19.509875 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1646/3361] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:19.516123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:19.517110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:19.524508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.525255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.525968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.526956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.527611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.528261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.706370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:19.718198 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0149798a-4a3b-43e0-ba15-863c05a074c7 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.205964 Oct 24 09:06:19.719523 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1647/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:19 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:19.725008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:19.726474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:19.733161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.734507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.735201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.736583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.737106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.737700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.902707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:19.912921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-100b1ac5-493a-47dd-87b7-cf95d63c562f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1542 microversion: 2.1 time: 1.011110 Oct 24 09:06:19.913134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:19.913548 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1716/3363] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:18 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1542 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:19.932979 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a04621ee-333d-44ce-940c-9beb7695b03e tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.211834 Oct 24 09:06:19.938295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:19.944690 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1648/3364] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:19 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:19.946935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:19.961751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.963169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.963874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.965032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:19.965765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:19.966593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:19.972413 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:20.039223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.039730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.040359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.041000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lazy-loading 'fault' on Instance uuid 77fcda88-86f5-41dd-8878-0bedd83bb019 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:20.118859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:20.128590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:20.129290 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19c85ccf-f641-497d-8ecf-a73428559d94 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1306 microversion: 2.1 time: 0.208864 Oct 24 09:06:20.133661 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1717/3365] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:19 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1306 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:20.155143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:20.161588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.162091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.162528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.163233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.163691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.164127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.367857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:20.368495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:20.389709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.390745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.391195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.391919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.392380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.392809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.419513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:20.435335 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db50bcf5-6624-4c8e-af93-30b16c82c599 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1686 microversion: 2.1 time: 0.311860 Oct 24 09:06:20.450497 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1649/3366] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:20 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1686 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:20.464931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8931747d-e827-46e5-98f0-5529544ddbfe req-fdbf10f4-f75f-4ff5-a2d0-221e041b3188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-unplugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:20.476019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8931747d-e827-46e5-98f0-5529544ddbfe req-fdbf10f4-f75f-4ff5-a2d0-221e041b3188 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.476503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8931747d-e827-46e5-98f0-5529544ddbfe req-fdbf10f4-f75f-4ff5-a2d0-221e041b3188 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.476933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8931747d-e827-46e5-98f0-5529544ddbfe req-fdbf10f4-f75f-4ff5-a2d0-221e041b3188 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.503591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8931747d-e827-46e5-98f0-5529544ddbfe req-fdbf10f4-f75f-4ff5-a2d0-221e041b3188 service nova] Creating event network-vif-unplugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:06:20.516774 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8931747d-e827-46e5-98f0-5529544ddbfe req-fdbf10f4-f75f-4ff5-a2d0-221e041b3188 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064239 Oct 24 09:06:20.518008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1650/3367] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:20.560942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:20.580048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1589655e-7433-483e-915c-e4392d939db7 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1236 microversion: 2.1 time: 0.222395 Oct 24 09:06:20.585040 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1718/3368] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:20 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1236 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:20.744116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:20.745101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:20.748445 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:20.753831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.754614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.755228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.755945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.756395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.757009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.763010 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:20.938618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:20.939936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:20.947725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.949314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.949962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:20.950857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:20.951485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:20.952082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.023065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:21.035033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d0ddae0-8da5-4e1b-8740-7fa25498073e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.293804 Oct 24 09:06:21.049044 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1651/3369] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:20 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:21.049044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:21.049044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:21.074509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.075279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.075895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.076788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.077469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.078588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.300076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:21.309240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec525c35-d280-4216-b4bf-684b168f7e70 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1324 microversion: 2.1 time: 0.271352 Oct 24 09:06:21.319152 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1652/3370] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:21 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:21.334950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:21.335898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:21.344575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.345388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.346019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.346927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.347641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.348439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.399964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.402070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.402712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.403672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lazy-loading 'fault' on Instance uuid 77fcda88-86f5-41dd-8878-0bedd83bb019 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:21.462847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:21.485626 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52cb8163-5aec-4c60-b1b3-40d63ea0fe75 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 200 len: 1306 microversion: 2.1 time: 0.163343 Oct 24 09:06:21.486817 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1653/3371] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:21 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:21.492362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:21.493476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:21.513438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.513932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.514368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.515125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.515579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.515994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.554013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:21.562819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1382d08-ff14-422a-a38e-e703dfaf8fc4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1541 microversion: 2.1 time: 0.630468 Oct 24 09:06:21.586351 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1719/3372] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:20 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1541 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:21.607148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:21.608036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:21.615832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.620436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.622915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.623876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:21.626890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:21.627777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:21.712947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:21.723235 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fabc4c5-2b52-4d9d-a99f-11a48f5b4987 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1686 microversion: 2.1 time: 0.235169 Oct 24 09:06:21.724373 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1654/3373] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:21 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1686 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:21.760993 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:22.068895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:22.069531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:22.076487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.076889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.077359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.078637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.079088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.079511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.142400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:22.157408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8257acb9-be26-423a-9bde-27402bf5714e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1236 microversion: 2.1 time: 0.552588 Oct 24 09:06:22.161259 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1720/3374] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:21 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1236 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:22.266364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:22.275669 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe50cda2-4f94-4e3e-95a9-90efcc2cbced tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.212430 Oct 24 09:06:22.288076 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1655/3375] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:22 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:22.338049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:22.338686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:22.357700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.359664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.362574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.364620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.368576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.369265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.519907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:22.520544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 77fcda88-86f5-41dd-8878-0bedd83bb019] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:22.549006 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:22.558729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.565240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.566274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.567342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.571052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.571791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.604250 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 77fcda88-86f5-41dd-8878-0bedd83bb019 could not be found. Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 HTTP/1.1 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 77fcda88-86f5-41dd-8878-0bedd83bb019 could not be found. Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '77fcda88-86f5-41dd-8878-0bedd83bb019'} Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77fcda88-86f5-41dd-8878-0bedd83bb019 could not be found. Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77fcda88-86f5-41dd-8878-0bedd83bb019 could not be found. Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:22.606327 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77fcda88-86f5-41dd-8878-0bedd83bb019 could not be found. Oct 24 09:06:22.612215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:22.616107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 77fcda88-86f5-41dd-8878-0bedd83bb019 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:22.617331 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-946e4567-120a-4b16-aeae-ab5732fc2027 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019" status: 404 len: 111 microversion: 2.1 time: 0.110236 Oct 24 09:06:22.618507 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1656/3376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:22 2022] GET /compute/v2.1/servers/77fcda88-86f5-41dd-8878-0bedd83bb019 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:22.630941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:22.631987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:22.654635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.665930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.666652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.668572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.669683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.670353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.866571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:22.888137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9c29e3f-d03b-4c83-ba0e-de25720b5556 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1519 microversion: 2.1 time: 0.553931 Oct 24 09:06:22.896546 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1721/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:22 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1519 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:22.896546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:22.896546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:22.910329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.916102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.916662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.917530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:22.923368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:22.924017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:22.982525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:23.155028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f52d0062-af46-42d7-9f62-ee85d208d68f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 204 len: 0 microversion: 2.1 time: 0.264030 Oct 24 09:06:23.160327 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1722/3378] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:22 2022] DELETE /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:23.190099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:23.191754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:23.225878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.232932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.237376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.242796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.247989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.250195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.371639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:23.385690 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f47010f5-30c5-4197-bbcd-c36616b1f728 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1541 microversion: 2.1 time: 0.762812 Oct 24 09:06:23.393812 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1657/3379] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:22 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1541 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:23.398917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:23.399810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:23.414452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.418019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.418681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.426095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.426854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.427997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.438153 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:23.495100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:23.612457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:23.624058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-667d1e68-ba9c-45b1-a19b-f3414d8aefe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1686 microversion: 2.1 time: 0.463473 Oct 24 09:06:23.627130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1723/3380] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:23 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1686 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:23.632850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:23.637984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:23.652258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.653010 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5feccff-a2d9-4e36-815c-99f6bd6596ca tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 204 len: 0 microversion: 2.1 time: 0.253235 Oct 24 09:06:23.653311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.653996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.656096 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1658/3381] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:23 2022] DELETE /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:23.658449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.660214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.662400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.681771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:23.682665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:23.711056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.711698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.712237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:23.713049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:23.713640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:23.714159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.023448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:24.035494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c034d82d-511c-42d7-a16a-4082f078d6f1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1304 microversion: 2.1 time: 0.375746 Oct 24 09:06:24.036757 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1659/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:23 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1304 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:24.044098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:24.045448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:24.055729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.056703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.057421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.058431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.059299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.060021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.197601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:24.211243 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-247ada20-ee35-4cac-accf-783837e3a89b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1473 microversion: 2.1 time: 0.582502 Oct 24 09:06:24.215535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1724/3383] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:23 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1473 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:24.228872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:24.238678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:24.250747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.254631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.255524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.257163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.259868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.261798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.309759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:24.320301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e404c912-36a5-48aa-b189-b6cd2993e987 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.281252 Oct 24 09:06:24.321326 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1660/3384] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:24 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:24.410718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:24.412230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:24.426575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.427087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.427531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.428250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.430748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.433186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.579769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:24.594674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77685c83-e184-46ba-a96c-57b4328aac5a tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1525 microversion: 2.1 time: 0.372364 Oct 24 09:06:24.595357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1725/3385] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:24 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1525 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:24.613389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "name": "network-vif-unplugged", "status": "completed", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}, {"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-plugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:24.641131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.642205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.642840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.674895 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Creating event network-vif-unplugged:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:06:24.676234 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Creating event network-vif-plugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:06:24.693000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] Instance 5c4e4203-b14c-4c3c-98e5-71878225156a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:06:24.705913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:24.716052 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3849724b-8d9e-482d-806f-9e17323f6be7 req-c4829026-563d-4a1f-94d5-07dfb03063c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.119385 Oct 24 09:06:24.716673 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1726/3386] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:24.720050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c19d895-86df-4d9b-aa53-e9b8dec5e078 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1473 microversion: 2.1 time: 0.314182 Oct 24 09:06:24.734017 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1661/3387] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:24 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:24.734432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:24.737141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:24.754967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.755493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.755950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.756838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.757334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.757968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.947981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4c768807-a965-42a3-afb3-12643f1db1e6 req-c37440a1-b9c1-4b07-86da-2ea2aef568e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20606f53-dad1-4b06-bf59-fa1700228811", "tag": "d5b3eb31-b4d8-47aa-941d-f6c64ace63ba"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:24.966494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4c768807-a965-42a3-afb3-12643f1db1e6 req-c37440a1-b9c1-4b07-86da-2ea2aef568e3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:24.967291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4c768807-a965-42a3-afb3-12643f1db1e6 req-c37440a1-b9c1-4b07-86da-2ea2aef568e3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:24.967965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4c768807-a965-42a3-afb3-12643f1db1e6 req-c37440a1-b9c1-4b07-86da-2ea2aef568e3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:24.990625 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4c768807-a965-42a3-afb3-12643f1db1e6 req-c37440a1-b9c1-4b07-86da-2ea2aef568e3 service nova] Creating event network-changed:d5b3eb31-b4d8-47aa-941d-f6c64ace63ba for instance 20606f53-dad1-4b06-bf59-fa1700228811 on n-h2-master-1 Oct 24 09:06:24.997845 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4c768807-a965-42a3-afb3-12643f1db1e6 req-c37440a1-b9c1-4b07-86da-2ea2aef568e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053461 Oct 24 09:06:24.998598 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1662/3388] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:06:25.067081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:25.067961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:25.080530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.082753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.083832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.085977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.086922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.088004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.156910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:25.199804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-558d0e0b-4d6d-45db-a364-bf4a00dff047 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1686 microversion: 2.1 time: 0.477954 Oct 24 09:06:25.203805 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1727/3389] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:24 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1686 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:25.246021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:25.247653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:25.268357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.268869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.269773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.272543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.273024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.273552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.380221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:25.390993 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7c81c49-6450-48b0-8ceb-7ffbab9f6c0e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1304 microversion: 2.1 time: 0.329997 Oct 24 09:06:25.391813 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1663/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:25 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1304 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:25.396882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:25.397800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:25.405694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.407045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.407722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.410440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.411090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.412132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.610429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:25.635940 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3585a481-0e7c-4204-a1b8-4a52448cb21e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.242717 Oct 24 09:06:25.639762 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1664/3391] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:25 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:25.646083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:25.646869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:25.655589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.656363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.656996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.657984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.660178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.661124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.693679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:25.703572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34f5f292-2a9f-4abe-a11e-196a06d4eafa tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1473 microversion: 2.1 time: 0.463279 Oct 24 09:06:25.710468 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1728/3392] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:25 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1473 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:25.743982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:25.745005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:25.756119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.761989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.762598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:25.763471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:25.764074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:25.764757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:26.018551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:26.032613 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79986ca0-a879-452d-b382-cef09573abe2 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1525 microversion: 2.1 time: 0.391035 Oct 24 09:06:26.033541 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1665/3393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:25 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1525 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:26.226957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:26.227675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:26.237696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:26.240609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:26.241232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:26.242855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:26.245930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:26.246570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:26.711455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:26.729165 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17475e18-04ab-4064-912d-2d0fdd4806fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.505094 Oct 24 09:06:26.735615 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1666/3394] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:26 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:26.746244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:26.747534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:26.779447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:26.781981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:26.782825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:26.783777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:26.785462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:26.787401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.149326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:27.169563 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73a60ab8-f844-4e6a-93b0-a4766a3c7112 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1304 microversion: 2.1 time: 0.432406 Oct 24 09:06:27.172296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1667/3395] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:26 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1304 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:27.200451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:27.201711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:27.217695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:27.218544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:27.219083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.219960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:27.222580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:27.223302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.632157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:27.650993 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c2ea427-cefb-403c-ba12-151c4b10b5e3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.475787 Oct 24 09:06:27.657327 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1668/3396] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:27 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:27.661944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:27.679138 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98b6dc0b-8031-4559-9dc3-321499ff9ffe tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1470 microversion: 2.1 time: 1.937786 Oct 24 09:06:27.700897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:27.701540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:27.703419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1729/3397] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:25 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1470 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:27.747544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:27.748348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:27.748529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.762717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:27.772028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:27.775500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.859486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1fc092c5-477e-41cb-ac92-2a20b1da6541 req-9d64f859-f4bc-4b43-94f7-3355bb6cfa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1939b26-efff-4eec-81ef-e38a049a0a01", "name": "network-vif-deleted", "tag": "52e53c3b-b2cd-4671-9036-ed8f3f9b049c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:27.906655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1fc092c5-477e-41cb-ac92-2a20b1da6541 req-9d64f859-f4bc-4b43-94f7-3355bb6cfa1b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:27.907096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1fc092c5-477e-41cb-ac92-2a20b1da6541 req-9d64f859-f4bc-4b43-94f7-3355bb6cfa1b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:27.918243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1fc092c5-477e-41cb-ac92-2a20b1da6541 req-9d64f859-f4bc-4b43-94f7-3355bb6cfa1b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.947759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:27.949562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:27.950265 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1fc092c5-477e-41cb-ac92-2a20b1da6541 req-9d64f859-f4bc-4b43-94f7-3355bb6cfa1b service nova] Creating event network-vif-deleted:52e53c3b-b2cd-4671-9036-ed8f3f9b049c for instance c1939b26-efff-4eec-81ef-e38a049a0a01 on n-h2-master-1 Oct 24 09:06:27.953280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:27.956382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lazy-loading 'fault' on Instance uuid c1939b26-efff-4eec-81ef-e38a049a0a01 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:27.962569 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1fc092c5-477e-41cb-ac92-2a20b1da6541 req-9d64f859-f4bc-4b43-94f7-3355bb6cfa1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253317 Oct 24 09:06:27.963389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1730/3398] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:27.983766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:27.989812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:28.007581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.008370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.009047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.009996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.010679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.011333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.120961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:28.142661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb0a2258-2b7d-4b41-955b-1f2748710f45 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 200 len: 1307 microversion: 2.1 time: 0.459510 Oct 24 09:06:28.145990 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1669/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:27 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 1307 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:28.161159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:28.170563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:28.190160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.195711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.198832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.201967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.205031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.206394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.364380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.365157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.366056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.367595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.368560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.370181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.410906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:06:28.433990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for user 4dde4bb72f914457a633358837d178de and project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:06:28.577094 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:28.610792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:28.615346 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-620af554-48e3-4017-a6c8-97cac9a57adb tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a/action" status: 202 len: 0 microversion: 2.1 time: 0.464661 Oct 24 09:06:28.617148 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1670/3400] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:28 2022] POST /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:06:28.623262 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40c38e6b-c53c-42eb-a956-04d42b826432 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1525 microversion: 2.1 time: 0.656721 Oct 24 09:06:28.637890 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1731/3401] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:27 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1525 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:28.642042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:28.643135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:28.654216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.654963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.656739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.657678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.658664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.659425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b6ff9712-033a-4a21-acbe-2d0865bac4a9 req-7c527ef5-39eb-4899-833a-9e7da5decb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92096759-c3f1-4279-abbe-5e823421740c", "name": "network-vif-plugged", "status": "completed", "tag": "80ad4d66-4f35-4cdb-8063-3147e1c2eab9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:28.660270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.681145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b6ff9712-033a-4a21-acbe-2d0865bac4a9 req-7c527ef5-39eb-4899-833a-9e7da5decb3a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.687586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b6ff9712-033a-4a21-acbe-2d0865bac4a9 req-7c527ef5-39eb-4899-833a-9e7da5decb3a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.688362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b6ff9712-033a-4a21-acbe-2d0865bac4a9 req-7c527ef5-39eb-4899-833a-9e7da5decb3a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.716449 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b6ff9712-033a-4a21-acbe-2d0865bac4a9 req-7c527ef5-39eb-4899-833a-9e7da5decb3a service nova] Creating event network-vif-plugged:80ad4d66-4f35-4cdb-8063-3147e1c2eab9 for instance 92096759-c3f1-4279-abbe-5e823421740c on n-h2-master-1 Oct 24 09:06:28.724662 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b6ff9712-033a-4a21-acbe-2d0865bac4a9 req-7c527ef5-39eb-4899-833a-9e7da5decb3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085097 Oct 24 09:06:28.726296 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1732/3402] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:28.736120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:28.748257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:28.756101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.757554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.758263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.759221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:28.759915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:28.760588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:28.802203 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:29.256496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:29.290516 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da8ce0c7-a853-430a-bc06-5c0bf41840c0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.562581 Oct 24 09:06:29.301705 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1733/3403] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:28 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:29.311427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:29.312562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:29.328016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.328564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.329016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.329779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.330246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.330679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.505667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:29.515589 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2eb20de4-f8e0-4f3e-b389-89d48cb03cc0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.896432 Oct 24 09:06:29.521796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1671/3404] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:28 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:29.539591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:29.540943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:29.547587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.549982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.552797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.553839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.558005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.558761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.774975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:29.785073 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c7bff6c-590e-4d18-83d2-51047bdf15d2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1469 microversion: 2.1 time: 0.482204 Oct 24 09:06:29.791564 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1734/3405] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:29 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:29.803402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:29.807653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: c1939b26-efff-4eec-81ef-e38a049a0a01] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:29.832047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.834201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.834924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.835846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.836543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.837168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.861001 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance c1939b26-efff-4eec-81ef-e38a049a0a01 could not be found. Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 HTTP/1.1 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: exception: Instance c1939b26-efff-4eec-81ef-e38a049a0a01 could not be found. Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c1939b26-efff-4eec-81ef-e38a049a0a01'} Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1939b26-efff-4eec-81ef-e38a049a0a01 could not be found. Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1939b26-efff-4eec-81ef-e38a049a0a01 could not be found. Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:29.863175 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1939b26-efff-4eec-81ef-e38a049a0a01 could not be found. Oct 24 09:06:29.868577 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:29.870166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance c1939b26-efff-4eec-81ef-e38a049a0a01 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:29.871342 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a3c7fc3-fbd0-490b-9417-3ea10f71fd6a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01" status: 404 len: 111 microversion: 2.1 time: 0.078128 Oct 24 09:06:29.872431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1735/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:29 2022] GET /compute/v2.1/servers/c1939b26-efff-4eec-81ef-e38a049a0a01 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:29.879376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9f74c6de-23be-48bc-a52a-124c3c355fad req-71c6a682-7cd0-4efe-8e63-7d6f3b2f9edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8f90cb-0de8-40d5-babf-9e0b0f0afee2", "name": "network-vif-deleted", "tag": "8c6cd823-6d29-4622-8232-cbe4886b8090"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:29.893667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9f74c6de-23be-48bc-a52a-124c3c355fad req-71c6a682-7cd0-4efe-8e63-7d6f3b2f9edb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.895218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9f74c6de-23be-48bc-a52a-124c3c355fad req-71c6a682-7cd0-4efe-8e63-7d6f3b2f9edb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.896033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9f74c6de-23be-48bc-a52a-124c3c355fad req-71c6a682-7cd0-4efe-8e63-7d6f3b2f9edb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.915625 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9f74c6de-23be-48bc-a52a-124c3c355fad req-71c6a682-7cd0-4efe-8e63-7d6f3b2f9edb service nova] Creating event network-vif-deleted:8c6cd823-6d29-4622-8232-cbe4886b8090 for instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 on n-h2-master-1 Oct 24 09:06:29.923926 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9f74c6de-23be-48bc-a52a-124c3c355fad req-71c6a682-7cd0-4efe-8e63-7d6f3b2f9edb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050037 Oct 24 09:06:29.928587 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1736/3407] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:29.940124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:29.941028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:29.962017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.962837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.963027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:29.965480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.966415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:29.967861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:29.968530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:29.976350 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0937e26-02d7-46fa-a771-c7a0be3d26bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.453075 Oct 24 09:06:29.978088 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1672/3408] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:29 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:29.991925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:29.996290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:30.012534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.013542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.014375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.015322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.015978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.016610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.086273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:30.090010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:30.111399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7181168-d932-48ff-bae7-5b8f7c31cf51 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1483 microversion: 2.1 time: 0.178520 Oct 24 09:06:30.113723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1737/3409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:29 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1483 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:30.247600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b95923f5-66b2-438b-969b-cac0507e6be2 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 204 len: 0 microversion: 2.1 time: 0.263424 Oct 24 09:06:30.251585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1673/3410] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:29 2022] DELETE /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:30.260815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:30.261508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:30.271378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.271975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.272499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.278745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.279356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.280051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.317558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:30.318841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:30.337024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.340536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.340998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.348749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.349543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.350180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.362988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:30.493641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-401f7806-f3ab-4d48-ae00-ad0c15115b9f tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 204 len: 0 microversion: 2.1 time: 0.236443 Oct 24 09:06:30.496497 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1738/3411] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:30 2022] DELETE /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:30.510493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:30.512081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:30.518395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.518867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.519487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.520419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.521051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.521715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.666728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:30.681408 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af496df8-4732-48dc-a93d-fe5de18864c6 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.367991 Oct 24 09:06:30.682008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1674/3412] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:30 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:30.688964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:30.689615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:30.706703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.707347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.707627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.714297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.715004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.715603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.742287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:30.751812 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-188f22a6-58b7-46d5-8061-2368cdbf32ee tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1475 microversion: 2.1 time: 0.247141 Oct 24 09:06:30.753841 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1739/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:30 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1475 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:30.759985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "name": "network-vif-plugged", "status": "completed", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:30.771150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.771687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.772176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.787171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] Creating event network-vif-plugged:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:06:30.801011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] Instance 5c4e4203-b14c-4c3c-98e5-71878225156a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:06:30.812130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9d29ef8a-beeb-4669-9da8-e39143c3e21a req-f1b2e482-3bc2-4a1a-8744-180bf774bb44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056094 Oct 24 09:06:30.812273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1740/3414] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:30.818351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:30.820151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:30.827195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.830347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.831048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.832011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:30.832650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:30.833984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:30.946162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:30.962249 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-40790feb-a5d1-4103-ba8e-38b43cac53d0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.279171 Oct 24 09:06:30.963249 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1675/3415] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:30 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:31.014031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:31.014767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:31.027865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.030950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.032035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.033244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.033962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.034566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.111934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:31.123356 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef9bfeed-3320-421c-b7dd-be3fa41307b0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1469 microversion: 2.1 time: 0.309264 Oct 24 09:06:31.130193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1741/3416] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:30 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:31.170531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:31.175240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:31.193903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.194419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.194869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.197752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.198238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.198689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.265396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.266214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.266840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.267372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lazy-loading 'fault' on Instance uuid af8f90cb-0de8-40d5-babf-9e0b0f0afee2 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:31.283545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:31.300116 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-616359e3-b90b-41c0-b993-377b1bd8bd1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.290044 Oct 24 09:06:31.301756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1676/3417] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:31 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:31.395326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b32a47b2874040a560e3f3776fdff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a13a281b24a6289e68a76402eb470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:31.404353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b6665ec-3329-42d9-b473-ad48b1ef3c93 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 200 len: 1314 microversion: 2.1 time: 0.249883 Oct 24 09:06:31.421503 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1742/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:31 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:31.709565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:31.710574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:31.733377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.733926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.734359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.735062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.739989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.746728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.776763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:31.777491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:31.788244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.794692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.797976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:31.801329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:31.805063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:31.805751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:32.248119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:32.265727 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fad6ae6a-b632-47a5-bb50-c38bcadd771e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.559557 Oct 24 09:06:32.272146 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1677/3419] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:31 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:32.284763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:32.286883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:32.305818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:32.306595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:32.308344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:32.309226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:32.313062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:32.313816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:32.550174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:32.575708 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-463df5fa-459d-44c2-9b5b-f8a7848f6e2c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1475 microversion: 2.1 time: 0.802607 Oct 24 09:06:32.590384 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1743/3420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:31 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1475 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:32.603557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:32.604586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:32.615803 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:32.617829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:32.618629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:32.619587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:32.621503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:32.622210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:32.622913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:32.904225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:32.914527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39a7368b-ecd7-4fa9-a472-0e5afc68ca77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.639786 Oct 24 09:06:32.923963 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1678/3421] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:32 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:32.929494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:32.932202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:32.950390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:32.951072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:32.951666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:32.954141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:32.954895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:32.955486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:33.594787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:33.610725 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e834b274-3c06-45e9-8014-de047962abeb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1519 microversion: 2.1 time: 0.685293 Oct 24 09:06:33.614556 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1679/3422] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:32 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1519 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:33.623982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:33.627363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:33.628231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: af8f90cb-0de8-40d5-babf-9e0b0f0afee2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:33.648711 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05f50734-3a6f-4b54-ad80-f03e25a51f6b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1469 microversion: 2.1 time: 1.049586 Oct 24 09:06:33.651918 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1744/3423] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:32 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1469 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:33.657154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:33.663944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:33.664703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:33.672386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:33.673734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:33.674719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:33.675412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:33.676146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:33.692797 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 could not be found. Oct 24 09:06:33.707602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:33.708094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:33.708779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:33.709681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:33.710297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:33.710882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 HTTP/1.1 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: exception: Instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 could not be found. Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'af8f90cb-0de8-40d5-babf-9e0b0f0afee2'} Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 could not be found. Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 could not be found. Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:33.718958 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 could not be found. Oct 24 09:06:33.723450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:33.731850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance af8f90cb-0de8-40d5-babf-9e0b0f0afee2 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:33.735071 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98da5a4c-da0a-46b0-809d-191c1e5a77c7 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2" status: 404 len: 111 microversion: 2.1 time: 0.119206 Oct 24 09:06:33.736230 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1680/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:33 2022] GET /compute/v2.1/servers/af8f90cb-0de8-40d5-babf-9e0b0f0afee2 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:33.758184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:33.758848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:33.812145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:33.812783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:33.813250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:33.818796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:33.819298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:33.825212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.142317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:34.159483 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb92f4ed-e3b5-4b48-a3cb-8e6a75dedec2 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.506087 Oct 24 09:06:34.161242 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1745/3425] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:33 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:34.201818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-310e5cc9-55f6-419a-b3f6-9a17220dafaa tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '.version_select at 0x7f8dab0a2e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:34.266408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-310e5cc9-55f6-419a-b3f6-9a17220dafaa tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Image not found. Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-310e5cc9-55f6-419a-b3f6-9a17220dafaa tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f HTTP/1.1 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1f7c8c5a-69f3-4b61-bab3-fe0778360d8f'} Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1f7c8c5a-69f3-4b61-bab3-fe0778360d8f to delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f7c8c5a-69f3-4b61-bab3-fe0778360d8f could not be found. Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:34.268971 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-310e5cc9-55f6-419a-b3f6-9a17220dafaa tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:34.273880 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-310e5cc9-55f6-419a-b3f6-9a17220dafaa tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f" status: 404 len: 62 microversion: 2.1 time: 0.107707 Oct 24 09:06:34.284284 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1746/3426] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:34 2022] DELETE /compute/v2.1/images/1f7c8c5a-69f3-4b61-bab3-fe0778360d8f => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:06:34.305810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-678209ae-4c1b-43b0-b119-6413cc1665dd req-c61ff02d-3045-4e04-a1f3-4a7caf3a80ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57931b05-1825-48c4-b9a7-6a6428f90265", "name": "network-vif-deleted", "tag": "a877f774-d630-4f0a-994f-ce1ddcbd0fac"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:34.378273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-678209ae-4c1b-43b0-b119-6413cc1665dd req-c61ff02d-3045-4e04-a1f3-4a7caf3a80ef service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.378802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-678209ae-4c1b-43b0-b119-6413cc1665dd req-c61ff02d-3045-4e04-a1f3-4a7caf3a80ef service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.381487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-678209ae-4c1b-43b0-b119-6413cc1665dd req-c61ff02d-3045-4e04-a1f3-4a7caf3a80ef service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.401556 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-678209ae-4c1b-43b0-b119-6413cc1665dd req-c61ff02d-3045-4e04-a1f3-4a7caf3a80ef service nova] Creating event network-vif-deleted:a877f774-d630-4f0a-994f-ce1ddcbd0fac for instance 57931b05-1825-48c4-b9a7-6a6428f90265 on n-h2-master-1 Oct 24 09:06:34.415565 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-678209ae-4c1b-43b0-b119-6413cc1665dd req-c61ff02d-3045-4e04-a1f3-4a7caf3a80ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125542 Oct 24 09:06:34.420350 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1747/3427] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:34.440464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:34.444363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:34.456967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.457608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.458128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.459007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.459546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.460373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.591990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:34.620565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4bd517b6-b96e-4cda-b345-76c7a5da768a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1475 microversion: 2.1 time: 0.881819 Oct 24 09:06:34.651299 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1681/3428] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:33 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1475 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:34.664858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:34.665385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:34.688343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.689860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.690588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.691643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.692252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.692841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.711743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:34.719521 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 HTTP/1.1 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b77df50d-86f7-446e-9419-c9e4658fb7e4'} Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:34.731228 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:34.736234 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:34.737171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11725842-a429-4b0d-9c51-c866409ad870 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.309223 Oct 24 09:06:34.741050 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1748/3429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:34 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:34.746578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:34.747770 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ddb6b1a-3416-4ca8-bcb4-8424b75972cc tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 404 len: 111 microversion: 2.1 time: 0.095501 Oct 24 09:06:34.748627 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1682/3430] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:34 2022] DELETE /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:34.755823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:34.756591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:34.757504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:34.762574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:34.764892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.765603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.766433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.767892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.770187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.770187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.776249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.780839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.781510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.786212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:34.786969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:34.787565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:34.953975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:34.964956 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e3afe3c-2918-45c5-a161-c82de2a0df9f tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.223339 Oct 24 09:06:34.978570 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1749/3431] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:34 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:34.992518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:34.993455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: b77df50d-86f7-446e-9419-c9e4658fb7e4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:35.003330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.004061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.004645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.005959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.006934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.007622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.050417 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 HTTP/1.1 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b77df50d-86f7-446e-9419-c9e4658fb7e4'} Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:35.053015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance b77df50d-86f7-446e-9419-c9e4658fb7e4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e75f3aa0-4619-475a-baa2-dcaf08a1c611 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4" status: 404 len: 111 microversion: 2.1 time: 0.072859 Oct 24 09:06:35.057459 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1750/3432] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:34 2022] GET /compute/v2.1/servers/b77df50d-86f7-446e-9419-c9e4658fb7e4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:35.069133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:35.070010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:35.077620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.078292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.078916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.079835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.080500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.081060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.298067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:35.308586 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5bb5b80a-1c50-47fb-a467-20c50967bd8b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.250897 Oct 24 09:06:35.322322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1751/3433] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:35 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:35.337865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d154947-8114-4eb4-b668-197b943c144d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '.version_select at 0x7f8daaf9c3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:35.380029 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d154947-8114-4eb4-b668-197b943c144d tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105342967" status: 202 len: 0 microversion: 2.1 time: 0.055949 Oct 24 09:06:35.381253 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1752/3434] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105342967 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:06:35.386767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:35.388087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:35.407159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.409467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.413615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.414816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.418676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.420658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.434097 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:35.569398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:35.595493 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c2fa5d41-eb91-4400-9ba2-fc259de5687f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1535 microversion: 2.1 time: 0.843662 Oct 24 09:06:35.601266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1683/3435] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:34 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1535 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:35.614561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:35.617534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:35.632488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.647927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.650082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.653806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.659473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.660860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.806283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:35.816346 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bea6d25c-9908-4b59-8cc1-b6630d2c6241 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.433682 Oct 24 09:06:35.820869 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1753/3436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:35 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:35.847057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:35.847362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:35.861132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.861561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.862068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.863190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.863638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.864078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.979154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:35.979495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:35.979953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:35.980434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lazy-loading 'fault' on Instance uuid 79880949-0db7-4d94-ad5a-b089feeb6b12 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:36.096627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:36.108359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-325d317c-2a80-4b1d-885b-802d2f3e3a18 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 200 len: 1309 microversion: 2.1 time: 0.271774 Oct 24 09:06:36.112180 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1754/3437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:35 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:36.117456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:36.118006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:36.141056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.151515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.156177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.159566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.162787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.167457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.225954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:36.237906 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ced547c5-073e-497c-8e71-6030de21ee4d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.631227 Oct 24 09:06:36.242921 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1684/3438] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:35 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:36.262846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "name": "network-vif-unplugged", "status": "completed", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:36.282389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.284699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.285044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.312613 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] Creating event network-vif-unplugged:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:06:36.321114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] Instance 5c4e4203-b14c-4c3c-98e5-71878225156a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:06:36.342178 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c7c0dd93-1f61-4653-833f-6599c6ca9ce0 req-91388904-fc69-49a9-859e-21cb2e0fdc4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097421 Oct 24 09:06:36.344381 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1685/3439] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:36.360771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25666b27-1a67-4d94-b2bf-f3e169984c1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:36.397782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-25666b27-1a67-4d94-b2bf-f3e169984c1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 17a2f504-7d22-4f0d-b30b-29442f52e0b9 has no mapping to a cell. Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25666b27-1a67-4d94-b2bf-f3e169984c1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/17a2f504-7d22-4f0d-b30b-29442f52e0b9/action HTTP/1.1 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 15 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: {"os-stop": {}} Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 17a2f504-7d22-4f0d-b30b-29442f52e0b9 has no mapping to a cell. Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '17a2f504-7d22-4f0d-b30b-29442f52e0b9', 'body': {'os-stop': {}}} Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 17a2f504-7d22-4f0d-b30b-29442f52e0b9 has no mapping to a cell. Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:36.404076 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a2f504-7d22-4f0d-b30b-29442f52e0b9 has no mapping to a cell. Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a2f504-7d22-4f0d-b30b-29442f52e0b9 has no mapping to a cell. Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25666b27-1a67-4d94-b2bf-f3e169984c1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 17a2f504-7d22-4f0d-b30b-29442f52e0b9 has no mapping to a cell. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25666b27-1a67-4d94-b2bf-f3e169984c1e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/17a2f504-7d22-4f0d-b30b-29442f52e0b9/action" status: 404 len: 117 microversion: 2.1 time: 0.059890 Oct 24 09:06:36.413030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1686/3440] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:36 2022] POST /compute/v2.1/servers/17a2f504-7d22-4f0d-b30b-29442f52e0b9/action => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:36.415045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:36.415166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:36.459873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.461947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.463715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.466727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.467622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.468588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.703971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:36.717030 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21d6d80f-21d3-41a4-8df2-cfca6f31650d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.603683 Oct 24 09:06:36.720896 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1755/3441] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:36 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:36.732647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d33c96c2-f48d-4456-8f32-205ec5003f5b req-4b06f2f8-d3be-4788-a561-ae97301ac063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79880949-0db7-4d94-ad5a-b089feeb6b12", "name": "network-vif-deleted", "tag": "d0aa76ce-106c-4a84-b277-1b2116ea94fa"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:36.758336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d33c96c2-f48d-4456-8f32-205ec5003f5b req-4b06f2f8-d3be-4788-a561-ae97301ac063 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.762207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d33c96c2-f48d-4456-8f32-205ec5003f5b req-4b06f2f8-d3be-4788-a561-ae97301ac063 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.764067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d33c96c2-f48d-4456-8f32-205ec5003f5b req-4b06f2f8-d3be-4788-a561-ae97301ac063 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.801050 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d33c96c2-f48d-4456-8f32-205ec5003f5b req-4b06f2f8-d3be-4788-a561-ae97301ac063 service nova] Creating event network-vif-deleted:d0aa76ce-106c-4a84-b277-1b2116ea94fa for instance 79880949-0db7-4d94-ad5a-b089feeb6b12 on n-h1-master-1 Oct 24 09:06:36.812471 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d33c96c2-f48d-4456-8f32-205ec5003f5b req-4b06f2f8-d3be-4788-a561-ae97301ac063 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090041 Oct 24 09:06:36.814181 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1756/3442] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:36.828174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:36.829323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:36.837425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.839103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.839699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.840591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:36.841265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:36.842258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:36.995295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:37.014572 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6dd33a86-c4dc-492d-96c5-2b86ff91b914 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.600557 Oct 24 09:06:37.017571 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1687/3443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:36 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:37.042640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:37.046381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:37.069865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:37.078556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:37.079236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:37.080096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:37.081144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:37.081785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:37.093687 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:37.395610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:37.403753 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87592a2e-2072-4a3b-8846-11c166da9030 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1535 microversion: 2.1 time: 0.585508 Oct 24 09:06:37.423882 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1757/3444] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:36 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1535 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:37.435027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:37.435661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:37.458327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:37.458819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:37.459516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:37.462738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:37.463738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:37.464344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:37.785224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:37.802402 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31156c16-3342-4356-b5cb-3ab3c40fd2f3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.377241 Oct 24 09:06:37.818641 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1758/3445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:37 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:37.835637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:37.836439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 79880949-0db7-4d94-ad5a-b089feeb6b12] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:37.854514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:37.861715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:37.862937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:37.863819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:37.865914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:37.866477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:37.910396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 79880949-0db7-4d94-ad5a-b089feeb6b12 could not be found. Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 HTTP/1.1 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 79880949-0db7-4d94-ad5a-b089feeb6b12 could not be found. Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '79880949-0db7-4d94-ad5a-b089feeb6b12'} Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79880949-0db7-4d94-ad5a-b089feeb6b12 could not be found. Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79880949-0db7-4d94-ad5a-b089feeb6b12 could not be found. Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:37.915358 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79880949-0db7-4d94-ad5a-b089feeb6b12 could not be found. Oct 24 09:06:37.920566 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.925761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 79880949-0db7-4d94-ad5a-b089feeb6b12 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:37.929620 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d92fd39-711d-4c54-b25a-6d10f11a7f1a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12" status: 404 len: 111 microversion: 2.1 time: 0.105359 Oct 24 09:06:37.930915 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1759/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:37 2022] GET /compute/v2.1/servers/79880949-0db7-4d94-ad5a-b089feeb6b12 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:37.942989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-757e4e6d-54d4-414b-b818-f1c1d4d31656 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '.version_select at 0x7f8daadf5af0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:37.988864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-757e4e6d-54d4-414b-b818-f1c1d4d31656 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Image not found. Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-757e4e6d-54d4-414b-b818-f1c1d4d31656 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/images/818c9df6-7014-429a-96bd-dd542098b847 HTTP/1.1 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: exception: Image not found. Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '818c9df6-7014-429a-96bd-dd542098b847'} Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 818c9df6-7014-429a-96bd-dd542098b847 to delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 818c9df6-7014-429a-96bd-dd542098b847 could not be found. Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:37.990729 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-757e4e6d-54d4-414b-b818-f1c1d4d31656 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Image not found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:37.995199 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-757e4e6d-54d4-414b-b818-f1c1d4d31656 tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/images/818c9df6-7014-429a-96bd-dd542098b847" status: 404 len: 62 microversion: 2.1 time: 0.062406 Oct 24 09:06:37.997793 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1760/3447] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:37 2022] DELETE /compute/v2.1/images/818c9df6-7014-429a-96bd-dd542098b847 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:06:38.004586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:38.005462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:38.013146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.013912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.014578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.016179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.016875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.025710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.199537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:38.214768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f49ff2c-c623-43a6-87c6-e1955d200847 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 1.190753 Oct 24 09:06:38.239099 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1688/3448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:37 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:38.249114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c592688-11ef-4264-9e9c-337a9578179e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:38.257290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c592688-11ef-4264-9e9c-337a9578179e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: d1a75438-c6be-4bc6-83ee-8c2cc5692773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:38.268237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3c592688-11ef-4264-9e9c-337a9578179e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance d1a75438-c6be-4bc6-83ee-8c2cc5692773 could not be found. Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c592688-11ef-4264-9e9c-337a9578179e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/d1a75438-c6be-4bc6-83ee-8c2cc5692773/action HTTP/1.1 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 15 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: {"suspend": {}} Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: exception: Instance d1a75438-c6be-4bc6-83ee-8c2cc5692773 could not be found. Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'd1a75438-c6be-4bc6-83ee-8c2cc5692773', 'body': {'suspend': {}}} Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a75438-c6be-4bc6-83ee-8c2cc5692773 could not be found. Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a75438-c6be-4bc6-83ee-8c2cc5692773 could not be found. Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:38.270269 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:38.278754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:38.278754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:38.278754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a75438-c6be-4bc6-83ee-8c2cc5692773 could not be found. Oct 24 09:06:38.278754 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.280451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c592688-11ef-4264-9e9c-337a9578179e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance d1a75438-c6be-4bc6-83ee-8c2cc5692773 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:38.281598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c592688-11ef-4264-9e9c-337a9578179e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/d1a75438-c6be-4bc6-83ee-8c2cc5692773/action" status: 404 len: 111 microversion: 2.1 time: 0.040986 Oct 24 09:06:38.282742 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1689/3449] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:38 2022] POST /compute/v2.1/servers/d1a75438-c6be-4bc6-83ee-8c2cc5692773/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:38.288104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:38.289206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 57931b05-1825-48c4-b9a7-6a6428f90265] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:38.298197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.299066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.299742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.300767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.301536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.302192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.320203 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 57931b05-1825-48c4-b9a7-6a6428f90265 could not be found. Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 HTTP/1.1 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 57931b05-1825-48c4-b9a7-6a6428f90265 could not be found. Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '57931b05-1825-48c4-b9a7-6a6428f90265'} Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57931b05-1825-48c4-b9a7-6a6428f90265 could not be found. Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57931b05-1825-48c4-b9a7-6a6428f90265 could not be found. Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:38.322268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57931b05-1825-48c4-b9a7-6a6428f90265 could not be found. Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.327830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 57931b05-1825-48c4-b9a7-6a6428f90265 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:38.329266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9aa0303c-e87c-4e9f-815f-72b36dac07b4 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265" status: 404 len: 111 microversion: 2.1 time: 0.043435 Oct 24 09:06:38.333632 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1690/3450] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:38 2022] GET /compute/v2.1/servers/57931b05-1825-48c4-b9a7-6a6428f90265 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:38.339964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:38.340874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:38.348301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.349782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.350666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.351825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.353061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.353756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.371696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf HTTP/1.1 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf'} Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:38.374895 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:38.381591 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:38.384087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:38.385197 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5962cc70-287c-4cc4-82fe-15eb8abdc70b tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 404 len: 111 microversion: 2.1 time: 0.050244 Oct 24 09:06:38.386009 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1691/3451] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:38 2022] DELETE /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:38.396645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:38.397782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:38.404464 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:38.406898 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:38.408842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.409697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.410723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.412277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.412987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.413941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.797970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:38.809267 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39e8fc36-94ec-4321-b820-f6061d8226b3 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.417652 Oct 24 09:06:38.812779 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1692/3452] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:38 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:38.826799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ff2c8c5-914d-493e-aac3-e3b6ed08d269 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:38.938693 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ff2c8c5-914d-493e-aac3-e3b6ed08d269 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e4467b06-108a-4f75-a4d0-5f365d110411" status: 204 len: 0 microversion: 2.1 time: 0.118947 Oct 24 09:06:38.939459 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1693/3453] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:06:38 2022] DELETE /compute/v2.1/os-server-groups/e4467b06-108a-4f75-a4d0-5f365d110411 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:38.950336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:38.956436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] [instance: e1c30cbd-eeaa-47e8-80a6-6b54432918bf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:38.967087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.967627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.969768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:38.971101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:38.972022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:38.972622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.001594 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] HTTP exception thrown: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Request method failure captured: Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf HTTP/1.1 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlUTb-afTzn2TNeyHFN6jqb102BTEcPNEhcIp6mHIt7fExPPtk-4rC9xaTNMU1aYqR4jDAYRqL6WSx4qdvMoZijMl0gHtY0wuqCagwHFH_koiEC9Dh5bLo8KcCbNunKRiWMy8icMI3UFEnmfbvsUUbv_uA4y9NgUMpeQsK51tCxTgR0 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_175a13a281b24a6289e68a76402eb470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/175a13a281b24a6289e68a76402eb470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/175a13a281b24a6289e68a76402eb470"}]}] Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 175a13a281b24a6289e68a76402eb470 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672741504 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 09b32a47b2874040a560e3f3776fdff9 Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672741504-project Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e1c30cbd-eeaa-47e8-80a6-6b54432918bf'} Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:39.005189 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. Oct 24 09:06:39.011537 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:39.013226 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] Returning 404 to user: Instance e1c30cbd-eeaa-47e8-80a6-6b54432918bf could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:39.015593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76233c28-e536-4639-acb5-8ae2be2ae94f tempest-ImagesOneServerNegativeTestJSON-672741504 tempest-ImagesOneServerNegativeTestJSON-672741504-project] 10.222.0.25 "GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf" status: 404 len: 111 microversion: 2.1 time: 0.068105 Oct 24 09:06:39.032177 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1694/3454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:38 2022] GET /compute/v2.1/servers/e1c30cbd-eeaa-47e8-80a6-6b54432918bf => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:39.050255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:39.051184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:39.058602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.059322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.059914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.060798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.061565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.063276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.135481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:39.153194 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16fb2493-22bf-4b01-a321-547cb0d9c755 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 1.154255 Oct 24 09:06:39.154481 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1761/3455] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:37 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:39.163711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:39.164605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:39.172069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.172771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.173417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.174526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.175177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.175772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.422703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:39.433977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1727c785-aa74-495e-b9c5-b9bb14ac478e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1535 microversion: 2.1 time: 0.399825 Oct 24 09:06:39.436057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1695/3456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:39 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1535 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:39.443133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:39.443943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:39.454034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.454933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.455627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.456591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.457272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.457960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.498317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:39.501763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:39.513200 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0371b12b-5bd4-45c6-aad7-7dc1e3e3559e tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.354245 Oct 24 09:06:39.515124 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1762/3457] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:39 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:39.521433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:39.522292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:39.528623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.529336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.529924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.536117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.539445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.542088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.691215 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c396aa5-2d44-4fb6-b13a-fc724dd62bfc tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 204 len: 0 microversion: 2.1 time: 0.252676 Oct 24 09:06:39.692505 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1696/3458] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:39 2022] DELETE /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:39.699278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:39.705078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:39.721397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.722131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.722723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.723666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.726033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.727081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.783618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lazy-loading 'flavor' on Instance uuid 92096759-c3f1-4279-abbe-5e823421740c {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:39.948059 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a7cbd752-1ba4-4354-b92f-d5f59525ce2b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 202 len: 0 microversion: 2.1 time: 0.252712 Oct 24 09:06:39.948059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1697/3459] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:39 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:06:39.959213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:39.960223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:39.978883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.979392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.981546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:39.984154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:39.984154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:39.984154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.044508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:40.051902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:40.056331 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6a9755b-37e4-44d9-a6a5-bd1358d361e0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.539927 Oct 24 09:06:40.057260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1763/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:39 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:40.091350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:40.093685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:40.101983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.103768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.104513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.105738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.107373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.108378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.226713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cdbaa4a-ac1e-4bb8-8ce8-8c3bc97e6b0a tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 204 len: 0 microversion: 2.1 time: 0.277188 Oct 24 09:06:40.229563 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1698/3461] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:39 2022] DELETE /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:40.243223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:40.245781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:40.254625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.258404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.260678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.267125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.267819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.268438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.382673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:40.396279 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c12bd154-415f-421f-8eb8-ad9ae3180341 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1514 microversion: 2.1 time: 0.322342 Oct 24 09:06:40.413482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1764/3462] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:40 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:40.426967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:40.427759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:40.443383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.445894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.446380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.447111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.447570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.449673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.539995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:40.554277 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a97acf2b-6121-4e1f-a1d2-bd7772976c98 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.322050 Oct 24 09:06:40.556367 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1699/3463] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:40 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:40.567356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b02088e2-d43d-45c5-82ef-7346956a8a05 req-66d6fb14-bdfe-4df5-87bb-d9c83ec73a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20606f53-dad1-4b06-bf59-fa1700228811", "name": "network-vif-plugged", "status": "completed", "tag": "d5b3eb31-b4d8-47aa-941d-f6c64ace63ba"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:40.633552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b02088e2-d43d-45c5-82ef-7346956a8a05 req-66d6fb14-bdfe-4df5-87bb-d9c83ec73a16 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.634322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b02088e2-d43d-45c5-82ef-7346956a8a05 req-66d6fb14-bdfe-4df5-87bb-d9c83ec73a16 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.635252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b02088e2-d43d-45c5-82ef-7346956a8a05 req-66d6fb14-bdfe-4df5-87bb-d9c83ec73a16 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.661236 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b02088e2-d43d-45c5-82ef-7346956a8a05 req-66d6fb14-bdfe-4df5-87bb-d9c83ec73a16 service nova] Creating event network-vif-plugged:d5b3eb31-b4d8-47aa-941d-f6c64ace63ba for instance 20606f53-dad1-4b06-bf59-fa1700228811 on n-h2-master-1 Oct 24 09:06:40.675432 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b02088e2-d43d-45c5-82ef-7346956a8a05 req-66d6fb14-bdfe-4df5-87bb-d9c83ec73a16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114806 Oct 24 09:06:40.680368 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1700/3464] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:40.692057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:40.693142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:40.708165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.709043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.709740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.712384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:40.714484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:40.716206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:40.802070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:40.810668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3fba5827-64f3-4aae-a39b-f59f004597eb tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 200 len: 1474 microversion: 2.1 time: 0.396000 Oct 24 09:06:40.822103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1765/3465] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:40 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:41.084724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:41.085814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:41.092485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.093018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.093482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.094185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.094821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.095626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.197052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:41.210414 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d6b51dc-e8d4-4dad-af2d-acceb1996ae6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1535 microversion: 2.1 time: 0.527673 Oct 24 09:06:41.211840 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1701/3466] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:40 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1535 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:41.427140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:41.428053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:41.436185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:41.440443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.440938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.441398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.444852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.445369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.445808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.448144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-421d751c-edfd-4be2-8900-5fcf67d71dd0 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1292 microversion: 2.1 time: 0.367494 Oct 24 09:06:41.462665 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1766/3467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:41 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1292 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:41.584778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:41.585828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:41.602197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.603002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.603455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.604495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.604959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.605427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.826374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:41.835992 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63df17c5-d7a9-4ca0-bc38-2ee678441e80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.256207 Oct 24 09:06:41.853362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1767/3468] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:41 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:41.853362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:41.853936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:41.878311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.878823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.879269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.880089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:41.880529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:41.880958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:41.973124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:41.983194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-876c7a02-5001-4d33-8e1e-e56ccb85a3ff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1497 microversion: 2.1 time: 0.563810 Oct 24 09:06:41.987221 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1702/3469] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:41 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1497 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:42.009897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:42.010763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:42.022140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.026556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.027259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.028220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.028851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.029485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.073873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lazy-loading 'flavor' on Instance uuid 92096759-c3f1-4279-abbe-5e823421740c {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:42.106507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'suspend' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state suspended Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 15 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: {"suspend": {}} Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: exception: Cannot 'suspend' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state suspended Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'suspend': {}}} Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state suspended. Cannot suspend while the instance is in this state. Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 24 09:06:42.109947 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state suspended Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state suspended Oct 24 09:06:42.115273 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:42.125011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:42.126105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'suspend' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state suspended {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:42.129104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11d5e391-5d23-4190-9d3e-ef3b5ef705d1 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 148 microversion: 2.1 time: 0.122949 Oct 24 09:06:42.133827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1703/3470] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:42 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 148 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 24 09:06:42.138574 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6c5358d-c806-4b31-b2d4-c2fac9c342af tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 200 len: 1474 microversion: 2.1 time: 0.292338 Oct 24 09:06:42.141031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:42.153676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1768/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:41 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 1474 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:42.156048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:42.171333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.172334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.172782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.174029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.174670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.175868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.206555 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:42.241167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:42.243118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:42.256634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.257350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.262023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.263011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.263656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.264256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.375104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cdea3298-2d8e-445f-8533-88fca2cfbc6c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 202 len: 0 microversion: 2.1 time: 0.237330 Oct 24 09:06:42.376643 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1704/3472] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:42 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:06:42.396920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:42.398343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:42.418956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.423388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.424352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.425504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.426224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.426911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.612757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:42.632840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5044817b-6cb4-4b4a-b955-319221861b9f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1535 microversion: 2.1 time: 0.396203 Oct 24 09:06:42.634710 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1769/3473] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:42 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1535 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:42.642691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:42.643609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:42.651572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.652306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.652949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.653874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:42.654883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:42.655996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:42.936718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:42.947343 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ed57e91-3206-4274-83d5-bd14d20485fd tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1484 microversion: 2.1 time: 0.309151 Oct 24 09:06:42.955374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1770/3474] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:42 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1484 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:42.968133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:42.970828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:43.002461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:43.007273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:43.007774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:43.008542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:43.014255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:43.016101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:43.363940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:43.371042 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:43.376542 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4df7be3f-4b2f-40b1-bd8b-e6d4399975c4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.419571 Oct 24 09:06:43.397116 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1771/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:42 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:43.411958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:43.412467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:43.419001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:43.419751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:43.420365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:43.421287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:43.421931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:43.422522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:43.535454 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92722fd7-36c9-45dd-8c9f-b92a85db64de tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137104 Oct 24 09:06:43.544153 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1772/3476] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:06:43 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:43.563730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:43.564857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:43.574699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:43.578013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:43.578660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:43.579772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:43.580726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:43.581533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:44.045536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:44.055102 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3de9617-3aac-4632-a1b1-bf1810885484 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1503 microversion: 2.1 time: 1.672579 Oct 24 09:06:44.067881 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1705/3477] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:42 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1503 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:44.073896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-305f532b-7398-4f54-bcc6-516767c1b4c3 req-8ec80b25-5bad-49ee-854f-351819445429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "name": "network-vif-plugged", "status": "completed", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:44.089409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-305f532b-7398-4f54-bcc6-516767c1b4c3 req-8ec80b25-5bad-49ee-854f-351819445429 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:44.096267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-305f532b-7398-4f54-bcc6-516767c1b4c3 req-8ec80b25-5bad-49ee-854f-351819445429 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:44.096939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-305f532b-7398-4f54-bcc6-516767c1b4c3 req-8ec80b25-5bad-49ee-854f-351819445429 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:44.118469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-305f532b-7398-4f54-bcc6-516767c1b4c3 req-8ec80b25-5bad-49ee-854f-351819445429 service nova] Creating event network-vif-plugged:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:06:44.129896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-305f532b-7398-4f54-bcc6-516767c1b4c3 req-8ec80b25-5bad-49ee-854f-351819445429 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060388 Oct 24 09:06:44.134979 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1706/3478] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:44.147149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:44.148113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:44.168812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:44.169655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:44.170260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:44.171216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:44.177063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:44.177888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:44.732543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:44.743429 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d70785ba-680c-4c72-b315-9f6fe94f8cbf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1528 microversion: 2.1 time: 0.606799 Oct 24 09:06:44.744082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1707/3479] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:44 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1528 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:44.767742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:44.768626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:44.775816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:44.776523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:44.777214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:44.778328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:44.779027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:44.779695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:45.012341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:45.027238 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f406a76-6e32-4c3d-a23b-2ea184a1e8ec tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 200 len: 1474 microversion: 2.1 time: 1.475950 Oct 24 09:06:45.027833 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1773/3480] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:43 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 1474 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:45.057159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:45.064598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:45.072052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:45.079768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:45.080460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:45.082245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:45.082887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:45.084442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:45.959379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:45.976203 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5caa2323-9c4b-4ea9-b579-d1b27cf426a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 1.213594 Oct 24 09:06:45.977126 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1708/3481] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:44 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:45.986782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:45.987408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:46.013820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:46.014319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:46.015335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:46.019271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:46.019975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:46.023662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:46.024883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:46.034144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eead144f-43ed-4e94-8a92-4607e06c5395 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1528 microversion: 2.1 time: 0.984516 Oct 24 09:06:46.035293 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1774/3482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:45 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1528 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:46.039932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3e7b588a-ec47-4610-9afe-e4788944ddaf req-23a48f32-01e3-45b5-a85e-efe8e7abae75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bfde29-b507-464b-8e03-4b489e1c5022", "name": "network-vif-deleted", "tag": "174f5f5c-67a6-419f-b87b-a93dc251186c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:46.050920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3e7b588a-ec47-4610-9afe-e4788944ddaf req-23a48f32-01e3-45b5-a85e-efe8e7abae75 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:46.051660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3e7b588a-ec47-4610-9afe-e4788944ddaf req-23a48f32-01e3-45b5-a85e-efe8e7abae75 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:46.052877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3e7b588a-ec47-4610-9afe-e4788944ddaf req-23a48f32-01e3-45b5-a85e-efe8e7abae75 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:46.075418 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3e7b588a-ec47-4610-9afe-e4788944ddaf req-23a48f32-01e3-45b5-a85e-efe8e7abae75 service nova] Creating event network-vif-deleted:174f5f5c-67a6-419f-b87b-a93dc251186c for instance 12bfde29-b507-464b-8e03-4b489e1c5022 on n-h1-master-1 Oct 24 09:06:46.081524 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3e7b588a-ec47-4610-9afe-e4788944ddaf req-23a48f32-01e3-45b5-a85e-efe8e7abae75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044842 Oct 24 09:06:46.082652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1775/3483] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:46.088161 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:46.089126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:46.096112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:46.096941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:46.097656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:46.098596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:46.099285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:46.099966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:46.997361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:47.006408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4971262-8d6a-409a-b51d-6e31bb450abe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 200 len: 1432 microversion: 2.1 time: 0.922365 Oct 24 09:06:47.037894 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1776/3484] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:46 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 1432 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:47.046982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e98ed391-f50b-467f-aefb-7daf0fa209f8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:47.066242 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e98ed391-f50b-467f-aefb-7daf0fa209f8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] HTTP exception thrown: Flavor a47b1aef-e06d-4b9a-bd63-b853b468df48 could not be found. Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e98ed391-f50b-467f-aefb-7daf0fa209f8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Request method failure captured: Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/flavors/a47b1aef-e06d-4b9a-bd63-b853b468df48 HTTP/1.1 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTD8jJpM4j4wmyGGMT-n4Lgr7xAplZPQxzftKAn5tIrJyH4uUJM3x9C9pF4BJF7pgXsdindZ3O_Zd_kZun5jpXjWWU1PkQt_oEqhkKSt5C63i3Ta3xsWTPSUTmR0PrGJ3TBLMZFHouOtguo2KSAMu-cd8VL5FjP61cEhAFWoBTKlfU Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a2f1f02e88af4e77b8cc8c09da030d0d Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-MigrationsAdminTest-503076301 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2f1f02e88af4e77b8cc8c09da030d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2f1f02e88af4e77b8cc8c09da030d0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2f1f02e88af4e77b8cc8c09da030d0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2f1f02e88af4e77b8cc8c09da030d0d"}]}] Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-MigrationsAdminTest-503076301 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a2f1f02e88af4e77b8cc8c09da030d0d Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-MigrationsAdminTest-503076301 Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-MigrationsAdminTest-503076301-project-admin Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 6a527b0a494f4fe59ebe528dad993e1b Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-MigrationsAdminTest-503076301-project-admin Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: exception: Flavor a47b1aef-e06d-4b9a-bd63-b853b468df48 could not be found. Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a47b1aef-e06d-4b9a-bd63-b853b468df48'} Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a47b1aef-e06d-4b9a-bd63-b853b468df48 could not be found. Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a47b1aef-e06d-4b9a-bd63-b853b468df48 could not be found. Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:47.073470 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a47b1aef-e06d-4b9a-bd63-b853b468df48 could not be found. Oct 24 09:06:47.078360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:47.088861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e98ed391-f50b-467f-aefb-7daf0fa209f8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Returning 404 to user: Flavor a47b1aef-e06d-4b9a-bd63-b853b468df48 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:47.091047 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e98ed391-f50b-467f-aefb-7daf0fa209f8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/a47b1aef-e06d-4b9a-bd63-b853b468df48" status: 404 len: 109 microversion: 2.1 time: 0.050729 Oct 24 09:06:47.101778 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1777/3485] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:47 2022] DELETE /compute/v2.1/flavors/a47b1aef-e06d-4b9a-bd63-b853b468df48 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:47.107362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a3f66989-45f5-43fc-8dd3-f3fc56e1b823 req-e0bb89ce-4135-4499-82b7-8f5b57dececb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9974bbd3-693c-41a1-9181-98ebb7b7f2a3", "name": "network-vif-unplugged", "status": "completed", "tag": "826c0f4b-598f-4f5c-abba-c70b65dafd22"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:47.135140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a3f66989-45f5-43fc-8dd3-f3fc56e1b823 req-e0bb89ce-4135-4499-82b7-8f5b57dececb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:47.136072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a3f66989-45f5-43fc-8dd3-f3fc56e1b823 req-e0bb89ce-4135-4499-82b7-8f5b57dececb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:47.136762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a3f66989-45f5-43fc-8dd3-f3fc56e1b823 req-e0bb89ce-4135-4499-82b7-8f5b57dececb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:47.172207 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a3f66989-45f5-43fc-8dd3-f3fc56e1b823 req-e0bb89ce-4135-4499-82b7-8f5b57dececb service nova] Creating event network-vif-unplugged:826c0f4b-598f-4f5c-abba-c70b65dafd22 for instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 on n-h1-master-1 Oct 24 09:06:47.190915 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a3f66989-45f5-43fc-8dd3-f3fc56e1b823 req-e0bb89ce-4135-4499-82b7-8f5b57dececb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087375 Oct 24 09:06:47.191950 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1778/3486] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:47.205151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-02c36718-f393-46fc-ab5d-bc3d26fd95b3 req-2db1b700-771f-4f89-820e-8f90367be8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9974bbd3-693c-41a1-9181-98ebb7b7f2a3", "name": "network-vif-deleted", "tag": "826c0f4b-598f-4f5c-abba-c70b65dafd22"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:47.221265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02c36718-f393-46fc-ab5d-bc3d26fd95b3 req-2db1b700-771f-4f89-820e-8f90367be8ff service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:47.226139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02c36718-f393-46fc-ab5d-bc3d26fd95b3 req-2db1b700-771f-4f89-820e-8f90367be8ff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:47.226899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02c36718-f393-46fc-ab5d-bc3d26fd95b3 req-2db1b700-771f-4f89-820e-8f90367be8ff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:47.255832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-02c36718-f393-46fc-ab5d-bc3d26fd95b3 req-2db1b700-771f-4f89-820e-8f90367be8ff service nova] Creating event network-vif-deleted:826c0f4b-598f-4f5c-abba-c70b65dafd22 for instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 on n-h1-master-1 Oct 24 09:06:47.267002 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-02c36718-f393-46fc-ab5d-bc3d26fd95b3 req-2db1b700-771f-4f89-820e-8f90367be8ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073573 Oct 24 09:06:47.274372 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1779/3487] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:47.285649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:47.286174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:47.287242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:47.295011 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92af5339-5e55-4538-918a-9e780655f5c2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1503 microversion: 2.1 time: 1.316776 Oct 24 09:06:47.295607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1709/3488] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:45 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1503 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:47.318101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:47.326044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:47.326794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:47.328244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:47.328879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:47.329522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:47.345744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-689761203", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:47.491286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:06:47.730202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:47.747222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37577fd1-ffa1-4d79-94ec-89f815e27234 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.471319 Oct 24 09:06:47.752147 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1780/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:47 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:47.923463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:06:47.923893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:06:47.924383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:06:47.925010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:06:47.925461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:06:47.942072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:47.942566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:47.943008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:47.943743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:47.944201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:47.944632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:47.991032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:06:48.001776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Getting quotas for user 4dde4bb72f914457a633358837d178de and project 72b5d3aef4214073b745477d3d48442b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:06:48.030723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:06:48.038195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:06:48.040168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.040791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 9974bbd3-693c-41a1-9181-98ebb7b7f2a3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:48.048166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.052491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.052965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.053733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.054204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.054629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.140492 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 could not be found. Oct 24 09:06:48.143794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20acc4ac-e85c-4ef7-90d4-9f60be2f7b55 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820970 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 HTTP/1.1 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 could not be found. Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9974bbd3-693c-41a1-9181-98ebb7b7f2a3'} Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 could not be found. Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 could not be found. Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:48.145145 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 could not be found. Oct 24 09:06:48.149578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.152492 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1710/3490] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:06:48.157169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 9974bbd3-693c-41a1-9181-98ebb7b7f2a3 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:48.158785 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e030c07-56fa-4bea-afa9-6778a3f48235 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3" status: 404 len: 111 microversion: 2.1 time: 0.122104 Oct 24 09:06:48.163083 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1781/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:48 2022] GET /compute/v2.1/servers/9974bbd3-693c-41a1-9181-98ebb7b7f2a3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:06:48.163936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.164805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:48.178631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d235dda8-e8fe-47ad-92c8-4b4b611c791e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.179284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d235dda8-e8fe-47ad-92c8-4b4b611c791e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:48.179715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.180406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.181080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.182036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.184635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.185318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.443077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:48.451382 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-be71157e-d1ac-4718-ac3d-7cdb3b0e672e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1484 microversion: 2.1 time: 0.297572 Oct 24 09:06:48.452004 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1711/3492] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:48 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1484 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:48.468295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d235dda8-e8fe-47ad-92c8-4b4b611c791e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:48.489601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d235dda8-e8fe-47ad-92c8-4b4b611c791e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1212 microversion: 2.1 time: 0.312036 Oct 24 09:06:48.496966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1782/3493] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:48 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1212 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:48.498185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.498185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 12bfde29-b507-464b-8e03-4b489e1c5022] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:48.498994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.499938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:48.514667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.517138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.521814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.524206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.525909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.527368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.532021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.532398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.532873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.533662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.534128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.534563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.599087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 12bfde29-b507-464b-8e03-4b489e1c5022 could not be found. Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 HTTP/1.1 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 12bfde29-b507-464b-8e03-4b489e1c5022 could not be found. Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '12bfde29-b507-464b-8e03-4b489e1c5022'} Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bfde29-b507-464b-8e03-4b489e1c5022 could not be found. Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bfde29-b507-464b-8e03-4b489e1c5022 could not be found. Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:48.600805 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bfde29-b507-464b-8e03-4b489e1c5022 could not be found. Oct 24 09:06:48.605268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:48.612690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 12bfde29-b507-464b-8e03-4b489e1c5022 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:48.621944 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e530ea1-49df-45e0-9a73-65fb58e39608 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022" status: 404 len: 111 microversion: 2.1 time: 0.160725 Oct 24 09:06:48.622910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1712/3494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:48 2022] GET /compute/v2.1/servers/12bfde29-b507-464b-8e03-4b489e1c5022 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:48.631106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d73893c-ba10-4954-817b-23ac0bc5bd6b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.718714 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d73893c-ba10-4954-817b-23ac0bc5bd6b tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/257ff34c-28ae-4aed-8a1b-02a66fc5667f" status: 204 len: 0 microversion: 2.1 time: 0.091685 Oct 24 09:06:48.728768 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1713/3495] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:06:48 2022] DELETE /compute/v2.1/os-server-groups/257ff34c-28ae-4aed-8a1b-02a66fc5667f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:48.739977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:48.749441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:48.768051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.768643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.769568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.771362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:48.774001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:48.774814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:48.858913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:06:49.011798 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b19eaf9-96a5-4ac3-9958-f771057fd08c tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 204 len: 0 microversion: 2.1 time: 0.281140 Oct 24 09:06:49.016111 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1714/3496] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:06:48 2022] DELETE /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:06:49.034194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:49.037260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:49.060963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.068239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.069051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.070289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.070903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.073825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.340086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:49.352480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:49.356828 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cd2b672-4842-430e-b082-3ce60fcf51b5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.864650 Oct 24 09:06:49.362100 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1783/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:48 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:49.371019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cd9090fd-6446-45e3-ba71-d99e7e03d9a8 req-9a533b1b-4b60-4855-a95c-646fb3a0381f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20606f53-dad1-4b06-bf59-fa1700228811", "tag": "d5b3eb31-b4d8-47aa-941d-f6c64ace63ba"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:49.391863 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a5318cf-6267-4408-a1fd-282921436566 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.348242 Oct 24 09:06:49.393100 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1715/3498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:49 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:49.424767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:49.427143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:49.429487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cd9090fd-6446-45e3-ba71-d99e7e03d9a8 req-9a533b1b-4b60-4855-a95c-646fb3a0381f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.431654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cd9090fd-6446-45e3-ba71-d99e7e03d9a8 req-9a533b1b-4b60-4855-a95c-646fb3a0381f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.432228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cd9090fd-6446-45e3-ba71-d99e7e03d9a8 req-9a533b1b-4b60-4855-a95c-646fb3a0381f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.451389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.456651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.460542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.462181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.476941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.477986 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cd9090fd-6446-45e3-ba71-d99e7e03d9a8 req-9a533b1b-4b60-4855-a95c-646fb3a0381f service nova] Creating event network-changed:d5b3eb31-b4d8-47aa-941d-f6c64ace63ba for instance 20606f53-dad1-4b06-bf59-fa1700228811 on n-h2-master-1 Oct 24 09:06:49.492091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cd9090fd-6446-45e3-ba71-d99e7e03d9a8 req-9a533b1b-4b60-4855-a95c-646fb3a0381f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127739 Oct 24 09:06:49.495995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.500532 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1784/3499] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:49.515778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:49.518403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:49.538184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.538692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.541450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.542532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:49.545254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:49.546164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:49.934235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:49.958553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1460bf35-abe4-461c-a06e-ded70fd03425 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.455634 Oct 24 09:06:49.965144 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1785/3500] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:49 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:49.988546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:49.989740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:50.005539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:50.018410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:50.019295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:50.020390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:50.022839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:50.036515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:50.290390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:50.307807 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-103e5394-2baa-4532-862f-ad0c6ce1fb7c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1264 microversion: 2.1 time: 0.332656 Oct 24 09:06:50.308531 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1786/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:49 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:50.329079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a44ea54d-805e-4199-a994-733c2a34f209 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:50.332276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a44ea54d-805e-4199-a994-733c2a34f209 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 274f4ced-7b0a-46d7-99a2-879e2dd867b7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:50.371804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a44ea54d-805e-4199-a994-733c2a34f209 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 274f4ced-7b0a-46d7-99a2-879e2dd867b7 could not be found. Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a44ea54d-805e-4199-a994-733c2a34f209 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/274f4ced-7b0a-46d7-99a2-879e2dd867b7/action HTTP/1.1 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: {"unpause": {}} Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 274f4ced-7b0a-46d7-99a2-879e2dd867b7 could not be found. Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '274f4ced-7b0a-46d7-99a2-879e2dd867b7', 'body': {'unpause': {}}} Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274f4ced-7b0a-46d7-99a2-879e2dd867b7 could not be found. Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274f4ced-7b0a-46d7-99a2-879e2dd867b7 could not be found. Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:50.382600 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:50.388453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:50.388453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:50.388453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274f4ced-7b0a-46d7-99a2-879e2dd867b7 could not be found. Oct 24 09:06:50.388453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:50.388453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a44ea54d-805e-4199-a994-733c2a34f209 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 274f4ced-7b0a-46d7-99a2-879e2dd867b7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:50.390111 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a44ea54d-805e-4199-a994-733c2a34f209 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/274f4ced-7b0a-46d7-99a2-879e2dd867b7/action" status: 404 len: 111 microversion: 2.1 time: 0.079690 Oct 24 09:06:50.391301 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1787/3502] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:50 2022] POST /compute/v2.1/servers/274f4ced-7b0a-46d7-99a2-879e2dd867b7/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:50.399368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:50.406721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:50.435528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:50.437819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:50.438592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:50.439596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:50.442159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:50.442847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:50.802005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:50.817095 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-096fb16f-878e-47a4-8edd-0bdc5689b796 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1471 microversion: 2.1 time: 1.409851 Oct 24 09:06:50.833323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1716/3503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:49 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1471 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:50.833323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:50.833999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:50.848222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:50.848663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:50.852319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:50.854641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:50.858925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:50.859427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:51.253945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:51.270488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5205cedd-d466-4b83-9f55-1433433006bc tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.874948 Oct 24 09:06:51.272318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1788/3504] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:50 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:51.298889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:51.299826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:51.313990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:51.314734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:51.315360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:51.316975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:51.318244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:51.318908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:51.605870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:51.628487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c6b1f1f-d785-4f0a-80cc-4ddd046c83ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.806406 Oct 24 09:06:51.647905 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1717/3505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:50 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:51.660946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:51.662013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:51.674949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:51.675437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:51.675873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:51.676591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:51.677102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:51.677619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:51.847313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:51.867076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e14e976-2974-4865-8ade-4b8b9ed9309f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1270 microversion: 2.1 time: 0.213259 Oct 24 09:06:51.877376 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1718/3506] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:51 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:51.884587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:51.890601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:51.904783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:51.908150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:51.908626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:51.912885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:51.913454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:51.914377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.103218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:52.112069 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c11147c-254c-4ca4-a9c4-6e50154bf06a tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.818273 Oct 24 09:06:52.116753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1789/3507] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:51 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:52.145658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:52.146808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:52.158262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.161498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.163407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.168821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.171368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.175189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.259608 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'unpause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: {"unpause": {}} Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'unpause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'unpause': {}}} Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state active. Cannot unpause while the instance is in this state. Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:52.261587 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:52.267131 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:52.267131 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:52.267131 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:52.267131 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:52.267131 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:52.269770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'unpause' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:52.273419 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1cb47811-afc6-41f0-8e8b-be741ac52936 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 145 microversion: 2.1 time: 0.130439 Oct 24 09:06:52.275535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1790/3508] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:52 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 145 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 24 09:06:52.288867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:52.289850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:52.306198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.306953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.308326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.313486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.314633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.316488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.732101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:52.744428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-688f98d5-fae2-4d70-83b3-6ec7014b78dd tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1471 microversion: 2.1 time: 0.874033 Oct 24 09:06:52.748348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1719/3509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:51 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1471 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:52.765623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:52.766254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:52.781620 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:52.787150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.788091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.788776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.794729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.796190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.796910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.919444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:52.928921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a404f9d9-2751-47a5-8869-8b6058938cc8 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.649035 Oct 24 09:06:52.938273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1791/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:52 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:52.944111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:52.945917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:52.957085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.960002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.962297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:52.963361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:52.968536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:52.969491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:53.104852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:53.122756 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44a9486d-f4fe-4c18-bb71-8cbad0afbb89 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1270 microversion: 2.1 time: 0.182975 Oct 24 09:06:53.142753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1792/3511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:52 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:53.165582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:53.168809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:53.183999 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:53.188781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:53.197314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:53.198230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:53.201895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:53.205164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:53.208131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:53.456193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:53.465202 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85df1b23-0d0a-43d1-8849-b62a60bfa9bb tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.714507 Oct 24 09:06:53.475085 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1720/3512] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:52 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:53.483058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6845d355-3a16-40d9-8a38-6ff97c2562f7 req-5c03fa57-1f63-41a4-b8db-a2e19dd15ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b5e7e-bb4e-44b7-8d90-47945b4ae996", "name": "network-vif-deleted", "tag": "a8c787ca-0d62-4982-ae2e-384b6a3d7e71"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:53.552325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6845d355-3a16-40d9-8a38-6ff97c2562f7 req-5c03fa57-1f63-41a4-b8db-a2e19dd15ce6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:53.558384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6845d355-3a16-40d9-8a38-6ff97c2562f7 req-5c03fa57-1f63-41a4-b8db-a2e19dd15ce6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:53.562403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6845d355-3a16-40d9-8a38-6ff97c2562f7 req-5c03fa57-1f63-41a4-b8db-a2e19dd15ce6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:53.620789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6845d355-3a16-40d9-8a38-6ff97c2562f7 req-5c03fa57-1f63-41a4-b8db-a2e19dd15ce6 service nova] Creating event network-vif-deleted:a8c787ca-0d62-4982-ae2e-384b6a3d7e71 for instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 on n-h1-master-1 Oct 24 09:06:53.649137 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6845d355-3a16-40d9-8a38-6ff97c2562f7 req-5c03fa57-1f63-41a4-b8db-a2e19dd15ce6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169721 Oct 24 09:06:53.664658 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1721/3513] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:53.775509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:53.776616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:53.794788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:53.813248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:53.814786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:53.818835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:53.823858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:53.825787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:53.933883 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:53.984201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:53.996982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.000378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.004149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lazy-loading 'fault' on Instance uuid 228b5e7e-bb4e-44b7-8d90-47945b4ae996 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:06:54.267305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:54.278362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73a6e5af-0b58-4e45-9a16-ed2704abee26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 1.133933 Oct 24 09:06:54.305901 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1793/3514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:53 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:54.306330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20476ff91b34c24b84e67e4416b13b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8469ec38031e46da9bfde167e0b6da15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:54.306472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:54.306472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:54.306666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c22679a-c68a-4509-869b-43030eb6c4fe tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 200 len: 1306 microversion: 2.1 time: 0.534754 Oct 24 09:06:54.322139 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1722/3515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:53 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 1306 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:54.334571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4111ed28-5d74-49ea-a860-6b7c18512ba5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:54.336338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4111ed28-5d74-49ea-a860-6b7c18512ba5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: f1b2203e-e362-4b06-a978-1eace1730994] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:54.343491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:54.347915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.350017 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-4111ed28-5d74-49ea-a860-6b7c18512ba5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance f1b2203e-e362-4b06-a978-1eace1730994 could not be found. Oct 24 09:06:54.351938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.353057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:54.356767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4111ed28-5d74-49ea-a860-6b7c18512ba5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/f1b2203e-e362-4b06-a978-1eace1730994/action HTTP/1.1 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 18 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: {"unshelve": null} Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f1b2203e-e362-4b06-a978-1eace1730994 could not be found. Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f1b2203e-e362-4b06-a978-1eace1730994', 'body': {'unshelve': None}} Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b2203e-e362-4b06-a978-1eace1730994 could not be found. Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b2203e-e362-4b06-a978-1eace1730994 could not be found. Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:54.359336 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b2203e-e362-4b06-a978-1eace1730994 could not be found. Oct 24 09:06:54.364773 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:54.367577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.369964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4111ed28-5d74-49ea-a860-6b7c18512ba5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance f1b2203e-e362-4b06-a978-1eace1730994 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:54.372246 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4111ed28-5d74-49ea-a860-6b7c18512ba5 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/f1b2203e-e362-4b06-a978-1eace1730994/action" status: 404 len: 111 microversion: 2.1 time: 0.048948 Oct 24 09:06:54.374596 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1723/3516] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:54 2022] POST /compute/v2.1/servers/f1b2203e-e362-4b06-a978-1eace1730994/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:54.389185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:54.391867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:54.420697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:54.438311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.439639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.440842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:54.441724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.450826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.912462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:54.921959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c37bd1d1-0ad4-4c85-bf0a-265ca5657b77 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.627835 Oct 24 09:06:54.923155 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1794/3517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:54 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:54.928659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:54.929543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:54.936458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:54.937234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.937888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.938835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:54.939448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:54.940073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:54.967183 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:55.246913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:55.257159 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2947c47e-662a-4c4b-bca1-886ec692a4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1681 microversion: 2.1 time: 0.332004 Oct 24 09:06:55.267530 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1795/3518] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:54 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1681 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:55.329816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:55.330756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] [instance: 228b5e7e-bb4e-44b7-8d90-47945b4ae996] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:55.346756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:55.348753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:55.351687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:55.353573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:55.354228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:55.357230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:55.382881 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] HTTP exception thrown: Instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 could not be found. Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Request method failure captured: Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 HTTP/1.1 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTWRo0tdY8N0lruSyNrd3NdGPTWgNR31MIkD1OL7cq_iukYv4LlBWVVSy32iMJy3k9EP7_8-mQF2mFzJwDUHS2Y5mPO92z2LUMecRjWTIBvN1XRFUbvJT7vb1Uk_hJCWUO-Cd7n3SJvWgAcJWCNT5A3CmgGA0cCoQIvTcp3N-umCtQ Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8469ec38031e46da9bfde167e0b6da15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8469ec38031e46da9bfde167e0b6da15"}]}] Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 8469ec38031e46da9bfde167e0b6da15 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1223135991 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e20476ff91b34c24b84e67e4416b13b0 Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersOnMultiNodesTest-1223135991-project Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 could not be found. Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '228b5e7e-bb4e-44b7-8d90-47945b4ae996'} Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 could not be found. Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 could not be found. Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:55.385530 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 could not be found. Oct 24 09:06:55.392174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:55.393712 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] Returning 404 to user: Instance 228b5e7e-bb4e-44b7-8d90-47945b4ae996 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:55.394908 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5cf263f-52b8-4d36-b204-f73ca6d6eca0 tempest-ServersOnMultiNodesTest-1223135991 tempest-ServersOnMultiNodesTest-1223135991-project] 10.222.0.25 "GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996" status: 404 len: 111 microversion: 2.1 time: 0.070274 Oct 24 09:06:55.396680 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1796/3519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:55 2022] GET /compute/v2.1/servers/228b5e7e-bb4e-44b7-8d90-47945b4ae996 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:55.469745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:55.489533 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65c2f0bd-500b-4b99-915d-cd955209a2bf tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 1.108523 Oct 24 09:06:55.492471 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1724/3520] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:54 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:55.520292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:55.521363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:55.531868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:55.535628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:55.536369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:55.537420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:55.537905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:55.539939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:55.949853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:55.950660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:55.976376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:55.979380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:55.981387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:55.985280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:55.989962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:55.992210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:55.998170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:56.019620 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e11c50b3-fe2d-4713-bff0-971899f062ac tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.503512 Oct 24 09:06:56.021597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1797/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:55 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:56.054083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:56.054709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:56.065358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.066390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.067023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.070401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.071454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.076491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.170099 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Cannot 'unshelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action HTTP/1.1 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 18 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: {"unshelve": null} Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: exception: Cannot 'unshelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'unshelve': None}} Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92096759-c3f1-4279-abbe-5e823421740c in vm_state active. Cannot unshelve while the instance is in this state. Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 09:06:56.171996 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active Oct 24 09:06:56.177350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:56.180494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 409 to user: Cannot 'unshelve' instance 92096759-c3f1-4279-abbe-5e823421740c while it is in vm_state active {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:56.188972 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-af6d047e-3ee1-4fbd-96c3-f24b118857ae tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action" status: 409 len: 146 microversion: 2.1 time: 0.142887 Oct 24 09:06:56.193488 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1798/3522] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:06:56 2022] POST /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c/action => generated 146 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:06:56.201547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:56.203980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:56.212410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.212916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.218481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.219317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.219990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.220775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.502968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:56.533927 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-477dcefc-99e7-4bb0-ac7d-3455e8cec4ad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.588533 Oct 24 09:06:56.536700 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1725/3523] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:55 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:56.545855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:56.553856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:56.561750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.571945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.572739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.575939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.579573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.580301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.682338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:56.693841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6459c540-8ae5-445a-a744-f474ae780652 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.499186 Oct 24 09:06:56.698062 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1799/3524] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:56 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:56.706954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2b2bfb85-7b09-4ca6-a170-87e0cb1a9508 req-edcf9dee-4f5e-4d96-80e7-8a8122a40771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:56.729196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b2bfb85-7b09-4ca6-a170-87e0cb1a9508 req-edcf9dee-4f5e-4d96-80e7-8a8122a40771 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.729725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b2bfb85-7b09-4ca6-a170-87e0cb1a9508 req-edcf9dee-4f5e-4d96-80e7-8a8122a40771 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.730179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b2bfb85-7b09-4ca6-a170-87e0cb1a9508 req-edcf9dee-4f5e-4d96-80e7-8a8122a40771 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.742666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2b2bfb85-7b09-4ca6-a170-87e0cb1a9508 req-edcf9dee-4f5e-4d96-80e7-8a8122a40771 service nova] Creating event network-changed:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h2-master-1 Oct 24 09:06:56.749478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2b2bfb85-7b09-4ca6-a170-87e0cb1a9508 req-edcf9dee-4f5e-4d96-80e7-8a8122a40771 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Oct 24 09:06:56.750712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1800/3525] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:06:56.757202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:56.758110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:56.767197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.767882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.768491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:56.770238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:56.770902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:56.771503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.055612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:57.063584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e003776b-e40e-4a24-af6a-cf4362b2ee6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.524992 Oct 24 09:06:57.065788 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1726/3526] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:56 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:57.070996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:57.084490 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6499113c-c5bd-412f-b338-c1154f0e50d2 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.331504 Oct 24 09:06:57.086415 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1801/3527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:56 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:57.112736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a257bb9b-54b3-42b4-99b9-8811726a51d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1435402957_updated"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:57.115853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a257bb9b-54b3-42b4-99b9-8811726a51d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 879b391e-ab95-4937-9c82-5428c736ccfa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:57.133792 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a257bb9b-54b3-42b4-99b9-8811726a51d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 879b391e-ab95-4937-9c82-5428c736ccfa could not be found. Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a257bb9b-54b3-42b4-99b9-8811726a51d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: request: PUT /compute/v2.1/servers/879b391e-ab95-4937-9c82-5428c736ccfa HTTP/1.1 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 81 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1435402957_updated"}} Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 879b391e-ab95-4937-9c82-5428c736ccfa could not be found. Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '879b391e-ab95-4937-9c82-5428c736ccfa', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1435402957_updated'}}} Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879b391e-ab95-4937-9c82-5428c736ccfa could not be found. Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 24 09:06:57.135833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879b391e-ab95-4937-9c82-5428c736ccfa could not be found. Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879b391e-ab95-4937-9c82-5428c736ccfa could not be found. Oct 24 09:06:57.140969 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:06:57.143955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a257bb9b-54b3-42b4-99b9-8811726a51d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 879b391e-ab95-4937-9c82-5428c736ccfa could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:57.145100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a257bb9b-54b3-42b4-99b9-8811726a51d6 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "PUT /compute/v2.1/servers/879b391e-ab95-4937-9c82-5428c736ccfa" status: 404 len: 111 microversion: 2.1 time: 0.037152 Oct 24 09:06:57.149476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1727/3528] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:06:57 2022] PUT /compute/v2.1/servers/879b391e-ab95-4937-9c82-5428c736ccfa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:57.154232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:57.155708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:57.165660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.168494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.169909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.172167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.172840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.174682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.204784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:57.206331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:57.216443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.216945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.217483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.218699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.219165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.219597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.610950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:57.624517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3186d18-b02b-464e-8b60-9a9622db89ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.420099 Oct 24 09:06:57.649125 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1728/3529] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:57 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:57.665285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:57.665951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:57.682404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.682902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.683343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.684054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.686046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:57.687952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.688441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.707228 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71ed992d-c14a-46e1-a224-84e448e03315 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.552579 Oct 24 09:06:57.709163 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1802/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:57 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:57.735396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:57.736695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:57.748162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.749694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.750255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.751350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:57.752037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:57.753025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:57.962821 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:58.024516 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:58.050762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:58.072232 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e7a93e5-c931-48c0-9bd4-d2a9a3b81a0b tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.341830 Oct 24 09:06:58.073603 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1803/3531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:57 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:58.101781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4314765-f8af-40ec-870e-679ab7f0a2e0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4314765-f8af-40ec-870e-679ab7f0a2e0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c HTTP/1.1 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 280 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.109742 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:06:58.113518 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:58.121609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4314765-f8af-40ec-870e-679ab7f0a2e0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:58.122829 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e4314765-f8af-40ec-870e-679ab7f0a2e0 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "PUT /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 400 len: 619 microversion: 2.1 time: 0.026479 Oct 24 09:06:58.127377 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1804/3532] 10.222.0.25 () {60 vars in 1257 bytes} [Mon Oct 24 09:06:58 2022] PUT /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:06:58.140879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:58.155124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:58.173155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:58.174652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:58.175288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:58.176548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:58.177481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:58.178094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:58.254205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:58.266800 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c523e9dd-5d0f-4ef7-a777-d4d6cf1e385d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.614818 Oct 24 09:06:58.281409 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1729/3533] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:57 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:58.476131 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:58.480457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:58.491937 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1da4bd6b-46bb-4a82-bc05-eb7a6b7ce536 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.359150 Oct 24 09:06:58.497639 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1805/3534] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:58 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:58.519882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:58.520570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:58.533336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:58.533936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:58.535488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:58.537690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:58.539162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:58.540517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:58.974719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:58.988232 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46ea4bad-d688-496f-84dc-a619098d18e9 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.472732 Oct 24 09:06:58.992281 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1730/3535] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:58 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:06:59.017144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad804f1a-089c-4698-9dc1-5fb66935808d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad804f1a-089c-4698-9dc1-5fb66935808d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c HTTP/1.1 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 24 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": ""}} Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c', 'body': {'server': {'name': ''}}} Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '' Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:06:59.022360 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:06:59.027342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad804f1a-089c-4698-9dc1-5fb66935808d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:06:59.028522 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad804f1a-089c-4698-9dc1-5fb66935808d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "PUT /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 400 len: 108 microversion: 2.1 time: 0.015462 Oct 24 09:06:59.037182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:59.039572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:59.051827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1806/3536] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:06:59 2022] PUT /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:06:59.053381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:59.053892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:59.054353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:59.068506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:59.071585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:59.072047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:59.290947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:59.291778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:59.303203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:59.303714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:59.304559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:59.305652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:59.306426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:59.307032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:59.546847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:06:59.559759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd1ae812-a0c5-432d-9069-5880705e2a12 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1506 microversion: 2.1 time: 0.526240 Oct 24 09:06:59.562862 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1731/3537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:59 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:06:59.767443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:06:59.768208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:06:59.801534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:59.804323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:59.804924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:06:59.806980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:06:59.808042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:06:59.809206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:00.225562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:00.234850 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08a5be41-2598-4b65-b135-48fa2145b1f8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.473147 Oct 24 09:07:00.235440 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1732/3538] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:59 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:00.610707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d889bada-d208-414a-8dfe-97f4d69cb161 req-6c69b806-fe9d-44fc-ab8f-1677037f6017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-unplugged", "status": "completed", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:00.624153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d889bada-d208-414a-8dfe-97f4d69cb161 req-6c69b806-fe9d-44fc-ab8f-1677037f6017 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:00.642200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d889bada-d208-414a-8dfe-97f4d69cb161 req-6c69b806-fe9d-44fc-ab8f-1677037f6017 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:00.642703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d889bada-d208-414a-8dfe-97f4d69cb161 req-6c69b806-fe9d-44fc-ab8f-1677037f6017 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:00.670049 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d889bada-d208-414a-8dfe-97f4d69cb161 req-6c69b806-fe9d-44fc-ab8f-1677037f6017 service nova] Creating event network-vif-unplugged:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:07:00.682218 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d889bada-d208-414a-8dfe-97f4d69cb161 req-6c69b806-fe9d-44fc-ab8f-1677037f6017 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.442327 Oct 24 09:07:00.682838 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1733/3539] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:00.707630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:00.713005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:00.732888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:00.735059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:00.735538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:00.736256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:00.740202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:00.743214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:00.887427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:00.897577 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73931d98-d7d3-445c-9f84-711739dc60d6 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 1.611313 Oct 24 09:07:00.902334 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1807/3540] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:06:59 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:01.233780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:01.250022 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a02902a9-99e2-4340-b1a2-092eb7e4bad5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.556759 Oct 24 09:07:01.274400 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1734/3541] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:00 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:01.287807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:01.289391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:01.313734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.314489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.316495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.320554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.321381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.322037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.492419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:01.498294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.499226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.499801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.500656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.501320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.502200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.601254 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25ddcb42-1063-418f-8d1e-25fa24e91f84 tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.292267 Oct 24 09:07:01.610905 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1735/3542] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:01 2022] GET /compute/v2.1/os-services => generated 944 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:01.619083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:01.639748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.640586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.641456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.642528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.652021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.652896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.695594 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97536cd9-5a99-4ed3-b4c0-a7f1f83d189d tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.082870 Oct 24 09:07:01.710087 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1736/3543] 10.222.0.25 () {58 vars in 1172 bytes} [Mon Oct 24 09:07:01 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:01.716495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:01.721981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.722670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.723731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.724635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.725803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.726417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.776294 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe701e4d-9a97-4f7f-a8d4-b706582b7c4a tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064021 Oct 24 09:07:01.787267 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1737/3544] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 09:07:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:01.798366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:01.810525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.812542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.813149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.814403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.815565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.818909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.867799 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7d3831d-3f4d-484e-a58a-ec3d29bcf7de tempest-ServicesAdminTestJSON-471513736 tempest-ServicesAdminTestJSON-471513736-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.078497 Oct 24 09:07:01.869545 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1738/3545] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:01 2022] GET /compute/v2.1/os-services => generated 944 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:01.927354 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:01.927982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:01.934920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:01.944076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.944591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.945009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.945812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:01.946428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:01.946618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:01.956968 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53477d55-06d9-4221-9892-6faa10b3bdb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.667612 Oct 24 09:07:01.958610 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1808/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:01 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:02.023813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:02.027021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:02.040916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:02.041853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:02.042494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:02.043872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:02.044500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:02.045281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:02.302133 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c13a4a4-6f8a-471f-a86c-30c92d669e45 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.318144 Oct 24 09:07:02.320322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1809/3547] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:07:01 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:07:02.360348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:02.362426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:02.386708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:02.387220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:02.387681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:02.391849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:02.392242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:02.394815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:02.395499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:02.402242 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6880d314-6722-469a-926b-2fe26e102327 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.479129 Oct 24 09:07:02.417470 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1739/3548] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:01 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:02.838679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:02.847998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-945376da-c5a5-4ced-b1dd-25ecd7de70e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1670 microversion: 2.1 time: 0.522359 Oct 24 09:07:02.853607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1810/3549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:02 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:03.428754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:03.429393 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:03.452685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:03.452685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:03.452685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:03.452685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:03.453397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:03.453734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:03.879952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:03.880510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:03.901978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:03.914791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:03.915205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:03.915982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:03.916711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:03.917125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:03.997799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:04.011388 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4c1ddb8-822c-4f24-9fea-b9280d333c13 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.587283 Oct 24 09:07:04.012084 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1740/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:03 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:04.277825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:04.289478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa1e850b-32ab-438c-90d7-8942de20b9d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1670 microversion: 2.1 time: 0.416856 Oct 24 09:07:04.313282 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1811/3551] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:03 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1670 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:05.036462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:05.037803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:05.050095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.051129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.052050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.053095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.053902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.054941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.322713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:05.323929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:05.339886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.347944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.351296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.354938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:05.356897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.358804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.359479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.376443 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a551a6ff-80e7-48af-bc5d-14e6db0f9ad7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.343647 Oct 24 09:07:05.377399 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1741/3552] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:05 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:05.600458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:05.618433 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b1e68e4-7acf-49f7-9c3d-51fb71270d6e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.297712 Oct 24 09:07:05.625687 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1812/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:05 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:05.646886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:05.656381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:05.666057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.667244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.671589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.676362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.676771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.681819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.792704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e442e82c-f274-4409-9523-cc77dfc7ff9f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 200 len: 322 microversion: 2.1 time: 0.151406 Oct 24 09:07:05.794005 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1742/3554] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:07:05 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:05.806232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:05.806859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:05.816287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.816803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.817251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:05.817996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:05.820676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:05.821351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:06.016496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:06.028553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9cd3078a-8df9-4948-87d6-a743824f866a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.226316 Oct 24 09:07:06.032967 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1813/3555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:05 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:06.060743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:06.062250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:06.080881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:06.081877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:06.082913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:06.087467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:06.089353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:06.090114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:06.403154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:06.404473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:06.412968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:06.413889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:06.414613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:06.415609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:06.416405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:06.417241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:06.625832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:06.631058 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:06.642784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bef73467-d498-4edc-832d-bf22773d4be2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.244390 Oct 24 09:07:06.643962 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1814/3556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:06 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:06.668846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-56fb9225-85c6-421a-bdf2-ed7d41f3d154 req-0e41be1f-5b9e-4c0c-a3f4-f13a9e969a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "name": "network-vif-plugged", "status": "completed", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:06.701596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56fb9225-85c6-421a-bdf2-ed7d41f3d154 req-0e41be1f-5b9e-4c0c-a3f4-f13a9e969a24 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:06.702437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56fb9225-85c6-421a-bdf2-ed7d41f3d154 req-0e41be1f-5b9e-4c0c-a3f4-f13a9e969a24 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:06.703110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56fb9225-85c6-421a-bdf2-ed7d41f3d154 req-0e41be1f-5b9e-4c0c-a3f4-f13a9e969a24 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:06.740680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-56fb9225-85c6-421a-bdf2-ed7d41f3d154 req-0e41be1f-5b9e-4c0c-a3f4-f13a9e969a24 service nova] Creating event network-vif-plugged:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h2-master-1 Oct 24 09:07:06.751781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-56fb9225-85c6-421a-bdf2-ed7d41f3d154 req-0e41be1f-5b9e-4c0c-a3f4-f13a9e969a24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106315 Oct 24 09:07:06.759330 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1815/3557] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:07.093437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:07.106812 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-54b772ce-b298-4a74-ad7c-659a0fdfd94f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.050509 Oct 24 09:07:07.109638 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1743/3558] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:06 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:07.140598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:07.142478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:07.155857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:07.157811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:07.158937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:07.161760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:07.163722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:07.165805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:07.581163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:07.594559 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc19c0af-ae48-4f7e-9e7f-7cd8345e944a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.456882 Oct 24 09:07:07.596513 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1816/3559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:07 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:07.629481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:07.633510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:07.651709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:07.653776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:07.655985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:07.658504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:07.659071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:07.660745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:07.821442 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c9d1835-4a78-4b2f-973f-7ee6a9d37987 tempest-TenantUsagesNegativeTestJSON-1830349782 tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-23T09%3A07%3A07.504292&end=2022-10-25T09%3A07%3A07.504292" status: 404 len: 112 microversion: - time: 0.313380 Oct 24 09:07:07.828142 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1744/3560] 10.222.0.25 () {58 vars in 1316 bytes} [Mon Oct 24 09:07:07 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-23T09%3A07%3A07.504292&end=2022-10-25T09%3A07%3A07.504292 => generated 112 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 09:07:07.834935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:07.835567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:07.856035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:07.859450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:07.859973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:07.860743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:07.864328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:07.864814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:07.879116 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:08.184289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:08.195764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:08.198595 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cebcbfd-0d13-4936-8adf-4744e3e05b79 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.578073 Oct 24 09:07:08.201111 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1817/3561] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:07 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:08.215642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29875ddd-2a81-4bb1-a76e-2956bcdb6196 tempest-TenantUsagesNegativeTestJSON-1830349782 tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin] Calling method '.version_select at 0x7f8dab3c50d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:08.230343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-422c4c2d-7179-4439-b4df-ad63ee650401 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1312 microversion: 2.1 time: 0.401010 Oct 24 09:07:08.244720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-29875ddd-2a81-4bb1-a76e-2956bcdb6196 tempest-TenantUsagesNegativeTestJSON-1830349782 tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 24 09:07:08.246118 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1745/3562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:07 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29875ddd-2a81-4bb1-a76e-2956bcdb6196 tempest-TenantUsagesNegativeTestJSON-1830349782 tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin] Request method failure captured: Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-simple-tenant-usage/28e678ec94294cdd8a0d0c9decedb25a?start=2022-10-25T09%3A07%3A07.504292&end=2022-10-23T09%3A07%3A07.504292 HTTP/1.1 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlW7F-qHs5490zMsXTrSD6n3bp7pgZKw10qPReOyWh8lCwo7eL3gBIo9kzORARj90kNxW6q_Tpx2hlEL-z5hbxKMaWg3CPiPr5TOpsIplMt_0QJkewSrSqpwdPI57Cj64UeYALuh6H0WNidFOLSY5bP1C3lsVsM5YaxuoYRzXuILNcg Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 9535f147098642a4a50adbe73e0afc7f Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1830349782 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9535f147098642a4a50adbe73e0afc7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9535f147098642a4a50adbe73e0afc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9535f147098642a4a50adbe73e0afc7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9535f147098642a4a50adbe73e0afc7f"}]}] Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1830349782 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 9535f147098642a4a50adbe73e0afc7f Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1830349782 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c6894bd442c7465796694374c07ae771 Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid start time. The start time cannot occur after the end time. Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '28e678ec94294cdd8a0d0c9decedb25a'} Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 24 09:07:08.254611 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:08.260832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29875ddd-2a81-4bb1-a76e-2956bcdb6196 tempest-TenantUsagesNegativeTestJSON-1830349782 tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:07:08.263623 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29875ddd-2a81-4bb1-a76e-2956bcdb6196 tempest-TenantUsagesNegativeTestJSON-1830349782 tempest-TenantUsagesNegativeTestJSON-1830349782-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/28e678ec94294cdd8a0d0c9decedb25a?start=2022-10-25T09%3A07%3A07.504292&end=2022-10-23T09%3A07%3A07.504292" status: 400 len: 111 microversion: 2.1 time: 0.059616 Oct 24 09:07:08.265941 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1818/3563] 10.222.0.25 () {58 vars in 1412 bytes} [Mon Oct 24 09:07:08 2022] GET /compute/v2.1/os-simple-tenant-usage/28e678ec94294cdd8a0d0c9decedb25a?start=2022-10-25T09%3A07%3A07.504292&end=2022-10-23T09%3A07%3A07.504292 => generated 111 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:07:08.464701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-161366667", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "cbf671c7-9a45-4411-9bbb-7fbeb13e5538"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:08.540018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01b25cdf-b3bd-4d9f-aae6-7f321d8cfb66 tempest-TenantUsagesNegativeTestJSON-928312014 tempest-TenantUsagesNegativeTestJSON-928312014-project] Calling method '.version_select at 0x7f8da9ff0af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:08.544134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-01b25cdf-b3bd-4d9f-aae6-7f321d8cfb66 tempest-TenantUsagesNegativeTestJSON-928312014 tempest-TenantUsagesNegativeTestJSON-928312014-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7f5e5507c064421b8e6c7a2a6e4997b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e678ec94294cdd8a0d0c9decedb25a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01b25cdf-b3bd-4d9f-aae6-7f321d8cfb66 tempest-TenantUsagesNegativeTestJSON-928312014 tempest-TenantUsagesNegativeTestJSON-928312014-project] Request method failure captured: Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T09%3A07%3A07.504292&end=2022-10-25T09%3A07%3A07.504292&detailed=1 HTTP/1.1 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlW6gCzK79OT81tEDtYSkDObHdursHXl2bh5TyS4ZjXJw3pN5UeTkSfNnUSzWKvmUcaZ1qY_cNJu8pyFn7w9iytbPpdTo6euIfGjVjtulVDPpgI0EKibCn39c0A-2S-myiZASPXfIE8Fx8mzLbRh7ZZpGmdCrt7mQfvbNaBfrfvlI8o Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 28e678ec94294cdd8a0d0c9decedb25a Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-928312014 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28e678ec94294cdd8a0d0c9decedb25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28e678ec94294cdd8a0d0c9decedb25a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28e678ec94294cdd8a0d0c9decedb25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28e678ec94294cdd8a0d0c9decedb25a"}]}] Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-928312014 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 28e678ec94294cdd8a0d0c9decedb25a Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-928312014 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TenantUsagesNegativeTestJSON-928312014-project Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7f5e5507c064421b8e6c7a2a6e4997b8 Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-928312014-project Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: action_args: {} Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 09:07:08.546266 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:08.552407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01b25cdf-b3bd-4d9f-aae6-7f321d8cfb66 tempest-TenantUsagesNegativeTestJSON-928312014 tempest-TenantUsagesNegativeTestJSON-928312014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:07:08.561866 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01b25cdf-b3bd-4d9f-aae6-7f321d8cfb66 tempest-TenantUsagesNegativeTestJSON-928312014 tempest-TenantUsagesNegativeTestJSON-928312014-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T09%3A07%3A07.504292&end=2022-10-25T09%3A07%3A07.504292&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.275631 Oct 24 09:07:08.566957 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1746/3564] 10.222.0.25 () {58 vars in 1335 bytes} [Mon Oct 24 09:07:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T09%3A07%3A07.504292&end=2022-10-25T09%3A07%3A07.504292&detailed=1 => generated 123 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:07:08.589022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] validate_networks() for [('cbf671c7-9a45-4411-9bbb-7fbeb13e5538', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:07:08.867130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:08.868058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:08.898614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:08.900221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:08.905676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:08.907171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:08.911140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:08.911699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:09.015891 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac HTTP/1.1 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac'} Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:07:09.021363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.027439 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.030515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:07:09.033743 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1ab4f14-8ae8-48a2-8390-16d799aa4c42 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 404 len: 111 microversion: 2.1 time: 0.169712 Oct 24 09:07:09.038943 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1747/3565] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:07:08 2022] DELETE /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:07:09.055340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:09.057050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:09.077047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:09.078931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:09.080676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:09.086014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:09.086988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:09.088065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:09.119353 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac HTTP/1.1 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac'} Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:09.121725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. Oct 24 09:07:09.130570 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:07:09.134618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:07:09.136086 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-51f0e427-7522-4a2a-82d3-6c880d143165 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac" status: 404 len: 111 microversion: 2.1 time: 0.094001 Oct 24 09:07:09.140351 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1748/3566] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:09 2022] GET /compute/v2.1/servers/5e5f02d8-9d89-4f6c-95a4-8cd4157b81ac => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:07:09.157010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:09.157555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:09.202012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:09.202618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:09.202939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:09.211410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:09.211909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:09.212361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:09.329336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:07:09.564055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25d7bcb5-9ca2-4e95-b179-50bd23e5a5cb tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 204 len: 0 microversion: 2.1 time: 0.419779 Oct 24 09:07:09.566037 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1749/3567] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:07:09 2022] DELETE /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:07:09.588536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:09.590597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:09.606149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:09.606660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:09.607107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:09.617347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:09.618997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:09.622024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:10.343153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:10.353636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49932291-f44b-4ddf-beee-856746eb7f3c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1461 microversion: 2.1 time: 0.785340 Oct 24 09:07:10.354350 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1750/3568] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:09 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1461 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:10.380412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:10.381784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:10.392600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:10.393446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:10.394067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:10.394976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:10.395701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:10.396324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:10.632528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:07:10.633022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:07:10.633486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:07:10.633987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:07:10.634407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:07:10.657017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:10.657556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:10.659605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:10.661457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:10.664459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:10.666611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:10.732890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:07:10.743201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for user c703cc73a22749858ffe05500e52aa03 and project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:07:10.775500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:07:10.777894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:07:10.877513 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5174dbe-a895-4294-92a8-ae324e74ce95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418083 Oct 24 09:07:10.885125 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1819/3569] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:07:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:07:10.892121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:10.893030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:10.900486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:10.903811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:10.904507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:10.906267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:10.906922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:10.907534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:11.001624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:11.016234 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-16dc99a4-1777-4ebf-a2d2-267868252d26 tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.643917 Oct 24 09:07:11.016836 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1751/3570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:10 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:11.021638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c983e88-9c4f-4aa9-9ae9-6d4b8fe686e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:11.022214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c983e88-9c4f-4aa9-9ae9-6d4b8fe686e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:11.183467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c983e88-9c4f-4aa9-9ae9-6d4b8fe686e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:11.195992 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c983e88-9c4f-4aa9-9ae9-6d4b8fe686e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1214 microversion: 2.1 time: 0.178002 Oct 24 09:07:11.201834 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1752/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:11 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:11.653134 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d124581f-da6f-4c5e-bfe7-a960ab8ac854 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1612 microversion: 2.1 time: 0.765669 Oct 24 09:07:11.656950 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1820/3572] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:10 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1612 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:11.677408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:11.678711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:11.689659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:11.694384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:11.694918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:11.695681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:11.696122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:11.696552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:11.771869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6a527b0a494f4fe59ebe528dad993e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1f02e88af4e77b8cc8c09da030d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:11.779938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] flavor_id is None. Assuming migration. {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 24 09:07:11.780404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:07:11.835887 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:12.046260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:12.047187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:12.065327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:12.072789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:12.073779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:12.076950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:12.077581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:12.079689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:12.098043 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9eb40066-d30d-4da0-bf75-ad97b966ce39 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715/action" status: 202 len: 0 microversion: 2.1 time: 0.424575 Oct 24 09:07:12.102240 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1753/3573] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:07:11 2022] POST /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:07:12.113380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:12.117178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:12.136416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:12.146811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:12.148997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:12.150464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:12.152722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:12.153468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:12.542672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:12.554549 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06dcb05a-e08c-4445-b09a-ba4e24d01f60 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1470 microversion: 2.1 time: 0.448197 Oct 24 09:07:12.569958 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1754/3574] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:12 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:12.583515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:12.584142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:12.601669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:12.603990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:12.604467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:12.605212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:12.605730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:12.608425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:12.760492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:12.784509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:12.785119 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-735f1c63-b987-420a-8fd9-d17cba0d2aff tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1512 microversion: 2.1 time: 0.744379 Oct 24 09:07:12.794416 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1821/3575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:12 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:12.796808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbb68c88-37fe-465e-9fa5-d1c507468473 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1266 microversion: 2.1 time: 0.225510 Oct 24 09:07:12.805054 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1755/3576] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:12 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:13.549356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-24eaf997-59ea-49f1-877b-09ed36796f61 req-d38aa214-1ca1-4396-a289-e29fa0bc3fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92096759-c3f1-4279-abbe-5e823421740c", "name": "network-vif-deleted", "tag": "80ad4d66-4f35-4cdb-8063-3147e1c2eab9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:13.578306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-24eaf997-59ea-49f1-877b-09ed36796f61 req-d38aa214-1ca1-4396-a289-e29fa0bc3fb7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:13.579194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-24eaf997-59ea-49f1-877b-09ed36796f61 req-d38aa214-1ca1-4396-a289-e29fa0bc3fb7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:13.579900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-24eaf997-59ea-49f1-877b-09ed36796f61 req-d38aa214-1ca1-4396-a289-e29fa0bc3fb7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:13.582591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:13.583474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:13.599199 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-24eaf997-59ea-49f1-877b-09ed36796f61 req-d38aa214-1ca1-4396-a289-e29fa0bc3fb7 service nova] Creating event network-vif-deleted:80ad4d66-4f35-4cdb-8063-3147e1c2eab9 for instance 92096759-c3f1-4279-abbe-5e823421740c on n-h2-master-1 Oct 24 09:07:13.610165 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-24eaf997-59ea-49f1-877b-09ed36796f61 req-d38aa214-1ca1-4396-a289-e29fa0bc3fb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065045 Oct 24 09:07:13.611801 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1822/3577] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:13.622240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:13.627263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:13.629708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:13.634232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:13.635134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:13.635712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:13.830270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:13.836231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:13.846515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:13.847487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:13.848255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:13.850063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:13.852139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:13.852876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:13.979790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:13.980490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:13.981454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:13.984183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lazy-loading 'fault' on Instance uuid 92096759-c3f1-4279-abbe-5e823421740c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:07:14.090762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136253a1592742219ad302722be1d5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d52fd8cbf748b881b4cd6f065381dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:14.102325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0397f099-8cd9-4c68-8373-e0e043e2882c tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 200 len: 1307 microversion: 2.1 time: 0.293934 Oct 24 09:07:14.109718 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1823/3578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:13 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:14.118778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:14.120025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:14.143562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:14.169428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:14.172469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:14.173973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:14.175032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:14.176896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:14.347435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:14.357086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:14.363194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3b250ae-0c55-4cbe-aaa5-1322340c29c7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1470 microversion: 2.1 time: 0.784761 Oct 24 09:07:14.367346 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1756/3579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:13 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1470 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:14.373722 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d051539-86c2-4814-8139-a6ab828c86a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1272 microversion: 2.1 time: 0.267739 Oct 24 09:07:14.375128 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1824/3580] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:14 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:14.588810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4427ace-0614-43d5-b8b1-7179c013d4d8 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Action: 'create', calling method: .version_select at 0x7f8daa00a430>, body: {"keypair": {"name": "tempest-keypair-1050657892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFJ+y0JOU+mlVT50DjAeoUjG72emAUtJWyf1x46JXR+eR4mcSZEZqOceRrBlFEj6AqWjVX2ybSibrNr2RkQnOBDTIMODzIqr0KzwBjrIZgPbYjr6NWDSBrE0/ni+kPgFg=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:14.648542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c4427ace-0614-43d5-b8b1-7179c013d4d8 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Getting quotas for project 7efcd6b20b7945549462ff819faa6cd8. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:07:14.678305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c4427ace-0614-43d5-b8b1-7179c013d4d8 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Getting quotas for user c92b6e38d9c442b596b113895c61d7c6 and project 7efcd6b20b7945549462ff819faa6cd8. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:07:14.759146 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:14.770030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4427ace-0614-43d5-b8b1-7179c013d4d8 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.400879 Oct 24 09:07:14.771420 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1757/3581] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:07:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:15.136006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:15.138291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] [instance: 92096759-c3f1-4279-abbe-5e823421740c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:15.195570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:15.205444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:15.215990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:15.216768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:15.217872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:15.218307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:15.270232 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] HTTP exception thrown: Instance 92096759-c3f1-4279-abbe-5e823421740c could not be found. Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Request method failure captured: Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c HTTP/1.1 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTDbHocR4T46RNtbMnNl0t0hDZoh4WXuJpQOl4RmZM_oZg8lKMFCPYR9OTQ03-5b0uUQMTF0ki_TohMCrQCN47vWkyOJBZf_GVMn3eF_ScyH8LAy_kqJdHxlOYh3TDPuDxYmx_rGJBr4D4Dlr-LF_aOVcBHcgfUYPB2o8e5XRG9Q1w Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18d52fd8cbf748b881b4cd6f065381dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18d52fd8cbf748b881b4cd6f065381dc"}]}] Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 18d52fd8cbf748b881b4cd6f065381dc Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934513388 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 136253a1592742219ad302722be1d5f2 Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-1934513388-project Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 92096759-c3f1-4279-abbe-5e823421740c could not be found. Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '92096759-c3f1-4279-abbe-5e823421740c'} Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92096759-c3f1-4279-abbe-5e823421740c could not be found. Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92096759-c3f1-4279-abbe-5e823421740c could not be found. Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:15.287017 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92096759-c3f1-4279-abbe-5e823421740c could not be found. Oct 24 09:07:15.292263 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:15.294387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] Returning 404 to user: Instance 92096759-c3f1-4279-abbe-5e823421740c could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:07:15.295948 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f28ae09e-5c46-4ea4-af34-6af94efc377d tempest-ServersNegativeTestJSON-1934513388 tempest-ServersNegativeTestJSON-1934513388-project] 10.222.0.25 "GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c" status: 404 len: 111 microversion: 2.1 time: 0.165279 Oct 24 09:07:15.298040 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1825/3582] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:15 2022] GET /compute/v2.1/servers/92096759-c3f1-4279-abbe-5e823421740c => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:07:15.394151 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:15.395890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:15.401817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:15.402449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:15.417981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:15.419146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:15.420213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:15.423351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:15.424140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:15.425122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:15.425340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:15.429699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:15.430370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:15.431244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:15.431802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:15.432321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:16.023018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:16.036792 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d62899b-3478-4085-9590-e2e5a1278f38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1272 microversion: 2.1 time: 0.640216 Oct 24 09:07:16.054350 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1826/3583] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:15 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1272 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:16.085642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:16.098518 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4f46e742-9287-4b16-99b2-b862edd2467d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1470 microversion: 2.1 time: 0.710702 Oct 24 09:07:16.099108 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1758/3584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:15 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1470 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:16.317370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab410dfc-69dd-478a-b2c5-0ff8ca44849d tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.327505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab410dfc-69dd-478a-b2c5-0ff8ca44849d tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.183761 Oct 24 09:07:16.342982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f341c2ef-015a-46db-bf78-3b389bc28936 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.349282 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1827/3585] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:16.374953 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f341c2ef-015a-46db-bf78-3b389bc28936 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.030249 Oct 24 09:07:16.394484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1cd560b-a066-43c8-a8c1-3d8487299865 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.397449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1759/3586] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:16.413405 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1cd560b-a066-43c8-a8c1-3d8487299865 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023490 Oct 24 09:07:16.414532 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1828/3587] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:16.428990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa3d1100-6a65-4ec6-bdf2-10ea91a9ce0c tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.438111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa3d1100-6a65-4ec6-bdf2-10ea91a9ce0c tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013762 Oct 24 09:07:16.447378 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1760/3588] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:16.452684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13ac851a-fcdb-4471-859d-9b7d4cd3a558 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.496674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13ac851a-fcdb-4471-859d-9b7d4cd3a558 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.048838 Oct 24 09:07:16.497977 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1829/3589] 10.222.0.25 () {58 vars in 1165 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:16.517958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a8bfaa7-afb4-4e6b-af23-5b7f34a1c0ab tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.546819 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a8bfaa7-afb4-4e6b-af23-5b7f34a1c0ab tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033324 Oct 24 09:07:16.558739 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1761/3590] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:16.563845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2adc9ef1-34db-4a37-9e77-429d1dc6c9c1 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.634624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2adc9ef1-34db-4a37-9e77-429d1dc6c9c1 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.076041 Oct 24 09:07:16.648170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1830/3591] 10.222.0.25 () {58 vars in 1169 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:16.652086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-920c81a2-1c0c-4095-8c81-ee17f27f97a3 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.686528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-920c81a2-1c0c-4095-8c81-ee17f27f97a3 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038246 Oct 24 09:07:16.687987 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1762/3592] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:16.702555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1aacaa80-3c20-4ef9-87fd-308fc74cd4b4 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.718250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1aacaa80-3c20-4ef9-87fd-308fc74cd4b4 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016224 Oct 24 09:07:16.719583 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1831/3593] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:16.736494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-360e14bc-e863-4a9f-a13e-7e0f85010c4c tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.837211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-360e14bc-e863-4a9f-a13e-7e0f85010c4c tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.108652 Oct 24 09:07:16.855330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ccd3a50-f140-44a6-997a-9cc745d8e41b tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.866817 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1763/3594] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:16.879612 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ccd3a50-f140-44a6-997a-9cc745d8e41b tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026834 Oct 24 09:07:16.880270 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1832/3595] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:16.895734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90101a81-759f-4389-a3f7-34c35ec7eecd tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.929194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-90101a81-759f-4389-a3f7-34c35ec7eecd tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038734 Oct 24 09:07:16.942193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1764/3596] 10.222.0.25 () {58 vars in 1144 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:16.946900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47c69c47-13f1-43c1-a67f-7979e93aa609 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:16.955705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47c69c47-13f1-43c1-a67f-7979e93aa609 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012591 Oct 24 09:07:16.968423 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1833/3597] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:16.968933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-348f1ca5-29b2-46b2-99a6-67d8d8b44efe tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.019927 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-348f1ca5-29b2-46b2-99a6-67d8d8b44efe tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.054830 Oct 24 09:07:17.038649 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1765/3598] 10.222.0.25 () {58 vars in 1148 bytes} [Mon Oct 24 09:07:16 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:17.064459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f2ed676-1146-4326-b6fc-79e7eaace5c2 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.077465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.078342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:17.086644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f2ed676-1146-4326-b6fc-79e7eaace5c2 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.046500 Oct 24 09:07:17.088208 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1834/3599] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:17.093001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:17.098001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:17.101324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:17.102353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:17.106607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:17.108543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1186536-3ca0-463a-a790-a13d998a8cfc tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.108809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:17.152144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1186536-3ca0-463a-a790-a13d998a8cfc tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054982 Oct 24 09:07:17.152755 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1835/3600] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:17.165443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.166324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:17.175168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:17.181806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:17.182535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:17.183455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:17.184188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:17.184870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:17.609611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:17.628918 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1701f6f-2d07-4bb6-b87f-9d4ac2a4b2a1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.556438 Oct 24 09:07:17.630122 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1766/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:17.634902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a14dfa2-a439-4dac-bdc3-9384f97ce670 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.661488 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a14dfa2-a439-4dac-bdc3-9384f97ce670 tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.030022 Oct 24 09:07:17.662817 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1767/3602] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:17.674492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:17.684765 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5bca7319-95a0-483c-8f33-d28608eb2eaf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1470 microversion: 2.1 time: 0.523227 Oct 24 09:07:17.697544 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1836/3603] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:17.697795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bce56ab-66ef-4fa5-8c49-c5045e25e4ec tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.728898 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7bce56ab-66ef-4fa5-8c49-c5045e25e4ec tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047621 Oct 24 09:07:17.730488 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1768/3604] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:17.833610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-27bba0d7-d03d-404b-b44a-0facafe5cccf tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:17.842512 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-27bba0d7-d03d-404b-b44a-0facafe5cccf tempest-FlavorsV2TestJSON-2117745427 tempest-FlavorsV2TestJSON-2117745427-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014274 Oct 24 09:07:17.848216 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1837/3605] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:18.653145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:18.654471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:18.667163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:18.667667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:18.668107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:18.668821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:18.672151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:18.672807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:18.715222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:18.716645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:18.720751 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:18.740303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:18.742873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:18.743981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:18.749329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:18.757100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:18.757787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:19.200038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:19.226618 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff85760b-5b7e-4820-b859-6d6f544d6b00 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.518891 Oct 24 09:07:19.230152 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1838/3606] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:18 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:19.248000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:19.269636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d698088c-b0ec-47b6-bb89-cadcb01bd2cc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.621304 Oct 24 09:07:19.270986 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1769/3607] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:18 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:20.252231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:20.253807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:20.267933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:20.270725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:20.271320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:20.272164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:20.274184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:20.276674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:20.300308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:20.304264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:20.328392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:20.331197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:20.332652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:20.339577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:20.340435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:20.341216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:20.706519 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:20.753755 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:20.855359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:20.872011 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80e145d7-2aee-40cb-b110-dbf83f8d4876 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.623820 Oct 24 09:07:20.878317 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1839/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:20 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:20.897193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-48ca541b-6c54-4aec-9f4f-9bced4db3953 req-25b18382-5f0c-4326-971e-63a02c994f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2129433-b09b-4e75-93cc-db0ee3d987f1", "tag": "713963e9-7e12-49dc-a9c2-8143e0d22a2f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:20.922200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-48ca541b-6c54-4aec-9f4f-9bced4db3953 req-25b18382-5f0c-4326-971e-63a02c994f50 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:20.922611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-48ca541b-6c54-4aec-9f4f-9bced4db3953 req-25b18382-5f0c-4326-971e-63a02c994f50 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:20.923054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-48ca541b-6c54-4aec-9f4f-9bced4db3953 req-25b18382-5f0c-4326-971e-63a02c994f50 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:20.960255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-48ca541b-6c54-4aec-9f4f-9bced4db3953 req-25b18382-5f0c-4326-971e-63a02c994f50 service nova] Creating event network-changed:713963e9-7e12-49dc-a9c2-8143e0d22a2f for instance c2129433-b09b-4e75-93cc-db0ee3d987f1 on n-h1-master-1 Oct 24 09:07:20.966096 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-48ca541b-6c54-4aec-9f4f-9bced4db3953 req-25b18382-5f0c-4326-971e-63a02c994f50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084333 Oct 24 09:07:20.968234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1840/3609] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:21.269516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Calling method '.version_select at 0x7f8dab0a2940>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:21.304697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:21.305745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:21.306507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:21.313243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:21.314183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:21.314824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:21.342344 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8882503-5a53-4f3f-8747-899dcf90633d tempest-AbsoluteLimitsTestJSON-1574512405 tempest-AbsoluteLimitsTestJSON-1574512405-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.310747 Oct 24 09:07:21.354713 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1841/3610] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:21.679648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:21.696391 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c5ca7fe-abfd-4ed8-9073-29933827fabc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 1.400412 Oct 24 09:07:21.699433 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1770/3611] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:20 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:21.809545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "411797e7-ea79-4631-bec8-4a55bda4a6c2"}], "security_groups": [{"name": "tempest-securitygroup--691495668"}], "key_name": "tempest-keypair-1050657892", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:21.909490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:21.910262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:21.918257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:21.918958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:21.919580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:21.920376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:21.920999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:21.921751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:22.028662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] validate_networks() for [('411797e7-ea79-4631-bec8-4a55bda4a6c2', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:07:22.367796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:22.372214 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:22.380760 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11fe6674-14ad-4f4c-bd08-f72a60ca6db1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.476415 Oct 24 09:07:22.382362 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1771/3612] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:21 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:22.737500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:22.739068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:22.752607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:22.753735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:22.754946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:22.757043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:22.757770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:22.758415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:23.009113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:23.025350 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eedb5291-b43a-4c5a-80b4-5ebe25428fc6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.301484 Oct 24 09:07:23.028421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1772/3613] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:22 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:23.242522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:07:23.242992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:07:23.243423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:07:23.243863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:07:23.244274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:07:23.254451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:23.254935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:23.255372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:23.256095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:23.256743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:23.257387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:23.280278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Getting quotas for project 7efcd6b20b7945549462ff819faa6cd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:07:23.286473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Getting quotas for user c92b6e38d9c442b596b113895c61d7c6 and project 7efcd6b20b7945549462ff819faa6cd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:07:23.301268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:07:23.304137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:07:23.412691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:23.417188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:23.427428 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8cd858bb-275d-433b-b679-aa77cc4229a0 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.624259 Oct 24 09:07:23.428078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1842/3614] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:07:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:07:23.438804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:23.446063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:23.446793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:23.450105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:23.450791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:23.451465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:23.452635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3acc72d-483f-40f9-99de-7dcd33e87616 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:23.456340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3acc72d-483f-40f9-99de-7dcd33e87616 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:23.650656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3acc72d-483f-40f9-99de-7dcd33e87616 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:23.669846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3acc72d-483f-40f9-99de-7dcd33e87616 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1226 microversion: 2.1 time: 0.233967 Oct 24 09:07:23.683798 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1843/3615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:23 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:24.077111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:24.080763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:24.101417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:24.104042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:24.104695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:24.105584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:24.106971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:24.109418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:24.209465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:24.220547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-319be95e-bf1e-45a3-875b-485b8af8e4da tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.811477 Oct 24 09:07:24.221940 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1773/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:23 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:24.523503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:24.535044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a8d33c0-1876-4342-ac2f-88f1179305da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.484590 Oct 24 09:07:24.550266 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1844/3617] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:24 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:24.700295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:24.700914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:24.725010 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:24.729317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:24.730639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:24.731588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:24.734132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:24.734811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:24.739527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:24.953953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:24.968903 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dec46226-69bf-4d4a-b6eb-2674e2681658 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1222 microversion: 2.1 time: 0.272283 Oct 24 09:07:24.971254 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1774/3618] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:24 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:25.244346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:25.244891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:25.254616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:25.255101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:25.258671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:25.261944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:25.262606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:25.263211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:25.559995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:25.560720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:25.571008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:25.571660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:25.572108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:25.576070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:25.577387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:25.577984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:25.608152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:25.617519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fdb273f2-881b-4e2a-aabd-015d49274643 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.376624 Oct 24 09:07:25.619566 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1845/3619] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:25 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:25.849382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:25.857495 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82b3dab3-daa2-46a0-8e03-420a19c237e0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.301065 Oct 24 09:07:25.858478 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1775/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:25 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:26.002025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:26.003740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:26.020112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:26.024152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:26.028186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:26.029393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:26.032057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:26.032865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:26.179075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:26.195449 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53c680f4-2b26-434e-8591-d7d9e8af7cc4 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1284 microversion: 2.1 time: 0.199034 Oct 24 09:07:26.196164 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1846/3621] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:25 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:26.648284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:26.649631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:26.661640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:26.662402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:26.663598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:26.670203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:26.673178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:26.675533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:26.892440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:26.893174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:26.910364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:26.912508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:26.913582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:26.914984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:26.919082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:26.920518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:27.129337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:27.160197 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb73e0a1-051b-4186-b778-a0a38c7e26f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.515984 Oct 24 09:07:27.162090 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1776/3622] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:26 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:27.218919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:27.219820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:27.230877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:27.233728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:27.234423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:27.235413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:27.237895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:27.238581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:27.725400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:27.737727 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:27.744714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d403e2fa-9dc3-4172-818f-9f6bb8b6d116 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.865418 Oct 24 09:07:27.747589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1847/3623] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:26 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:28.061480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:28.071302 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d85dc4b-c2d8-434b-aeaf-0f1782b47f43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 0.856242 Oct 24 09:07:28.072477 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1777/3624] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:27 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:28.084277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-072307c2-01ec-47e0-969a-63e87e0c8cfa req-2f004e91-7160-47d0-b675-b7adcbc7633f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2129433-b09b-4e75-93cc-db0ee3d987f1", "name": "network-vif-plugged", "status": "completed", "tag": "713963e9-7e12-49dc-a9c2-8143e0d22a2f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:28.107703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-072307c2-01ec-47e0-969a-63e87e0c8cfa req-2f004e91-7160-47d0-b675-b7adcbc7633f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:28.108200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-072307c2-01ec-47e0-969a-63e87e0c8cfa req-2f004e91-7160-47d0-b675-b7adcbc7633f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:28.108694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-072307c2-01ec-47e0-969a-63e87e0c8cfa req-2f004e91-7160-47d0-b675-b7adcbc7633f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:28.129549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-072307c2-01ec-47e0-969a-63e87e0c8cfa req-2f004e91-7160-47d0-b675-b7adcbc7633f service nova] Creating event network-vif-plugged:713963e9-7e12-49dc-a9c2-8143e0d22a2f for instance c2129433-b09b-4e75-93cc-db0ee3d987f1 on n-h1-master-1 Oct 24 09:07:28.134854 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-072307c2-01ec-47e0-969a-63e87e0c8cfa req-2f004e91-7160-47d0-b675-b7adcbc7633f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055625 Oct 24 09:07:28.136207 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1848/3625] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:28.186086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:28.186640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:28.197142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:28.198723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:28.200299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:28.209880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:28.211313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:28.213499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:28.628917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:28.642632 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b1003c7-7599-42f6-8c8c-bf2ac154ac12 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.460052 Oct 24 09:07:28.665518 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1778/3626] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:28 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:28.775117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:28.776111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:28.790965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:28.791755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:28.792402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:28.793339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:28.798129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:28.798834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:29.102749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:29.103854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:29.115073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:29.115574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:29.116094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:29.116925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:29.117559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:29.118005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:29.228381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:29.238488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-963ed769-cc84-4c95-9e34-7eeb29caf918 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1314 microversion: 2.1 time: 0.468195 Oct 24 09:07:29.239000 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1849/3627] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:28 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:29.446337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:29.455981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cdd5fb59-90f0-4ae2-8e4d-214c1ef80d4c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 0.359718 Oct 24 09:07:29.457275 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1779/3628] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:29 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:29.471226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-664545f5-99f8-4877-90ac-90b1bac8b73a req-4583a84e-4cc7-417c-97f6-bc5a3b7ebbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8635f451-8133-4276-92fd-a675cbf47ea0", "tag": "403b8d1c-5cad-4793-8ca4-3d666b7fc401"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:29.486573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-664545f5-99f8-4877-90ac-90b1bac8b73a req-4583a84e-4cc7-417c-97f6-bc5a3b7ebbd2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:29.487335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-664545f5-99f8-4877-90ac-90b1bac8b73a req-4583a84e-4cc7-417c-97f6-bc5a3b7ebbd2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:29.487939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-664545f5-99f8-4877-90ac-90b1bac8b73a req-4583a84e-4cc7-417c-97f6-bc5a3b7ebbd2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:29.501997 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-664545f5-99f8-4877-90ac-90b1bac8b73a req-4583a84e-4cc7-417c-97f6-bc5a3b7ebbd2 service nova] Creating event network-changed:403b8d1c-5cad-4793-8ca4-3d666b7fc401 for instance 8635f451-8133-4276-92fd-a675cbf47ea0 on n-h2-master-1 Oct 24 09:07:29.509242 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-664545f5-99f8-4877-90ac-90b1bac8b73a req-4583a84e-4cc7-417c-97f6-bc5a3b7ebbd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046842 Oct 24 09:07:29.510412 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1850/3629] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:29.672952 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:29.673659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:29.693895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:29.694778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:29.696895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:29.697999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:29.700026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:29.702160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:30.215763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:30.233604 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-961e6151-00e0-4648-bd20-345aeb620242 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.563983 Oct 24 09:07:30.246976 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1780/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:29 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:30.268398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:30.270370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:30.277606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:30.279018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:30.279984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:30.281042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:30.282221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:30.282911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:30.482027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:30.483617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:30.490897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:30.491737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:30.492408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:30.493466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:30.494162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:30.495095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:30.845420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:30.859157 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c0c5a1dc-2540-48b9-a252-27734e4c5d0a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1501 microversion: 2.1 time: 0.596338 Oct 24 09:07:30.860381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1851/3631] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:30 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1501 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:30.898374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e18d282-64fc-4c13-8a38-1affebd9b84c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:30.926193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e18d282-64fc-4c13-8a38-1affebd9b84c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:30.927757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e18d282-64fc-4c13-8a38-1affebd9b84c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:30.928681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e18d282-64fc-4c13-8a38-1affebd9b84c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.043506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e18d282-64fc-4c13-8a38-1affebd9b84c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:07:31.182463 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e18d282-64fc-4c13-8a38-1affebd9b84c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1/action" status: 202 len: 0 microversion: 2.1 time: 0.289984 Oct 24 09:07:31.186999 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1852/3632] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:07:30 2022] POST /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:07:31.195558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:31.196285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:31.208432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:31.209332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:31.210391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.211149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:31.211674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:31.212124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.567417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:31.592824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:31.609175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1d48bd0-fd89-48b1-a734-f76174cfcc77 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.419402 Oct 24 09:07:31.614437 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b998fe2b-2a40-4e41-ad61-b25febaab71d tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 1.135163 Oct 24 09:07:31.615118 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1853/3633] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:31 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:31.629676 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1781/3634] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:30 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:31.639550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:31.642417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:31.650869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:31.651760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:31.658281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.659385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:31.660910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:31.661670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.796528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:31.819693 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:31.820742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Searching by: {'deleted': False, 'project_id': '62a15639dcb743da88acbde43c90e3a9'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:07:31.828645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:31.829529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:31.830259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.831249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:31.831900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:31.832613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:31.882850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:07:31.996636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d22be4aa-9343-4a54-b36b-63545a803659 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.222417 Oct 24 09:07:31.997696 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1782/3635] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:07:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:32.025786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:32.032209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:32.034094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Searching by: {'deleted': False, 'project_id': '62a15639dcb743da88acbde43c90e3a9'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:07:32.040156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.041030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.042247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:32.043243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.043967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.044668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:32.080861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:07:32.132680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:32.150808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.151625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.152638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:32.186252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:32.200932 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52c35c77-0f92-4534-8393-f3f2661e07cc tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.584360 Oct 24 09:07:32.202918 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1854/3636] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:31 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:32.395964 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-591f1562-35f0-48a4-bf0d-559a7023f80d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.380687 Oct 24 09:07:32.396587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1783/3637] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:07:32 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:32.422376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c614eac9-0c45-418d-81b5-6e8328ccd81d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:32.431256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c614eac9-0c45-418d-81b5-6e8328ccd81d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012640 Oct 24 09:07:32.439278 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1855/3638] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:07:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:32.640510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:32.641100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:32.647520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.648267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.648875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:32.649770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.650385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.652482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:32.658749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:32.659967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:32.688042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.688916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.696556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:32.697713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:32.698558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:32.699165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.137886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:33.154044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-912db61c-d005-45b0-bbab-f5b766290739 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.519156 Oct 24 09:07:33.155018 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1784/3639] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:32 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:33.163324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:33.170517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:33.177104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:33.177702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:33.178088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.178805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:33.179266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:33.179697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.216276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:07:33.266687 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:33.312326 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:33.356414 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22d8cd6e-5b24-43ce-a833-5bbf9913724c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 204 len: 0 microversion: 2.1 time: 0.199760 Oct 24 09:07:33.359131 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1785/3640] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:07:33 2022] DELETE /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:07:33.374662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:33.376740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:33.390298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:33.396552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:33.397824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:33.398448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.399381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:33.400017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:33.400619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.402403 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c37189d-aa1a-4cfc-a8c1-91c8cd149eda tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 0.747657 Oct 24 09:07:33.403027 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1856/3641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:32 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:33.412137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:33.412754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:33.434410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:33.434997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:33.435578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.436594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:33.441565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:33.442423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:33.666710 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:33.781516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:33.816876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2d9d43a-a4d5-4940-b7be-05fe0e6a47e4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1609 microversion: 2.1 time: 0.410609 Oct 24 09:07:33.820200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1857/3642] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:33 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1609 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:33.869902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:33.880288 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c44adab-ad50-4e7a-9542-5a06f5158411 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.519541 Oct 24 09:07:33.881066 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1786/3643] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:33 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:34.183942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:34.184917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:34.195058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:34.196074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:34.196874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:34.204155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:34.205230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:34.206300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:34.430054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:34.430816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:34.442629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:34.443404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:34.444219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:34.445756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:34.446644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:34.447397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:34.762844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:34.778452 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-297bfbe9-1c83-43f1-8b1c-fe32a45ac263 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.599244 Oct 24 09:07:34.784034 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1858/3644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:34 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:34.847534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:34.850920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:34.863130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:34.866279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:34.867808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:34.871349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:34.876611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:34.877425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:35.019604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:35.031905 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08256d90-c251-4eda-ad9d-596143649bf9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 0.606576 Oct 24 09:07:35.034257 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1787/3645] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:34 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:35.052955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:35.061541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:35.080337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:35.096119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:35.097935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:35.099636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:35.100531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:35.101381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:35.384133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:35.396114 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e069889-eabd-4ed6-a921-abcb1b750772 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.360653 Oct 24 09:07:35.409324 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1788/3646] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:35 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:35.474801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:35.486102 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2494669-5246-4dbd-9ea3-9a1ac28a4c21 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1609 microversion: 2.1 time: 0.647019 Oct 24 09:07:35.487006 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1859/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:34 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1609 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:35.809170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:35.811110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:35.823227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:35.829744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:35.830529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:35.831563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:35.832344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:35.833005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:36.059940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:36.061130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:36.085386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:36.085904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:36.086332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:36.087041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:36.087502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:36.087939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:36.478887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:36.494200 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-000a744a-b15d-42a5-9287-1775b7ea0677 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.689490 Oct 24 09:07:36.495529 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1789/3648] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:35 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:36.510496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:36.513877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:36.521120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:36.522063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:36.522693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:36.523767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:36.524398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:36.524987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:36.956332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:36.969713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01000272-9aa5-4e0e-83d8-d7a43a90a03a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.472682 Oct 24 09:07:36.971667 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1790/3649] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:36 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:36.976451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:36.977079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:37.003443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:37.012118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:37.012985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:37.014578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:37.015328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:37.016023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:37.099959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:37.111882 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec7cbbe4-1add-4527-a6e0-5117b68a6dc7 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 1.055696 Oct 24 09:07:37.113273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1860/3650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:36 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:37.522782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:37.523403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:37.549258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:37.550039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:37.550497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:37.551256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:37.551720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:37.552146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:37.738334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:37.762873 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06bc3c66-5074-484f-858d-2ffc2ab125df tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1609 microversion: 2.1 time: 0.790084 Oct 24 09:07:37.765289 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1791/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:36 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1609 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:38.081810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1019581987", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9c8a69b9-64d8-470d-a2c0-3d0dcb70a482"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:38.188340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] validate_networks() for [('9c8a69b9-64d8-470d-a2c0-3d0dcb70a482', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:07:38.661802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:38.674206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d9474dd-8f5c-41ee-8cc9-e294af5aad1d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 1.155192 Oct 24 09:07:38.674887 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1861/3652] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:37 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:38.705367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:38.706001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:38.728881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:38.729680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:38.730311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:38.731334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:38.731970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:38.732608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.381587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:39.404350 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20f3d90d-115b-4ef3-a1ea-1d9c5ecffa0e tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1475 microversion: 2.1 time: 0.711406 Oct 24 09:07:39.407216 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1862/3653] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:38 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1475 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:39.431510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:39.432247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:39.454276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:39.455125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:39.456148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.457212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:39.457854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:39.458610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.662210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:39.674997 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc1a90ed-f648-40e5-87c7-57308d4f3a43 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 0.264108 Oct 24 09:07:39.677645 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1863/3654] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:39 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:39.683825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b1aaecca-2904-47ee-9fb1-ea9ca34086e8 req-fa407dc2-9aa9-4693-b41e-d03ac5a6d007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8635f451-8133-4276-92fd-a675cbf47ea0", "name": "network-vif-plugged", "status": "completed", "tag": "403b8d1c-5cad-4793-8ca4-3d666b7fc401"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:39.698272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b1aaecca-2904-47ee-9fb1-ea9ca34086e8 req-fa407dc2-9aa9-4693-b41e-d03ac5a6d007 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:39.698996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b1aaecca-2904-47ee-9fb1-ea9ca34086e8 req-fa407dc2-9aa9-4693-b41e-d03ac5a6d007 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:39.699590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b1aaecca-2904-47ee-9fb1-ea9ca34086e8 req-fa407dc2-9aa9-4693-b41e-d03ac5a6d007 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.715536 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b1aaecca-2904-47ee-9fb1-ea9ca34086e8 req-fa407dc2-9aa9-4693-b41e-d03ac5a6d007 service nova] Creating event network-vif-plugged:403b8d1c-5cad-4793-8ca4-3d666b7fc401 for instance 8635f451-8133-4276-92fd-a675cbf47ea0 on n-h2-master-1 Oct 24 09:07:39.723109 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b1aaecca-2904-47ee-9fb1-ea9ca34086e8 req-fa407dc2-9aa9-4693-b41e-d03ac5a6d007 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043844 Oct 24 09:07:39.723903 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1864/3655] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:39.730214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:39.731330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:39.740862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:39.741683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:39.742293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.743229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:39.743845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:39.744481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.872172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:39.884166 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02a5e504-8942-48d4-bc89-11094fb609d8 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1251 microversion: 2.1 time: 0.158792 Oct 24 09:07:39.885028 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1865/3656] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:39 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1251 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:39.891035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-671bb97c-b39f-4ba1-af53-7ba4603a60cd req-f793f989-470a-4f4c-b3ef-f1b8e697e978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20606f53-dad1-4b06-bf59-fa1700228811", "name": "network-vif-deleted", "tag": "d5b3eb31-b4d8-47aa-941d-f6c64ace63ba"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:39.905011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-671bb97c-b39f-4ba1-af53-7ba4603a60cd req-f793f989-470a-4f4c-b3ef-f1b8e697e978 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:39.905748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-671bb97c-b39f-4ba1-af53-7ba4603a60cd req-f793f989-470a-4f4c-b3ef-f1b8e697e978 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:39.906381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-671bb97c-b39f-4ba1-af53-7ba4603a60cd req-f793f989-470a-4f4c-b3ef-f1b8e697e978 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:39.958004 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-671bb97c-b39f-4ba1-af53-7ba4603a60cd req-f793f989-470a-4f4c-b3ef-f1b8e697e978 service nova] Creating event network-vif-deleted:d5b3eb31-b4d8-47aa-941d-f6c64ace63ba for instance 20606f53-dad1-4b06-bf59-fa1700228811 on n-h2-master-1 Oct 24 09:07:39.964809 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-671bb97c-b39f-4ba1-af53-7ba4603a60cd req-f793f989-470a-4f4c-b3ef-f1b8e697e978 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077900 Oct 24 09:07:39.966067 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1866/3657] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:39.989100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:39.990240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:40.006239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.007010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.007807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.008727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.009454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.010056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.042381 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:40.261782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:07:40.262299 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:40.264507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:07:40.265205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:07:40.265825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:07:40.266420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:07:40.274579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1141d417-9422-4b18-b1d7-de1af58e072c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.300594 Oct 24 09:07:40.275765 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1867/3658] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:39 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:40.306363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.307064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.307710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.308617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.309247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.310052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.332851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Getting quotas for project 82888bc2bd7c40dcbae68a5e4fa6c4f2. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:07:40.339753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Getting quotas for user 5ae455a2351c4cf9a32ca68e686d27d0 and project 82888bc2bd7c40dcbae68a5e4fa6c4f2. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:07:40.356397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:07:40.359741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:07:40.432284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cfc6fbc-a939-4589-a33b-3484c6cc0e26 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.617239 Oct 24 09:07:40.435757 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1792/3659] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:07:40.445768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:40.446976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:40.455375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84f4f915-705e-4f71-9575-f26d408ad7db tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:40.456296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84f4f915-705e-4f71-9575-f26d408ad7db tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:40.471143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.473865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.474336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.478462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.478959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.479518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.795688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:40.805330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-417e6409-3dc7-408d-bb27-cca93958504b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1474 microversion: 2.1 time: 0.377438 Oct 24 09:07:40.818227 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1868/3660] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:40 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:40.843280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:40.843919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:40.844144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84f4f915-705e-4f71-9575-f26d408ad7db tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:40.854803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84f4f915-705e-4f71-9575-f26d408ad7db tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1218 microversion: 2.1 time: 0.412451 Oct 24 09:07:40.862233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1793/3661] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:40 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1218 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:40.877825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.879185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.879651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.880727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.881074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.881497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.911629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:40.915147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:40.917650 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:40.930544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.934816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.936937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:40.941426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:40.947971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:40.948803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:41.161667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:41.175672 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1251 microversion: 2.1 time: 0.267148 Oct 24 09:07:41.192731 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1794/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:40 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1251 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:41.194210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:41.196732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18c3a4cc-b99a-4479-8e5a-7bcf815523d4 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001488 Oct 24 09:07:41.197330 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1795/3663] 10.222.0.25 () {56 vars in 886 bytes} [Mon Oct 24 09:07:41 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 09:07:41.299868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:41.300561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:41.308711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:41.316967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:41.318046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:41.319695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:41.320200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:41.320644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:41.468310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:41.492753 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bc45ba8-cb39-4e58-8f3d-7d4e4fc35944 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1351 microversion: 2.1 time: 0.667484 Oct 24 09:07:41.493812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1869/3664] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:40 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1351 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:41.836173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:41.836818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:41.846196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:41.846697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:41.847146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:41.847865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:41.848328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:41.848763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.103177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:42.119567 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-587fce5f-a810-4e63-9699-11e7ea3d561b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.824963 Oct 24 09:07:42.121760 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1796/3665] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:41 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:42.137326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:42.137996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:42.182403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.183308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.185323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.192831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.195194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.197801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.342199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:42.351086 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c20dad64-dab1-4e9a-b5ee-3b327bb161f7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1474 microversion: 2.1 time: 0.521458 Oct 24 09:07:42.357777 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1870/3666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:41 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1474 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:42.372477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:42.373663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:42.402593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.403112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.403571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.404340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.404812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.410752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.574750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:42.588365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1423dc7b-e434-4a5b-9911-72662d35baa6 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1270 microversion: 2.1 time: 0.464024 Oct 24 09:07:42.591414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1797/3667] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:42 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1270 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:42.621659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "name": "network-vif-unplugged", "status": "completed", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:42.651920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.654391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.655100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.661582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:42.674704 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a99fa754-c0bf-44a2-af00-60ceb3a744d1 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1251 microversion: 2.1 time: 0.315658 Oct 24 09:07:42.675411 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1871/3668] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:42 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1251 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:42.695769 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] Creating event network-vif-unplugged:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h1-master-1 Oct 24 09:07:42.699417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:42.700511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:42.705888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] Instance 5a2d7405-eb56-40e2-b55b-b57117052715 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:07:42.715091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.715596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.716161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.717101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:42.717797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:42.718441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:42.726291 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-08610bea-54fb-4fcd-8746-f9470b354bc5 req-20b29cdc-8299-41b6-bd44-d9f812b789b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116995 Oct 24 09:07:42.727213 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1798/3669] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:43.150159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:43.151891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:43.170185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.172733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.173937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.178185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.178959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.179580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.467818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:43.477565 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc051f97-c7c6-4a04-a431-b456a77eb857 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1542 microversion: 2.1 time: 0.797743 Oct 24 09:07:43.493972 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1872/3670] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:42 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1542 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:43.508000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:43.514915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:43.527912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.528886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.530199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.531155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.531849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.534914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.661281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:43.672156 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-baf2f68a-0f54-46e5-a911-aa0718fb284f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.526713 Oct 24 09:07:43.688066 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1799/3671] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:43 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:43.688066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:43.688066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:43.703354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.704023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.704489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.707664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.733114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.733114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.933206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:43.946040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-33d44a02-2b90-41e7-b190-9a1367fc4b6d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1474 microversion: 2.1 time: 0.450107 Oct 24 09:07:43.947136 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1873/3672] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:43 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1474 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:43.959659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:43.960498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:43.972787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.974979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.983121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:43.988876 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-603d5884-1f2c-4c6c-baa0-60ef35072436 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.313633 Oct 24 09:07:43.989512 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1800/3673] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:07:43 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0/os-interface => generated 285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:43.990355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:43.995830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:43.996024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:43.996807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:44.004913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:44.019014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:44.020932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:44.021940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:44.027922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:44.028841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:44.029519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:44.143846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:44.160768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5f38a69-a7da-40c2-a4fb-babcfca6f1ff tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1276 microversion: 2.1 time: 0.205105 Oct 24 09:07:44.182319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1874/3674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:43 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:44.392285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:44.401447 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-815c62c9-219f-4ec8-ac6c-2d307086e95c tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1251 microversion: 2.1 time: 0.410617 Oct 24 09:07:44.425740 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1801/3675] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:43 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1251 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:44.707982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:44.709338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:44.719124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:44.720087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:44.721725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:44.722991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:44.724781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:44.726893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:44.953057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:44.980364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:44.980894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:44.981373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.035023 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] Creating event network-changed:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h1-master-1 Oct 24 09:07:45.051945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] Instance 5a2d7405-eb56-40e2-b55b-b57117052715 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:07:45.090671 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-44ed0981-23ab-449f-b27c-6d6933d16bdf req-cc9703a6-63ba-4c5e-ac7d-4bac4ece4267 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142179 Oct 24 09:07:45.092301 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1802/3676] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:45.099643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:45.100866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:45.110353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:45.111075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:45.112077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.113082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:45.114113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:45.114876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.135629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:45.148345 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4da2accc-622c-49fe-a2a2-ef257cab419f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.451005 Oct 24 09:07:45.166335 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1875/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:44 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:45.188925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:45.189647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:45.199449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:45.199951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:45.200390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.207674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:45.208372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:45.208988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.592657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:45.605472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb4992b0-b114-44e8-912e-190fc16d7736 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1276 microversion: 2.1 time: 0.419747 Oct 24 09:07:45.608329 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1876/3678] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:45 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1276 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:45.618505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:45.621616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:45.630613 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:45.655414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:45.655926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:45.656377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.657644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:45.658113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:45.658551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:45.818294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:45.831873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e8c4cfe1-b7a7-42a5-a934-d56b2d07ec67 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1251 microversion: 2.1 time: 0.222238 Oct 24 09:07:45.852275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1877/3679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:45 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1251 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:46.178354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:46.178989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:46.199422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:46.199926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:46.200577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:46.202096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:46.203603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:46.204244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:47.332388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:47.340518 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-82ad6c74-f2fc-4ef8-8e4a-f6eb0422a3f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 1.166056 Oct 24 09:07:47.341137 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1878/3680] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:46 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:47.363730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:47.368915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:47.389791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:47.390524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:47.391154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:47.392071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:47.397198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:47.398011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:47.536491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:47.546295 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82cabbe3-b1e6-4ef9-8773-f7db7adfa450 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1474 microversion: 2.1 time: 2.451789 Oct 24 09:07:47.547139 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1803/3681] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:45 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1474 bytes in 2454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:47.552163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:47.553135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:47.585722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:47.587710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:47.588367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:47.593526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:47.594957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:47.595628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:47.768935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e38267e38654eadbefc711d55365c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a15639dcb743da88acbde43c90e3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:47.781040 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15d0e366-af13-44ac-a946-ad9c74fa4b8e tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 200 len: 1251 microversion: 2.1 time: 0.229494 Oct 24 09:07:47.804910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1804/3682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:47 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 1251 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:48.364732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:48.365560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:48.383660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:48.386055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:48.387233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:48.389012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:48.390971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:48.396943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:48.449448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:48.470502 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-54543560-7f96-41a5-98c5-c3b90b1ca4c0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 1.110672 Oct 24 09:07:48.471786 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1879/3683] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:47 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:48.575054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:48.575951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:48.592879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:48.595655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:48.596118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:48.601844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:48.613867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:48.614412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:49.226396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:49.235057 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77a0fc57-1dd0-4fe1-b298-f1c847d8319b tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1474 microversion: 2.1 time: 0.665327 Oct 24 09:07:49.237794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1880/3684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:48 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1474 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:49.256562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:49.266338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] [instance: 20606f53-dad1-4b06-bf59-fa1700228811] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:49.282425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:49.283114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:49.283674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:49.284499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:49.285399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:49.286070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:49.313539 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] HTTP exception thrown: Instance 20606f53-dad1-4b06-bf59-fa1700228811 could not be found. Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Request method failure captured: Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 HTTP/1.1 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlVJUycq8sFdmbTLOf3w59eEUQdyNETLFTga3fAXSvAnvEY2kJzQf0ME8nuR0HOr9BqEHUX6f2s3UKIyx--OKbkOVvms_AtfF7de8-oVhkIuM3W1z8QubmNQFLB-on6nC46rEpKXwV4PlPX_aF1CdeT4rM5uxMnvH7WveN2rv2XNETg Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 62a15639dcb743da88acbde43c90e3a9 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestBootFromVolume-735221082 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62a15639dcb743da88acbde43c90e3a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62a15639dcb743da88acbde43c90e3a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62a15639dcb743da88acbde43c90e3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62a15639dcb743da88acbde43c90e3a9"}]}] Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestBootFromVolume-735221082 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 62a15639dcb743da88acbde43c90e3a9 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestBootFromVolume-735221082 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestBootFromVolume-735221082-project Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 1e38267e38654eadbefc711d55365c91 Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestBootFromVolume-735221082-project Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 20606f53-dad1-4b06-bf59-fa1700228811 could not be found. Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '20606f53-dad1-4b06-bf59-fa1700228811'} Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20606f53-dad1-4b06-bf59-fa1700228811 could not be found. Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20606f53-dad1-4b06-bf59-fa1700228811 could not be found. Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:07:49.319217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20606f53-dad1-4b06-bf59-fa1700228811 could not be found. Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:07:49.325324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Returning 404 to user: Instance 20606f53-dad1-4b06-bf59-fa1700228811 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:07:49.333284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35309224-1d31-423f-9050-6fc9234a596d tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811" status: 404 len: 111 microversion: 2.1 time: 0.080591 Oct 24 09:07:49.334197 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1881/3685] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:49 2022] GET /compute/v2.1/servers/20606f53-dad1-4b06-bf59-fa1700228811 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:07:49.343721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02bada17-b8c6-44ed-9ac0-656c68b23527 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] Calling method '.version_select at 0x7f8daf111e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:49.377203 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02bada17-b8c6-44ed-9ac0-656c68b23527 tempest-ServersTestBootFromVolume-735221082 tempest-ServersTestBootFromVolume-735221082-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866606457" status: 202 len: 0 microversion: 2.1 time: 0.038319 Oct 24 09:07:49.378803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1882/3686] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866606457 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:07:49.500808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:49.501504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:49.515460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:49.516607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:49.517009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:49.518595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:49.521790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:49.522619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:49.807135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:49.815271 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a19edb4c-a188-4bd4-98aa-4f6f50a59c38 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 1.454546 Oct 24 09:07:49.829769 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1805/3687] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:48 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:50.012517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:50.026277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-38406f35-d04d-4244-bfb5-ee37d2c6e73d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.531111 Oct 24 09:07:50.027242 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1883/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:49 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:50.208859 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-922d5cf3-d4e9-4988-826a-30e4310cbacc req-de07b707-01c5-49de-b856-88f6bd45bc6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3738b93f-63e5-4033-8466-b2ac2acf097e", "tag": "ea0b3348-48e8-482b-9f3f-6d4f9a3deb58"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:50.226972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-922d5cf3-d4e9-4988-826a-30e4310cbacc req-de07b707-01c5-49de-b856-88f6bd45bc6b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:50.228157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-922d5cf3-d4e9-4988-826a-30e4310cbacc req-de07b707-01c5-49de-b856-88f6bd45bc6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:50.228717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-922d5cf3-d4e9-4988-826a-30e4310cbacc req-de07b707-01c5-49de-b856-88f6bd45bc6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:50.234942 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:50.258713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:50.259339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:50.260517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-922d5cf3-d4e9-4988-826a-30e4310cbacc req-de07b707-01c5-49de-b856-88f6bd45bc6b service nova] Creating event network-changed:ea0b3348-48e8-482b-9f3f-6d4f9a3deb58 for instance 3738b93f-63e5-4033-8466-b2ac2acf097e on n-h1-master-1 Oct 24 09:07:50.269229 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-922d5cf3-d4e9-4988-826a-30e4310cbacc req-de07b707-01c5-49de-b856-88f6bd45bc6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064049 Oct 24 09:07:50.270443 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1806/3689] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:50.272422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:50.272929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:50.273419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:50.274141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:50.274601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:50.275032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:50.317932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a82a092e-687a-434b-94da-4abf2185506d req-8fed983f-f1b5-4cdc-b50a-d6699c4e5f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8635f451-8133-4276-92fd-a675cbf47ea0", "tag": "403b8d1c-5cad-4793-8ca4-3d666b7fc401"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:50.343509 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:50.356160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a82a092e-687a-434b-94da-4abf2185506d req-8fed983f-f1b5-4cdc-b50a-d6699c4e5f7d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:50.356831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a82a092e-687a-434b-94da-4abf2185506d req-8fed983f-f1b5-4cdc-b50a-d6699c4e5f7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:50.357428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a82a092e-687a-434b-94da-4abf2185506d req-8fed983f-f1b5-4cdc-b50a-d6699c4e5f7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:50.399215 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a82a092e-687a-434b-94da-4abf2185506d req-8fed983f-f1b5-4cdc-b50a-d6699c4e5f7d service nova] Creating event network-changed:403b8d1c-5cad-4793-8ca4-3d666b7fc401 for instance 8635f451-8133-4276-92fd-a675cbf47ea0 on n-h2-master-1 Oct 24 09:07:50.406720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a82a092e-687a-434b-94da-4abf2185506d req-8fed983f-f1b5-4cdc-b50a-d6699c4e5f7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095654 Oct 24 09:07:50.410967 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1807/3690] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:50.844156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:50.844809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:50.864259 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:50.882240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:50.891897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:50.893897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:50.898163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:50.898705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:50.900776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:50.999364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:51.010203 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a33d9d4b-7d4a-4747-87c0-90c47293298a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1472 microversion: 2.1 time: 0.755217 Oct 24 09:07:51.029995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1884/3691] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:50 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1472 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:51.054666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:51.055595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:51.070851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:51.071357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:51.071805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:51.072524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:51.072987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:51.073615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:51.133536 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:51.701882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:51.710424 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eea3a760-c51f-4ece-9d86-ab4a8a7172e4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.663105 Oct 24 09:07:51.722045 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1885/3692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:51 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:52.048078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:52.050340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:52.061444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:52.062283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:52.062921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:52.065097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:52.065952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:52.066567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:52.386977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:52.406696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9bfe510-6fc8-476c-b3d9-b30b55ca0423 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 1.563886 Oct 24 09:07:52.408128 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1808/3693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:50 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:52.752989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:52.754497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:52.775643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:52.776514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:52.778255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:52.781683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:52.782354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:52.783237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:53.305779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:53.318591 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a89c4125-0a66-4110-9d92-eeaecdf590a7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1469 microversion: 2.1 time: 1.272369 Oct 24 09:07:53.320323 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1886/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:52 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1469 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:53.348292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:53.349148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:53.360053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:53.365792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:53.366581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:53.367544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:53.368025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:53.368624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:53.646073 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b0aaf63c-cc45-4714-93e3-1fa8c31991c2 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "POST /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715/action" status: 202 len: 0 microversion: 2.1 time: 0.302176 Oct 24 09:07:53.650905 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1887/3695] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:07:53 2022] POST /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:07:53.664702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:53.685977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:53.704893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:53.705438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:53.705890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:53.706614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:53.707065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:53.707494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:53.842412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:53.880858 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a15792d4-02fe-49f9-ac23-c1d9a97b8fbd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 1.114082 Oct 24 09:07:53.900545 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1809/3696] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:52 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:53.919141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:53.923637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:53.950070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:53.951135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:53.951583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:53.962108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:53.963011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:53.963612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:54.503673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:54.512280 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47607082-8196-4d0c-b1be-16fac09443e7 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.608662 Oct 24 09:07:54.512868 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1810/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:53 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:54.561443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:54.569457 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-496a939c-4dfa-4988-b880-68c657d4f5d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.916783 Oct 24 09:07:54.581756 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1888/3698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:53 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:54.910758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:54.911989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:54.921154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:54.921667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:54.923981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:54.924710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:54.925184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:54.925655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:55.178377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:55.193065 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-226cc426-d2ac-4077-a884-1432e3fa7da0 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.283341 Oct 24 09:07:55.195451 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1811/3699] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:54 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:55.538711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:55.540032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:55.558952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:55.561760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:55.566481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:55.567523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:55.568329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:55.569105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:55.592471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:55.593452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:55.601606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:55.602103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:55.602547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:55.614830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:55.615400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:55.615860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:55.877615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:55.889156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3839f22e-f10a-4039-9cf6-32f02f98cec1 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.354657 Oct 24 09:07:55.890298 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1889/3700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:55 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:55.944549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:55.961806 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c5351d8-d86b-47c5-b660-2f162698ba70 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1511 microversion: 2.1 time: 0.373617 Oct 24 09:07:55.966657 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1812/3701] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:55 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:07:56.218175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:56.218806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:56.229982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:56.230734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:56.231194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:56.233267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:56.234330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:56.235024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:56.367470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "name": "network-vif-plugged", "status": "completed", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:56.391164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:56.391783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:56.392510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:56.450113 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] Creating event network-vif-plugged:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h1-master-1 Oct 24 09:07:56.470817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] Instance 5a2d7405-eb56-40e2-b55b-b57117052715 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:07:56.510046 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-66793358-6abc-42c2-8dcf-88b336a4c521 req-2f2e40c2-4570-418c-92e8-d926bca8e859 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146495 Oct 24 09:07:56.514142 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1813/3702] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:07:56.930666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:56.931980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:56.948535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:56.950383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:56.951604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:56.952590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:56.953282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:56.953981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.009689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:57.029340 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a0798ea-4400-4963-8445-2f99c9e65913 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.814425 Oct 24 09:07:57.048383 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1890/3703] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:56 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:57.068551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:57.069420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:57.077466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:57.080129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:57.080772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.081716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:57.082344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:57.082942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.178397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:57.186504 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-815ad8af-1741-406c-a357-0dae9e6356fd tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.276833 Oct 24 09:07:57.202559 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1814/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:56 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:57.423586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:57.442007 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-017c48c2-96fe-473a-a395-e917095783d3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1488 microversion: 2.1 time: 0.391599 Oct 24 09:07:57.442619 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1891/3705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:57 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1488 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:57.475524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:07:57.478469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:57.488203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:57.488966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:57.489676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.490564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:57.491217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:57.491888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.554988 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c21a206-1370-4448-b4f2-d7b492d963a0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 200 len: 150 microversion: 2.1 time: 0.088392 Oct 24 09:07:57.555751 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1815/3706] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:07:57 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:57.566098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:57.566803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:57.573470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:57.573963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:57.574404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.575108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:57.576342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:57.576895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:57.960218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:57.996318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09dd320a-9e09-401e-9d11-8d89838cded3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.432301 Oct 24 09:07:58.002280 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1892/3707] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:57 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:58.036460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:58.037518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:58.054800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:58.056298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:58.099038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:58.099774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:58.100232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:58.100980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:58.101467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:58.102901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:58.105412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:58.106062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:58.107662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:58.108630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:58.110838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:58.113829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:58.516458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:58.531612 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2228e965-fdc4-48ce-bb7a-d4dc5f998e83 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.499913 Oct 24 09:07:58.533244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:58.541705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5185e8d3-281c-4e93-b205-89985ee2ba6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.490939 Oct 24 09:07:58.556353 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1816/3708] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:58 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:58.561760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:58.566061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1893/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:58 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:58.578561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:58.597851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:58.602309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:58.602816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:58.603578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:58.604516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:58.604947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:58.841850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d82fa483-cbed-4a11-a082-c9d0f18fc5f5 tempest-ComputeTenantNetworksTest-608044928 tempest-ComputeTenantNetworksTest-608044928-project] Calling method '.version_select at 0x7f8daa484700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:59.001162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:59.018347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-408d1c27-bd77-44a8-86da-395abb7d13ea tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.461990 Oct 24 09:07:59.020200 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1817/3710] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:58 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:59.026409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:59.027276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:59.035398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:59.036316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:59.039024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:59.041074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:59.041788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:59.042404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:59.636201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d82fa483-cbed-4a11-a082-c9d0f18fc5f5 tempest-ComputeTenantNetworksTest-608044928 tempest-ComputeTenantNetworksTest-608044928-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.065911 Oct 24 09:07:59.636862 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1894/3711] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 09:07:58 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:07:59.647663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:07:59.649201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:07:59.676808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:59.677391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:59.677840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:59.678581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:07:59.679068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:07:59.679492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:07:59.917724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:07:59.930216 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7973357-50ae-47c3-884a-080dde991df5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.908683 Oct 24 09:07:59.931177 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1818/3712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:59 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:07:59.941585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e219fefc-aac4-49d2-a69b-895118f2a341 tempest-ComputeTenantNetworksTest-608044928 tempest-ComputeTenantNetworksTest-608044928-project] Calling method '.version_select at 0x7f8daaf030d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:00.118920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:00.128621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e213617-e4c4-4a72-a724-f7891e4c9a27 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.488372 Oct 24 09:08:00.136142 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1895/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:07:59 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:00.158464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:00.159337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:00.168240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:00.170455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:00.171007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:00.173321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:00.174108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:00.174794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:00.198365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e219fefc-aac4-49d2-a69b-895118f2a341 tempest-ComputeTenantNetworksTest-608044928 tempest-ComputeTenantNetworksTest-608044928-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/de046197-b9d6-4157-aab6-7bb8bac061bf" status: 200 len: 140 microversion: 2.1 time: 0.265742 Oct 24 09:08:00.199484 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1819/3714] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:07:59 2022] GET /compute/v2.1/os-tenant-networks/de046197-b9d6-4157-aab6-7bb8bac061bf => generated 140 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:00.205875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:00.206606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:00.237988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:00.239311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:00.239884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:00.240721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:00.242911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:00.243786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:00.440367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:00.449983 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dd07392-41cd-4f58-b470-8263f1adb605 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.311366 Oct 24 09:08:00.451214 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1896/3715] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:00 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:00.456095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3d4cf5c5-e83c-4994-9a06-0b997574251e req-97b951bc-ff31-4051-9ccf-faa78c288bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3738b93f-63e5-4033-8466-b2ac2acf097e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0b3348-48e8-482b-9f3f-6d4f9a3deb58"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:00.467167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3d4cf5c5-e83c-4994-9a06-0b997574251e req-97b951bc-ff31-4051-9ccf-faa78c288bc7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:00.467932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3d4cf5c5-e83c-4994-9a06-0b997574251e req-97b951bc-ff31-4051-9ccf-faa78c288bc7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:00.468537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3d4cf5c5-e83c-4994-9a06-0b997574251e req-97b951bc-ff31-4051-9ccf-faa78c288bc7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:00.506741 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3d4cf5c5-e83c-4994-9a06-0b997574251e req-97b951bc-ff31-4051-9ccf-faa78c288bc7 service nova] Creating event network-vif-plugged:ea0b3348-48e8-482b-9f3f-6d4f9a3deb58 for instance 3738b93f-63e5-4033-8466-b2ac2acf097e on n-h1-master-1 Oct 24 09:08:00.519910 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3d4cf5c5-e83c-4994-9a06-0b997574251e req-97b951bc-ff31-4051-9ccf-faa78c288bc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067223 Oct 24 09:08:00.520516 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1897/3716] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:00.697807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-109897738", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "cbf671c7-9a45-4411-9bbb-7fbeb13e5538"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:00.766803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:00.774770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] validate_networks() for [('cbf671c7-9a45-4411-9bbb-7fbeb13e5538', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:08:00.780231 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b87b5d30-63dc-4710-ae26-f1ba867689b4 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.579225 Oct 24 09:08:00.781519 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1820/3717] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:00 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:01.181871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:01.183248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:01.193715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:01.194297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:01.194820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:01.195607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:01.196646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:01.197827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:01.434705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:08:01.435861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:08:01.436623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:08:01.437221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:08:01.437919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:08:01.456512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:01.457333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:01.458049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:01.460875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:01.461560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:01.462151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:01.494313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:08:01.501134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for user c703cc73a22749858ffe05500e52aa03 and project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:08:01.515904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:08:01.518407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:08:01.531563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:01.542859 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01e4b563-f77d-4942-8eae-fbb640848de7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1318 microversion: 2.1 time: 0.383287 Oct 24 09:08:01.562318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1821/3718] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:01 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:01.581714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "name": "network-vif-unplugged", "status": "completed", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:01.614349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:01.614845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:01.615287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:01.645628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] Creating event network-vif-unplugged:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h2-master-1 Oct 24 09:08:01.657782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] Instance 5a2d7405-eb56-40e2-b55b-b57117052715 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:08:01.667316 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d0bb960-cf8b-44d4-814f-c37f18b9ee43 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972377 Oct 24 09:08:01.673157 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1898/3719] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:08:01.684430 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7875aae5-2107-41e5-90d3-1ac4c9a6a1a0 req-6504fb49-886e-4daa-ac32-40972fb622c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120025 Oct 24 09:08:01.687208 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1822/3720] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:01.692638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-326feb11-3943-4e54-ae5f-f1484ea22773 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:01.696250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-326feb11-3943-4e54-ae5f-f1484ea22773 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:01.964872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-326feb11-3943-4e54-ae5f-f1484ea22773 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:01.982477 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-326feb11-3943-4e54-ae5f-f1484ea22773 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1214 microversion: 2.1 time: 0.305367 Oct 24 09:08:01.987634 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1899/3721] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:01 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:02.168941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:02.172242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:02.199125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:02.199969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:02.200650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:02.201485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:02.202132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:02.204934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:02.574676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:02.575298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:02.594700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:02.596685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:02.597147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:02.598148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:02.598714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:02.601013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:02.678145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:02.688928 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3d5df71-ccd4-4c06-8b74-71a154722655 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.888577 Oct 24 09:08:02.699074 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1823/3722] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:01 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:02.857232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:02.870979 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b47692a-fbf2-47ef-96de-810b848c4dfc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1508 microversion: 2.1 time: 0.299181 Oct 24 09:08:02.878147 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1900/3723] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:02 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:02.897544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:02.898253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:02.910828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:02.915705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:02.915705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:02.915705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:02.915705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:02.915705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.011811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:03.012618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:03.023282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.025367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.026798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.033452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.034286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.035005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.221866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:03.231258 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e57cb2f-edad-449a-a114-aba6244b2bde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1266 microversion: 2.1 time: 0.224662 Oct 24 09:08:03.236796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1901/3724] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:03 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:03.535791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:03.545144 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3841ccf-c734-4429-8ac9-7bd8dab73ea9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1508 microversion: 2.1 time: 0.652232 Oct 24 09:08:03.547596 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1824/3725] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:02 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:03.570757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:03.574142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:03.588922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.590407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.592260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.593273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.594208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.597843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.721410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:03.726209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:03.739096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.741000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.741770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.745357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.746128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.746841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.767371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:08:03.768092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:08:03.768859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:08:03.769466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:08:03.770088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:08:03.844945 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:03.893246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:03.902877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.904976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.905824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.908059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:03.909006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:03.909807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:03.988176 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "POST /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e/action" status: 202 len: 1110 microversion: 2.1 time: 0.421845 Oct 24 09:08:03.994857 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1902/3726] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:03 2022] POST /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e/action => generated 1110 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 09:08:04.002815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:04.004619 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40c31479-13f0-4cae-990d-9423b8493e92 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008546 Oct 24 09:08:04.007239 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1903/3727] 10.222.0.25 () {56 vars in 886 bytes} [Mon Oct 24 09:08:03 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 09:08:04.027263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:04.043500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:04.044792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:04.045532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:04.068279 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] Creating event network-changed:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h2-master-1 Oct 24 09:08:04.076889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] Instance 5a2d7405-eb56-40e2-b55b-b57117052715 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:08:04.090241 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0d517ee3-1270-4c0f-af86-3e2c4e353a0b req-8a5b436b-44bb-4fc3-a094-5c0a2e32cb02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067983 Oct 24 09:08:04.095655 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1904/3728] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:04.101105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:04.109875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:04.120883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:04.121718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:04.122957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:04.123855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:04.124749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:04.125659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:04.611244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:04.631506 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.914193 Oct 24 09:08:04.649450 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1825/3729] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:03 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:04.654666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:04.656361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4966ec6-314a-42bb-a713-efda46597e15 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004895 Oct 24 09:08:04.658582 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1826/3730] 10.222.0.25 () {54 vars in 1035 bytes} [Mon Oct 24 09:08:04 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 24 09:08:04.669023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:04.673486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:04.683712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:04.684524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:04.685870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:04.686805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:04.687833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:04.689274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:04.715040 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:04.892613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:04.907818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1272 microversion: 2.1 time: 0.247810 Oct 24 09:08:04.909233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1827/3731] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:04 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:04.910721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:04.912359 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001637 Oct 24 09:08:04.920400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:04.925160 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1828/3732] 10.222.0.25 () {54 vars in 1041 bytes} [Mon Oct 24 09:08:04 2022] GET /compute/v2.1/ => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:04.926559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:04.928347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55cfb2d0-0f4f-4a7a-95a4-69e2235e7b3d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002081 Oct 24 09:08:04.928888 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1829/3733] 10.222.0.25 () {56 vars in 886 bytes} [Mon Oct 24 09:08:04 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 09:08:04.930665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04103fd6-0505-4011-82a0-847fdbd27215 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.833704 Oct 24 09:08:04.931508 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1905/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:04 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:05.662093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:05.662831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:05.675217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:05.675865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:05.676376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:05.677543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:05.678103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:05.679097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:05.939655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:05.940977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:05.957115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:05.958206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:05.958867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:05.959895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:05.961412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:05.962328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:05.997748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:06.005917 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a722d51-fce7-442a-854d-15671d20f266 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1468 microversion: 2.1 time: 0.349503 Oct 24 09:08:06.010442 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1830/3735] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:05 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:06.050044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:06.052067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:06.070671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:06.071156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:06.071852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:06.072559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:06.073209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:06.073989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:06.095696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:06.107667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbd28bcc-28e2-4bf1-8c23-d48f0179d186 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1272 microversion: 2.1 time: 0.175410 Oct 24 09:08:06.111560 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1906/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:05 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:06.531585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:06.546290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a59ba22-acea-45fa-9ce2-01cead75657a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.530469 Oct 24 09:08:06.547530 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1831/3737] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:06 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:07.039657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:07.040364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:07.074134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:07.074857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:07.078506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:07.079384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:07.083547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:07.084139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:07.137950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:07.139306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:07.157231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:07.170397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:07.172596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:07.176160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:07.181881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:07.182997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:07.776168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:07.788652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1df8136a-ab3e-488e-9c0e-087089077bad tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1461 microversion: 2.1 time: 0.752616 Oct 24 09:08:07.789290 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1907/3738] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:07 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1461 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:07.798941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:07.799848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:07.819776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:07.820724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:07.823883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:07.827421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:07.828366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:07.829887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:08.183070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:08.200643 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3b007ff2-4169-483c-b702-feb274c82e9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 1.067094 Oct 24 09:08:08.201700 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1832/3739] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:07 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:08.211764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:08.212706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:08.228615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:08.230098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:08.230558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:08.231283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:08.232285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:08.232725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:08.469356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:08.487784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e88173d-f123-40be-90b0-af55572f4ccc tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.692672 Oct 24 09:08:08.496240 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1908/3740] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:07 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:08.961347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41bfdebb-3930-427f-9861-da1e2f9a32d8 tempest-MigrationsAdminTest-503076301 tempest-MigrationsAdminTest-503076301-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1612 microversion: 2.1 time: 0.758364 Oct 24 09:08:08.981321 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1833/3741] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:08 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1612 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:09.008611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:09.010607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:09.027379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.028271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.028936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.030963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.033391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.034199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.079672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:09.223403 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6c05940-520c-4121-ba04-6e0385ba6dae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 204 len: 0 microversion: 2.1 time: 0.224316 Oct 24 09:08:09.225221 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1909/3742] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:08 2022] DELETE /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:08:09.230952 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:09.233388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:09.239379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:09.239647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:09.256386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.260379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.261025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.261996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.263734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.264952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.266649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.267658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.269068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.271088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.272094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.273038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.770612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:09.787764 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-522c8405-6819-49cb-b767-565507c742aa tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1467 microversion: 2.1 time: 0.556257 Oct 24 09:08:09.791956 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1910/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:09 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1467 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:09.812356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:09.813420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:09.826535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.827251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.828649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.829627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:09.832487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:09.833209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:09.956473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:09.974098 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c76cdba-2148-4a45-aaa4-eb871083b458 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.749488 Oct 24 09:08:09.976287 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1834/3744] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:09 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:09.984259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-76ae1c31-74bb-4319-a49a-059ec7a1784f req-848df729-56b1-42a2-a827-6c5f60903e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d345468d-80a3-4cc4-a6c7-d25cabb0c9b8", "tag": "9924c37c-e0ea-4b2b-85c3-193d00b9de74"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:10.019184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76ae1c31-74bb-4319-a49a-059ec7a1784f req-848df729-56b1-42a2-a827-6c5f60903e8f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:10.020002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76ae1c31-74bb-4319-a49a-059ec7a1784f req-848df729-56b1-42a2-a827-6c5f60903e8f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:10.020965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76ae1c31-74bb-4319-a49a-059ec7a1784f req-848df729-56b1-42a2-a827-6c5f60903e8f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:10.043243 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-76ae1c31-74bb-4319-a49a-059ec7a1784f req-848df729-56b1-42a2-a827-6c5f60903e8f service nova] Creating event network-changed:9924c37c-e0ea-4b2b-85c3-193d00b9de74 for instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 on n-h2-master-1 Oct 24 09:08:10.052593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-76ae1c31-74bb-4319-a49a-059ec7a1784f req-848df729-56b1-42a2-a827-6c5f60903e8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074656 Oct 24 09:08:10.054098 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1835/3745] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:10.492797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:10.501222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-940af2d3-1b1e-43ea-9c93-eb9071f33291 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.707581 Oct 24 09:08:10.503733 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1911/3746] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:09 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:10.542458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f97ff84-e34f-4f7d-b2f2-e3e03e23ecf2 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8dab3ae4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:10.634396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f97ff84-e34f-4f7d-b2f2-e3e03e23ecf2 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c9131ca5-3c00-4de1-9337-6dee5ad0b2d0" status: 200 len: 351 microversion: 2.1 time: 0.094297 Oct 24 09:08:10.635149 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1836/3747] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:08:10 2022] GET /compute/v2.1/os-volumes/c9131ca5-3c00-4de1-9337-6dee5ad0b2d0 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:10.819127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b0d66ef7-72df-489f-8e80-405f671a0b6a req-c869fe0f-9786-4f1e-a7db-c90307430640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "name": "network-vif-plugged", "status": "completed", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:10.821430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:10.824608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:10.847587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:10.849803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:10.850358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:10.855098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:10.858178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:10.860299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:10.864118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b0d66ef7-72df-489f-8e80-405f671a0b6a req-c869fe0f-9786-4f1e-a7db-c90307430640 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:10.866632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b0d66ef7-72df-489f-8e80-405f671a0b6a req-c869fe0f-9786-4f1e-a7db-c90307430640 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:10.869342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b0d66ef7-72df-489f-8e80-405f671a0b6a req-c869fe0f-9786-4f1e-a7db-c90307430640 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:10.893432 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b0d66ef7-72df-489f-8e80-405f671a0b6a req-c869fe0f-9786-4f1e-a7db-c90307430640 service nova] Creating event network-vif-plugged:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h2-master-1 Oct 24 09:08:10.920070 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b0d66ef7-72df-489f-8e80-405f671a0b6a req-c869fe0f-9786-4f1e-a7db-c90307430640 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105230 Oct 24 09:08:10.930881 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1837/3748] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:11.000355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:11.001633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:11.008542 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=76 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:11.011082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:11.011733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:11.013214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:11.015090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:11.020099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:11.020698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:11.474488 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:11.515656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:11.520517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:11.527750 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41ed72c7-a36a-4067-9177-77307ca9ed20 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.531520 Oct 24 09:08:11.533676 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1838/3749] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:10 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:11.535056 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8c2fbb9-7f55-48ca-aec9-68d84f8c176d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1467 microversion: 2.1 time: 0.724776 Oct 24 09:08:11.536085 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1912/3750] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:10 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1467 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:11.548315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:11.548973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:11.577189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:11.577833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:11.584278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:11.585228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:11.585821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:11.586343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:11.841845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:11.852152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61ecb536-6f33-40f3-8513-9f1540536cc7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.317315 Oct 24 09:08:11.855145 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1839/3751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:11 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:12.554252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:12.557349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:12.561536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:12.562776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:12.563575 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:12.565539 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:12.567151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.567757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.568206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:12.569017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.569510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.569948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:12.580800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.582037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.582037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:12.583427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.583427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.583653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:12.760436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:12.769916 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73275f87-9ad9-4100-9718-d77a07d657b4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.222169 Oct 24 09:08:12.770885 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1913/3752] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:12 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:12.776084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cdb84acf-cd6f-4bbe-aa59-9e83e3dd0e7b req-f61d4f09-451e-4ee4-a489-efc4a2c2a93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2d7405-eb56-40e2-b55b-b57117052715", "name": "network-vif-deleted", "tag": "a10252da-027d-434d-ab70-b56284324e73"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:12.786623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cdb84acf-cd6f-4bbe-aa59-9e83e3dd0e7b req-f61d4f09-451e-4ee4-a489-efc4a2c2a93c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.787331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cdb84acf-cd6f-4bbe-aa59-9e83e3dd0e7b req-f61d4f09-451e-4ee4-a489-efc4a2c2a93c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.787846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cdb84acf-cd6f-4bbe-aa59-9e83e3dd0e7b req-f61d4f09-451e-4ee4-a489-efc4a2c2a93c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:12.801169 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cdb84acf-cd6f-4bbe-aa59-9e83e3dd0e7b req-f61d4f09-451e-4ee4-a489-efc4a2c2a93c service nova] Creating event network-vif-deleted:a10252da-027d-434d-ab70-b56284324e73 for instance 5a2d7405-eb56-40e2-b55b-b57117052715 on n-h2-master-1 Oct 24 09:08:12.806583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cdb84acf-cd6f-4bbe-aa59-9e83e3dd0e7b req-f61d4f09-451e-4ee4-a489-efc4a2c2a93c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033966 Oct 24 09:08:12.807317 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1914/3753] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:12.881508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:12.882502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:12.890328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.890982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.891739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:12.892622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:12.893330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:12.893860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:13.068781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:13.072073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:13.079247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84b92466-ca7b-4482-ad3f-b65d22b3891c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1425 microversion: 2.1 time: 0.521781 Oct 24 09:08:13.080764 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1840/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:12 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1425 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:13.083297 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e4072f8-c951-4c69-b207-f372a0d4548f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.206940 Oct 24 09:08:13.084064 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1915/3755] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:12 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:13.502581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-916ebc67-90f4-49cc-9bb3-02931ee9df69 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daa0c33a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:13.567099 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-916ebc67-90f4-49cc-9bb3-02931ee9df69 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3eedb482-af71-40d6-9e99-5f8396c2c94d" status: 200 len: 351 microversion: 2.1 time: 0.070085 Oct 24 09:08:13.568435 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1841/3756] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:08:13 2022] GET /compute/v2.1/os-volumes/3eedb482-af71-40d6-9e99-5f8396c2c94d => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:13.795882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:13.796991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:13.818902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:13.819706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:13.820139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:13.821074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:13.821581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:13.822449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:14.104328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:14.119937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:14.120490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:14.130424 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a87fbc20-a643-4a85-b53c-56a752741dc9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.340794 Oct 24 09:08:14.131824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1916/3757] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:13 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:14.136870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:14.137193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:14.138268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:14.138908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:14.140118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:14.142474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:14.143432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:14.147449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:14.152747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:14.154090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:14.154763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:14.155685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:14.156414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:14.157072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:14.224024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:14.224793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:14.225435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:14.226071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lazy-loading 'fault' on Instance uuid 5a2d7405-eb56-40e2-b55b-b57117052715 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:08:14.319233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:14.327380 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d646f2c-303e-48e7-80f4-a83655f06a2a tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 200 len: 1302 microversion: 2.1 time: 0.228389 Oct 24 09:08:14.328165 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1842/3758] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:14 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 1302 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:14.391008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:14.402146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59eae66a-3817-4fe9-b4b4-b127fd814247 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.269056 Oct 24 09:08:14.403119 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1917/3759] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:14 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:15.158650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:15.159502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:15.168113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.175190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.176648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.177712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.180179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.180842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.352960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:15.354375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5a2d7405-eb56-40e2-b55b-b57117052715] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:15.367477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.381596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.382691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.384302 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.385604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.387474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.431939 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] HTTP exception thrown: Instance 5a2d7405-eb56-40e2-b55b-b57117052715 could not be found. Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Request method failure captured: Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 HTTP/1.1 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlTCsbXJYT0ag7gnkF9G17j9T2tac9PM7sH7xsBzvI2g4VukXHnQrWyFaafqIocfakJLPp9X3mjcdJXVmx_8KsMMZo-VjczuaSCn-8apcJfSBsLZKTzGgXCxBb1EnP9X9nIOcBwonTSJmPqPG58qW_Is7kAT2k98UbBrB3WzY29pfJY Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72b5d3aef4214073b745477d3d48442b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72b5d3aef4214073b745477d3d48442b"}]}] Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 4dde4bb72f914457a633358837d178de Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 5a2d7405-eb56-40e2-b55b-b57117052715 could not be found. Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5a2d7405-eb56-40e2-b55b-b57117052715'} Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2d7405-eb56-40e2-b55b-b57117052715 could not be found. Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2d7405-eb56-40e2-b55b-b57117052715 could not be found. Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:15.439793 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2d7405-eb56-40e2-b55b-b57117052715 could not be found. Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Returning 404 to user: Instance 5a2d7405-eb56-40e2-b55b-b57117052715 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a8e98fd-804f-42a2-8fa2-2d5155d30c5f tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715" status: 404 len: 111 microversion: 2.1 time: 0.093135 Oct 24 09:08:15.447391 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1918/3760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:15 2022] GET /compute/v2.1/servers/5a2d7405-eb56-40e2-b55b-b57117052715 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:08:15.452686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:15.454401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:15.471321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.472093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.472570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.474696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.476237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.478217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.531899 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:15.722167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:15.728942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:15.736839 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71beb211-7f77-4748-8849-f1a80eb072a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.583086 Oct 24 09:08:15.738823 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1843/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:15 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:15.739776 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-593ab2dc-ef9f-43ce-92a8-5215155ddbba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.295859 Oct 24 09:08:15.745249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:15.746267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:15.749751 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1919/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:15 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:15.757789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.758527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.758970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.759712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.760170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.760599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.809125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:15.922825 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e258d9c7-deea-477d-a246-b9c238368929 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 204 len: 0 microversion: 2.1 time: 0.180568 Oct 24 09:08:15.924457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1844/3763] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:15 2022] DELETE /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:08:15.933350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:15.934408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:15.942144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.942656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.943766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:15.944490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:15.945184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:15.945885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:16.119889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:16.131351 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-570373b4-9534-4613-82b2-d808bcea3cb8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1534 microversion: 2.1 time: 0.202650 Oct 24 09:08:16.132732 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1920/3764] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:15 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1534 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:16.272650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-426805415", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "2a6a477b-9acb-41b7-b06d-493887e80b17"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:16.287054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-88e007b0-dfde-46b3-9268-c53336900a3d tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daa4904c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:16.334796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] validate_networks() for [('2a6a477b-9acb-41b7-b06d-493887e80b17', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:08:16.351995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-88e007b0-dfde-46b3-9268-c53336900a3d tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed7e4ded-2a75-4658-a0dd-d4dc90abfa0d" status: 200 len: 350 microversion: 2.1 time: 0.070355 Oct 24 09:08:16.362090 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1921/3765] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:08:16 2022] GET /compute/v2.1/os-volumes/ed7e4ded-2a75-4658-a0dd-d4dc90abfa0d => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:16.367700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b6ea2add-2be8-443b-8c55-68c496b21042 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daa442b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:16.527552 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b6ea2add-2be8-443b-8c55-68c496b21042 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.163705 Oct 24 09:08:16.528482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1922/3766] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:08:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:16.550828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-045badce-be4e-4084-b428-2022bc69fe93 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daa442f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:16.705046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-045badce-be4e-4084-b428-2022bc69fe93 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.160970 Oct 24 09:08:16.706556 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1923/3767] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 09:08:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:16.722965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5b54cfe-107a-4988-8e85-c631af7168d0 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daf2bfa60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:16.871209 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5b54cfe-107a-4988-8e85-c631af7168d0 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.153433 Oct 24 09:08:16.872283 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1924/3768] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:08:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:16.877434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:16.878226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:16.886718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:16.898116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:16.898594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:16.899369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:16.905048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:16.905857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:16.984323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:08:16.984781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:08:16.985261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:08:16.985696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:08:16.986138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:08:16.995814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:16.996361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:16.996749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:16.997556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:16.998026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:16.998490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:17.017697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Getting quotas for project 567f2f97a829442d95c67be784f82734. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:08:17.023967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Getting quotas for user 1f771366ecb64bc38869072b6d3cc06e and project 567f2f97a829442d95c67be784f82734. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:08:17.039603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:08:17.042072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:08:17.124318 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19779909-1158-4ed6-b474-20cda43dd76e tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998868 Oct 24 09:08:17.136239 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1845/3769] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:08:17.160241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:17.160994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:17.179248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:17.179748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:17.184862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:17.185759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:17.186241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:17.186679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:17.259908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:17.269036 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-39119f21-a6af-4c3f-bc0c-6026ae1dec96 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.395649 Oct 24 09:08:17.272834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1925/3770] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:16 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:17.286011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1f6e87f-7464-42f9-b97b-e2763ef31f11 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daa4505e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:17.490219 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1f6e87f-7464-42f9-b97b-e2763ef31f11 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.211946 Oct 24 09:08:17.492078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1926/3771] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 09:08:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:17.498306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a87add5-9253-4503-a377-69702c7a5738 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:17.499343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a87add5-9253-4503-a377-69702c7a5738 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:17.584109 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6a87add5-9253-4503-a377-69702c7a5738 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:17.592408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a87add5-9253-4503-a377-69702c7a5738 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1224 microversion: 2.1 time: 0.098921 Oct 24 09:08:17.593569 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1927/3772] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:17 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:17.598516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:17.599324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:17.606009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:17.607420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:17.608040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:17.609883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:17.610541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:17.611244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:17.759340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:17.771040 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf6dc382-9fac-4e85-a8d6-1ab3d617a2bd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.633436 Oct 24 09:08:17.775190 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1846/3773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:17 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:17.788873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13d3fff9-fc78-4c40-aa91-27f140353493 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8dab3ee040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:17.806040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:17.814574 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44f5ffbf-63fa-47b8-9f12-01c05b63473c tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1534 microversion: 2.1 time: 0.219714 Oct 24 09:08:17.817437 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1928/3774] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:17 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1534 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:17.985842 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13d3fff9-fc78-4c40-aa91-27f140353493 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.209070 Oct 24 09:08:17.986762 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1847/3775] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 09:08:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:18.014460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb35cef8-1439-4b5e-abc7-9bbbee5ae2c8 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8dab3c5c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.156271 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb35cef8-1439-4b5e-abc7-9bbbee5ae2c8 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.152475 Oct 24 09:08:18.157051 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1929/3776] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:18.171323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17842a69-296f-41fa-bfd9-b5286f8f7c72 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daaef0670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.305492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.306276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:18.318822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.319777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.322429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.324894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.325478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.325953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.367341 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17842a69-296f-41fa-bfd9-b5286f8f7c72 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199944 Oct 24 09:08:18.377282 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1848/3777] 10.222.0.25 () {58 vars in 1188 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:18.384733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adf5d861-5b12-48da-ba0c-87bfdbd3c3c0 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] Calling method '.version_select at 0x7f8daae42940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.559168 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-adf5d861-5b12-48da-ba0c-87bfdbd3c3c0 tempest-VolumesTestJSON-1149172855 tempest-VolumesTestJSON-1149172855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.180108 Oct 24 09:08:18.559819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1849/3778] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:18.575073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cce6af16-69bb-4408-a933-9471afbf3c67 req-b48dfd78-fed1-4ae9-91ad-6ffeb9ac3b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d345468d-80a3-4cc4-a6c7-d25cabb0c9b8", "name": "network-vif-plugged", "status": "completed", "tag": "9924c37c-e0ea-4b2b-85c3-193d00b9de74"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:18.616949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cce6af16-69bb-4408-a933-9471afbf3c67 req-b48dfd78-fed1-4ae9-91ad-6ffeb9ac3b13 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.619293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cce6af16-69bb-4408-a933-9471afbf3c67 req-b48dfd78-fed1-4ae9-91ad-6ffeb9ac3b13 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.620112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cce6af16-69bb-4408-a933-9471afbf3c67 req-b48dfd78-fed1-4ae9-91ad-6ffeb9ac3b13 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.664260 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cce6af16-69bb-4408-a933-9471afbf3c67 req-b48dfd78-fed1-4ae9-91ad-6ffeb9ac3b13 service nova] Creating event network-vif-plugged:9924c37c-e0ea-4b2b-85c3-193d00b9de74 for instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 on n-h2-master-1 Oct 24 09:08:18.679470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cce6af16-69bb-4408-a933-9471afbf3c67 req-b48dfd78-fed1-4ae9-91ad-6ffeb9ac3b13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107578 Oct 24 09:08:18.682717 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1850/3779] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:18.732378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.733568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:18.741070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.742884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.743509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.746440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.747320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.747998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.780755 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:18.843340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:18.868046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7fcd8a20-12f2-4415-9779-59dcd8f6e52f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.574907 Oct 24 09:08:18.874016 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1930/3780] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:18.891923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.896007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:18.907987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.907987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.907987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.907987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.907987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.907987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.927471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:18.937615 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a3556ad-4103-40f5-b380-6507fdece4a6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1276 microversion: 2.1 time: 0.251310 Oct 24 09:08:18.938687 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1851/3781] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:18.952654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:18.952654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:18.963066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.963567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.964008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:18.964727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:18.965203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:18.971297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:19.261864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:19.272689 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92d49896-e505-4fca-a677-a32ec5875500 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 200 len: 1492 microversion: 2.1 time: 0.331467 Oct 24 09:08:19.273284 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1852/3782] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 1492 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:19.441268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-561472f5-661d-4956-90cc-168e09b44873 req-7962b3d2-444a-4f7e-b19b-0ed5e692c9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e4203-b14c-4c3c-98e5-71878225156a", "name": "network-vif-deleted", "tag": "97545f39-6a21-4845-ad2b-cc9bab2e2586"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:19.459559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:19.463893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-561472f5-661d-4956-90cc-168e09b44873 req-7962b3d2-444a-4f7e-b19b-0ed5e692c9de service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:19.464618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-561472f5-661d-4956-90cc-168e09b44873 req-7962b3d2-444a-4f7e-b19b-0ed5e692c9de service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:19.465260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-561472f5-661d-4956-90cc-168e09b44873 req-7962b3d2-444a-4f7e-b19b-0ed5e692c9de service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:19.468777 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d4125b9-88b1-4026-b84d-bbb138590c99 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.594903 Oct 24 09:08:19.472986 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1931/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:18 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:19.495682 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-561472f5-661d-4956-90cc-168e09b44873 req-7962b3d2-444a-4f7e-b19b-0ed5e692c9de service nova] Creating event network-vif-deleted:97545f39-6a21-4845-ad2b-cc9bab2e2586 for instance 5c4e4203-b14c-4c3c-98e5-71878225156a on n-h1-master-1 Oct 24 09:08:19.516093 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-561472f5-661d-4956-90cc-168e09b44873 req-7962b3d2-444a-4f7e-b19b-0ed5e692c9de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072994 Oct 24 09:08:19.516998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1853/3784] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:08:19.897647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:19.898931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:19.914449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:19.915890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:19.916348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:19.917085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:19.917580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:19.920382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:19.968594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:19.969344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:19.987414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:19.988145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:19.988813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:19.989680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:19.990362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:19.991020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.107522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:20.124411 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-074da08f-69ed-4b62-8695-c0a2845de941 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1282 microversion: 2.1 time: 0.161170 Oct 24 09:08:20.125641 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1854/3785] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:19 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:20.132417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:20.145494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:20.157095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.157703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.158265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.159087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.159653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.160530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.199026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:20.362967 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de58664f-b75f-4711-b8ff-ecc58e69afc2 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 204 len: 0 microversion: 2.1 time: 0.235856 Oct 24 09:08:20.364209 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1855/3786] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:20 2022] DELETE /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:08:20.374301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:20.377723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: 5c4e4203-b14c-4c3c-98e5-71878225156a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:20.415384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.423764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.425432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.426213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.428917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.430124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.454994 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] HTTP exception thrown: Instance 5c4e4203-b14c-4c3c-98e5-71878225156a could not be found. Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Request method failure captured: Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a HTTP/1.1 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTCsbXJYT0ag7gnkF9G17j9T2tac9PM7sH7xsBzvI2g4VukXHnQrWyFaafqIocfakJLPp9X3mjcdJXVmx_8KsMMZo-VjczuaSCn-8apcJfSBsLZKTzGgXCxBb1EnP9X9nIOcBwonTSJmPqPG58qW_Is7kAT2k98UbBrB3WzY29pfJY Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72b5d3aef4214073b745477d3d48442b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72b5d3aef4214073b745477d3d48442b"}]}] Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4dde4bb72f914457a633358837d178de Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 5c4e4203-b14c-4c3c-98e5-71878225156a could not be found. Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '5c4e4203-b14c-4c3c-98e5-71878225156a'} Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4e4203-b14c-4c3c-98e5-71878225156a could not be found. Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4e4203-b14c-4c3c-98e5-71878225156a could not be found. Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:20.458143 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4e4203-b14c-4c3c-98e5-71878225156a could not be found. Oct 24 09:08:20.464882 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:20.467126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Returning 404 to user: Instance 5c4e4203-b14c-4c3c-98e5-71878225156a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:20.468741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b27d4eda-fffc-402a-923c-cbfbb9085282 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a" status: 404 len: 111 microversion: 2.1 time: 0.102966 Oct 24 09:08:20.470741 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1856/3787] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:20 2022] GET /compute/v2.1/servers/5c4e4203-b14c-4c3c-98e5-71878225156a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:08:20.478030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:20.478904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:20.486338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.488090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.488754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.490325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.490985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.491586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.526656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:20.539697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c10d64f-abc0-4c45-83a3-7dab7f3ec147 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.646219 Oct 24 09:08:20.540306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1932/3788] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:19 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:20.558512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-458c8d24-9472-446e-a8de-e55db2434e90 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '.version_select at 0x7f8dab0a2d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:20.604450 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-458c8d24-9472-446e-a8de-e55db2434e90 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-260237284" status: 202 len: 0 microversion: 2.1 time: 0.058363 Oct 24 09:08:20.605794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1933/3789] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:08:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-260237284 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:20.617415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:20.618760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:20.656126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.656700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.657535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.658332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:20.658808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:20.659249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:20.932624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:20.948065 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-630d0ce9-6cb9-4a1b-a533-0ea939c2256c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1667 microversion: 2.1 time: 0.475760 Oct 24 09:08:20.953046 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1857/3790] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:20 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1667 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:21.150951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:21.151460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:21.160079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:21.170362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:21.171522 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-255cff9f-5dd3-446b-bcac-6a9192d08725 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1314 microversion: 2.1 time: 0.563969 Oct 24 09:08:21.172130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1934/3791] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:20 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:21.173086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:21.177242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:21.196748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:21.198425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:21.203041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:21.357013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:21.365943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-424a124f-f07c-4438-9027-d8b5b9926355 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1282 microversion: 2.1 time: 0.219862 Oct 24 09:08:21.366879 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1858/3792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:21 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:21.571322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:21.572284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:21.585240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:21.588128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:21.592115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:21.593209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:21.593997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:21.594693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:21.976625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:21.977700 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:21.988848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:21.990750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:21.991431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:21.993181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:21.995593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:21.998036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.138062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:22.159128 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b64784f-51b3-4d28-b58a-4b02929f41da tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.592781 Oct 24 09:08:22.161159 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1935/3793] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:21 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:22.206306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:22.207304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:22.224178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:22.225016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:22.225823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.229734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:22.230460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:22.231093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.666668 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:22.686109 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9adac6fa-418f-4600-95ca-5b7e0ddcbd80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1501 microversion: 2.1 time: 0.491228 Oct 24 09:08:22.688796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1936/3794] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:22 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1501 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:22.696189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:22.697688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:22.712091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:22.713105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:22.713748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.715057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:22.716850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:22.718201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.856650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:22.869673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c1cb66e-4f7c-4576-9fc3-bfbb3c6d22d9 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1667 microversion: 2.1 time: 0.896724 Oct 24 09:08:22.870271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1859/3795] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:21 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1667 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:22.884037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:22.889995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:22.910161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:22.913462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:22.914126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.915265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:22.916051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:22.916677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:22.999034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2197e6d-6b44-4220-befa-8ef5227bac91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.118116 Oct 24 09:08:22.999034 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1860/3796] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:22 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:08:23.188418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:23.189479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:23.202191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:23.206848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:23.207558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:23.208493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:23.209128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:23.209782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:23.790993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:23.799981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61c1caba-d314-48f5-aa07-12354a48c19b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.616116 Oct 24 09:08:23.804854 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1861/3797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:23 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:23.811460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:23.816959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:23.856058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:23.859047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:23.859563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:23.860228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:23.860864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:23.861532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:23.917455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:23.951436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:23.968592 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ebce39d6-7208-478a-b3a8-def206ca87b8 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 1.276883 Oct 24 09:08:23.984963 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1937/3798] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:22 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:23.999078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:24.003789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:24.035416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.036515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:24.037905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:24.043204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.046195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:24.047245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:24.124091 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-454a9f72-b4cd-480c-9edb-14c6aee0e9c0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 204 len: 0 microversion: 2.1 time: 0.316710 Oct 24 09:08:24.125062 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1862/3799] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:23 2022] DELETE /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:08:24.133033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:24.135979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:24.157693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.158237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:24.160520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:24.161281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.163487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:24.164147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:24.318062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:24.337515 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-586bad35-7ec9-426e-a513-ac20f44c39bb tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1600 microversion: 2.1 time: 0.355937 Oct 24 09:08:24.338167 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1938/3800] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:23 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1600 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:24.343022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:24.353890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:24.368772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.369289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:24.369764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:24.370495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.370962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:24.371397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:24.932325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:24.947314 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8dcf8afe-348b-4b1b-ae40-9fc3afd4fe9d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1469 microversion: 2.1 time: 0.605657 Oct 24 09:08:24.948765 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1939/3801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:24 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:24.976144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c84382c6-10f5-4cf0-879a-a8f8bc5657a2 req-2e577f76-0b4c-4f22-93c6-80034e214b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8635f451-8133-4276-92fd-a675cbf47ea0", "name": "network-vif-deleted", "tag": "403b8d1c-5cad-4793-8ca4-3d666b7fc401"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:24.998703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c84382c6-10f5-4cf0-879a-a8f8bc5657a2 req-2e577f76-0b4c-4f22-93c6-80034e214b93 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:24.999488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c84382c6-10f5-4cf0-879a-a8f8bc5657a2 req-2e577f76-0b4c-4f22-93c6-80034e214b93 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.000095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c84382c6-10f5-4cf0-879a-a8f8bc5657a2 req-2e577f76-0b4c-4f22-93c6-80034e214b93 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.048607 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c84382c6-10f5-4cf0-879a-a8f8bc5657a2 req-2e577f76-0b4c-4f22-93c6-80034e214b93 service nova] Creating event network-vif-deleted:403b8d1c-5cad-4793-8ca4-3d666b7fc401 for instance 8635f451-8133-4276-92fd-a675cbf47ea0 on n-h2-master-1 Oct 24 09:08:25.062558 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c84382c6-10f5-4cf0-879a-a8f8bc5657a2 req-2e577f76-0b4c-4f22-93c6-80034e214b93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097111 Oct 24 09:08:25.071488 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1940/3802] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:25.090374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:25.092651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:25.104888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.105915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.107562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.108314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.108776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.109415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.225585 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf348875-fa7c-434d-b3c7-e181302bd1a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 1.098612 Oct 24 09:08:25.230028 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1863/3803] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:24 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:08:25.240225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:25.241080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:25.249780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.250604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.251326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.252646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.253403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.254797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.600680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:25.614432 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24ad5918-4d00-4420-b8e0-a36a5b44d81a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.528242 Oct 24 09:08:25.616346 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1941/3804] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:25 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:25.627823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:25.629525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:25.640373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.641758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.642464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.643979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.644680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.645517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.693643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.694515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.695189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.696052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lazy-loading 'fault' on Instance uuid 8635f451-8133-4276-92fd-a675cbf47ea0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:08:25.720033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:25.729818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbb3f7de-ffb8-4349-ab31-4fbd2aca04eb tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 0.497397 Oct 24 09:08:25.730743 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1864/3805] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:25 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:25.735492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1f9fbea7-9f16-41a8-b3cf-4431fa68544a req-d15a2a20-0657-4ab6-b755-3022546a415b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4", "tag": "48e55965-1922-4f3a-a720-7eaed7bf1cf8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:25.766583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92b6e38d9c442b596b113895c61d7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcd6b20b7945549462ff819faa6cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:25.773904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f9fbea7-9f16-41a8-b3cf-4431fa68544a req-d15a2a20-0657-4ab6-b755-3022546a415b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.777690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f9fbea7-9f16-41a8-b3cf-4431fa68544a req-d15a2a20-0657-4ab6-b755-3022546a415b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.779042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f9fbea7-9f16-41a8-b3cf-4431fa68544a req-d15a2a20-0657-4ab6-b755-3022546a415b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.779979 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1abdb9a-4a02-4f4e-81ea-7cd425ffea58 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 200 len: 1316 microversion: 2.1 time: 0.159381 Oct 24 09:08:25.781656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1942/3806] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:25 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:25.805844 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1f9fbea7-9f16-41a8-b3cf-4431fa68544a req-d15a2a20-0657-4ab6-b755-3022546a415b service nova] Creating event network-changed:48e55965-1922-4f3a-a720-7eaed7bf1cf8 for instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 on n-h2-master-1 Oct 24 09:08:25.813273 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1f9fbea7-9f16-41a8-b3cf-4431fa68544a req-d15a2a20-0657-4ab6-b755-3022546a415b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081044 Oct 24 09:08:25.814566 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1865/3807] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:25.972698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:25.973722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:25.981905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.982553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.982830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:25.983734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:25.984200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:25.984625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.239313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:26.243137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:26.258858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:26.261827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:26.265471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.267663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:26.269257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:26.269915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.384548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-89323b9d-2e4e-456d-bccf-aa09d32c1105 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.149827 Oct 24 09:08:26.385801 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1866/3808] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:26 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 09:08:26.654046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:26.654749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:26.667524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:26.668023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:26.668464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.673280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:26.673893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:26.674353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.722639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:26.731653 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-335811a4-1fd4-43db-ad0b-a2084ce3ab93 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1469 microversion: 2.1 time: 0.762865 Oct 24 09:08:26.755087 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1943/3809] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:25 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1469 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:26.768639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:26.771494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:26.788830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:26.789942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:26.792731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.794802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:26.797104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:26.797822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:26.863551 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:27.006632 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:27.031811 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:27.072443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:27.076929 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:27.083272 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1c2054f-5359-4483-82cd-7d58f99c616b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.433443 Oct 24 09:08:27.084423 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1867/3810] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:26 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:27.089248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:27.090138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] [instance: 8635f451-8133-4276-92fd-a675cbf47ea0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:27.099192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:27.099960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:27.100696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:27.101661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:27.102279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:27.102880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:27.134462 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] HTTP exception thrown: Instance 8635f451-8133-4276-92fd-a675cbf47ea0 could not be found. Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Request method failure captured: Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 HTTP/1.1 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlXBtMR1JllrZEsgAVMY30lmi6bDMcFx7tABwuXTPVRMQqkRki76uHirT-cNlwDXowROsVfjd9GTzk43wdXAnOXWOQ7OgOxHHlMW1kPEogogh9Izq4QQN_tgYyUajMfLTOvI-Y_jufRykSfdNxaphC63BfXMkeTGQz8MW4mcnZrmbkA Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7efcd6b20b7945549462ff819faa6cd8 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestFqdnHostnames-1126980093 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7efcd6b20b7945549462ff819faa6cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7efcd6b20b7945549462ff819faa6cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7efcd6b20b7945549462ff819faa6cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7efcd6b20b7945549462ff819faa6cd8"}]}] Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestFqdnHostnames-1126980093 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7efcd6b20b7945549462ff819faa6cd8 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1126980093 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestFqdnHostnames-1126980093-project Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c92b6e38d9c442b596b113895c61d7c6 Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestFqdnHostnames-1126980093-project Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 8635f451-8133-4276-92fd-a675cbf47ea0 could not be found. Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '8635f451-8133-4276-92fd-a675cbf47ea0'} Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8635f451-8133-4276-92fd-a675cbf47ea0 could not be found. Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8635f451-8133-4276-92fd-a675cbf47ea0 could not be found. Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:27.149834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8635f451-8133-4276-92fd-a675cbf47ea0 could not be found. Oct 24 09:08:27.156281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:27.158432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Returning 404 to user: Instance 8635f451-8133-4276-92fd-a675cbf47ea0 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:27.159477 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-151b4855-d280-44ab-ae3c-5b8aae723a86 tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0" status: 404 len: 111 microversion: 2.1 time: 0.073945 Oct 24 09:08:27.160548 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1868/3811] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:27 2022] GET /compute/v2.1/servers/8635f451-8133-4276-92fd-a675cbf47ea0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:08:27.161191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:27.169734 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89d7f317-e221-4f60-a0f8-6e1838f0cac4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 0.409029 Oct 24 09:08:27.175085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9493323-2e17-4cb1-9eab-fc64d58c5f8c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] Calling method '.version_select at 0x7f8dab3ae4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:27.190322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1944/3812] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:26 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:27.211707 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9493323-2e17-4cb1-9eab-fc64d58c5f8c tempest-ServersTestFqdnHostnames-1126980093 tempest-ServersTestFqdnHostnames-1126980093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050657892" status: 202 len: 0 microversion: 2.1 time: 0.040292 Oct 24 09:08:27.212667 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1869/3813] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050657892 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:27.396901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:27.399778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:27.419916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:27.431859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:27.432428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:27.433274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:27.437534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:27.439715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:27.588886 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:27.708483 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96553903-553f-47ae-ad38-1b6e1d3b9cde tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.315848 Oct 24 09:08:27.709540 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1945/3814] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:27 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:08:27.769509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:27.771703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:27.797285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:27.797799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:27.799080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:27.799080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:27.799439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:27.803377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.006639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:28.015286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-945dcbc1-1638-43e6-b96f-e8101a54f33d tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1427 microversion: 2.1 time: 0.251720 Oct 24 09:08:28.035820 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1870/3815] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:27 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1427 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:28.113372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:28.114096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:28.132351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.132854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.136092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.153547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2fb13858-1b1f-481d-bdd8-66ece1c46a51 req-1d57ba13-94a2-452d-9344-0f385a1235ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1aa993-e737-4665-8cf7-131a2664698e", "name": "network-vif-deleted", "tag": "33302f1a-e11a-4309-ab6f-81766769c0ea"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:28.166259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.168012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.168943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.189184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fb13858-1b1f-481d-bdd8-66ece1c46a51 req-1d57ba13-94a2-452d-9344-0f385a1235ba service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.190117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fb13858-1b1f-481d-bdd8-66ece1c46a51 req-1d57ba13-94a2-452d-9344-0f385a1235ba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.192866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fb13858-1b1f-481d-bdd8-66ece1c46a51 req-1d57ba13-94a2-452d-9344-0f385a1235ba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.258043 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2fb13858-1b1f-481d-bdd8-66ece1c46a51 req-1d57ba13-94a2-452d-9344-0f385a1235ba service nova] Creating event network-vif-deleted:33302f1a-e11a-4309-ab6f-81766769c0ea for instance ea1aa993-e737-4665-8cf7-131a2664698e on n-h2-master-1 Oct 24 09:08:28.286048 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2fb13858-1b1f-481d-bdd8-66ece1c46a51 req-1d57ba13-94a2-452d-9344-0f385a1235ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143518 Oct 24 09:08:28.291026 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1871/3816] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:28.298219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:28.313942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:28.327977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.330539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.331169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.332088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.332786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.333408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.796435 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:28.803913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:28.814146 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f88c918a-960e-49c6-8eb7-03492e25dcc4 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 0.521411 Oct 24 09:08:28.828124 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1872/3817] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:28 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:28.850193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:28.852482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:28.852836 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-329c6f47-1051-4cf0-8b00-4f1903fda4a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.739791 Oct 24 09:08:28.855046 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1946/3818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:28 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:28.879596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.880113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.894113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:28.894932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:28.895634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:28.900731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.037424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df4bf70b-17e0-43f3-a61d-ab7873e64c47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.206663 Oct 24 09:08:29.041878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1873/3819] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:28 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:08:29.065806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:29.066481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:29.095348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.095863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.096301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.097022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.097567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.097996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.212417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.213176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.213369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.217347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lazy-loading 'fault' on Instance uuid ea1aa993-e737-4665-8cf7-131a2664698e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:08:29.306206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:29.320479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59a667f4-bb49-4b64-ba1b-edcdfd1fa2ae tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 200 len: 1303 microversion: 2.1 time: 0.269669 Oct 24 09:08:29.359553 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1947/3820] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:29 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:29.856629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:29.861019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:29.872874 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:29.879760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.880303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.880686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.882756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.882756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.882756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.888200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:29.890201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:29.906687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.907194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.907641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:29.908367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:29.908822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:29.909479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.558196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:30.567822 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f4915a3-c965-46f3-a2ae-259113400bbc tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 0.719101 Oct 24 09:08:30.584150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1874/3821] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:29 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:30.589796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:30.592567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:30.600603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:30.601432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:30.602103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.603063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:30.603750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:30.604616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.653980 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5222f46b-ebe1-4fc0-8702-7571c0fd0d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.068016 Oct 24 09:08:30.654937 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1875/3822] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:30 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:08:30.671311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:30.672258 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: ea1aa993-e737-4665-8cf7-131a2664698e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:30.689191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:30.691161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:30.691758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:30.692412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.695408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:30.695962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:30.696418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.710974 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bedf23ce-b54e-41eb-ae86-e0e6ca100cc1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1515 microversion: 2.1 time: 0.819885 Oct 24 09:08:30.724333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1948/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:29 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1515 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:30.732619 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] HTTP exception thrown: Instance ea1aa993-e737-4665-8cf7-131a2664698e could not be found. Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Request method failure captured: Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e HTTP/1.1 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTCsbXJYT0ag7gnkF9G17j9T2tac9PM7sH7xsBzvI2g4VukXHnQrWyFaafqIocfakJLPp9X3mjcdJXVmx_8KsMMZo-VjczuaSCn-8apcJfSBsLZKTzGgXCxBb1EnP9X9nIOcBwonTSJmPqPG58qW_Is7kAT2k98UbBrB3WzY29pfJY Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72b5d3aef4214073b745477d3d48442b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72b5d3aef4214073b745477d3d48442b"}]}] Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4dde4bb72f914457a633358837d178de Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ea1aa993-e737-4665-8cf7-131a2664698e could not be found. Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ea1aa993-e737-4665-8cf7-131a2664698e'} Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1aa993-e737-4665-8cf7-131a2664698e could not be found. Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1aa993-e737-4665-8cf7-131a2664698e could not be found. Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:30.734621 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1aa993-e737-4665-8cf7-131a2664698e could not be found. Oct 24 09:08:30.741147 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:30.744734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Returning 404 to user: Instance ea1aa993-e737-4665-8cf7-131a2664698e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:30.745658 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ee3de57-3235-4880-8952-644f4f253c43 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e" status: 404 len: 111 microversion: 2.1 time: 0.089250 Oct 24 09:08:30.755170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:30.755555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:30.765225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:30.765668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1876/3824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:30 2022] GET /compute/v2.1/servers/ea1aa993-e737-4665-8cf7-131a2664698e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:08:30.766211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:30.766660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.767382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:30.767859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:30.768282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:30.852226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:31.052411 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0badd467-ffb1-4c3f-b5fa-f7de995bea33 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 204 len: 0 microversion: 2.1 time: 0.301067 Oct 24 09:08:31.054205 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1949/3825] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:30 2022] DELETE /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:08:31.063491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:31.064136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:31.081844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.082609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.083228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.084134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.084771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.085539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.342287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:31.355585 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4f823e1-814a-41a2-a7a2-811639c5d312 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1468 microversion: 2.1 time: 0.297850 Oct 24 09:08:31.366487 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1877/3826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:31 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1468 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:31.594776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:31.596127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:31.604315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.605232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.606525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.609063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.613423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.614346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.666910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:31.673940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:31.704227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.708157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.710011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.710772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.711247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.711684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.797808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a6ff2c3-9cf2-45ab-b2d6-8ce332a74030 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.135334 Oct 24 09:08:31.802346 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1878/3827] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:31 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 09:08:31.811300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:31.812074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:31.819590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.820138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.820586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:31.821321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:31.821788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:31.822221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:32.073630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:32.088261 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be8aebfa-75b0-4108-a435-d847d381b502 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 0.500349 Oct 24 09:08:32.089408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1950/3828] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:31 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:32.126387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:32.137600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db60f642-28b6-4f7e-8247-58859b4cd0d1 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1521 microversion: 2.1 time: 0.333571 Oct 24 09:08:32.150512 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1879/3829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:31 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:32.383416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:32.385379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:32.402325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:32.403330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:32.406112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:32.409021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:32.410045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:32.411610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:32.484852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-08685941-9660-40a6-b8c0-05dc977699e9 req-ef8d42b4-ce0d-4705-bf6e-103d52668305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4", "name": "network-vif-plugged", "status": "completed", "tag": "48e55965-1922-4f3a-a720-7eaed7bf1cf8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:32.509961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08685941-9660-40a6-b8c0-05dc977699e9 req-ef8d42b4-ce0d-4705-bf6e-103d52668305 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:32.511159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08685941-9660-40a6-b8c0-05dc977699e9 req-ef8d42b4-ce0d-4705-bf6e-103d52668305 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:32.511935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08685941-9660-40a6-b8c0-05dc977699e9 req-ef8d42b4-ce0d-4705-bf6e-103d52668305 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:32.536161 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-08685941-9660-40a6-b8c0-05dc977699e9 req-ef8d42b4-ce0d-4705-bf6e-103d52668305 service nova] Creating event network-vif-plugged:48e55965-1922-4f3a-a720-7eaed7bf1cf8 for instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 on n-h2-master-1 Oct 24 09:08:32.542469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-08685941-9660-40a6-b8c0-05dc977699e9 req-ef8d42b4-ce0d-4705-bf6e-103d52668305 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062311 Oct 24 09:08:32.548155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1880/3830] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:32.616993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:32.626713 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-703d6222-1793-44b9-be7d-d3bc64febbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1468 microversion: 2.1 time: 0.250394 Oct 24 09:08:32.627536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1951/3831] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:32 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:32.811530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:32.813999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:32.829578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:32.830081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:32.830740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:32.831649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:32.832279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:32.832875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:32.906244 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5db63526-6d9f-419e-8944-dacc8078e4e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 14 microversion: 2.1 time: 0.099497 Oct 24 09:08:32.910321 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1881/3832] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:32 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:08:33.111996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:33.112598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:33.121783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.122624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.123499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.124457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.125120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.128306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.163569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:33.164939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:33.188627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.196842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.197334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.198101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.198571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.198989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.425413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:33.438915 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf789d63-c985-4c9c-be46-3913d03dbc01 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1324 microversion: 2.1 time: 0.330859 Oct 24 09:08:33.439776 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1952/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:33 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:33.657461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:33.658088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:33.672344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.674161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.675145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.676112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.677009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.677701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.806984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:33.819511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa47909a-cea5-43cd-a3f6-ef475d1f1d17 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1521 microversion: 2.1 time: 0.660865 Oct 24 09:08:33.830552 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1882/3834] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:33 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:33.920640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:33.924551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:33.933510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.934320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.935027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:33.936616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:33.937321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:33.938033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.013088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0761279-abe9-4967-8c68-40ed980dba04 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action" status: 200 len: 8208 microversion: 2.1 time: 0.098510 Oct 24 09:08:34.013270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:34.019093 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1883/3835] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:33 2022] POST /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8/action => generated 8208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:34.026152 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57923408-a1ec-4c4f-bc42-7ed9f4aa7fdf tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1468 microversion: 2.1 time: 0.373955 Oct 24 09:08:34.031006 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1953/3836] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:33 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:34.039474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:34.044680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:34.057812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.066186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.069672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.070501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.072144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.072482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.466341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:34.467709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:34.479710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.480630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.482101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.495650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.500409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.502562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.793483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:34.810718 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8dd89fd3-4952-4837-88c4-657e84d76b47 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.788859 Oct 24 09:08:34.811318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1884/3837] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:34 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:34.853566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f2119164-3286-4fb4-90e5-f80547f27ede req-aff8ca04-687f-411b-839d-faa07b688c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3738b93f-63e5-4033-8466-b2ac2acf097e", "name": "network-vif-unplugged", "status": "completed", "tag": "ea0b3348-48e8-482b-9f3f-6d4f9a3deb58"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:34.899727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f2119164-3286-4fb4-90e5-f80547f27ede req-aff8ca04-687f-411b-839d-faa07b688c7d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.899727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f2119164-3286-4fb4-90e5-f80547f27ede req-aff8ca04-687f-411b-839d-faa07b688c7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.899727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f2119164-3286-4fb4-90e5-f80547f27ede req-aff8ca04-687f-411b-839d-faa07b688c7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.915408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:34.928771 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f2119164-3286-4fb4-90e5-f80547f27ede req-aff8ca04-687f-411b-839d-faa07b688c7d service nova] Creating event network-vif-unplugged:ea0b3348-48e8-482b-9f3f-6d4f9a3deb58 for instance 3738b93f-63e5-4033-8466-b2ac2acf097e on n-h1-master-1 Oct 24 09:08:34.929891 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5f83719-b275-4614-a653-e3f2bd7f93b6 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1520 microversion: 2.1 time: 0.470823 Oct 24 09:08:34.930468 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1954/3838] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:34 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:34.950342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:34.951041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:34.957361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f2119164-3286-4fb4-90e5-f80547f27ede req-aff8ca04-687f-411b-839d-faa07b688c7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127403 Oct 24 09:08:34.958308 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1885/3839] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:34.964388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:34.965220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:34.972712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.973447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.974397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.975403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.975951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.976421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.978524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.982358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.983038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:34.983939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:34.984540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:34.985924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.191411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:35.211272 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb3683fb-3654-458a-bb99-8b40d3ae79aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.251613 Oct 24 09:08:35.214075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1886/3840] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:34 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:35.219892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.220688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.227704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.228476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.229122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.230349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.231678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.232384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.305103 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] HTTP exception thrown: Action 999 not found Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Request method failure captured: Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4/os-instance-actions/999 HTTP/1.1 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlX_hwBNlTgv6qywWxofhRDFI00AbJoU0RbjjGO4_PUsxgWgLo5f6J-XyFoowyOeOBowfioOh-Ysnebp8GebrHyywDIgIov0Es0Bu69KT9JUXHAtFx_XU25vxLjloCKAIoiqn6kD7tNhXAwotrB4F2ohAAlCAQIkDRhpBNQLGSmBGnc Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 567f2f97a829442d95c67be784f82734 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/567f2f97a829442d95c67be784f82734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_567f2f97a829442d95c67be784f82734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/567f2f97a829442d95c67be784f82734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/567f2f97a829442d95c67be784f82734"}]}] Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 567f2f97a829442d95c67be784f82734 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-InstanceActionsNegativeTestJSON-654023544-project Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1f771366ecb64bc38869072b6d3cc06e Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-654023544-project Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: exception: Action 999 not found Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4', 'id': '999'} Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.322956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Returning 404 to user: Action 999 not found {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:35.328279 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-45d362c0-0742-4a53-995b-0492055f629c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.112867 Oct 24 09:08:35.332634 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1887/3841] 10.222.0.25 () {58 vars in 1308 bytes} [Mon Oct 24 09:08:35 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4/os-instance-actions/999 => generated 66 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:08:35.346030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.346732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.355587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.356764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.357453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.358249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.358785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.359284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.404086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:35.408011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.408845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.409482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.410381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lazy-loading 'fault' on Instance uuid b8e958a9-578a-4eaf-b3c4-178f159b3e09 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:08:35.420235 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f909168a-6974-45b4-b8ea-10f12d1fba0a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1521 microversion: 2.1 time: 0.485210 Oct 24 09:08:35.420820 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1955/3842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:34 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:35.425241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-31b09f09-4474-4fec-9c85-8255f4ac5b3e req-e17f0f23-0b09-4f95-8e5b-983a8d978c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e958a9-578a-4eaf-b3c4-178f159b3e09", "name": "network-vif-deleted", "tag": "50214b1c-6db3-4cff-b4e5-3537e025e23c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:35.453955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-31b09f09-4474-4fec-9c85-8255f4ac5b3e req-e17f0f23-0b09-4f95-8e5b-983a8d978c6d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.454841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-31b09f09-4474-4fec-9c85-8255f4ac5b3e req-e17f0f23-0b09-4f95-8e5b-983a8d978c6d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.456306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-31b09f09-4474-4fec-9c85-8255f4ac5b3e req-e17f0f23-0b09-4f95-8e5b-983a8d978c6d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.492459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-31b09f09-4474-4fec-9c85-8255f4ac5b3e req-e17f0f23-0b09-4f95-8e5b-983a8d978c6d service nova] Creating event network-vif-deleted:50214b1c-6db3-4cff-b4e5-3537e025e23c for instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 on n-h1-master-1 Oct 24 09:08:35.502005 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-31b09f09-4474-4fec-9c85-8255f4ac5b3e req-e17f0f23-0b09-4f95-8e5b-983a8d978c6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079844 Oct 24 09:08:35.502576 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1956/3843] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:35.508624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.509384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.513160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dde4bb72f914457a633358837d178de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b5d3aef4214073b745477d3d48442b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:35.516084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.516645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.517081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.518524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.519262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.519854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.521857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e443c1d-da3e-4846-b0e8-f62c14d4d3c8 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 200 len: 1302 microversion: 2.1 time: 0.186259 Oct 24 09:08:35.533074 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1888/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:35 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 1302 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:35.548629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e9a825c-62ff-43fc-8897-74eb04ab1da7 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '.version_select at 0x7f8dab115dc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.549450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e9a825c-62ff-43fc-8897-74eb04ab1da7 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: 73e90d19-8dbe-480b-9c6e-f534891a0607] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.555273 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3e9a825c-62ff-43fc-8897-74eb04ab1da7 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] HTTP exception thrown: Instance 73e90d19-8dbe-480b-9c6e-f534891a0607 could not be found. Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e9a825c-62ff-43fc-8897-74eb04ab1da7 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Request method failure captured: Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/73e90d19-8dbe-480b-9c6e-f534891a0607/os-instance-actions HTTP/1.1 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlX_hwBNlTgv6qywWxofhRDFI00AbJoU0RbjjGO4_PUsxgWgLo5f6J-XyFoowyOeOBowfioOh-Ysnebp8GebrHyywDIgIov0Es0Bu69KT9JUXHAtFx_XU25vxLjloCKAIoiqn6kD7tNhXAwotrB4F2ohAAlCAQIkDRhpBNQLGSmBGnc Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 567f2f97a829442d95c67be784f82734 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/567f2f97a829442d95c67be784f82734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_567f2f97a829442d95c67be784f82734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/567f2f97a829442d95c67be784f82734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/567f2f97a829442d95c67be784f82734"}]}] Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 567f2f97a829442d95c67be784f82734 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-InstanceActionsNegativeTestJSON-654023544-project Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1f771366ecb64bc38869072b6d3cc06e Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-654023544-project Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 73e90d19-8dbe-480b-9c6e-f534891a0607 could not be found. Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '73e90d19-8dbe-480b-9c6e-f534891a0607'} Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e90d19-8dbe-480b-9c6e-f534891a0607 could not be found. Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:35.556911 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e90d19-8dbe-480b-9c6e-f534891a0607 could not be found. Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e90d19-8dbe-480b-9c6e-f534891a0607 could not be found. Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e9a825c-62ff-43fc-8897-74eb04ab1da7 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Returning 404 to user: Instance 73e90d19-8dbe-480b-9c6e-f534891a0607 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e9a825c-62ff-43fc-8897-74eb04ab1da7 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/73e90d19-8dbe-480b-9c6e-f534891a0607/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024171 Oct 24 09:08:35.560932 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1889/3845] 10.222.0.25 () {58 vars in 1296 bytes} [Mon Oct 24 09:08:35 2022] GET /compute/v2.1/servers/73e90d19-8dbe-480b-9c6e-f534891a0607/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:08:35.568434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.569018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.576707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.577361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.577965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.578797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.579594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.581017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.608950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:35.625248 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:35.715922 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2691c2f-f08d-453f-bfb7-34dbbd05390c tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 204 len: 0 microversion: 2.1 time: 0.150912 Oct 24 09:08:35.716527 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1890/3846] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:35 2022] DELETE /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:08:35.725744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.726460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.732733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.733507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.733962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.734664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.735120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.735547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.845513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:35.861510 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c742a760-3b8c-422b-98f9-7a1b277d0758 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.357339 Oct 24 09:08:35.874969 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1957/3847] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:35 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:35.890802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:35.891774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:35.899640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.900346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.901245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.902173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:35.902883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:35.904004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:35.992834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:36.007960 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6aba0da4-77af-4f81-a464-b1040938d47d tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1526 microversion: 2.1 time: 0.281956 Oct 24 09:08:36.008871 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1891/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:35 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1526 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:36.281339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:36.290046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-18858f3a-ad9a-4278-8a1f-ed1b475a215d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.404997 Oct 24 09:08:36.293317 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1958/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:35 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:36.317469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:36.318422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:36.327408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.328334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.328951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.330097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.341964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.342435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.418504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Locking {{(pid=126919) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 24 09:08:36.450693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:36.452091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:36.468201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.474114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.475468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.477810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.479151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.479596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.543161 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-661a32e3-38f9-43b6-afb3-e17ac84f8476 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.230612 Oct 24 09:08:36.544423 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1892/3850] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:36 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:36.554720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:36.555566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:36.573089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.578091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.578483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.579210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.579811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.580541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.911379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:36.923425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:36.924787 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7dd9c7cd-98ca-4670-895b-129fc22a1e31 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.375058 Oct 24 09:08:36.926295 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1893/3851] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:36 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:36.935377 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ef4a84d-207e-4af8-a123-d722d119b878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1521 microversion: 2.1 time: 0.491052 Oct 24 09:08:36.941077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:36.941946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] [instance: b8e958a9-578a-4eaf-b3c4-178f159b3e09] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:36.951749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.952437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.952865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.953583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.954253 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1959/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:36 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:36.956829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.958344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.966925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:36.980474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:36.983209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:36.983888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:36.989701 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:36.994704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] HTTP exception thrown: Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 could not be found. Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Request method failure captured: Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 HTTP/1.1 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlTCsbXJYT0ag7gnkF9G17j9T2tac9PM7sH7xsBzvI2g4VukXHnQrWyFaafqIocfakJLPp9X3mjcdJXVmx_8KsMMZo-VjczuaSCn-8apcJfSBsLZKTzGgXCxBb1EnP9X9nIOcBwonTSJmPqPG58qW_Is7kAT2k98UbBrB3WzY29pfJY Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72b5d3aef4214073b745477d3d48442b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72b5d3aef4214073b745477d3d48442b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72b5d3aef4214073b745477d3d48442b"}]}] Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 72b5d3aef4214073b745477d3d48442b Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-MigrationsAdminTest-448375090 Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 4dde4bb72f914457a633358837d178de Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-MigrationsAdminTest-448375090-project Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 could not be found. Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b8e958a9-578a-4eaf-b3c4-178f159b3e09'} Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 could not be found. Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 could not be found. Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:36.998868 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 could not be found. Oct 24 09:08:37.001941 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.004232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] Returning 404 to user: Instance b8e958a9-578a-4eaf-b3c4-178f159b3e09 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:37.005185 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cc07f02-73d2-431d-93fd-fdf2d504dbc0 tempest-MigrationsAdminTest-448375090 tempest-MigrationsAdminTest-448375090-project] 10.222.0.25 "GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09" status: 404 len: 111 microversion: 2.1 time: 0.077765 Oct 24 09:08:37.008580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1894/3853] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:36 2022] GET /compute/v2.1/servers/b8e958a9-578a-4eaf-b3c4-178f159b3e09 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:08:37.023183 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] HTTP exception thrown: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 is locked Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Request method failure captured: Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action HTTP/1.1 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 15 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlT-Gwl-QL4RmTnmqxij31goZNj1DohdSNDs5nmArEp82KeeRin_XKj9vYVMxI3moiVuuii5bAUuyG1jpFWdoiqWSoqjt-4f9s2X2R4RFGpH0ZkRJguuLpkyMcWuw0UfdTx6-vCaFDNZCH4c5yQQZrz2t_yj87_WXCyQAVc2NSrsZrE Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be8fffe9b0994ded9f07301735105917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be8fffe9b0994ded9f07301735105917"}]}] Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c703cc73a22749858ffe05500e52aa03 Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: {"os-stop": {}} Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 is locked Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '29e407b5-a14a-4395-a9ac-771605f5ecd3', 'body': {'os-stop': {}}} Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 is locked Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 is locked Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 is locked Oct 24 09:08:37.025247 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:08:37.031804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Returning 409 to user: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 is locked {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:37.032858 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c7bc526-fd93-4c52-866e-12b148bcfe7a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 409 len: 107 microversion: 2.1 time: 0.077388 Oct 24 09:08:37.033649 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1960/3854] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:36 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 107 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:08:37.034015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:37.034707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:37.042295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:37.043110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:37.045116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.047552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.048088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.050555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.051158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.051717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.052437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.052537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.053143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.054042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.054700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.055307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.161815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Unlocking {{(pid=126920) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 24 09:08:37.281486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab63434e-3ae2-49dc-84f0-e4d8854a11b8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.243384 Oct 24 09:08:37.282726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1961/3855] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:37 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:37.294180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b73edb40-5c99-4872-876a-e16264d35a2d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:37.303107 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:37.306437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73edb40-5c99-4872-876a-e16264d35a2d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.306944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73edb40-5c99-4872-876a-e16264d35a2d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.310767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73edb40-5c99-4872-876a-e16264d35a2d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.378258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b73edb40-5c99-4872-876a-e16264d35a2d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:08:37.457815 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b73edb40-5c99-4872-876a-e16264d35a2d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.168310 Oct 24 09:08:37.458457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1962/3856] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:37 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:08:37.485411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:37.488424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:37.505513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.506251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.506864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.507749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.509439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.509871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.756778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f771366ecb64bc38869072b6d3cc06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567f2f97a829442d95c67be784f82734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:37.766732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8634ec4-e812-49ac-8138-627e185f0102 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 200 len: 1526 microversion: 2.1 time: 0.738475 Oct 24 09:08:37.767319 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1895/3857] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:37 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 1526 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:37.962156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:37.963154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:37.970434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.972386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.973543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:37.974498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:37.975243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:37.976134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:38.275544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:38.285591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:38.286132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a775615d-442c-4de5-a1ab-9190ac015a6e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1521 microversion: 2.1 time: 0.328392 Oct 24 09:08:38.287271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1896/3858] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:37 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:38.298719 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b148c6b-1751-486b-9599-cdf9c169d8ec tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.835499 Oct 24 09:08:38.300633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1963/3859] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:37 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:38.306803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-86e9838a-d192-4fdc-853b-7bd7b03a4665 req-f9dbc481-82ea-4a79-88b7-644eafb5338a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4", "name": "network-vif-deleted", "tag": "48e55965-1922-4f3a-a720-7eaed7bf1cf8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:38.318866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-86e9838a-d192-4fdc-853b-7bd7b03a4665 req-f9dbc481-82ea-4a79-88b7-644eafb5338a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:38.319626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-86e9838a-d192-4fdc-853b-7bd7b03a4665 req-f9dbc481-82ea-4a79-88b7-644eafb5338a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:38.320245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-86e9838a-d192-4fdc-853b-7bd7b03a4665 req-f9dbc481-82ea-4a79-88b7-644eafb5338a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:38.354696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-86e9838a-d192-4fdc-853b-7bd7b03a4665 req-f9dbc481-82ea-4a79-88b7-644eafb5338a service nova] Creating event network-vif-deleted:48e55965-1922-4f3a-a720-7eaed7bf1cf8 for instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 on n-h2-master-1 Oct 24 09:08:38.368042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-86e9838a-d192-4fdc-853b-7bd7b03a4665 req-f9dbc481-82ea-4a79-88b7-644eafb5338a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079268 Oct 24 09:08:38.368835 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1897/3860] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:38.595202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c9b3745a-ca2b-4745-b32d-74b6a90230a8 req-8bd01601-6290-4f95-b4ec-170acc13b20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3738b93f-63e5-4033-8466-b2ac2acf097e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0b3348-48e8-482b-9f3f-6d4f9a3deb58"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:38.613792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c9b3745a-ca2b-4745-b32d-74b6a90230a8 req-8bd01601-6290-4f95-b4ec-170acc13b20a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:38.614762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c9b3745a-ca2b-4745-b32d-74b6a90230a8 req-8bd01601-6290-4f95-b4ec-170acc13b20a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:38.615302 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c9b3745a-ca2b-4745-b32d-74b6a90230a8 req-8bd01601-6290-4f95-b4ec-170acc13b20a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:38.648124 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c9b3745a-ca2b-4745-b32d-74b6a90230a8 req-8bd01601-6290-4f95-b4ec-170acc13b20a service nova] Creating event network-vif-plugged:ea0b3348-48e8-482b-9f3f-6d4f9a3deb58 for instance 3738b93f-63e5-4033-8466-b2ac2acf097e on n-h1-master-1 Oct 24 09:08:38.663606 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c9b3745a-ca2b-4745-b32d-74b6a90230a8 req-8bd01601-6290-4f95-b4ec-170acc13b20a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070497 Oct 24 09:08:38.665422 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1964/3861] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:38.792648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:38.794007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] [instance: e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:38.808846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:38.809675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:38.810259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:38.810975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:38.811428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:38.811846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:38.829879 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] HTTP exception thrown: Instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 could not be found. Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Request method failure captured: Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 HTTP/1.1 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlX_hwBNlTgv6qywWxofhRDFI00AbJoU0RbjjGO4_PUsxgWgLo5f6J-XyFoowyOeOBowfioOh-Ysnebp8GebrHyywDIgIov0Es0Bu69KT9JUXHAtFx_XU25vxLjloCKAIoiqn6kD7tNhXAwotrB4F2ohAAlCAQIkDRhpBNQLGSmBGnc Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 567f2f97a829442d95c67be784f82734 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/567f2f97a829442d95c67be784f82734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_567f2f97a829442d95c67be784f82734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/567f2f97a829442d95c67be784f82734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/567f2f97a829442d95c67be784f82734"}]}] Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 567f2f97a829442d95c67be784f82734 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-654023544 Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-InstanceActionsNegativeTestJSON-654023544-project Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1f771366ecb64bc38869072b6d3cc06e Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-654023544-project Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 could not be found. Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4'} Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 could not be found. Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 could not be found. Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:38.831757 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 could not be found. Oct 24 09:08:38.834807 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:08:38.836487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] Returning 404 to user: Instance e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:08:38.837541 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd9c2087-8b12-4e83-9bb0-aebbc8c1bfc1 tempest-InstanceActionsNegativeTestJSON-654023544 tempest-InstanceActionsNegativeTestJSON-654023544-project] 10.222.0.25 "GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4" status: 404 len: 111 microversion: 2.1 time: 0.049123 Oct 24 09:08:38.838094 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1898/3862] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:38 2022] GET /compute/v2.1/servers/e92dad8c-4f8a-4cb9-80c5-1b42f2f17db4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:08:39.311914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:39.312626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:39.323663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:39.325698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:39.334414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:39.334923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:39.335375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:39.335937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:39.339864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:39.340426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:39.340931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:39.342359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:39.342971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:39.348730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:39.351972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:39.352569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:39.589843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:39.599757 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4bb3b239-b9b2-4446-ab90-d831297c3d17 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.279824 Oct 24 09:08:39.601109 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1899/3863] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:39 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:39.848811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:39.864202 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4be1eda-cec6-4f8a-aa87-e9c00dd95ec2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1521 microversion: 2.1 time: 0.553462 Oct 24 09:08:39.868235 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1965/3864] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:39 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:40.626572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:40.627203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:40.646327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:40.649208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:40.650026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:40.651079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:40.652011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:40.658208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:40.890751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:40.892034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:40.904071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:40.904603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:40.905842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:40.907313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:40.907785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:40.908217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:41.032561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:41.046230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e33a0367-c004-4446-b692-dce45c22c69d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.423748 Oct 24 09:08:41.047431 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1900/3865] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:40 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:41.114193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:41.126742 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a63e0304-8c6e-4605-9c0b-a4de7cdf9844 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1506 microversion: 2.1 time: 0.241760 Oct 24 09:08:41.129399 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1966/3866] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:40 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:41.174729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:41.176815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:41.191162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:41.191724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:41.192306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:41.193367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:41.193818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:41.194390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:41.523382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:41.536024 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ada68a10-e787-4eb1-8155-f029817faeba tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 200 len: 1506 microversion: 2.1 time: 0.380904 Oct 24 09:08:41.539178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1901/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:41 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:41.561088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:41.561851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:41.571788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:41.572300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:41.572730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:41.573473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:41.573934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:41.574361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:41.664300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:08:41.944913 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a0d79f5d-d1b3-4503-a8a4-1234fff04db9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 204 len: 0 microversion: 2.1 time: 0.383148 Oct 24 09:08:41.947370 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1967/3868] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:08:41 2022] DELETE /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:08:42.070823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:42.071436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:42.091714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:42.097567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:42.100133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:42.101617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:42.106208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:42.108831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:42.249430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1809839995", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9c8a69b9-64d8-470d-a2c0-3d0dcb70a482"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:42.345396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] validate_networks() for [('9c8a69b9-64d8-470d-a2c0-3d0dcb70a482', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:08:42.614231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:42.626979 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31ec0da2-153d-44cc-9cc0-67a5a30d61ce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.560857 Oct 24 09:08:42.630326 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1902/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:42 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:43.656004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:43.656628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:43.671100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:43.673288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:43.674339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:43.675388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:43.677045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:43.679526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:44.320767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:08:44.323809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:08:44.325533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:08:44.326205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:08:44.327938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:08:44.353820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:44.354966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:44.355606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:44.357106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:44.357636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:44.358077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:44.381535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Getting quotas for project 82888bc2bd7c40dcbae68a5e4fa6c4f2. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:08:44.388554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Getting quotas for user 5ae455a2351c4cf9a32ca68e686d27d0 and project 82888bc2bd7c40dcbae68a5e4fa6c4f2. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:08:44.410520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:08:44.415804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:08:44.488143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:44.507237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1ec5cc5-c27f-4414-b5d2-6991ae81ecb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.854799 Oct 24 09:08:44.507896 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1903/3870] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:43 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:44.513769 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60d0b406-372c-461c-b235-7f0f731e9a1e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.268773 Oct 24 09:08:44.521550 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1968/3871] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:08:44.537476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54dd1fdc-455c-4a51-863e-16ab51ec464c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:44.538550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-54dd1fdc-455c-4a51-863e-16ab51ec464c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:44.688393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-54dd1fdc-455c-4a51-863e-16ab51ec464c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:44.700276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-54dd1fdc-455c-4a51-863e-16ab51ec464c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1218 microversion: 2.1 time: 0.174384 Oct 24 09:08:44.723264 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1969/3872] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:44 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:44.815817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Action: 'update', calling method: .version_select at 0x7f8daaeddd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:44.942272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:44.943281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:44.944599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:44.946019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:44.947260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:44.948368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:45.019853 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-629136b2-50ec-4e49-a846-83eb6e6eff2f tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7" status: 200 len: 148 microversion: 2.57 time: 0.506899 Oct 24 09:08:45.020587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1904/3873] 10.222.0.25 () {62 vars in 1303 bytes} [Mon Oct 24 09:08:44 2022] PUT /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7 => generated 148 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:08:45.035140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Calling method '.version_select at 0x7f8daa3c5e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:45.159661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:45.160159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:45.160609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:45.161365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:45.164611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:45.165000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:45.217050 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-238e32f8-f70c-4713-a328-897a98036045 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7/detail" status: 200 len: 463 microversion: 2.57 time: 0.189268 Oct 24 09:08:45.218260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1970/3874] 10.222.0.25 () {60 vars in 1304 bytes} [Mon Oct 24 09:08:45 2022] GET /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7/detail => generated 463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:08:45.538908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:45.539336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:45.555728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:45.556224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:45.558593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:45.558959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Action: 'update', calling method: .version_select at 0x7f8daa40aaf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:45.560151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:45.560862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:45.563941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.231373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:46.237653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.239328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.239897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.242290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01ed7f77-c056-4dc7-be11-c1871695bac9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.711159 Oct 24 09:08:46.242616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.243980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.248482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.250736 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1905/3875] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:45 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:46.256093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-57afb3e9-1843-46b3-abe9-7476245c8820 req-6806eb1a-305a-4147-ae7f-3351cb6dd1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3738b93f-63e5-4033-8466-b2ac2acf097e", "name": "network-vif-deleted", "tag": "ea0b3348-48e8-482b-9f3f-6d4f9a3deb58"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:46.300155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-57afb3e9-1843-46b3-abe9-7476245c8820 req-6806eb1a-305a-4147-ae7f-3351cb6dd1f1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.304537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-57afb3e9-1843-46b3-abe9-7476245c8820 req-6806eb1a-305a-4147-ae7f-3351cb6dd1f1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.305256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-57afb3e9-1843-46b3-abe9-7476245c8820 req-6806eb1a-305a-4147-ae7f-3351cb6dd1f1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.319239 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-57afb3e9-1843-46b3-abe9-7476245c8820 req-6806eb1a-305a-4147-ae7f-3351cb6dd1f1 service nova] Creating event network-vif-deleted:ea0b3348-48e8-482b-9f3f-6d4f9a3deb58 for instance 3738b93f-63e5-4033-8466-b2ac2acf097e on n-h1-master-1 Oct 24 09:08:46.336830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-57afb3e9-1843-46b3-abe9-7476245c8820 req-6806eb1a-305a-4147-ae7f-3351cb6dd1f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083994 Oct 24 09:08:46.339856 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1906/3876] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:08:46.348719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:46.350484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:46.370299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.370527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.372646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.373115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.374580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.375063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.375500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.376334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.378389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.379724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:46.381893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:46.383372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:46.409117 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:46.498629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:46.520400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9e5d156-87d7-4231-b5a5-dc68b3dabb81 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1270 microversion: 2.1 time: 0.172648 Oct 24 09:08:46.547677 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1907/3877] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:46 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1270 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:46.563225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61ca39bd-6386-495d-b55d-cbca6ad8dbec tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7?user_id=a71e2ef7a6dd406bb8400ad6ecd76da6" status: 200 len: 148 microversion: 2.57 time: 1.010655 Oct 24 09:08:46.570325 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1971/3878] 10.222.0.25 () {62 vars in 1384 bytes} [Mon Oct 24 09:08:45 2022] PUT /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7?user_id=a71e2ef7a6dd406bb8400ad6ecd76da6 => generated 148 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:08:46.574672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c939f97c-da99-440f-aaf0-ea39c4c13b54 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Calling method '.version_select at 0x7f8dab48e280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:47.187962 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c939f97c-da99-440f-aaf0-ea39c4c13b54 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7?user_id=a71e2ef7a6dd406bb8400ad6ecd76da6" status: 200 len: 190 microversion: 2.57 time: 0.614753 Oct 24 09:08:47.188662 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1908/3879] 10.222.0.25 () {60 vars in 1364 bytes} [Mon Oct 24 09:08:46 2022] GET /compute/v2.1/os-quota-sets/ba2baf466cf8466c936c0a7e55f630c7?user_id=a71e2ef7a6dd406bb8400ad6ecd76da6 => generated 190 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:08:47.274581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:47.275810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:47.284518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:47.285846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:47.286488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:47.287601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:47.288254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:47.288870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:47.559688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:47.560306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:47.572098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:47.572596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:47.573037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:47.582206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:47.582713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:47.583161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:47.888867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:47.898517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-316d5fe4-29f7-4328-842d-c8bd3296df6b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1276 microversion: 2.1 time: 0.343059 Oct 24 09:08:47.899116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1909/3880] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:47 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:48.068715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:48.078672 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d32a78d0-0f68-4025-933f-7e31182ae655 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.810550 Oct 24 09:08:48.083263 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1972/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:47 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:48.923683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:48.924935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:48.936610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:48.950142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:48.950972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:48.951914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:48.952714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:48.953315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:49.114417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:49.115710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:49.124069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:49.138064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:49.138955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:49.140104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:49.140780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:49.151262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:49.362736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:49.374913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9999b75-f100-47e4-ab7d-cf317213a4a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.455944 Oct 24 09:08:49.375800 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1910/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:48 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:49.759742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:49.773148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8337d5f-fcdf-4c98-bc7b-699a0bb5e8f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1655 microversion: 2.1 time: 0.662409 Oct 24 09:08:49.774272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1973/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:49 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1655 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:49.801249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4007d231-a68c-4105-a4bf-3c70e878fafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:49.814530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4007d231-a68c-4105-a4bf-3c70e878fafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:49.815514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4007d231-a68c-4105-a4bf-3c70e878fafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:49.817083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4007d231-a68c-4105-a4bf-3c70e878fafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:49.893238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4007d231-a68c-4105-a4bf-3c70e878fafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Going to try to start instance {{(pid=126919) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 09:08:49.968294 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4007d231-a68c-4105-a4bf-3c70e878fafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.171411 Oct 24 09:08:49.979549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:49.980491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:49.986654 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1911/3884] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:49 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:49.992787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:49.995019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:49.996103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:50.001489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:50.002244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:50.002889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:50.401558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:50.402726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:50.405112 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:50.414690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:50.421660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:50.422738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:50.423922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:50.427013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:50.428185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:50.450661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:50.466172 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae5f7eb7-7efe-4680-909a-2ed799a97066 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1664 microversion: 2.1 time: 0.491441 Oct 24 09:08:50.482734 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1974/3885] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:49 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1664 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:51.441825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f10936ba-b0ee-4ba5-b313-5b6a34eb808a req-f2fa086d-be1f-4139-b597-231cd6ddf4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b6cab5-9253-4873-9fcd-5886c4472af9", "tag": "79b12027-aac6-4321-a58b-2db9abfe6d8a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:51.477236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f10936ba-b0ee-4ba5-b313-5b6a34eb808a req-f2fa086d-be1f-4139-b597-231cd6ddf4d7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:51.477767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f10936ba-b0ee-4ba5-b313-5b6a34eb808a req-f2fa086d-be1f-4139-b597-231cd6ddf4d7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:51.478068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f10936ba-b0ee-4ba5-b313-5b6a34eb808a req-f2fa086d-be1f-4139-b597-231cd6ddf4d7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:51.481107 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:51.501645 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f10936ba-b0ee-4ba5-b313-5b6a34eb808a req-f2fa086d-be1f-4139-b597-231cd6ddf4d7 service nova] Creating event network-changed:79b12027-aac6-4321-a58b-2db9abfe6d8a for instance 80b6cab5-9253-4873-9fcd-5886c4472af9 on n-h2-master-1 Oct 24 09:08:51.507735 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f10936ba-b0ee-4ba5-b313-5b6a34eb808a req-f2fa086d-be1f-4139-b597-231cd6ddf4d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075808 Oct 24 09:08:51.509065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1975/3886] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:08:51.514849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:51.515556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:51.524196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:51.524697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:51.525145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:51.526050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:51.526600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:51.527034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:51.802778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:51.814907 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aeb5f14f-69a3-49d2-a9a7-9887ba942ffb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 1.418413 Oct 24 09:08:51.826974 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1912/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:50 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:52.044742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:52.052615 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7952cb0b-1c87-4fdc-ac34-e24d016980f6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1664 microversion: 2.1 time: 0.542277 Oct 24 09:08:52.079831 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1976/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:51 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1664 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:52.837911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:52.838530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:52.852513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:52.858753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:52.860739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:52.862368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:52.868269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:52.871002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:53.084687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:53.085509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:53.096200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:53.096728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:53.097175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:53.097936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:53.098390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:53.098797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:53.599179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:53.613087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28d91d8e-ff03-4b52-aad8-5037a9876e52 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.778377 Oct 24 09:08:53.627722 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1913/3889] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:52 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:53.906734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:53.922966 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8644886a-47e7-446c-bf29-4e1295be80f0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.839472 Oct 24 09:08:53.924384 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1977/3890] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:53 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:53.951473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:53.952085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:53.969263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:53.969770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:53.970226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:53.971022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:53.971483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:53.971915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:54.640165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:54.640787 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:54.651066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:54.651568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:54.652002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:54.653356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:54.660630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:54.661347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:54.961412 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:55.045810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:55.056677 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd5903c1-fd95-4978-a098-d932527f902c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.109942 Oct 24 09:08:55.068771 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1914/3891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:53 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:55.096154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:55.097046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:55.107534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:55.109992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:55.110497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:55.111241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:55.111698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:55.112121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:55.188790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Unlocking {{(pid=126919) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 24 09:08:55.274862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e8ef180e-a090-4063-b500-dcd279b9021a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.182705 Oct 24 09:08:55.278506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:55.282416 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1915/3892] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:55 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:55.290208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:55.290377 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80f96c49-3362-4473-bbf2-118eb314303a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.654655 Oct 24 09:08:55.291261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:55.291456 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1978/3893] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:54 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:08:55.299565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:55.300247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:55.300968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:55.302693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:55.303340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:55.304055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:55.825274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:55.838100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0b18273-df43-49f1-881a-fa4474956408 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.554522 Oct 24 09:08:55.844536 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1916/3894] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:55 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:56.087552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1400508240", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:56.213661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:08:56.214257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:08:56.217942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:08:56.218569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:08:56.219143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:08:56.226210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1252239169", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "b0c3e107-3575-4d89-bc72-dde29716e719"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:56.241872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:56.243726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:56.244399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:56.247675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:56.248402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:56.249968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:56.335726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] validate_networks() for [('b0c3e107-3575-4d89-bc72-dde29716e719', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:08:56.343945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Getting quotas for project 1449a35c24254626bbe1449feb02e9f8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:08:56.358462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Getting quotas for user a943f2c455934d74a696c209c0c46ae0 and project 1449a35c24254626bbe1449feb02e9f8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:08:56.397663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:08:56.403703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:08:56.584730 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-38203875-2ed1-4cf7-b980-798561449f2f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.822553 Oct 24 09:08:56.597608 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1979/3895] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:08:56.609095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:56.610432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:56.618674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:56.620070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:56.620798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:56.621760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:56.622474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:56.623127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:56.933506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:56.946468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5f2da6a-9289-41a4-b618-d8ec4d4086d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.341116 Oct 24 09:08:56.947503 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1980/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:56 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:56.977007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:56.980097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:57.003679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:57.004463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:57.008070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:57.009336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:57.010933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:57.012114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:57.170833 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:57.312582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:57.326548 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d27c5fb0-28a7-4a4a-8a9d-904c0ab28e21 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.355903 Oct 24 09:08:57.329169 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1981/3897] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:56 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:57.343309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:57.350674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:57.372033 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:57.540010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:57.540010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:57.543645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.040073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:58.048310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:58.057376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:58.062342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lazy-loading 'trusted_certs' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:08:58.093759 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ed639bb-76a5-493a-882c-78bd0809e98f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "PUT /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1355 microversion: 2.75 time: 0.763052 Oct 24 09:08:58.097693 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1982/3898] 10.222.0.25 () {62 vars in 1297 bytes} [Mon Oct 24 09:08:57 2022] PUT /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1355 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:08:58.517750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:08:58.518210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:08:58.518676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:08:58.519074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:08:58.519486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:08:58.531355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:58.532686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:58.533340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.534259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:58.534867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:58.535457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.566162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Getting quotas for project ef70895cb8074b00a5800de8113eac1c. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:08:58.572812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Getting quotas for user 04f2de8673fd4835b9382c22a1259df1 and project ef70895cb8074b00a5800de8113eac1c. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:08:58.594432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:08:58.597495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:08:58.646254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:58.647106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:58.661166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:58.661705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:58.662150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.669207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:58.669973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:58.671367 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb7b6379-cb54-475f-9b85-a1954e696634 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.825202 Oct 24 09:08:58.672314 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1917/3899] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:08:58.673097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.677797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:58.678982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:58.686040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:58.686786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:58.687909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.688793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:58.689477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:58.690109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:58.979536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:58.995101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.002300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.027154 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a973a550-98dd-4735-95a1-1e801c9c1d99 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1411 microversion: 2.75 time: 0.351359 Oct 24 09:08:59.043878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1918/3900] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:08:58 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1411 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:08:59.050509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:59.051135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:59.084181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:59.084691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:59.085133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:59.085888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:59.086523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:59.087304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:59.335890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.352887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22e197c1-2158-4b1c-ad8d-75c4b7247456 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.245342 Oct 24 09:08:59.373484 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1983/3901] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:58 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:59.380686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6bbb2b1-49d0-45a1-9121-79db9bdbf072 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:59.382282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6bbb2b1-49d0-45a1-9121-79db9bdbf072 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:59.563290 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6bbb2b1-49d0-45a1-9121-79db9bdbf072 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.584252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6bbb2b1-49d0-45a1-9121-79db9bdbf072 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.601396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6bbb2b1-49d0-45a1-9121-79db9bdbf072 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.605984 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6bbb2b1-49d0-45a1-9121-79db9bdbf072 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1259 microversion: 2.21 time: 0.229861 Oct 24 09:08:59.608294 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1984/3902] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:08:59 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:08:59.620554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:08:59.622065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:59.649371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:59.650541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:59.651137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:59.653263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:59.655008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:59.656097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:59.725250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:08:59.733805 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dd4e3e05-573e-464d-b3a4-259fd88ea799 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.688738 Oct 24 09:08:59.737149 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1919/3903] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:59 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:08:59.858978 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa7629aa-eb10-440a-b466-04d66b6a6a02 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.248565 Oct 24 09:08:59.861347 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1985/3904] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:08:59 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:08:59.873658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:08:59.874287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:08:59.893799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:59.896803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:59.897489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:08:59.907517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:08:59.916047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:08:59.916951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.059871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:00.060572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:00.069757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:00.070541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:00.071117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.072055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:00.073264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:00.076848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.406604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:00.435258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:00.440140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:00.448998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73401f0c-1360-432f-ba01-573d2979e1bb tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1417 microversion: 2.75 time: 0.393465 Oct 24 09:09:00.449887 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1986/3905] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:00 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1417 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:00.771671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:00.773430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:00.792538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:00.793419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:00.793931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.794728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:00.797578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:00.798181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.810089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:00.819876 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b2631a1-47ae-41b9-a1b6-de4045d526b7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1673 microversion: 2.1 time: 0.955586 Oct 24 09:09:00.842594 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1920/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:08:59 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1673 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:00.848048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:00.849406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:00.858508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:00.859196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:00.859782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.860642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:00.861110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:09:00.861471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:00.862044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:00.984513 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5120c417-16e7-478a-9a89-d67d76846062 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 204 len: 0 microversion: 2.42 time: 0.533185 Oct 24 09:09:00.986522 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1987/3907] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:09:00 2022] DELETE /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:09:00.993763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:00.994964 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:01.004160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.008051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.008720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.009598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.010522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.011112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.040232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.046780 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:01.055805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.059400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.060868 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cde0ca79-8d92-4d25-ad16-49d030945dc1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1311 microversion: 2.21 time: 0.216674 Oct 24 09:09:01.062550 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1921/3908] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:00 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:01.067746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:01.068363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:01.076169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.076839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.077460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.078307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.078940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.079517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.240290 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.251576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ef483a8-c5ce-40cc-8eb4-c5da389994dd tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.263018 Oct 24 09:09:01.283277 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1988/3909] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:00 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:01.484444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:01.485061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:01.505175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.511140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.512137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.512893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.513399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.513831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.552764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.564163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.575566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.577088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-03b30aaa-2450-485a-9cea-40cc214463f3 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2957 microversion: 2.42 time: 0.513387 Oct 24 09:09:01.583628 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1922/3910] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:01 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2957 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:01.753651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.769936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.774346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:01.787133 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-166d8609-b551-4800-ad55-4023d72ffa0c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1417 microversion: 2.75 time: 0.306825 Oct 24 09:09:01.787626 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1989/3911] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:01 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1417 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:01.848992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:01.849797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:01.858092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.858593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.860409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:01.863069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:01.863556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:01.863989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.091141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:02.092120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:02.108400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.108908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.109439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.110222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.110693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.111122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.254395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:02.257676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:02.279866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:02.285871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58332bf6-730e-448a-b810-8ad43851a0ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1653 microversion: 2.1 time: 0.440655 Oct 24 09:09:02.289588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:02.310706 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1923/3912] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:01 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1653 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:02.316309 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ea06ce5-1eaf-47c4-92d1-870ce866a3f6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1311 microversion: 2.21 time: 0.230633 Oct 24 09:09:02.316923 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1990/3913] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:02 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:02.329630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:02.329630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:02.336880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:02.337732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:02.346406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.350111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.352711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.357688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.359825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.360601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.369862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.370663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.372047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.373138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.373809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.374460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.403539 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:02.493888 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad3493f7-fb01-4229-b8be-e75ec6d4f8aa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.164011 Oct 24 09:09:02.503669 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1991/3914] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:09:02 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:09:02.518282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:02.521600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:02.539094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.540769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.542042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.546901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.547536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.548151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.942924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:02.955221 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7875236d-c3f9-4ce5-8d99-a068dc127b63 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1660 microversion: 2.1 time: 0.448431 Oct 24 09:09:02.957701 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1992/3915] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:02 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1660 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:02.970279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:02.971141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:02.980268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.980988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.981681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:02.982860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:02.983486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:02.984505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.369694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.391903 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8cc8b223-d55a-4f43-a5b0-01a0adf3cbd9 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 1.078478 Oct 24 09:09:03.410872 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1924/3916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:02 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:03.416758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:03.418157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:03.427240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.427838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.428379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.429188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.429839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.430372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.632768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.644152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.645895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.651911 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b92d57b-ab13-4b83-9990-947d55b59e7a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1438 microversion: 2.75 time: 0.244753 Oct 24 09:09:03.667587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1925/3917] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:03 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1438 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:03.685475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:03.686229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:03.700142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.700411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.700915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.701387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.702108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.702571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.703785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.722892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.725664 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.728227 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06b6b87b-1673-41b3-b8eb-6f5be2024ce0 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2957 microversion: 2.42 time: 0.768413 Oct 24 09:09:03.729019 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1993/3918] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:02 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2957 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:03.746921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:03.750498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:03.759838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.760343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.760789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.761568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.762032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.762466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.854959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:03.856245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:03.856965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:03.857582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:03.858196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:03.930426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.941480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.943493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:03.944996 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b14aa417-8f73-45ea-b163-b079719e3cfe tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1317 microversion: 2.21 time: 0.275549 Oct 24 09:09:03.945746 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1926/3919] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:03 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:03.950658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b9b15a85-8848-41a6-94d3-af2ecfd26bdd req-984f2eb7-8740-4250-aef8-1a27d811a563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b6cab5-9253-4873-9fcd-5886c4472af9", "name": "network-vif-plugged", "status": "completed", "tag": "79b12027-aac6-4321-a58b-2db9abfe6d8a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:03.961168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9b15a85-8848-41a6-94d3-af2ecfd26bdd req-984f2eb7-8740-4250-aef8-1a27d811a563 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.964319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:03.974957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.976050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.976981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.979763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:03.981085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.982558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:03.990542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9b15a85-8848-41a6-94d3-af2ecfd26bdd req-984f2eb7-8740-4250-aef8-1a27d811a563 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:03.991918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9b15a85-8848-41a6-94d3-af2ecfd26bdd req-984f2eb7-8740-4250-aef8-1a27d811a563 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:04.026228 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b9b15a85-8848-41a6-94d3-af2ecfd26bdd req-984f2eb7-8740-4250-aef8-1a27d811a563 service nova] Creating event network-vif-plugged:79b12027-aac6-4321-a58b-2db9abfe6d8a for instance 80b6cab5-9253-4873-9fcd-5886c4472af9 on n-h2-master-1 Oct 24 09:09:04.045838 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b9b15a85-8848-41a6-94d3-af2ecfd26bdd req-984f2eb7-8740-4250-aef8-1a27d811a563 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098535 Oct 24 09:09:04.050759 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1927/3920] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:04.064826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:04.067601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:04.077767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:04.078881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:04.079689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:04.081265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:04.082144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:04.082818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:04.650405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:04.669095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:04.671956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:04.683482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e0076085-5c17-4ee9-b0cc-70fde299108a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "POST /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24/action" status: 202 len: 1495 microversion: 2.75 time: 0.952925 Oct 24 09:09:04.684450 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1994/3921] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:09:03 2022] POST /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24/action => generated 1495 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 09:09:04.695559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:04.696216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:04.708493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:04.708998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:04.709474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:04.710191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:04.710705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:04.711074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:04.874077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:04.888530 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f70f7a8e-46c2-4daf-9819-bb27f39e5932 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.835696 Oct 24 09:09:04.889855 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1928/3922] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:04 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:04.906961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:04.907934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:04.918866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:04.919631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:04.920411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:04.922364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:04.923032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:04.923778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.252683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.305590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.309155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.326438 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4bac62e-1be7-474b-95d8-7abce9d9a01f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.431877 Oct 24 09:09:05.335199 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1929/3923] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:04 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:05.352908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:05.364785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:05.381264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:05.381798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:05.382251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.383127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:05.383591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:05.384020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.402993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.416256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2ca4a89-c593-4f2d-ad2b-ce5390e77a13 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1318 microversion: 2.1 time: 0.730690 Oct 24 09:09:05.428837 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1995/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:04 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:05.446966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:05.453043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:05.472076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:05.473032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:05.473709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.476558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:05.477226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:05.478981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.756059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.765482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dc21cb0-99b4-4516-a77a-c34b6bf88124 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.335395 Oct 24 09:09:05.766088 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1996/3925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:05 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:05.782425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:05.783052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:05.811049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:05.811548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:05.812162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.813061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:05.814357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:05.815609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:05.967249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.979754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.981261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:05.986035 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad8fe429-38c1-42e1-96fd-10ca0985b83a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1317 microversion: 2.21 time: 0.218924 Oct 24 09:09:05.988771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1997/3926] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:05 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:06.000294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:06.002404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:06.014756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:06.017902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:06.019443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:06.020337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:06.022714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:06.023311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:06.296333 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=11 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:06.616362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.632627 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6f885c7-8be0-4158-abe7-f2e81e6c63c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.638639 Oct 24 09:09:06.634018 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1998/3927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:05 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:06.647059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:06.647698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:06.680561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:06.681911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:06.688164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:06.690259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:06.696142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:06.697943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:06.884248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.900738 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.906513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.930775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-177a7e03-c1d1-4faa-bec7-fa4ec55f4155 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.295007 Oct 24 09:09:06.931604 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1999/3928] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:06 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:06.943260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.963931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.969364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:06.973047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:06.973690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:06.975013 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-91008d5a-fdf2-4e38-85b9-759d60cf0b28 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2936 microversion: 2.42 time: 1.636492 Oct 24 09:09:06.989016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:06.989967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:06.990955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:06.991987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:06.992596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:06.993796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1930/3929] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:05 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2936 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:06.996867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:07.026198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:07.026836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:07.049894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:07.050394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:07.050843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:07.056109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:07.056622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:07.057074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:08.126145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:08.137036 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11e0ce15-d0c8-4fbb-a206-bb95f61e2595 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.142066 Oct 24 09:09:08.141074 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1931/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:06 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:08.172547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:08.175041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:08.194179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:08.196134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:08.196794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:08.198458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:08.202798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:08.203554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:08.247286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:08.319222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da13568d-17b2-44bc-9e22-6175bcc66061 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1508 microversion: 2.1 time: 1.372065 Oct 24 09:09:08.327306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2000/3931] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:06 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1508 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:08.352618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:08.353261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:08.373059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:08.373605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:08.381438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:08.382461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:08.384118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:08.389087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:08.547596 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:08.585338 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:08.646001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:08.678830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:08.681429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:08.714033 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cffd91f-264f-476f-a00c-52f6f922cf55 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.392750 Oct 24 09:09:08.716549 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2001/3932] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:08 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:08.736318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:08.737970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:08.776847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:08.780792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:08.782230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:08.784458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:08.785635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:08.786827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:09.257798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:09.283192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:09.292889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:09.297107 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e97e90e-5936-4ca1-9030-b33bffce46b6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 1.131132 Oct 24 09:09:09.298885 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1932/3933] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:08 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:09.317590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a3dcc79f-6736-4a6a-afc1-6b25bd0a75e9 req-83ae8946-9a6a-43a1-a2b4-f08ca7e73a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-deleted", "tag": "7633943c-b1d2-4ca2-a70d-10e5b43a0f47"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:09.350516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a3dcc79f-6736-4a6a-afc1-6b25bd0a75e9 req-83ae8946-9a6a-43a1-a2b4-f08ca7e73a0a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:09.356952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a3dcc79f-6736-4a6a-afc1-6b25bd0a75e9 req-83ae8946-9a6a-43a1-a2b4-f08ca7e73a0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:09.358996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a3dcc79f-6736-4a6a-afc1-6b25bd0a75e9 req-83ae8946-9a6a-43a1-a2b4-f08ca7e73a0a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:09.394565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a3dcc79f-6736-4a6a-afc1-6b25bd0a75e9 req-83ae8946-9a6a-43a1-a2b4-f08ca7e73a0a service nova] Creating event network-vif-deleted:7633943c-b1d2-4ca2-a70d-10e5b43a0f47 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:09.407437 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a3dcc79f-6736-4a6a-afc1-6b25bd0a75e9 req-83ae8946-9a6a-43a1-a2b4-f08ca7e73a0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106549 Oct 24 09:09:09.410556 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1933/3934] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:09.420208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-49845e36-c156-4d38-8d90-d627e388af8a req-add5d490-fd66-4302-9205-c1daad0521b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-unplugged", "status": "completed", "tag": "35793050-203b-480a-aeab-dbd45b7acd5b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:09.460810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-49845e36-c156-4d38-8d90-d627e388af8a req-add5d490-fd66-4302-9205-c1daad0521b4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:09.464315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-49845e36-c156-4d38-8d90-d627e388af8a req-add5d490-fd66-4302-9205-c1daad0521b4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:09.465031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-49845e36-c156-4d38-8d90-d627e388af8a req-add5d490-fd66-4302-9205-c1daad0521b4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:09.497108 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-49845e36-c156-4d38-8d90-d627e388af8a req-add5d490-fd66-4302-9205-c1daad0521b4 service nova] Creating event network-vif-unplugged:35793050-203b-480a-aeab-dbd45b7acd5b for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:09.506684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-49845e36-c156-4d38-8d90-d627e388af8a req-add5d490-fd66-4302-9205-c1daad0521b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094670 Oct 24 09:09:09.508561 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1934/3935] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:09.517074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:09.518194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:09.527856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:09.528660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:09.529540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:09.530558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:09.531198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:09.532000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:09.572575 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=32 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:09.756180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:09.790685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:09.795111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:09.797077 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-10022a4b-16b8-4530-9ac9-02ebec938bee tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2869 microversion: 2.42 time: 1.075077 Oct 24 09:09:09.797946 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2002/3936] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:08 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2869 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:09.804020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:09.804968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:09.818223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:09.819850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:09.820559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:09.821546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:09.822793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:09.823716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.159964 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.174164 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08103384-9205-4a53-8b9a-41b7796d5c9a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1508 microversion: 2.1 time: 0.374887 Oct 24 09:09:10.189811 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2003/3937] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:09 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:10.198123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:10.199614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:10.207518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.208453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.209131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.210152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.210921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.211665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.326143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.328572 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:10.342191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.343832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.356891 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-001a3786-65fd-45ac-bc41-bfa4121728c5 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.165786 Oct 24 09:09:10.358219 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2004/3938] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:10 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:10.363637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:10.366449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:10.373397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.374187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.375004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.375977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.376653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.377316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.468934 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52ba05c6-e66e-4fc8-af32-6cf427a78ad4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "PUT /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1080 microversion: 2.1 time: 0.108516 Oct 24 09:09:10.485662 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2005/3939] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:09:10 2022] PUT /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1080 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:10.493500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:10.497399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:10.505863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.507640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.508933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.509570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.510159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.511075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.604483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.618561 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b7ae489-0ec7-4d5c-b814-bdfe8b0a266b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.107589 Oct 24 09:09:10.620060 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1935/3940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:09 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:10.626864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:10.627905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:10.638794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.639444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.641224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.642364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.643123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.644202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.793946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.811996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.819141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:10.821136 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c72adb56-5537-4dc9-ba05-4d228b975036 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.334043 Oct 24 09:09:10.825919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2006/3941] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:10 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:10.839698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:10.845101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:10.859326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.862160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.864163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:10.868074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:10.868802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:10.869533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.075235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:11.091509 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-be57a68f-0fe6-491e-835f-6589283724a8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1506 microversion: 2.1 time: 0.469270 Oct 24 09:09:11.092469 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1936/3942] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:10 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:11.104813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:11.106524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:11.119552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.126022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.126946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.127976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.128651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.129577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.304843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:11.317095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fc6993d-7b58-4109-ac58-1bec4a0b679b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.488518 Oct 24 09:09:11.320795 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2007/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:10 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:11.335949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:11.336758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:11.346832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.347657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.348594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.356935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.357464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.358120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.728459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:11.740943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:11.742594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:11.743913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42be13c8-2827-4a6b-abed-22dbb9fdc915 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2709 microversion: 2.42 time: 0.650259 Oct 24 09:09:11.750021 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1937/3944] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:11 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2709 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:11.764789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:11.767776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:11.775950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.779512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.780120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.798109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.798834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.800578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.831031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:11.844398 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-051d6198-16d3-4774-ae30-df1506c4aa8d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1506 microversion: 2.1 time: 0.513550 Oct 24 09:09:11.861832 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2008/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:11 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:11.873498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-unplugged", "status": "completed", "tag": "4f2e3565-64aa-492a-810f-751d064afa17"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-unplugged", "status": "completed", "tag": "9a5a2cfa-da17-4a1f-bfd7-98eca3fde566"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-unplugged", "status": "completed", "tag": "9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:11.904683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.905170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.905644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.918128 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Creating event network-vif-unplugged:4f2e3565-64aa-492a-810f-751d064afa17 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:11.918632 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Creating event network-vif-unplugged:9a5a2cfa-da17-4a1f-bfd7-98eca3fde566 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:11.919126 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] Creating event network-vif-unplugged:9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:11.925633 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-145162ac-d2a0-4756-9ab2-d05819590e3c req-86e04ede-77ef-4fd4-b6d7-49977bfa25cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.062227 Oct 24 09:09:11.926234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2009/3946] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:11.932586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-46f59ff0-31e2-440c-a03b-d562889f3d44 req-72bbc8fd-5312-4d81-a588-a4723938ba38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-deleted", "tag": "4f2e3565-64aa-492a-810f-751d064afa17"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:11.942794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-46f59ff0-31e2-440c-a03b-d562889f3d44 req-72bbc8fd-5312-4d81-a588-a4723938ba38 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.943301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-46f59ff0-31e2-440c-a03b-d562889f3d44 req-72bbc8fd-5312-4d81-a588-a4723938ba38 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.943726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-46f59ff0-31e2-440c-a03b-d562889f3d44 req-72bbc8fd-5312-4d81-a588-a4723938ba38 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.961167 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-46f59ff0-31e2-440c-a03b-d562889f3d44 req-72bbc8fd-5312-4d81-a588-a4723938ba38 service nova] Creating event network-vif-deleted:4f2e3565-64aa-492a-810f-751d064afa17 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:11.967763 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-46f59ff0-31e2-440c-a03b-d562889f3d44 req-72bbc8fd-5312-4d81-a588-a4723938ba38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039981 Oct 24 09:09:11.968719 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2010/3947] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:11.973826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:11.974521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:11.980917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.981645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.982224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:11.983204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:11.983808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:11.984381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.007977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:12.018549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:12.027931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:12.035052 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10d07029-cc9c-4354-8053-8d0dd0fc7009 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.283704 Oct 24 09:09:12.035652 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1938/3948] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:11 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:12.051149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:12.057729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:12.065909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.069644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.077104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.078179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.079121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.080891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.285671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:12.286914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:12.287535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:12.288107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:12.288659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:12.347838 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:12.449754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:12.463012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.463513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.463964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.464708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.474209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.475442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.545683 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-583da563-d689-41fd-b578-c6c9b44b2686 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "POST /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9/action" status: 202 len: 1112 microversion: 2.1 time: 0.501915 Oct 24 09:09:12.563164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1939/3949] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:09:12 2022] POST /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9/action => generated 1112 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 09:09:12.563164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8655b344-80c6-4c12-81e6-aeaac347c634 req-93c5bd69-3ad1-4def-8685-e1ecdaaff671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0bb7a3d-c298-4c67-821a-ed17e543d402", "tag": "3bc11083-1a4a-4e8c-b324-e345707f7e27"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:12.582957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8655b344-80c6-4c12-81e6-aeaac347c634 req-93c5bd69-3ad1-4def-8685-e1ecdaaff671 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.583436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8655b344-80c6-4c12-81e6-aeaac347c634 req-93c5bd69-3ad1-4def-8685-e1ecdaaff671 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.586090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8655b344-80c6-4c12-81e6-aeaac347c634 req-93c5bd69-3ad1-4def-8685-e1ecdaaff671 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.615685 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8655b344-80c6-4c12-81e6-aeaac347c634 req-93c5bd69-3ad1-4def-8685-e1ecdaaff671 service nova] Creating event network-changed:3bc11083-1a4a-4e8c-b324-e345707f7e27 for instance a0bb7a3d-c298-4c67-821a-ed17e543d402 on n-h1-master-1 Oct 24 09:09:12.642618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8655b344-80c6-4c12-81e6-aeaac347c634 req-93c5bd69-3ad1-4def-8685-e1ecdaaff671 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086466 Oct 24 09:09:12.643537 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1940/3950] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:12.695408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:12.708945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:12.711169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:12.716687 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95490a7e-7689-4f3f-b36e-127837f56f7f tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.746765 Oct 24 09:09:12.718726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2011/3951] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:11 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:12.723633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:12.733583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:12.753756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.754889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.755348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:12.756095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:12.756569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:12.757004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:13.049243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1272216185", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "96a382ff-4e39-4380-a808-4a6d6d82ea11"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:13.168055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] validate_networks() for [('96a382ff-4e39-4380-a808-4a6d6d82ea11', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:09:13.701483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:13.702145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:13.702805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:13.703361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:13.703923 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:13.719196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:13.720025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:13.721565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:13.722525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:13.723197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:13.723952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:13.748480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Getting quotas for project 618a2425e6cd4c0cb64f25f6fe99f778. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:09:13.756710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Getting quotas for user fde7b27b41384ebba2211631caaeee72 and project 618a2425e6cd4c0cb64f25f6fe99f778. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:09:13.775878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:09:13.780643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:09:13.859846 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc74df87-a849-44d8-bd5c-75a0d38cf30c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210095 Oct 24 09:09:13.860937 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1941/3952] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:09:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:09:13.868783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:13.869805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:13.897283 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:13.900813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:13.902427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:13.903099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:13.904107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:13.904810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:13.905482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:14.155331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.179638 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43b5273e-c223-4b58-9ece-c55b72561ca2 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 1.452599 Oct 24 09:09:14.180342 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2012/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:12 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:14.197231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:14.199767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:14.215124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:14.224117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:14.224545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:14.225331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:14.236645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:14.236835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:14.426684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.443611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.445663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.457274 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2d4d598-060f-4d4b-8d4d-8d43523ff537 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.274148 Oct 24 09:09:14.466072 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2013/3954] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:14 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:14.471136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:14.471928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:14.474079 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:14.484809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:14.490127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:14.490975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:14.492985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:14.493761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:14.494448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:14.539335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.553026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.559557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.561121 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe4acf95-baee-4a42-a9e6-7d887632d0ac tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2503 microversion: 2.42 time: 0.698515 Oct 24 09:09:14.585956 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1942/3955] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:13 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2503 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:14.599053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68f95ce2-3ab4-4566-8762-50e7f312fbf4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:14.599860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68f95ce2-3ab4-4566-8762-50e7f312fbf4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:14.713208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68f95ce2-3ab4-4566-8762-50e7f312fbf4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:14.721595 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68f95ce2-3ab4-4566-8762-50e7f312fbf4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1217 microversion: 2.1 time: 0.133978 Oct 24 09:09:14.737739 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1943/3956] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:14 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:14.765113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-dac5176e-34e0-4461-b76f-9bc07de01838 req-ded1d084-6056-44ab-ab25-f553248bdd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-deleted", "tag": "9a5a2cfa-da17-4a1f-bfd7-98eca3fde566"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:14.808056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dac5176e-34e0-4461-b76f-9bc07de01838 req-ded1d084-6056-44ab-ab25-f553248bdd2d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:14.809037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dac5176e-34e0-4461-b76f-9bc07de01838 req-ded1d084-6056-44ab-ab25-f553248bdd2d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:14.817148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dac5176e-34e0-4461-b76f-9bc07de01838 req-ded1d084-6056-44ab-ab25-f553248bdd2d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:14.840967 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-dac5176e-34e0-4461-b76f-9bc07de01838 req-ded1d084-6056-44ab-ab25-f553248bdd2d service nova] Creating event network-vif-deleted:9a5a2cfa-da17-4a1f-bfd7-98eca3fde566 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:14.867223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-dac5176e-34e0-4461-b76f-9bc07de01838 req-ded1d084-6056-44ab-ab25-f553248bdd2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127639 Oct 24 09:09:14.867842 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1944/3957] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:15.152940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:15.166216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:15.172519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:15.174063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05882366-4432-4e96-a038-983d5ea619e6 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.706787 Oct 24 09:09:15.178152 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2014/3958] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:14 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:15.212701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:15.219049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:15.238233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:15.238962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:15.239678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:15.242530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:15.244607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:15.247955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:15.496681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:15.497448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:15.506743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:15.510187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:15.510456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:15.511324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:15.516091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:15.516653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:15.649931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:15.669158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:15.686959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:15.703192 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71258995-1765-4db7-9723-2a74bb235835 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.209883 Oct 24 09:09:15.707031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2015/3959] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:15 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:15.713269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:15.716282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:15.728028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:15.732225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:15.734512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:15.735417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:15.739482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:15.740113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.008476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.040184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.043452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.045390 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6baf10ed-8cd9-4e8d-96a7-faf2bdc091f7 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 2144 microversion: 2.42 time: 0.336643 Oct 24 09:09:16.047903 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2016/3960] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:15 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 2144 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:16.053536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:16.054484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:16.062496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.063880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.064595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.065620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.066374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.066989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.148311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.156843 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9f722529-5402-4201-95f0-080f0566b301 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.948528 Oct 24 09:09:16.169211 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1945/3961] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:15 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:16.205427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:16.206035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:16.251160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.251896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.252477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.256312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.256976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.257594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.471475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.503585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42f3e377-0f12-4283-abc8-b98a4f205435 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1277 microversion: 2.1 time: 0.454278 Oct 24 09:09:16.510043 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2017/3962] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:16 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:16.737913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.738047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:16.738047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:16.750327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.751866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.753452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.754307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.755046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.755172 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f26fe47b-35fb-41fd-abd8-a69cb2369dbf tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.553620 Oct 24 09:09:16.756305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.756994 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1946/3963] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:16 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:16.774677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.779011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.932951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-deleted", "tag": "35793050-203b-480a-aeab-dbd45b7acd5b"}, {"server_uuid": "2b86e284-91ab-421c-87c0-4bdef9e3c5a5", "name": "network-vif-deleted", "tag": "9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:16.950023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:16.955837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:16.956404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:16.958432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.976337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.977940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:16.979059 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] Creating event network-vif-deleted:35793050-203b-480a-aeab-dbd45b7acd5b for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:16.986331 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] Creating event network-vif-deleted:9b6b3e9d-39ee-4d5d-9ff5-03d949d16ac5 for instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 on n-h1-master-1 Oct 24 09:09:16.994865 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a5ba0cce-9ea4-494e-9f29-1c32cd647d27 req-359819da-f54c-4036-8fa4-60fb9c6dc5d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066013 Oct 24 09:09:16.996163 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1947/3964] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:09:16.998503 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0818617b-53e5-406e-a62b-4417d2d107fc tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.265631 Oct 24 09:09:17.004438 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2018/3965] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:16 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:17.076873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:17.077993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:17.089917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.091969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.093121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.095117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.097595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.098149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.195463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:17.196218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:17.210498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.211337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.211980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.212888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.213591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.220233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.296742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:17.311036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:17.315170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:17.319012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1bc52ba-f97d-44f9-b924-eb3fb14a68b5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.246571 Oct 24 09:09:17.330192 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1948/3966] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:17 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:17.532353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:17.533182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:17.545644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.547201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.547810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.549808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.551937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:17.552784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.553281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.563792 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8bb5980-b4de-4ae5-9ac8-67e57ec95878 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.372070 Oct 24 09:09:17.581892 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2019/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:17 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:17.786237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:17.787089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:17.802445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.802872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.811627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:17.817657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:17.818655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:17.819220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.124773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.147944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.149757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.151272 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a8b3616-6ce1-472e-9393-13c075bf6c46 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.369608 Oct 24 09:09:18.152567 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2020/3968] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:17 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:18.167240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:18.168522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:18.175131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:18.177028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:18.177682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.187893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:18.188830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:18.189613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.312906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.324978 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2cd9a89-21c4-431e-b3e7-11ca6b7138b0 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.797165 Oct 24 09:09:18.328323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1949/3969] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:17 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:18.349722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:18.350816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:18.365591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:18.366094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:18.366534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.373067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:18.374536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:18.375615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.471331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.484061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.485654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.508024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37165197-f0c2-46c9-8802-a219a59b3964 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.352640 Oct 24 09:09:18.508930 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2021/3970] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:18 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:18.569441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.592118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:18.594237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:18.604728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:18.606132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:18.606905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.607923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:18.608624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:18.608741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.609358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:18.610170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.615243 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32be5e2d-9713-42cf-8ea7-0b7371b0b128 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.268038 Oct 24 09:09:18.616351 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1950/3971] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:18 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:18.618816 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:18.802327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:18.813491 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-81088892-e2cc-4160-a23d-7dceb1cbca89 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.225405 Oct 24 09:09:18.826429 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2022/3972] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:18 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:19.183661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:19.184423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:19.191252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.191937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.192373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.193077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.193553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.193975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.352345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:19.353135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:19.360553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.361198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.361773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.362720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.363295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.363837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.544334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.554145 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85439733-6c32-4c68-b4d5-de546c4738ee tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.205904 Oct 24 09:09:19.555234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2023/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:19 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:19.561826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:19.562744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:19.569534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.570423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.571117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.571897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.572432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.572935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.659051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.668508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.670998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.673119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.674484 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-126c7c4d-ffde-4f03-a7bb-6715f44245bd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.495994 Oct 24 09:09:19.685692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.685692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.686325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61c31dd6-c0ee-4b62-a333-587e977a4dae tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.129561 Oct 24 09:09:19.686517 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1951/3974] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:19 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:19.694423 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2024/3975] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:19 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:19.699967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:19.700753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:19.706977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.707451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.707882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.708563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.709012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.709469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.838419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:19.840671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:19.850098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.850919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.851566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.852720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:19.853427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:19.854085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:19.856157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.873464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.877866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:19.890693 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3035ec8-eefe-4eaa-a6ef-55364cd3e776 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.195139 Oct 24 09:09:19.892678 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1952/3976] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:19 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:20.035123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:20.045496 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d6ec8a2-87bc-4d78-8912-28b5fa8944be tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.211239 Oct 24 09:09:20.046518 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2025/3977] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:19 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:20.317729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-84e0f5e3-2bab-4358-b70d-d4fe1159798d req-cb4fdbe4-1fe8-4a73-b0a7-3a663997213d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e11b871-af27-41a5-853d-bf2075cba09e", "tag": "a0a34758-bd95-43e2-b2d6-f12947a0af16"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:20.348967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-84e0f5e3-2bab-4358-b70d-d4fe1159798d req-cb4fdbe4-1fe8-4a73-b0a7-3a663997213d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.349488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-84e0f5e3-2bab-4358-b70d-d4fe1159798d req-cb4fdbe4-1fe8-4a73-b0a7-3a663997213d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.349925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-84e0f5e3-2bab-4358-b70d-d4fe1159798d req-cb4fdbe4-1fe8-4a73-b0a7-3a663997213d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:20.373761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-84e0f5e3-2bab-4358-b70d-d4fe1159798d req-cb4fdbe4-1fe8-4a73-b0a7-3a663997213d service nova] Creating event network-changed:a0a34758-bd95-43e2-b2d6-f12947a0af16 for instance 4e11b871-af27-41a5-853d-bf2075cba09e on n-h2-master-1 Oct 24 09:09:20.395132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-84e0f5e3-2bab-4358-b70d-d4fe1159798d req-cb4fdbe4-1fe8-4a73-b0a7-3a663997213d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081480 Oct 24 09:09:20.396075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1953/3978] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:20.579578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:20.580209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:20.586921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.587401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.587845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:20.588546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.589006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.589504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:20.703707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:20.704468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:20.720521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.721204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.723774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:20.724536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.725184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.726546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:20.820466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:20.835525 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3738b7d-10c8-4665-b338-18e63472856b tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.259773 Oct 24 09:09:20.836176 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2026/3979] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:20 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:20.844193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:20.845138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:20.871634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.872183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.874291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:20.875230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:20.877176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:20.879200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.034792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.050002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.050301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.053627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.067826 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe6e4af3-e4d4-4f7a-9971-a6280ff43bd8 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.230405 Oct 24 09:09:21.068738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.069536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2027/3980] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:20 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:21.083625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.084249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:21.085071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:21.099084 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f18450a-4b89-43a3-9548-256e49209cb1 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.400360 Oct 24 09:09:21.100096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.101221 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1954/3981] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:20 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:21.102412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.102879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.107506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.108583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.109033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.111658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:21.115407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:21.140668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.141488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.143585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.145367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.146825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.148143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.298397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.315931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.321591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.323049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56102700-2626-4b05-ae79-08ddd4642c1f tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.247820 Oct 24 09:09:21.324355 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2028/3982] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:21 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:21.335057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-39181b93-b5dd-4dbb-80fa-49c0f8e585ce req-c6eba2f2-532b-41e3-8df4-65d7b3db155f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bb7a3d-c298-4c67-821a-ed17e543d402", "name": "network-vif-plugged", "status": "completed", "tag": "3bc11083-1a4a-4e8c-b324-e345707f7e27"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:21.362589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-39181b93-b5dd-4dbb-80fa-49c0f8e585ce req-c6eba2f2-532b-41e3-8df4-65d7b3db155f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.363088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-39181b93-b5dd-4dbb-80fa-49c0f8e585ce req-c6eba2f2-532b-41e3-8df4-65d7b3db155f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.363528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-39181b93-b5dd-4dbb-80fa-49c0f8e585ce req-c6eba2f2-532b-41e3-8df4-65d7b3db155f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.409135 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-39181b93-b5dd-4dbb-80fa-49c0f8e585ce req-c6eba2f2-532b-41e3-8df4-65d7b3db155f service nova] Creating event network-vif-plugged:3bc11083-1a4a-4e8c-b324-e345707f7e27 for instance a0bb7a3d-c298-4c67-821a-ed17e543d402 on n-h1-master-1 Oct 24 09:09:21.414730 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-39181b93-b5dd-4dbb-80fa-49c0f8e585ce req-c6eba2f2-532b-41e3-8df4-65d7b3db155f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086611 Oct 24 09:09:21.416033 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2029/3983] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:21.474732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:21.486105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0eb3ac7a-74e8-43a2-9871-94b5e7ba4b0e tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.383245 Oct 24 09:09:21.486837 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1955/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:21 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:21.870535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:21.872218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:21.884758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.885327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.885776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:21.887958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:21.891900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:21.892941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.106738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:22.107390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:22.122939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.124815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.125462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.128876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.133211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.134647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.182707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.196089 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5daa70c3-80c5-454f-810a-c4642ba88b37 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.333627 Oct 24 09:09:22.204609 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2030/3985] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:21 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:22.216364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:22.217231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:22.234234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.236125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.236942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.238161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.238885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.240234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.315958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.330069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.333631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.352719 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cfc29315-bb8b-4ce5-b05e-296c0f9cf50f tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.254496 Oct 24 09:09:22.374179 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1956/3986] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:22 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:22.388898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:22.388898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:22.393751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.394456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.394969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.395761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.396509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.397044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.491469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.506781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.507091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.508360 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-828d24ad-c8db-4846-9ca4-e02effb29274 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1359 microversion: 2.21 time: 0.302378 Oct 24 09:09:22.509050 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2031/3987] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:22 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:22.515203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:22.515999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:22.522563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.523344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.524155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.525053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:22.525714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:22.526379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:22.683575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.693225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be6aff6c-31a1-45c0-a3b0-b8faab1f42f8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.181850 Oct 24 09:09:22.699452 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2032/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:22 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:22.946522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.957866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.959483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:22.960581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ac6984f-a2c1-4e1e-9577-b4b14e9428a9 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.580629 Oct 24 09:09:22.961194 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1957/3989] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:22 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:23.227910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:23.229208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:23.236946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.237782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.238435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.239627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.240995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.241677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.392077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:23.393357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:23.410089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.418348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.418801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.419241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.420128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.420711 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9bca4dd-a41c-4930-a7f2-be0713481f4c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.196414 Oct 24 09:09:23.421012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.421479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.435154 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2033/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:23 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:23.535131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:23.535793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:23.546183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.547103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.547809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.548833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.549864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.550581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.553735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.568528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.571262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.588449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab8f6109-bf19-4f67-a165-572421cd740e tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.204586 Oct 24 09:09:23.589416 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1958/3991] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:23 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:23.721963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:23.722740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:23.734475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.736409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.738009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.747360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.749536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.750008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.753660 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:23.754287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.764908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.766842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:23.768447 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e8eb6e7-8f2f-4f8b-82f3-f90db14c4b1a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1552 microversion: 2.21 time: 0.238040 Oct 24 09:09:23.769638 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2034/3992] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:23 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1552 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:23.797924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:23.798837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:23.809987 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:23.812736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.813578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.814269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.815321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:23.815990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:23.817109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:23.890919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:09:24.006183 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c05df7a-9d7b-49ad-9dc5-cf2226c46097 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 204 len: 0 microversion: 2.21 time: 0.213078 Oct 24 09:09:24.007447 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2035/3993] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:09:23 2022] DELETE /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:09:24.018267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:24.019508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:24.025924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.026267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.027328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.028027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.028478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.028923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.106629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.116766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.118675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.119891 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf07976d-0a84-425b-acde-085ae13b0ab5 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.110901 Oct 24 09:09:24.125925 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2036/3994] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:24 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:24.126656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:24.127268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:24.134179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.134832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.135272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.136515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.136965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.137410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.196561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.206810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15a258a3-f809-4505-bb68-777dea81b565 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.492785 Oct 24 09:09:24.210331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1959/3995] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:23 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:24.310610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.317834 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:24.329624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.331447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.333329 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67007cf6-0a16-4aa9-8c00-9af0ee5dc28c tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1558 microversion: 2.21 time: 0.211162 Oct 24 09:09:24.335108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2037/3996] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:24 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:24.449646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:24.450594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:24.459288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.460027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.460825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.462761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.463819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.464404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.619742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:24.620302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:24.632696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.633509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.635008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.635893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:24.637003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:24.637908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:24.716524 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:24.718864 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:24.726467 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0d4f68c-e84b-4652-a4df-642f47468383 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.281461 Oct 24 09:09:24.742034 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1960/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:24 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:25.031709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.039753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.041181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.047026 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-521f1ceb-08c7-439c-864c-e0fc5faf3c93 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.432491 Oct 24 09:09:25.067995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2038/3998] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:24 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:25.156021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:25.156887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:25.166504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.168179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.168888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.169847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.170533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.171750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.238481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:25.239191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:25.250040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.253027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.254422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.257379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.258812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.260573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.275835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.289935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.292004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.294310 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4afd8ff5-383c-43c8-a350-75f6a743c61d tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.148746 Oct 24 09:09:25.296178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1961/3999] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:25 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:25.362831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:25.365559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:25.375546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.376559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.378421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.380019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.380776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.381425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.638578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.646201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.648251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.649760 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd8dda35-e7e6-4413-ab93-ef76af1f4f80 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1558 microversion: 2.21 time: 0.293640 Oct 24 09:09:25.650682 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1962/4000] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:25 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1558 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:25.755189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:25.755821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:25.765126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.765702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.766316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.767115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:25.767627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:25.768162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:25.964637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:25.982804 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8d50e4f-92a4-4104-bc59-6cc60009817f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.232644 Oct 24 09:09:25.985430 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1963/4001] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:25 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:26.075776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:26.076401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:26.082480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.082963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.083399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.084094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.084543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.084963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.129666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.147836 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c82792eb-ae20-46cf-a1ec-f74c8873729b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.909359 Oct 24 09:09:26.164008 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2039/4002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:25 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:26.170219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.179553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.180126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.185564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17a82267-6e2c-4d44-9dc8-c6a6e889d426 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.114245 Oct 24 09:09:26.201910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1964/4003] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:26 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:26.325432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:26.326051 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:26.333914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.334411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.334844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.335704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.335995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.336410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.524150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.534957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.554286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.558636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30b04c28-620d-4dc2-b7b6-7006b7ac008a tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.234471 Oct 24 09:09:26.559499 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2040/4004] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:26 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:26.658064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9c36270d-9408-4b56-a480-f4420a84ef67 req-83fb141e-3360-4537-b73a-fc4b30cf213f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e11b871-af27-41a5-853d-bf2075cba09e", "name": "network-vif-plugged", "status": "completed", "tag": "a0a34758-bd95-43e2-b2d6-f12947a0af16"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:26.677782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:26.678741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:26.687938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.689588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.689726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9c36270d-9408-4b56-a480-f4420a84ef67 req-83fb141e-3360-4537-b73a-fc4b30cf213f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.692338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9c36270d-9408-4b56-a480-f4420a84ef67 req-83fb141e-3360-4537-b73a-fc4b30cf213f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.693002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9c36270d-9408-4b56-a480-f4420a84ef67 req-83fb141e-3360-4537-b73a-fc4b30cf213f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.693336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.694345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:26.697163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:26.697908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:26.718499 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9c36270d-9408-4b56-a480-f4420a84ef67 req-83fb141e-3360-4537-b73a-fc4b30cf213f service nova] Creating event network-vif-plugged:a0a34758-bd95-43e2-b2d6-f12947a0af16 for instance 4e11b871-af27-41a5-853d-bf2075cba09e on n-h2-master-1 Oct 24 09:09:26.726843 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9c36270d-9408-4b56-a480-f4420a84ef67 req-83fb141e-3360-4537-b73a-fc4b30cf213f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076547 Oct 24 09:09:26.728322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1965/4005] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:26.945327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.963970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.971174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:26.976667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4fba6870-4bab-430d-a17b-aa6473a6f98a tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1516 microversion: 2.21 time: 0.301746 Oct 24 09:09:26.978499 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2041/4006] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:26 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1516 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:27.008107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:27.008909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:27.009243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3c76219d-e716-4048-b4e8-040312b8534e req-4948a7c1-ef2b-439d-b93f-8aa45b34676e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bb7a3d-c298-4c67-821a-ed17e543d402", "name": "network-vif-deleted", "tag": "3bc11083-1a4a-4e8c-b324-e345707f7e27"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:27.024912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.026117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.029034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.030038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.032392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.033031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.037689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3c76219d-e716-4048-b4e8-040312b8534e req-4948a7c1-ef2b-439d-b93f-8aa45b34676e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.040007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3c76219d-e716-4048-b4e8-040312b8534e req-4948a7c1-ef2b-439d-b93f-8aa45b34676e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.041843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3c76219d-e716-4048-b4e8-040312b8534e req-4948a7c1-ef2b-439d-b93f-8aa45b34676e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.069789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3c76219d-e716-4048-b4e8-040312b8534e req-4948a7c1-ef2b-439d-b93f-8aa45b34676e service nova] Creating event network-vif-deleted:3bc11083-1a4a-4e8c-b324-e345707f7e27 for instance a0bb7a3d-c298-4c67-821a-ed17e543d402 on n-h1-master-1 Oct 24 09:09:27.082186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3c76219d-e716-4048-b4e8-040312b8534e req-4948a7c1-ef2b-439d-b93f-8aa45b34676e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086692 Oct 24 09:09:27.086300 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1966/4007] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:27.177372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:27.178578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:27.194370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.196309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.196969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.199050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.201083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.201857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.454896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.469721 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-496b0aea-3600-463b-9ae5-e729724a5855 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1317 microversion: 2.1 time: 0.463717 Oct 24 09:09:27.471216 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2042/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:27 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:27.482402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:27.486807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:27.497806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.501600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.503277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.504327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.504803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.511970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.513260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.524377 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9088e6ca-7461-4cf7-85de-72e1afd44563 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.357337 Oct 24 09:09:27.529590 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1967/4009] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:27 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:27.591863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:27.592477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:27.599560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.600041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.600468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.605797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:27.606288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:27.607605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:27.673874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.682095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.686934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.700294 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62703ae4-7dab-417d-aaf7-1918bd64a1aa tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.227874 Oct 24 09:09:27.701535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2043/4010] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:27 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:27.799605 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.812898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.814608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:27.817890 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-327ccc17-e33b-4e69-ab8e-83917150f845 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.230412 Oct 24 09:09:27.821636 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1968/4011] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:27 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:28.010593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:28.013752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:28.023208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.024816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.025611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.026789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.027742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.028628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.089520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.090341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.090895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.091469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lazy-loading 'fault' on Instance uuid a0bb7a3d-c298-4c67-821a-ed17e543d402 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:28.169613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:28.222729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:28.225723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04f2de8673fd4835b9382c22a1259df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef70895cb8074b00a5800de8113eac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:28.228053 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d74a8085-9264-42ee-8f9a-b3695806ddbd tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 200 len: 1349 microversion: 2.21 time: 0.224126 Oct 24 09:09:28.248055 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2044/4012] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:28 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 1349 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:28.495106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:28.495983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:28.503036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.503749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.504628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.505702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.506335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.506950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.552284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:28.553618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:28.560743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.561691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.562515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.563572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.564243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.564887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.801809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:28.811359 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c738a18-0991-4d91-8ed4-7688fbc603a5 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1505 microversion: 2.1 time: 0.319925 Oct 24 09:09:28.838291 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1969/4013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:28 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:28.844190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:28.845163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:28.855027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.855863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.860133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.862083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.862793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.863454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.885085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:28.893618 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-588181d2-7dd1-4147-a2a2-c0b94c44a107 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.345413 Oct 24 09:09:28.894208 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2045/4014] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:28 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:28.905781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:28.906294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:28.933673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.934522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.935132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.936028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.936674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.937259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.976285 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b81dc6f-8427-480a-9992-2be939236957 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e/ips" status: 200 len: 108 microversion: 2.1 time: 0.081012 Oct 24 09:09:28.978193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2046/4015] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:09:28 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e/ips => generated 108 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:28.984218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:28.985731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:28.989434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:28.993015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.994356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.995042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:28.996009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:28.996956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:28.997691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.006455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:29.010598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:29.028255 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32a35e23-201b-4cec-a485-427fc88c2e26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.187883 Oct 24 09:09:29.028864 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1970/4016] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:28 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:29.057940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.059881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.070199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.070706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.071142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.071842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.072294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.072714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.098214 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-784d9b29-ef4a-4e42-a466-6b5c00c60f2c tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e/ips" status: 200 len: 108 microversion: 2.1 time: 0.052694 Oct 24 09:09:29.099194 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1971/4017] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e/ips => generated 108 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:29.110516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.111227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.118090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.118905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.119483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.120424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.121066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.121708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.122866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:29.140679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:29.142528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:29.143992 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86852aea-b4b9-4573-8d94-10235413cf31 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.164043 Oct 24 09:09:29.144719 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2047/4018] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:28 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:29.167171 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d65316ef-009f-4041-9dc1-8dcb9d3a3cb4 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e/ips/tempest-ServerAddressesTestJSON-32154819-network" status: 200 len: 93 microversion: 2.1 time: 0.059990 Oct 24 09:09:29.168263 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1972/4019] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e/ips/tempest-ServerAddressesTestJSON-32154819-network => generated 93 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 09:09:29.180927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.181479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.187855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.188567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.189223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.190241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.190861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.191447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.222856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:09:29.262080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.262721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.281597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.282410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.283730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.284667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.285337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.286013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.304569 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] HTTP exception thrown: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Request method failure captured: Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 HTTP/1.1 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlYnHJSk8O5Pan_f2THpwJhLGV08kjDDwPdc2RlwAldcbuR09mMYynrpLRmNDs2ecvt8MKil2wx0tXOaIiLtJ_X4_TX78ZXe6Zdy60oPmJ7q1O8Isyvk1s---ec8aUv-p20L9RUjsuP_qZulgiA6hmtH36lh6odlYor9Aezkvy-_Qd4 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.21 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ef70895cb8074b00a5800de8113eac1c Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef70895cb8074b00a5800de8113eac1c"}]}] Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ef70895cb8074b00a5800de8113eac1c Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-InstanceActionsV221TestJSON-502282689-project Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 04f2de8673fd4835b9382c22a1259df1 Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-InstanceActionsV221TestJSON-502282689-project Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a0bb7a3d-c298-4c67-821a-ed17e543d402'} Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.309059 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.313217 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.315868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Returning 404 to user: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:29.317187 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c2d95bd6-0a32-4536-9699-f76cc10e78f3 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 404 len: 111 microversion: 2.21 time: 0.059858 Oct 24 09:09:29.335061 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1973/4020] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:09:29.351823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '.version_select at 0x7f8daa44f430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.353113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.366992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.371533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.372337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.374172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.375071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.377100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.392127 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84b45c3d-1f33-4070-89a7-611fbeebef8f tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 204 len: 0 microversion: 2.1 time: 0.215873 Oct 24 09:09:29.397386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2048/4021] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:09:29 2022] DELETE /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:09:29.406107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.406837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.422096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.422596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.424991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.425791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.427699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.428399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.529093 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c804781e-c048-4f3d-9a39-5159493e2a6d tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.191717 Oct 24 09:09:29.530561 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1974/4022] 10.222.0.25 () {60 vars in 1337 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402/os-instance-actions => generated 611 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:09:29.552063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.552852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.561151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.562016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.565236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.567048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.567777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.568440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.603417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] HTTP exception thrown: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Request method failure captured: Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 HTTP/1.1 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlYnHJSk8O5Pan_f2THpwJhLGV08kjDDwPdc2RlwAldcbuR09mMYynrpLRmNDs2ecvt8MKil2wx0tXOaIiLtJ_X4_TX78ZXe6Zdy60oPmJ7q1O8Isyvk1s---ec8aUv-p20L9RUjsuP_qZulgiA6hmtH36lh6odlYor9Aezkvy-_Qd4 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.21 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ef70895cb8074b00a5800de8113eac1c Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef70895cb8074b00a5800de8113eac1c"}]}] Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ef70895cb8074b00a5800de8113eac1c Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-InstanceActionsV221TestJSON-502282689-project Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 04f2de8673fd4835b9382c22a1259df1 Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-InstanceActionsV221TestJSON-502282689-project Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a0bb7a3d-c298-4c67-821a-ed17e543d402'} Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:29.606200 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.610142 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.612008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Returning 404 to user: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:29.614717 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-218bb17d-c38e-403a-8faf-c02f83f23623 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 404 len: 111 microversion: 2.21 time: 0.066820 Oct 24 09:09:29.619922 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1975/4023] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:09:29 2022] DELETE /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:09:29.632630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.635801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] [instance: a0bb7a3d-c298-4c67-821a-ed17e543d402] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.648626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.649191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.649660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.650432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.650897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.657424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.691224 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] HTTP exception thrown: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Request method failure captured: Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 HTTP/1.1 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlYnHJSk8O5Pan_f2THpwJhLGV08kjDDwPdc2RlwAldcbuR09mMYynrpLRmNDs2ecvt8MKil2wx0tXOaIiLtJ_X4_TX78ZXe6Zdy60oPmJ7q1O8Isyvk1s---ec8aUv-p20L9RUjsuP_qZulgiA6hmtH36lh6odlYor9Aezkvy-_Qd4 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.21 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ef70895cb8074b00a5800de8113eac1c Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef70895cb8074b00a5800de8113eac1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef70895cb8074b00a5800de8113eac1c"}]}] Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ef70895cb8074b00a5800de8113eac1c Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-502282689 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-InstanceActionsV221TestJSON-502282689-project Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 04f2de8673fd4835b9382c22a1259df1 Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-InstanceActionsV221TestJSON-502282689-project Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a0bb7a3d-c298-4c67-821a-ed17e543d402'} Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.693867 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] Returning 404 to user: Instance a0bb7a3d-c298-4c67-821a-ed17e543d402 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:29.697374 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5edc130-0373-417a-893f-d562b6438eb5 tempest-InstanceActionsV221TestJSON-502282689 tempest-InstanceActionsV221TestJSON-502282689-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402" status: 404 len: 111 microversion: 2.21 time: 0.073463 Oct 24 09:09:29.699493 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1976/4024] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/a0bb7a3d-c298-4c67-821a-ed17e543d402 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:09:29.847221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:29.866589 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89635390-20f2-432c-8565-7669e3daaaf7 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1511 microversion: 2.1 time: 0.466429 Oct 24 09:09:29.867410 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2049/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:29.917804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:29.918455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:29.935536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.936097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.936797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:29.937731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:29.938332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:29.940151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:30.058806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:30.059846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:30.070672 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:30.072963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:30.075475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:30.077743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:30.079171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:30.080631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:30.081411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:30.217875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.220024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.228611 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c98b4d0-43d4-430f-9738-9437c4dc0bae tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1517 microversion: 2.1 time: 0.315093 Oct 24 09:09:30.229186 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1977/4026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:29 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:30.231386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.232986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.244320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:30.246877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:30.247158 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f5dbd7f-5b39-475c-aabc-056ad6582c5a tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.191900 Oct 24 09:09:30.251318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2050/4027] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:30 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:30.283842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:30.284653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:30.285408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:30.286307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:30.286911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:30.287514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:30.478341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.495933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.503362 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:30.505896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3acc3697-6f27-4bea-ae98-1e8fcbfa2562 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.273293 Oct 24 09:09:30.508935 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1978/4028] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:30 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:30.895759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:30.896465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:30.904676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:30.905503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:30.905938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:30.906793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:30.907436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:30.908011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.016189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:31.019290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:31.027142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.027919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.028573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.029518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.030186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.030885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.095494 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:31.133189 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83699fe3-846f-4ee8-aa67-9090c067cf3b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.120199 Oct 24 09:09:31.136280 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1979/4029] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:09:31 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:09:31.155017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:31.159077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:31.173094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.175213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.175705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.176526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.177835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.178911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.367083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.377023 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-236a6796-f708-4ff7-a02b-d0519fee0333 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1670 microversion: 2.1 time: 0.237778 Oct 24 09:09:31.389329 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1980/4030] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:31 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1670 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:31.389696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.389807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:31.389807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:31.391004 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9ba58fa-7b9e-41fb-b480-16b41ca878a9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1511 microversion: 2.1 time: 0.499512 Oct 24 09:09:31.397813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.397813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.397813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.397813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.398201 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2051/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:30 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:31.403186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:31.406779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.407407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.408731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:31.423756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.424260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.424702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.429226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.429820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.430278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.606390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.618236 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30e8f0b9-c016-4192-9769-e6833988b007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1523 microversion: 2.1 time: 0.239006 Oct 24 09:09:31.633324 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1981/4032] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:31 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:31.633324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:31.633324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:31.634963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.638582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.639222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.640189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:31.640866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:31.641482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:31.703271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.708437 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:31.720321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.721799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.736040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.737692 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-906dbc1e-3139-4ca8-a9de-8aae5e779dab tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1447 microversion: 2.75 time: 0.338597 Oct 24 09:09:31.755771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2052/4033] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:31 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1447 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:31.756832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.756832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:31.756832 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e40b07e9-95f2-40f3-a8c2-9eea6e529d19 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.133722 Oct 24 09:09:31.756832 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1982/4034] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:31 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:32.406100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:32.407264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:32.420595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:32.421930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:32.432553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:32.434638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:32.434816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:32.437010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:32.437753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:32.440240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:32.440491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:32.441140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:32.442541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:32.443025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:32.452758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:32.454857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:32.984060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:32.993166 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6dd8610-9da8-44c4-9aff-f6ba766a6e7d tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1511 microversion: 2.1 time: 0.576281 Oct 24 09:09:33.005885 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1983/4035] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:32 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1511 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:33.011033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:33.012262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:33.020275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.030131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.030786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.031685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.032295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.032900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.222372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.240479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b83528e-f165-4eb3-a0ba-2fb8164c94d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1670 microversion: 2.1 time: 0.838783 Oct 24 09:09:33.241584 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2053/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:32 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1670 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:33.247106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:33.247743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:33.261525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.262037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.262485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.263213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.263677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.264110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.512310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.520870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.522379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.536767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-82e70c5c-99c1-43ee-bea8-d8354df19464 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1453 microversion: 2.75 time: 0.294044 Oct 24 09:09:33.537751 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2054/4037] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:33 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1453 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:33.542737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:33.543567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:33.552378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.552878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.553411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.554116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.554880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.555458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.727017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.728794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.752116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.754336 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-169a872f-a3d9-404d-acfb-5d49d4a462b7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1523 microversion: 2.1 time: 0.735360 Oct 24 09:09:33.755239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:33.757962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1984/4038] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:33 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1523 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:33.772016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f9b375af-7f2d-4cd9-95e6-13c2b661d9f4 req-6a3ef538-13a7-43b3-a5db-04f818cfd97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e11b871-af27-41a5-853d-bf2075cba09e", "name": "network-vif-deleted", "tag": "a0a34758-bd95-43e2-b2d6-f12947a0af16"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:33.782175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9b375af-7f2d-4cd9-95e6-13c2b661d9f4 req-6a3ef538-13a7-43b3-a5db-04f818cfd97f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:33.782892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9b375af-7f2d-4cd9-95e6-13c2b661d9f4 req-6a3ef538-13a7-43b3-a5db-04f818cfd97f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:33.783504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f9b375af-7f2d-4cd9-95e6-13c2b661d9f4 req-6a3ef538-13a7-43b3-a5db-04f818cfd97f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:33.785505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13273bf0-abd3-4bc9-bfc5-30d0fc85a345 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1603 microversion: 2.42 time: 0.238546 Oct 24 09:09:33.786379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2055/4039] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:33 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1603 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:33.799463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f9b375af-7f2d-4cd9-95e6-13c2b661d9f4 req-6a3ef538-13a7-43b3-a5db-04f818cfd97f service nova] Creating event network-vif-deleted:a0a34758-bd95-43e2-b2d6-f12947a0af16 for instance 4e11b871-af27-41a5-853d-bf2075cba09e on n-h2-master-1 Oct 24 09:09:33.821479 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f9b375af-7f2d-4cd9-95e6-13c2b661d9f4 req-6a3ef538-13a7-43b3-a5db-04f818cfd97f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061637 Oct 24 09:09:33.822651 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1985/4040] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:34.034411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:34.035510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:34.046699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.047496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.060633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.062066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.063168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.065037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.214964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.222935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.223415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.229151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lazy-loading 'fault' on Instance uuid 4e11b871-af27-41a5-853d-bf2075cba09e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:34.268927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:34.269514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:34.286588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.287127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.288424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.291136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.291619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.294513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.393645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde7b27b41384ebba2211631caaeee72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a2425e6cd4c0cb64f25f6fe99f778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:34.401606 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-817c24e3-b2e7-4ab8-a0e3-6da9a03707c9 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 200 len: 1307 microversion: 2.1 time: 0.373336 Oct 24 09:09:34.402501 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2056/4041] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:34 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:34.569157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-02b20608-1853-4f3c-bc6b-42fe2c102cd4 req-4cc12e2a-c977-422f-9a74-a57757918c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b6cab5-9253-4873-9fcd-5886c4472af9", "name": "network-vif-unplugged", "status": "completed", "tag": "79b12027-aac6-4321-a58b-2db9abfe6d8a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:34.583930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02b20608-1853-4f3c-bc6b-42fe2c102cd4 req-4cc12e2a-c977-422f-9a74-a57757918c43 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.584645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02b20608-1853-4f3c-bc6b-42fe2c102cd4 req-4cc12e2a-c977-422f-9a74-a57757918c43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.585346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-02b20608-1853-4f3c-bc6b-42fe2c102cd4 req-4cc12e2a-c977-422f-9a74-a57757918c43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.646714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-02b20608-1853-4f3c-bc6b-42fe2c102cd4 req-4cc12e2a-c977-422f-9a74-a57757918c43 service nova] Creating event network-vif-unplugged:79b12027-aac6-4321-a58b-2db9abfe6d8a for instance 80b6cab5-9253-4873-9fcd-5886c4472af9 on n-h2-master-1 Oct 24 09:09:34.656656 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-02b20608-1853-4f3c-bc6b-42fe2c102cd4 req-4cc12e2a-c977-422f-9a74-a57757918c43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090182 Oct 24 09:09:34.659369 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2057/4042] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:09:34.686667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:34.689156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:34.701417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.702255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.702959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.703887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.704677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.705350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.841789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:34.858686 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b75ae317-034d-470e-96fb-c7df1bd87117 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1670 microversion: 2.1 time: 0.597635 Oct 24 09:09:34.860089 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1986/4043] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:34 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1670 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:34.865345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:34.871618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:34.874899 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:34.893769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.894635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.895245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.896547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:34.897195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:34.897809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:34.905214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:34.926348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:34.929811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:34.945598 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9eac0a5-723f-4aea-bca1-ef204cbf5175 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1438 microversion: 2.75 time: 0.282895 Oct 24 09:09:34.973464 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2058/4044] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:34 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1438 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:34.988297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:34.991429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:35.005204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.005693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.006304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.007039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.009645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.010083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.122316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.131089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.131813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.134087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lazy-loading 'fault' on Instance uuid 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:35.159028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:35.168427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8932b57-413c-48be-9f68-c9205c97f728 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1523 microversion: 2.1 time: 0.306774 Oct 24 09:09:35.169148 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1987/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:34 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:35.386311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:35.390616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:35.399949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.405268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.407381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.408647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.409401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.410050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.614866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:35.615645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:35.616490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:35.617108 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:35.617789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:35.716008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:35.722744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.723599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.724256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.725378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.726067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.727610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.837996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:35.885975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:35.902822 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79823f94-900c-4d0b-8c94-44c3edec6935 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24/action" status: 202 len: 1942 microversion: 2.75 time: 0.719710 Oct 24 09:09:35.906808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:35.910278 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1988/4046] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:09:35 2022] POST /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24/action => generated 1942 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 09:09:35.915642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b245555254674c8eac74a684b9da59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c86dafe5aca46ecac15a54389270136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:35.918837 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47758bfb-8e79-42ad-82d7-2b570097add8 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 200 len: 1370 microversion: 2.42 time: 0.942813 Oct 24 09:09:35.930127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:35.931120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] [instance: 4e11b871-af27-41a5-853d-bf2075cba09e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:35.934822 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2059/4047] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:34 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 1370 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:35.960815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.961883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.963003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.963244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:35.963929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:35.964690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.970150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.970935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.972693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.973203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.973675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:35.978185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:35.983588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:35.984221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:36.003283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] HTTP exception thrown: Instance 4e11b871-af27-41a5-853d-bf2075cba09e could not be found. Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Request method failure captured: Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e HTTP/1.1 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlY4rHV0MzOZ1OaMCc086aX30PUSVA9VHeXu-ehp-JQNtZUJCJyXgb6oK4oBzSRiIPCuVAL3g7gTbUQfJqIDyfHJeTK3DL8c8LOkKxS36vJRpkWKTdJG1BkWSCOijn58vu12TFchP7F0smkrKgkaB5kTX-2DVhjqrz8OpQ0rcZljPYc Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 618a2425e6cd4c0cb64f25f6fe99f778 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerAddressesTestJSON-261250393 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/618a2425e6cd4c0cb64f25f6fe99f778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_618a2425e6cd4c0cb64f25f6fe99f778"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/618a2425e6cd4c0cb64f25f6fe99f778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/618a2425e6cd4c0cb64f25f6fe99f778"}]}] Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerAddressesTestJSON-261250393 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 618a2425e6cd4c0cb64f25f6fe99f778 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerAddressesTestJSON-261250393 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerAddressesTestJSON-261250393-project Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: fde7b27b41384ebba2211631caaeee72 Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerAddressesTestJSON-261250393-project Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 4e11b871-af27-41a5-853d-bf2075cba09e could not be found. Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '4e11b871-af27-41a5-853d-bf2075cba09e'} Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e11b871-af27-41a5-853d-bf2075cba09e could not be found. Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e11b871-af27-41a5-853d-bf2075cba09e could not be found. Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:36.005577 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e11b871-af27-41a5-853d-bf2075cba09e could not be found. Oct 24 09:09:36.009369 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:36.010658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] Returning 404 to user: Instance 4e11b871-af27-41a5-853d-bf2075cba09e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:36.014563 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43837723-1b10-481c-9109-e4f100163f87 tempest-ServerAddressesTestJSON-261250393 tempest-ServerAddressesTestJSON-261250393-project] 10.222.0.25 "GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e" status: 404 len: 111 microversion: 2.1 time: 0.096029 Oct 24 09:09:36.015724 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1989/4048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:35 2022] GET /compute/v2.1/servers/4e11b871-af27-41a5-853d-bf2075cba09e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:09:36.022389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:36.023189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:36.035732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:36.036441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:36.037704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:36.038562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:36.039181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:36.039758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:36.151084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:36.189107 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4436e22b-c5a0-4c6d-b884-f1283506b4fd tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.171902 Oct 24 09:09:36.210457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1990/4049] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:36 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:36.220308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:36.221662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:36.229168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:36.232276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:36.233526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:36.236536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:36.238598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:36.239501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:36.668710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:36.681872 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf1b3e25-07a2-44b9-bfa5-ac35e4ba3718 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.745556 Oct 24 09:09:36.683451 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2060/4050] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:35 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:36.951603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:36.952233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:36.966774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:36.967525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:36.968116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:36.969064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:36.969862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:36.970460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:37.006708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:37.007649 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] HTTP exception thrown: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Request method failure captured: Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 HTTP/1.1 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlPeK4jUC5j5Cg7n3rnUb7NQtAEPhINrLXV1V4uiYiG-aMga2fGbxXOdo7aZaivQo3I-Le5iWaFQ0BfIjp2PJnjbW45TVu0IR1NHgNkizLyiv9OUmBXmCWH1ePE1sLkYu7jEJcezGbnS7KZkavep5oXKAND2loh1ndO0JwVL9hS6aoA Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.42 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 3c86dafe5aca46ecac15a54389270136 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c86dafe5aca46ecac15a54389270136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c86dafe5aca46ecac15a54389270136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c86dafe5aca46ecac15a54389270136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c86dafe5aca46ecac15a54389270136"}]}] Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 3c86dafe5aca46ecac15a54389270136 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TaggedBootDevicesTest_v242-1737247252-project Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b245555254674c8eac74a684b9da59cc Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1737247252-project Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '2b86e284-91ab-421c-87c0-4bdef9e3c5a5'} Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:09:37.009385 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Returning 404 to user: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:37.014457 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d714241d-2d6b-4a69-a794-7dcf08998cf2 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 404 len: 111 microversion: 2.42 time: 0.064716 Oct 24 09:09:37.015843 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18146cfd-0b73-4972-ac91-4ad914dec2a7 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1523 microversion: 2.1 time: 0.803430 Oct 24 09:09:37.023448 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1991/4051] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:36 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1523 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:37.023633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2061/4052] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:36 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:09:37.031924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-567746b8-c979-4a96-be64-1f27c788e081 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '.version_select at 0x7f8daa08bb80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:37.060154 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-567746b8-c979-4a96-be64-1f27c788e081 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289734879" status: 204 len: 0 microversion: 2.42 time: 0.039372 Oct 24 09:09:37.060958 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1992/4053] 10.222.0.25 () {60 vars in 1259 bytes} [Mon Oct 24 09:09:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289734879 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:09:37.222683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:37.223298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:37.234643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:37.235148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:37.235594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:37.236309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:37.236770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:37.244466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:37.392984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:37.413255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d31f084-e341-4612-bd62-b4d0661ce530 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.194263 Oct 24 09:09:37.414838 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2062/4054] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:37 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:38.047037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:38.048080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:38.059654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:38.060673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:38.061364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:38.062177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:38.062734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:38.063324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:38.399330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-20eb740c-d1de-45ab-af29-0ad8ef7dedd8 req-5587e6fa-7f5e-4a6f-950d-3df0bd8f69c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b6cab5-9253-4873-9fcd-5886c4472af9", "name": "network-vif-plugged", "status": "completed", "tag": "79b12027-aac6-4321-a58b-2db9abfe6d8a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:38.413340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:38.424988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-20eb740c-d1de-45ab-af29-0ad8ef7dedd8 req-5587e6fa-7f5e-4a6f-950d-3df0bd8f69c5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:38.425530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-20eb740c-d1de-45ab-af29-0ad8ef7dedd8 req-5587e6fa-7f5e-4a6f-950d-3df0bd8f69c5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:38.427537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-20eb740c-d1de-45ab-af29-0ad8ef7dedd8 req-5587e6fa-7f5e-4a6f-950d-3df0bd8f69c5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:38.443835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db64585d-a807-4c69-a144-688e228b4b31 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1523 microversion: 2.1 time: 0.403494 Oct 24 09:09:38.455963 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-20eb740c-d1de-45ab-af29-0ad8ef7dedd8 req-5587e6fa-7f5e-4a6f-950d-3df0bd8f69c5 service nova] Creating event network-vif-plugged:79b12027-aac6-4321-a58b-2db9abfe6d8a for instance 80b6cab5-9253-4873-9fcd-5886c4472af9 on n-h2-master-1 Oct 24 09:09:38.458703 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1993/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:38 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:38.464397 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-20eb740c-d1de-45ab-af29-0ad8ef7dedd8 req-5587e6fa-7f5e-4a6f-950d-3df0bd8f69c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068134 Oct 24 09:09:38.465457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:38.465614 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2063/4056] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:38.466377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:38.473785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:38.474553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:38.475545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:38.476449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:38.477380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:38.477969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:38.597967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:38.603629 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:38.639687 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ddabd08-b306-442a-b99f-f26185d075c2 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.179644 Oct 24 09:09:38.641155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1994/4057] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:38 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:39.471103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:39.472292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:39.487010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:39.487601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:39.488523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:39.491351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:39.492300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:39.493324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:39.674366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:39.676306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:39.689798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:39.690688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:39.691501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:39.692560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:39.695560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:39.696249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:39.822134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:39.851137 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d28f7a68-1df6-4daf-a2d3-89fe4715cace tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.182139 Oct 24 09:09:39.871746 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1995/4058] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:39 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:40.045510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:40.060882 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12c7e474-af4c-4208-a813-6d63b30d25de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1523 microversion: 2.1 time: 0.593878 Oct 24 09:09:40.062820 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2064/4059] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:39 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1523 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:40.883897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:40.884654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:40.892551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:40.893181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:40.893764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:40.894562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:40.895156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:40.895676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:41.037832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:41.086176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:41.087576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:41.095380 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-570741ca-2bbe-46bc-99b5-d7ffd3360caf tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.215306 Oct 24 09:09:41.100695 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1996/4060] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:40 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:41.104029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:41.107077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:41.113999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:41.115013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:41.115661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:41.116284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:41.785841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:41.794379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25e7628a-8c3d-43a1-be56-2650a6a34795 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1508 microversion: 2.1 time: 0.712788 Oct 24 09:09:41.798056 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2065/4061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:41 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1508 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:41.822133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:41.822935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:41.834554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:41.835055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:41.835498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:41.836215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:41.836672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:41.837101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:42.134628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:42.136653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:42.144150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:42.144639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:42.145248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:42.146290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:42.146898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:42.147476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:42.185683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:42.194614 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fcd2ceae-acbc-4087-811e-17a04b964c0d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 200 len: 1508 microversion: 2.1 time: 0.376300 Oct 24 09:09:42.195806 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1997/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:41 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:42.223115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:42.223619 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:42.235489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:42.237956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:42.238797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:42.239746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:42.240565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:42.241278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:42.274191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:09:42.301065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:42.326266 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3fa22f2-920b-4db8-9638-5e22a04445bc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.195287 Oct 24 09:09:42.341120 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2066/4063] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:42 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:42.401995 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe1f91b5-aa11-41b8-a077-b453e23ae8b8 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 204 len: 0 microversion: 2.1 time: 0.183527 Oct 24 09:09:42.404702 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1998/4064] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:09:42 2022] DELETE /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:09:42.547286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1234657556", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "9c8a69b9-64d8-470d-a2c0-3d0dcb70a482"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:42.646468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] validate_networks() for [('9c8a69b9-64d8-470d-a2c0-3d0dcb70a482', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:09:43.596189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-204253645", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "1eeb1fee-054b-416e-b231-7e81d016f0d4"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:43.687159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] validate_networks() for [('1eeb1fee-054b-416e-b231-7e81d016f0d4', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:09:44.271991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:44.274301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:44.276943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:44.277894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:44.280041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:44.324644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:44.326359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:44.327506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:44.329889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:44.330604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:44.331203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:44.398764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Getting quotas for project 82888bc2bd7c40dcbae68a5e4fa6c4f2. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:09:44.430071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Getting quotas for user 5ae455a2351c4cf9a32ca68e686d27d0 and project 82888bc2bd7c40dcbae68a5e4fa6c4f2. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:09:44.455517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:09:44.458573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:09:44.543889 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad7e727d-58ad-41d6-8ab3-6063816b277b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000264 Oct 24 09:09:44.554297 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2067/4065] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:09:44.577743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:44.578526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:44.611483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:44.612263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:44.612729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:44.628855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:44.629690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:44.630140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:45.091135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:45.091135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:45.091612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:45.092014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:45.092615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:45.112800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:45.113786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:45.114843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:45.117969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:45.119466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:45.121103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:45.121282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:45.189279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Getting quotas for project 126c5b989a304f1cb217c95ebfbbd8b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:09:45.199721 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34477993-4e35-4f7c-bd4e-35d061798cbb tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.641813 Oct 24 09:09:45.208597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Getting quotas for user abd944e891194ac498c21b55da9cb581 and project 126c5b989a304f1cb217c95ebfbbd8b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:09:45.221624 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2068/4066] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:44 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:45.240077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d39df572-3b42-4a7f-af13-89221028b89d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:45.241046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d39df572-3b42-4a7f-af13-89221028b89d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:45.260033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:09:45.263369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:09:45.390297 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cc3ceb8-482a-4506-bf8a-6a315e65abb5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.244866 Oct 24 09:09:45.391664 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1999/4067] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:09:45.604990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d39df572-3b42-4a7f-af13-89221028b89d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:45.616904 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d39df572-3b42-4a7f-af13-89221028b89d tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1218 microversion: 2.1 time: 0.390320 Oct 24 09:09:45.622955 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2069/4068] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:45 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1218 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:45.693821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-496089441", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "1eeb1fee-054b-416e-b231-7e81d016f0d4"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:45.812729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-4f5c7600-b15f-42fd-ae08-100ebc5e223f req-3795c834-2879-4a12-91ac-cd65d3bde6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b6cab5-9253-4873-9fcd-5886c4472af9", "name": "network-vif-deleted", "tag": "79b12027-aac6-4321-a58b-2db9abfe6d8a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:45.874317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] validate_networks() for [('1eeb1fee-054b-416e-b231-7e81d016f0d4', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:09:45.882082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4f5c7600-b15f-42fd-ae08-100ebc5e223f req-3795c834-2879-4a12-91ac-cd65d3bde6f4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:45.882598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4f5c7600-b15f-42fd-ae08-100ebc5e223f req-3795c834-2879-4a12-91ac-cd65d3bde6f4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:45.883041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4f5c7600-b15f-42fd-ae08-100ebc5e223f req-3795c834-2879-4a12-91ac-cd65d3bde6f4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:45.938641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-4f5c7600-b15f-42fd-ae08-100ebc5e223f req-3795c834-2879-4a12-91ac-cd65d3bde6f4 service nova] Creating event network-vif-deleted:79b12027-aac6-4321-a58b-2db9abfe6d8a for instance 80b6cab5-9253-4873-9fcd-5886c4472af9 on n-h2-master-1 Oct 24 09:09:45.958580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-4f5c7600-b15f-42fd-ae08-100ebc5e223f req-3795c834-2879-4a12-91ac-cd65d3bde6f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146502 Oct 24 09:09:45.959980 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2070/4069] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:09:46.248175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:46.250456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:46.284510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:46.285738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:46.288655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:46.297065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:46.298460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:46.300655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:46.487580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:46.498332 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:46.579738 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91d5cdb3-f6e7-4122-b828-390a233083fa tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.344332 Oct 24 09:09:46.581693 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2071/4070] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:46 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:46.644644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:46.646460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:46.685940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:46.687171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:46.688686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:46.692452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:46.693204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:46.696175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:46.921046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:46.933453 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6bd3dafd-2ee8-4cd6-948d-9cfc9bb96007 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1270 microversion: 2.1 time: 0.293205 Oct 24 09:09:46.940873 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2072/4071] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:46 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:47.610919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:47.611615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:47.627369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:47.628435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:47.629091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:47.631644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:47.635550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:47.636777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:47.889730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:47.954640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8694d9ce-a2ad-4893-9ffd-29f6b5d44a51 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.342757 Oct 24 09:09:47.962267 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2073/4072] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:47 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:47.990678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:47.992502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:48.013560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:48.020445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:48.022702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:48.027839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:48.028670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:48.030417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:48.201829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:48.213320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ef1ccac-3ce3-4db9-911a-5cfa28f0ac19 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1276 microversion: 2.1 time: 0.249223 Oct 24 09:09:48.228051 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2074/4073] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:47 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:48.556270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:48.556838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:48.558553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:48.559213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:48.560127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:48.570040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:48.571438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:48.572095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:48.574240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:48.574939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:48.575585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:48.611224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Getting quotas for project 126c5b989a304f1cb217c95ebfbbd8b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:09:48.617822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Getting quotas for user abd944e891194ac498c21b55da9cb581 and project 126c5b989a304f1cb217c95ebfbbd8b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:09:48.633870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:09:48.636590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:09:48.696915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-436a7b9a-9db9-4f53-8016-e8fcff99cf1d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008261 Oct 24 09:09:48.698868 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2000/4074] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:09:48.852931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-765480531", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "451", "networks": [{"uuid": "1eeb1fee-054b-416e-b231-7e81d016f0d4"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:48.915282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:48.916003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:48.937442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:48.940151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:48.942451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:48.946108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:48.946743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:48.947338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:48.963616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] validate_networks() for [('1eeb1fee-054b-416e-b231-7e81d016f0d4', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:09:48.988936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] HTTP exception thrown: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Request method failure captured: Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 HTTP/1.1 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlPeK4jUC5j5Cg7n3rnUb7NQtAEPhINrLXV1V4uiYiG-aMga2fGbxXOdo7aZaivQo3I-Le5iWaFQ0BfIjp2PJnjbW45TVu0IR1NHgNkizLyiv9OUmBXmCWH1ePE1sLkYu7jEJcezGbnS7KZkavep5oXKAND2loh1ndO0JwVL9hS6aoA Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.42 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3c86dafe5aca46ecac15a54389270136 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c86dafe5aca46ecac15a54389270136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c86dafe5aca46ecac15a54389270136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c86dafe5aca46ecac15a54389270136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c86dafe5aca46ecac15a54389270136"}]}] Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3c86dafe5aca46ecac15a54389270136 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TaggedBootDevicesTest_v242-1737247252-project Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b245555254674c8eac74a684b9da59cc Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1737247252-project Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '2b86e284-91ab-421c-87c0-4bdef9e3c5a5'} Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:49.002828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.007335 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.011318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Returning 404 to user: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:49.014602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6157f0d7-be5e-4e1d-a15c-bcb170613071 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 404 len: 111 microversion: 2.42 time: 0.104961 Oct 24 09:09:49.017518 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2001/4075] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:09:48 2022] DELETE /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:09:49.024190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:49.031610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:49.065781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:49.066684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:49.067603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:49.069337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:49.069933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:49.070283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:49.187358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:49.226752 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c52d689-9c9f-4e45-b098-88842f301885 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.205684 Oct 24 09:09:49.229038 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2002/4076] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:49 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:49.259009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:49.259751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] [instance: 2b86e284-91ab-421c-87c0-4bdef9e3c5a5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:49.266305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:49.267114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:49.267815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:49.268773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:49.269507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:49.270154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:49.285886 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] HTTP exception thrown: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Request method failure captured: Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 HTTP/1.1 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlPeK4jUC5j5Cg7n3rnUb7NQtAEPhINrLXV1V4uiYiG-aMga2fGbxXOdo7aZaivQo3I-Le5iWaFQ0BfIjp2PJnjbW45TVu0IR1NHgNkizLyiv9OUmBXmCWH1ePE1sLkYu7jEJcezGbnS7KZkavep5oXKAND2loh1ndO0JwVL9hS6aoA Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.42 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3c86dafe5aca46ecac15a54389270136 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c86dafe5aca46ecac15a54389270136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c86dafe5aca46ecac15a54389270136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c86dafe5aca46ecac15a54389270136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c86dafe5aca46ecac15a54389270136"}]}] Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3c86dafe5aca46ecac15a54389270136 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1737247252 Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TaggedBootDevicesTest_v242-1737247252-project Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b245555254674c8eac74a684b9da59cc Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1737247252-project Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '2b86e284-91ab-421c-87c0-4bdef9e3c5a5'} Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.287983 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. Oct 24 09:09:49.291544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:09:49.294024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] Returning 404 to user: Instance 2b86e284-91ab-421c-87c0-4bdef9e3c5a5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:09:49.295176 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f98aff8c-b291-4c2f-958d-5848df4e49f6 tempest-TaggedBootDevicesTest_v242-1737247252 tempest-TaggedBootDevicesTest_v242-1737247252-project] 10.222.0.25 "GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5" status: 404 len: 111 microversion: 2.42 time: 0.050938 Oct 24 09:09:49.296012 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2003/4077] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:49 2022] GET /compute/v2.1/servers/2b86e284-91ab-421c-87c0-4bdef9e3c5a5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:09:49.302490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:49.303404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:49.311281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:49.311981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:49.312678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:49.313675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:49.314379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:49.315445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:49.410897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:49.429219 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d3e1726-7866-4e20-a907-21e0eaeefc14 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1276 microversion: 2.1 time: 0.131827 Oct 24 09:09:49.455935 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2004/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:49 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:50.263022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:50.264615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:50.278065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:50.280282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:50.280896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:50.284015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:50.285333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:50.285965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:50.454582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:50.491163 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d9c492f-506c-44aa-a161-4ae5f37ee63a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.231247 Oct 24 09:09:50.492708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2005/4079] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:50 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:50.501346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:50.502251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:50.519303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:50.519883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:50.520540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:50.521708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:50.534354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:50.534925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:50.977083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:50.987424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7586405-819f-40d2-8e58-115cb5d6ec8a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.493178 Oct 24 09:09:50.990426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2006/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:50 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:51.523497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:51.525027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:51.534788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:51.541351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:51.542539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:51.543478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:51.544089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:51.544665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:51.602596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:09:51.603536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:09:51.605631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:09:51.607429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:09:51.607892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:09:51.630752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:51.631235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:51.631680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:51.632427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:51.632872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:51.633314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:51.681551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Getting quotas for project 126c5b989a304f1cb217c95ebfbbd8b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:09:51.695817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Getting quotas for user abd944e891194ac498c21b55da9cb581 and project 126c5b989a304f1cb217c95ebfbbd8b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:09:51.745286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:09:51.748226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:09:51.787439 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:51.801498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:51.819272 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b3b55c1-11b4-48a1-954b-e91c8ba182bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.970379 Oct 24 09:09:51.822289 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2075/4081] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:09:51.834346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b226fdd8-68b2-4be7-874e-3981f9c5eda6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:51.835273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b226fdd8-68b2-4be7-874e-3981f9c5eda6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:51.855659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-965180ce-308c-4c23-83d3-f1dbe8931cf9 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.337165 Oct 24 09:09:51.856571 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2007/4082] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:51 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:52.011280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:52.012044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:52.018358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:52.023722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:52.024189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:52.029686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:52.030312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:52.030775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:52.235479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b226fdd8-68b2-4be7-874e-3981f9c5eda6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:52.244610 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b226fdd8-68b2-4be7-874e-3981f9c5eda6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1220 microversion: 2.1 time: 0.414965 Oct 24 09:09:52.249490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2076/4083] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:51 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1220 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:52.886440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:52.887098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:52.898303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:52.908016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:52.908752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:52.909713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:52.910354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:52.910993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:52.959031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:52.967514 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4f2e7631-fec1-42ca-9d74-89ad139f8f4a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.960543 Oct 24 09:09:52.973991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2008/4084] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:52 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:53.107814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-06da9a86-cf6c-43a2-ad78-07d4a0caa60c req-e3cdcc12-a36c-41a3-a3fc-2c9beffc0a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2b1175-4979-4bdb-9a4d-f511169dd1e2", "tag": "33589a3e-17eb-4df5-b074-931636a6e195"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:53.146307 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:53.165230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-06da9a86-cf6c-43a2-ad78-07d4a0caa60c req-e3cdcc12-a36c-41a3-a3fc-2c9beffc0a3c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:53.166120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-06da9a86-cf6c-43a2-ad78-07d4a0caa60c req-e3cdcc12-a36c-41a3-a3fc-2c9beffc0a3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:53.167280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-06da9a86-cf6c-43a2-ad78-07d4a0caa60c req-e3cdcc12-a36c-41a3-a3fc-2c9beffc0a3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:53.210050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-06da9a86-cf6c-43a2-ad78-07d4a0caa60c req-e3cdcc12-a36c-41a3-a3fc-2c9beffc0a3c service nova] Creating event network-changed:33589a3e-17eb-4df5-b074-931636a6e195 for instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 on n-h1-master-1 Oct 24 09:09:53.216115 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-06da9a86-cf6c-43a2-ad78-07d4a0caa60c req-e3cdcc12-a36c-41a3-a3fc-2c9beffc0a3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112572 Oct 24 09:09:53.219671 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2009/4085] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:53.243646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:53.272031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:53.272732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:53.276027 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1a9b6b4-05a2-4295-bb62-4e89ea3ea9dc tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.393118 Oct 24 09:09:53.277686 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2077/4086] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:52 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:53.282042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:53.286246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:53.291481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:53.292683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:53.293349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:53.297157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:53.432567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-43030f8d-09d4-4ce9-a2c9-1b41c864ca5d req-ae5553c1-8800-42a2-8413-169c693bf3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc", "tag": "829d3f45-b803-445e-b5a2-205b7ddf1ea4"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:53.454368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-43030f8d-09d4-4ce9-a2c9-1b41c864ca5d req-ae5553c1-8800-42a2-8413-169c693bf3e0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:53.454864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-43030f8d-09d4-4ce9-a2c9-1b41c864ca5d req-ae5553c1-8800-42a2-8413-169c693bf3e0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:53.455297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-43030f8d-09d4-4ce9-a2c9-1b41c864ca5d req-ae5553c1-8800-42a2-8413-169c693bf3e0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:53.481544 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-43030f8d-09d4-4ce9-a2c9-1b41c864ca5d req-ae5553c1-8800-42a2-8413-169c693bf3e0 service nova] Creating event network-changed:829d3f45-b803-445e-b5a2-205b7ddf1ea4 for instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc on n-h1-master-1 Oct 24 09:09:53.486645 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-43030f8d-09d4-4ce9-a2c9-1b41c864ca5d req-ae5553c1-8800-42a2-8413-169c693bf3e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057821 Oct 24 09:09:53.487748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2078/4087] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:09:53.561828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:53.570150 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ef1405f-6808-40f1-90d9-b5fd5c7d1f5c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1272 microversion: 2.1 time: 0.302081 Oct 24 09:09:53.570656 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2010/4088] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:53 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:09:54.006024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:54.007832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:54.023892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:54.024717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:54.025820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:54.028010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:54.028823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:54.030398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:54.309590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:54.311498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:54.324900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:54.325676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:54.328875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:54.330077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:54.330985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:54.333377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:54.394219 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:54.627283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:54.672730 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8af7b938-9257-4d92-8f77-1b326c46c92e tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.367771 Oct 24 09:09:54.693122 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2011/4089] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:54 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:54.693122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:54.693122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:54.696795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:54.697332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:54.697804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:54.700293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:54.700293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:54.700293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:55.014543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:55.044926 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5f09de4e-5727-4e84-a8fc-04c0ed052423 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 1.045726 Oct 24 09:09:55.053846 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2079/4090] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:53 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:55.228637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:55.250496 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-486ca2c6-4fd6-4253-a122-c76a778ecd40 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1278 microversion: 2.1 time: 0.575949 Oct 24 09:09:55.257333 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2012/4091] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:54 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1278 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:55.701619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:55.702328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:55.715136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:55.717814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:55.718348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:55.719167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:55.720264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:55.730658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:55.922056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:55.973320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d07c845-f5cf-406c-96b2-9d703f364499 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.276174 Oct 24 09:09:55.978226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2080/4092] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:55 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:56.107495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-500fd8ad-a8f0-4950-8a75-b779d1bb9a30 req-e5d071ba-914b-4fc1-afb0-05a50e4b99cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd02b56-a01e-4a1c-a415-0792683e903f", "tag": "c9c69745-9562-4273-af8e-6072ebbe581b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:09:56.110472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:56.113105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:56.174112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:56.179814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:56.180415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:56.181239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:56.186546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-500fd8ad-a8f0-4950-8a75-b779d1bb9a30 req-e5d071ba-914b-4fc1-afb0-05a50e4b99cc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:56.187447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:56.187905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:56.189738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-500fd8ad-a8f0-4950-8a75-b779d1bb9a30 req-e5d071ba-914b-4fc1-afb0-05a50e4b99cc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:56.190193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-500fd8ad-a8f0-4950-8a75-b779d1bb9a30 req-e5d071ba-914b-4fc1-afb0-05a50e4b99cc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:56.249020 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-500fd8ad-a8f0-4950-8a75-b779d1bb9a30 req-e5d071ba-914b-4fc1-afb0-05a50e4b99cc service nova] Creating event network-changed:c9c69745-9562-4273-af8e-6072ebbe581b for instance 6fd02b56-a01e-4a1c-a415-0792683e903f on n-h2-master-1 Oct 24 09:09:56.279481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-500fd8ad-a8f0-4950-8a75-b779d1bb9a30 req-e5d071ba-914b-4fc1-afb0-05a50e4b99cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184975 Oct 24 09:09:56.281577 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2081/4093] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:09:56.295206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:56.296004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:56.333530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:56.335649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:56.336504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:56.337675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:56.338154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:56.339363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:56.757615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:56.778792 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa0f2402-f109-47a3-befd-493e06312250 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1278 microversion: 2.1 time: 0.495849 Oct 24 09:09:56.779687 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2082/4094] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:56 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1278 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:57.008669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:57.009460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:57.017145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:57.029732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:57.030526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:57.031651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:57.032242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:57.032768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:57.086230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:57.104907 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5fad5d5e-1e0e-40c1-bfdf-2b8c3bcaa5c5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 1.018979 Oct 24 09:09:57.107674 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2013/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:56 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:57.203876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:57.243420 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f1e84f4-26cd-4325-b77f-afa207bfc398 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.238775 Oct 24 09:09:57.244324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2083/4096] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:57 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:09:57.809770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:57.811192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:57.833675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:57.834176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:57.834621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:57.835341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:57.842512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:57.843184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:58.132235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:58.132957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:58.154010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:58.158311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:58.158887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:58.159739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:58.160311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:58.165021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:58.517062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:58.532911 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-030f3533-5bc8-440f-830f-5c7c99f62eb6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 0.726193 Oct 24 09:09:58.538471 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2014/4097] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:57 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:58.550353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:58.553042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:58.574442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:58.578375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:58.579114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:58.579935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:58.581910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:58.583540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:58.597188 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:58.674144 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:58.676297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:09:58.686540 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d60204d-48ea-4d43-9024-69ebfe7ab8d3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.559477 Oct 24 09:09:58.700201 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2084/4098] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:58 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:09:58.797825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:09:58.843538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-16f32cb8-9516-435c-b833-a53bcf52a0d3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.302974 Oct 24 09:09:58.845375 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2015/4099] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:09:58 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:09:59.563199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:59.564095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:59.574104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:59.578030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:59.582449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:59.583450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:59.584089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:59.584680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:59.717198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:09:59.717839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:09:59.735879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:59.736376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:59.736814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:09:59.737551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:09:59.738004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:09:59.738427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:00.284519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:00.297673 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c7e5666-c74a-4cda-9b08-f9f44a4cf8a1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 0.738777 Oct 24 09:10:00.298279 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2085/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:59 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:00.320878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:00.321603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:00.344504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:00.345058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:00.345626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:00.347590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:00.348249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:00.350872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:00.515438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:00.558661 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4eed93d-d53d-427b-a85f-e1a9862f02f3 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.252883 Oct 24 09:10:00.559288 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2086/4101] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:00 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:00.578539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:00.592381 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2335c8ed-ab32-4541-bb88-55239855da11 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.878905 Oct 24 09:10:00.592978 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2016/4102] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:09:59 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:01.324481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:01.325911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:01.340876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:01.341805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:01.342915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:01.348389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:01.349403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:01.350140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:01.593081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:01.594695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:01.602824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:01.604035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:01.604886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:01.606571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:01.607308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:01.608045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:01.658775 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:01.792685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:01.802840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eef48b78-0945-454a-9f9e-f552a7f52af7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 0.483499 Oct 24 09:10:01.806488 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2087/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:01 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:01.821353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:01.822552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:01.838759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:01.839735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:01.841964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:01.844160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:01.845089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:01.847951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:01.942173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:01.966435 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6b2f2953-b8da-4aa2-8062-93c37353845a tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.378343 Oct 24 09:10:01.967253 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2017/4104] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:01 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:10:02.241631 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:02.261006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-138bcab7-e3c5-43e5-964c-aa1294c4fc3e req-ad6b2e99-4498-428e-91e0-fb182dd21613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7dbc45-6db8-4932-963f-195b2d4e5f58", "tag": "d8c3d946-fa76-4ee4-9df2-ded5ccff5a84"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:02.283500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-138bcab7-e3c5-43e5-964c-aa1294c4fc3e req-ad6b2e99-4498-428e-91e0-fb182dd21613 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:02.286326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-138bcab7-e3c5-43e5-964c-aa1294c4fc3e req-ad6b2e99-4498-428e-91e0-fb182dd21613 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:02.287037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-138bcab7-e3c5-43e5-964c-aa1294c4fc3e req-ad6b2e99-4498-428e-91e0-fb182dd21613 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:02.319784 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-138bcab7-e3c5-43e5-964c-aa1294c4fc3e req-ad6b2e99-4498-428e-91e0-fb182dd21613 service nova] Creating event network-changed:d8c3d946-fa76-4ee4-9df2-ded5ccff5a84 for instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 on n-h2-master-1 Oct 24 09:10:02.334094 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-138bcab7-e3c5-43e5-964c-aa1294c4fc3e req-ad6b2e99-4498-428e-91e0-fb182dd21613 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075837 Oct 24 09:10:02.336740 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2018/4105] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:02.548479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:02.563464 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c603f895-bf4b-413e-ba48-9e51ee7aa1a3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.754349 Oct 24 09:10:02.564098 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2088/4106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:01 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:02.835848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:02.837787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:02.855850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:02.856344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:02.856778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:02.857502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:02.863938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:02.864549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:02.999226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:02.999852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:03.009226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:03.009760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:03.010766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:03.011487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:03.011967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:03.012388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:03.471893 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:03.481426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:03.501999 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d696e0c9-a2cd-4fa7-b901-bcacb5c8e3c4 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1929 microversion: 2.75 time: 0.507488 Oct 24 09:10:03.513952 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2089/4107] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:02 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1929 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:10:03.559019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:03.570228 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3cb872e-39f7-4633-aa06-bf0af64af377 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 0.741572 Oct 24 09:10:03.575992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2019/4108] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:02 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:03.586823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:03.587619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:03.596961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:03.606088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:03.608028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:03.610324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:03.610956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:03.612144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:04.122729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:04.139773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d055cfc9-cbc2-4ec2-99f1-d259f2d4fcb4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.556733 Oct 24 09:10:04.140369 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2090/4109] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:03 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:04.532534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:04.534163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:04.551073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:04.552030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:04.552626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:04.553541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:04.554004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:04.554440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:04.603778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:04.604998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:04.618586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:04.619331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:04.619995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:04.620868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:04.633058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:04.633814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:04.692598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:04.743015 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39199e0c-0702-45ec-bd26-5567077abfb6 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1935 microversion: 2.75 time: 0.210640 Oct 24 09:10:04.745266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2020/4110] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:04 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1935 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:04.878525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b59a2b68-3b2c-4ca0-8993-0f00a408a606 req-de5a0b99-68e8-4363-983d-5daf02be95e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd02b56-a01e-4a1c-a415-0792683e903f", "name": "network-vif-plugged", "status": "completed", "tag": "c9c69745-9562-4273-af8e-6072ebbe581b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:04.911086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b59a2b68-3b2c-4ca0-8993-0f00a408a606 req-de5a0b99-68e8-4363-983d-5daf02be95e2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:04.912968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b59a2b68-3b2c-4ca0-8993-0f00a408a606 req-de5a0b99-68e8-4363-983d-5daf02be95e2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:04.915427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b59a2b68-3b2c-4ca0-8993-0f00a408a606 req-de5a0b99-68e8-4363-983d-5daf02be95e2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:04.948764 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b59a2b68-3b2c-4ca0-8993-0f00a408a606 req-de5a0b99-68e8-4363-983d-5daf02be95e2 service nova] Creating event network-vif-plugged:c9c69745-9562-4273-af8e-6072ebbe581b for instance 6fd02b56-a01e-4a1c-a415-0792683e903f on n-h2-master-1 Oct 24 09:10:04.956083 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b59a2b68-3b2c-4ca0-8993-0f00a408a606 req-de5a0b99-68e8-4363-983d-5daf02be95e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080938 Oct 24 09:10:04.957870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2021/4111] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:05.165366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:05.167629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:05.186746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:05.189384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:05.191371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:05.195494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:05.196566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:05.197218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:05.624045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:05.634573 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c610331-c4f7-46b4-8727-11c5e3858070 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.474800 Oct 24 09:10:05.639068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2022/4112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:05 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:05.776809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:05.777785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:05.789084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:05.793836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:05.794520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:05.795482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:05.796126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:05.796831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:06.230606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:06.245935 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-172fbf5b-c2c2-4529-afa4-cea1c1d910a8 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 1.645954 Oct 24 09:10:06.259754 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2091/4113] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:04 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:06.437761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:06.472722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18be702f-3dd3-4774-8242-3a178bc6ad10 tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1935 microversion: 2.75 time: 0.700246 Oct 24 09:10:06.490331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2023/4114] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:05 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1935 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:06.665892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:06.667079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:06.677323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:06.678774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:06.684705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:06.685884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:06.687228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:06.687950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.006868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc", "name": "network-vif-plugged", "status": "completed", "tag": "829d3f45-b803-445e-b5a2-205b7ddf1ea4"}, {"server_uuid": "ce2b1175-4979-4bdb-9a4d-f511169dd1e2", "name": "network-vif-plugged", "status": "completed", "tag": "33589a3e-17eb-4df5-b074-931636a6e195"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:07.031920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.032790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.035682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.084427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] Creating event network-vif-plugged:829d3f45-b803-445e-b5a2-205b7ddf1ea4 for instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc on n-h1-master-1 Oct 24 09:10:07.084427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] Creating event network-vif-plugged:33589a3e-17eb-4df5-b074-931636a6e195 for instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 on n-h1-master-1 Oct 24 09:10:07.114555 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cc33814d-b0fc-4297-bdd8-982bb5c058ba req-f0758041-b2f0-4682-98c2-a64076635f6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119871 Oct 24 09:10:07.123519 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2024/4115] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:10:07.278548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:07.279589 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:07.297188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.297696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.298126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.298823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.302643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.303062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.579182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:07.595091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b18f6b4-a721-4001-ae72-4818a35a47b5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.933457 Oct 24 09:10:07.595670 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2092/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:06 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:07.610540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:07.611423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:07.619039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.619953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.620627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.621601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.622418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.623041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.855302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] Lazy-loading 'services' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:07.889867 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5f1d9e9a-08da-4f12-b880-2c6c8a669e8d tempest-ServersAdmin275Test-772115550 tempest-ServersAdmin275Test-772115550-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1920 microversion: 2.75 time: 0.291435 Oct 24 09:10:07.891299 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2093/4117] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:07 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1920 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:07.926713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:07.927530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:07.934971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.935772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.936410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.937369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:07.940113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:07.940783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:07.976038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:10:08.084368 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59312012-6e7a-408d-881c-53b48bee5697 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 204 len: 0 microversion: 2.75 time: 0.159851 Oct 24 09:10:08.087562 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2094/4118] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:10:07 2022] DELETE /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:10:08.095685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:08.097123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:08.101924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:08.103769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:08.105282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:08.105486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:08.106195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:08.106651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:08.107104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:08.113457 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e753f6d-d1ef-4b1f-9fee-2e07f4a94863 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 0.839195 Oct 24 09:10:08.128998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2025/4119] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:07 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:08.236225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:08.246370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:08.248000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:08.257645 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9366f555-d43f-44ed-8421-aafdee794f26 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1444 microversion: 2.75 time: 0.167627 Oct 24 09:10:08.259020 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2095/4120] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:08 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:10:08.619840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:08.620859 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:08.627726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:08.628623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:08.629283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:08.630547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:08.631234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:08.631882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.137857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:09.138523 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:09.145943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.146738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.147179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.150768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.151454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.152145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.343809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:09.352657 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0609180a-b033-400c-8f23-64c04a7cbb58 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1318 microversion: 2.1 time: 0.737283 Oct 24 09:10:09.367301 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2026/4121] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:08 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:09.374249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6e90893d-f750-45a1-aa49-8be88a9a8b26 req-9d84c2a1-8929-4b85-90b6-0e28974c8ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7dbc45-6db8-4932-963f-195b2d4e5f58", "name": "network-vif-plugged", "status": "completed", "tag": "d8c3d946-fa76-4ee4-9df2-ded5ccff5a84"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:09.385881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e90893d-f750-45a1-aa49-8be88a9a8b26 req-9d84c2a1-8929-4b85-90b6-0e28974c8ec8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.386628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e90893d-f750-45a1-aa49-8be88a9a8b26 req-9d84c2a1-8929-4b85-90b6-0e28974c8ec8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.387515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e90893d-f750-45a1-aa49-8be88a9a8b26 req-9d84c2a1-8929-4b85-90b6-0e28974c8ec8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.401450 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6e90893d-f750-45a1-aa49-8be88a9a8b26 req-9d84c2a1-8929-4b85-90b6-0e28974c8ec8 service nova] Creating event network-vif-plugged:d8c3d946-fa76-4ee4-9df2-ded5ccff5a84 for instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 on n-h2-master-1 Oct 24 09:10:09.408472 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6e90893d-f750-45a1-aa49-8be88a9a8b26 req-9d84c2a1-8929-4b85-90b6-0e28974c8ec8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039636 Oct 24 09:10:09.412239 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2027/4122] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:09.418785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:09.431111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:09.438655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.439471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.447303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.452925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.454352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.455709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.675564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:09.694082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:09.696189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:09.724495 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-391a36cc-d4ab-4c1c-8f0e-47e4cf3b4e18 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1444 microversion: 2.75 time: 0.310679 Oct 24 09:10:09.729360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:09.737693 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2028/4123] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:09 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1444 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:09.751856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:09.752480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:09.776623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.781507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96449809-8a25-40d7-b21a-00efa8e255b1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1320 microversion: 2.1 time: 0.647898 Oct 24 09:10:09.781973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.782489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.783237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:09.787022 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2096/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:09 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1320 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:09.788189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:09.788816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:09.821011 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:10.278673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2101180166", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:10.362782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] validate_networks() for [('132293ad-afe6-46fc-9635-403a133a69ac', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:10:10.593212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:10.621093 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d57ab425-4c2b-4e2f-b678-ff2938d3255e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.880900 Oct 24 09:10:10.621982 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2029/4125] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:09 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:10.628414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:10.629249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:10.636422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:10.637271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:10.638485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:10.639363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:10.639973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:10.640557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.161136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:11.180099 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36a700d1-6fbe-4c3d-9b88-c072f9b4925c tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1508 microversion: 2.1 time: 0.556863 Oct 24 09:10:11.180893 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2030/4126] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:10 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1508 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:11.185393 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:11.186880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:11.197014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.198092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.209552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.210520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.211021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.211473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.397432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:10:11.397922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:10:11.398334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:10:11.398754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:10:11.399339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:10:11.418278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.418706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.419159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.423771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.424289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.424749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.484557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Getting quotas for project d6c4858fe89d4bfb8b989aa476a58a84. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:11.499911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Getting quotas for user d271cce474064255b276e240e88bbe0c and project d6c4858fe89d4bfb8b989aa476a58a84. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:11.533336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:10:11.539247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:11.644732 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7a60f3c-06dd-401a-a677-2ac7b784176d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.591808 Oct 24 09:10:11.645817 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2097/4127] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:10:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:10:11.651569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:11.657786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:11.670925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.671697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.672152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.672936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.673472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.673880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.680749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:11.696919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-853e41f8-1573-418d-a035-2b9c89c4c27b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.515002 Oct 24 09:10:11.700071 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2031/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:11 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:11.706487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:11.707316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:11.716286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.725429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.730392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.733216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.733907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.735122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.846474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:11.861480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:11.863275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:11.879970 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1bd55364-48da-40c1-b23e-8603235f9884 tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1444 microversion: 2.75 time: 0.232687 Oct 24 09:10:11.882586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2098/4129] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:11 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1444 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:11.890168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:11.890991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:11.929840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.930408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.930903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:11.931723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:11.932240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:11.932700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:12.302123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:12.317158 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d2ed657-7bb9-4a81-bdad-a3281901a75a tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1508 microversion: 2.1 time: 0.430653 Oct 24 09:10:12.321341 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2099/4130] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:11 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:12.350846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b05bfe4f-9a1b-4979-8780-d93e3d94955f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:12.351588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b05bfe4f-9a1b-4979-8780-d93e3d94955f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:12.581622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b05bfe4f-9a1b-4979-8780-d93e3d94955f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:12.594866 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b05bfe4f-9a1b-4979-8780-d93e3d94955f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1214 microversion: 2.1 time: 0.268099 Oct 24 09:10:12.597847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2100/4131] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:12 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:12.605018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:12.605926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:12.627124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:12.628783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:12.629870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:12.633577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:12.634353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:12.635061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:12.681284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:12.710004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-406c36c0-8826-4cf9-85f1-0eeb3114c31c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1512 microversion: 2.1 time: 1.001995 Oct 24 09:10:12.720831 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2032/4132] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:11 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1512 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:12.737944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:12.758301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:12.791039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:12.791735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:12.792453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:12.794938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:12.796057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:12.799041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.006565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0bbb0cd-5083-4480-b335-96d549f4f2d5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "PUT /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1080 microversion: 2.1 time: 0.282987 Oct 24 09:10:13.013518 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2033/4133] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:10:12 2022] PUT /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1080 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:13.026753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:13.030800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:13.077835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.078340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.078781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.079508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.079956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.080378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.508158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:13.525588 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7cce5557-2379-41a1-bfd9-94f8d521deab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.926127 Oct 24 09:10:13.527098 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2101/4134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:12 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:13.536519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:13.545372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:13.549727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:13.554991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.556245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.559352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.561435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.562108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.564666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68b71657-7bb5-4ac4-8736-53604810c19b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1512 microversion: 2.1 time: 0.549984 Oct 24 09:10:13.565266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2034/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:13 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:13.576232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:13.576846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:13.587543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.611202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.616424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.616843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.617616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.635113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.635602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.708071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:13.708945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:13.714221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:13.715025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lazy-loading 'fault' on Instance uuid c65c60b1-fdf8-492a-a124-5e65f1d3fb24 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:14.358729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:14.368983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:14.373188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a943f2c455934d74a696c209c0c46ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449a35c24254626bbe1449feb02e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:14.387207 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:14.397567 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29cd5dc7-f391-4fb9-8b03-cbff6a32239d tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 200 len: 1449 microversion: 2.75 time: 0.867272 Oct 24 09:10:14.400089 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2102/4136] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:13 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 1449 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:10:14.414456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:14.415365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:14.427525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:14.428479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:14.430498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:14.436908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:14.437670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:14.438439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:14.695449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:14.704308 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77068b1b-ca10-4287-a9dd-7b5970da62de tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1506 microversion: 2.1 time: 1.137967 Oct 24 09:10:14.714308 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2035/4137] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:13 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1506 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:14.719963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:14.721681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:14.738093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:14.738910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:14.743756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:14.750737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:14.751398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:14.751950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:14.781231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:14.790852 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad00a406-c144-4da6-8433-4fe3d37ca90c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.388836 Oct 24 09:10:14.794207 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2103/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:14 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:14.808463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:14.813821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:14.833865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:14.837617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:14.838182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:14.839498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:14.843145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:14.844495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.053142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:15.062085 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c10553b6-966b-48fe-a52c-e39250a5d652 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1272 microversion: 2.1 time: 0.266651 Oct 24 09:10:15.078193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2104/4139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:14 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:15.091000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:15.091666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:15.112138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.112626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.113040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.114344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.114956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.115545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.136299 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:15.274199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:15.298026 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33bf7ec9-56f1-47cc-9779-2a131ac5cfac tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 200 len: 1511 microversion: 2.1 time: 0.581966 Oct 24 09:10:15.300807 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2036/4140] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:14 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:15.312702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1474165909", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "cbf671c7-9a45-4411-9bbb-7fbeb13e5538"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:15.423128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:15.430517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] validate_networks() for [('cbf671c7-9a45-4411-9bbb-7fbeb13e5538', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:10:15.432485 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2810a349-3c45-40f8-9cd7-74f2f67ecc73 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1506 microversion: 2.1 time: 0.352293 Oct 24 09:10:15.459159 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2105/4141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:15 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:15.464134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:15.470487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:15.471401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:15.484392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.484897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.485431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.486828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.487316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.487759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.663961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:15.748503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:15.755367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.755836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.756467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.881162 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-887a0c2d-7311-465a-9b3c-7517e5a3e717 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.425254 Oct 24 09:10:15.881808 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2106/4142] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 09:10:15 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:15.888890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:15.889589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] [instance: c65c60b1-fdf8-492a-a124-5e65f1d3fb24] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:15.898064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.898847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.899294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.900011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.901256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.905325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.919313 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] HTTP exception thrown: Instance c65c60b1-fdf8-492a-a124-5e65f1d3fb24 could not be found. Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Request method failure captured: Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 HTTP/1.1 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlYmPJGQg4wylDkJ-m6eHGj5oGRRCPLBCnnIe8gbZ2cZPLHEDiNfG0mPoOwNQsaqIxfTfERTB8TLU-ZwIDICk9y8wYFajY5Enoh5vxv06ft8pZY4XOGoSt-IvWk-xgUK0nLVA0dG8Wv4RXJN6zoJnKg8Kv7G2sy4HPzDYHExq9fhJWk Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.75 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 1449a35c24254626bbe1449feb02e9f8 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdmin275Test-64848406 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1449a35c24254626bbe1449feb02e9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1449a35c24254626bbe1449feb02e9f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1449a35c24254626bbe1449feb02e9f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1449a35c24254626bbe1449feb02e9f8"}]}] Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdmin275Test-64848406 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 1449a35c24254626bbe1449feb02e9f8 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdmin275Test-64848406 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdmin275Test-64848406-project Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a943f2c455934d74a696c209c0c46ae0 Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdmin275Test-64848406-project Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: exception: Instance c65c60b1-fdf8-492a-a124-5e65f1d3fb24 could not be found. Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c65c60b1-fdf8-492a-a124-5e65f1d3fb24'} Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65c60b1-fdf8-492a-a124-5e65f1d3fb24 could not be found. Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65c60b1-fdf8-492a-a124-5e65f1d3fb24 could not be found. Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:15.921082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65c60b1-fdf8-492a-a124-5e65f1d3fb24 could not be found. Oct 24 09:10:15.926020 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:15.927420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] Returning 404 to user: Instance c65c60b1-fdf8-492a-a124-5e65f1d3fb24 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:10:15.928335 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3c27514-b4c3-4e33-b18d-25e31cd0af5c tempest-ServersAdmin275Test-64848406 tempest-ServersAdmin275Test-64848406-project] 10.222.0.25 "GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24" status: 404 len: 111 microversion: 2.75 time: 0.045183 Oct 24 09:10:15.932394 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2107/4143] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:10:15 2022] GET /compute/v2.1/servers/c65c60b1-fdf8-492a-a124-5e65f1d3fb24 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:10:15.934979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:15.938813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:15.948610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.949384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.949842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:15.950657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:15.951350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:15.951796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.042551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79ca9df3-4a4f-4e4e-8ea2-bcc627bfceee tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "PUT /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1082 microversion: 2.1 time: 0.111958 Oct 24 09:10:16.043588 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2108/4144] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:10:15 2022] PUT /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1082 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:16.048377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:16.062623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:16.063666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-204253645', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:16.075494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.075997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.076641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.077595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.078552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.079158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.205915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:16.299192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:16.306433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.307607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.308138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.577529 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c03fbaea-8d5f-45d3-89f8-7494e4e287e6 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-204253645" status: 200 len: 1515 microversion: 2.1 time: 0.532554 Oct 24 09:10:16.593690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2109/4145] 10.222.0.25 () {58 vars in 1261 bytes} [Mon Oct 24 09:10:16 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-204253645 => generated 1515 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:16.602300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:16.602926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:16.609131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.609656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.610097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.610800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.611254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.611675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.928912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:10:16.930131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:10:16.931273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:10:16.932451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:10:16.933062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:10:16.952643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.954185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.954709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.956567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.957828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.960294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:16.960792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.968913 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c5e6a0a-1af3-4a7b-80f3-ec7974ad981f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1508 microversion: 2.1 time: 0.374031 Oct 24 09:10:16.972090 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2110/4146] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:16 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:16.978163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:16.982480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:16.982862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:16.988807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for user c703cc73a22749858ffe05500e52aa03 and project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:16.996349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:16.997055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:16.997692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:16.999912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.005846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:10:17.007384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.008074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.008498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:17.091302 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dec19e6d-6b06-4c2a-b804-03c41de9ef9e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786443 Oct 24 09:10:17.097479 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2037/4147] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:10:17.104879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:17.117012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:17.131657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:17.134549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:17.136617 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b34e9ac1-e467-4642-abf9-02ab77dbf6d4 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1272 microversion: 2.1 time: 0.161186 Oct 24 09:10:17.143768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.144514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.144977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.145785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.146371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.146807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.154065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2111/4148] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:16 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:17.173173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:17.186821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:17.210506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.211030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.211482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.212212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.212682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.213152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.408577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:17.547467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:17.549502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:17.559326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30eed2b3-37e1-4695-8844-6da615f237a5 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1508 microversion: 2.1 time: 0.389577 Oct 24 09:10:17.560633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2112/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:17 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:17.562220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.563342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.563932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.568269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ab63fb4-9d35-4261-8f7c-ec5aae8016cd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:17.570606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ab63fb4-9d35-4261-8f7c-ec5aae8016cd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:17.722067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ab63fb4-9d35-4261-8f7c-ec5aae8016cd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:17.732468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ab63fb4-9d35-4261-8f7c-ec5aae8016cd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1215 microversion: 2.1 time: 0.170103 Oct 24 09:10:17.733402 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2113/4150] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:17 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:17.758426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:17.760584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:17.770891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.771851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.772461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.773388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.774014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.774607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.815107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:10:17.929691 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-acd389f0-0a4e-4fa1-aad5-e1affc18bbdb tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 204 len: 0 microversion: 2.1 time: 0.177698 Oct 24 09:10:17.931434 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2114/4151] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:10:17 2022] DELETE /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:10:17.945387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:17.946758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:17.954648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.955831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.957710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:17.959982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:17.960657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:17.961861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.014191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:10:18.074139 n-d-master-1 devstack@n-api.service[126920]: INFO nova.compute.api [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Instance is already in deleting state, ignoring this request Oct 24 09:10:18.075928 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4763f9b1-26d6-4b9c-b2b7-33433c8b2cf4 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 204 len: 0 microversion: 2.1 time: 0.136528 Oct 24 09:10:18.081080 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2115/4152] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:10:17 2022] DELETE /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:10:18.087770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:18.089188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:18.099669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.100447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.101474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.102493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.103994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.104602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.373197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:18.403549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24959e1e-440f-4b5e-8234-d2287f14e486 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1514 microversion: 2.1 time: 0.320497 Oct 24 09:10:18.408096 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2116/4153] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:18 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:18.420036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:18.420915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:18.430985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.432759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.433612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.434587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.437023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.437767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.561853 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c404be0-5545-4cd6-ac26-244efafbf575 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.462303 Oct 24 09:10:18.565879 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2038/4154] 10.222.0.25 () {58 vars in 1173 bytes} [Mon Oct 24 09:10:17 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:18.590881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:18.596307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:18.596761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.servers [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Removing options 'limit' from query {{(pid=126919) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 09:10:18.597541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:18.606208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.611189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.611806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.613050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.615471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.616063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.686118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:18.699176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.699857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.700532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.737363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:18.753124 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0670c2e1-9747-42ad-a06c-7302427366d7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.340240 Oct 24 09:10:18.765525 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2117/4155] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:18 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:18.775709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:18.779553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:18.797423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.798045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.798753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.799594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:18.800310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:18.812460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:18.961415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:18.965916 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:18.997794 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1da824c-9913-4fe1-894f-3a96faae7265 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1219 microversion: 2.1 time: 0.238244 Oct 24 09:10:19.000552 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2118/4156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:18 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1219 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:19.454558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:19.456601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:19.479961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.482419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.484418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.488002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.488782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.490265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.591207 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9993478-9db9-4091-b7f5-4e945e217332 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.004817 Oct 24 09:10:19.606323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2039/4157] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 09:10:18 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:19.619759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:19.624694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:19.625441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:19.639799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.640464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.652989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.654164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.654632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.655055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.811178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:19.826034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:19.830331 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99e72191-80f9-4f98-bb9e-17241bd4d0b3 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1514 microversion: 2.1 time: 0.392868 Oct 24 09:10:19.831019 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2119/4158] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:19 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:19.849106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:19.851679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:19.891729 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d720429-7ce0-4d3c-977f-f7bbb98d02f4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.276934 Oct 24 09:10:19.893030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2040/4159] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:10:19 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:19.896378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.897095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.897653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.900278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.900603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.904380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.908540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:19.917912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:19.919164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.servers [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Removing options 'limit' from query {{(pid=126919) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 09:10:19.921739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:19.933789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.936165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.937741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:19.938992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:19.942331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:19.944185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.007881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:20.076952 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7abfb171-2e4b-428c-b797-8ba0155c536f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.174341 Oct 24 09:10:20.084269 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2041/4160] 10.222.0.25 () {58 vars in 1150 bytes} [Mon Oct 24 09:10:19 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:20.084269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:20.084269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:20.090991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.091580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.092138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.092928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.093535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.094054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.226831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:20.241904 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a39905e0-0e46-4dbc-a9cb-234f07a35fb0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.408845 Oct 24 09:10:20.243762 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2120/4161] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:19 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:20.261923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:20.266801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:20.267579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:20.281528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.282211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.282805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.283711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.284351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.284931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.328147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:20.360515 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-930db591-5a8f-4b61-90c4-331060b41691 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.113274 Oct 24 09:10:20.370467 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2121/4162] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:10:20 2022] GET /compute/v2.1/servers => generated 1009 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:20.377677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:20.384082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:20.384895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:20.398202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.398741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.399177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.399982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.400805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.401024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.428382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:20.437085 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bbb83e55-6268-4105-b5c5-d0eb7edf0ae9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1267 microversion: 2.1 time: 0.357880 Oct 24 09:10:20.457741 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2042/4163] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:20 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1267 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:20.545740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:20.605088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ccbb8f4e-460d-400c-8750-cad1db810bb3 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.233287 Oct 24 09:10:20.613968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2122/4164] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:10:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:20.628339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:20.634940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:20.635734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.servers [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Removing options 'limit' from query {{(pid=126919) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 09:10:20.637012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:20.644103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.644770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.646447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.648515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.660380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.661269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.719707 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f09f0535-c07e-4561-b7df-d4e10b2e986a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.103445 Oct 24 09:10:20.720254 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2043/4165] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Oct 24 09:10:20 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:20.737208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:20.741166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:20.742008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-204253645', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:20.747809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.747809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.748524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.748793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.750443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.750555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.851236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:20.860040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:20.860917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:20.869953 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:20.872742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.873585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.874216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.875842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.876817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.877574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:20.962812 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b383d188-8514-4b3b-a844-07c61c43c884 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-204253645" status: 200 len: 345 microversion: 2.1 time: 0.230871 Oct 24 09:10:20.973654 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2123/4166] 10.222.0.25 () {58 vars in 1240 bytes} [Mon Oct 24 09:10:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-204253645 => generated 345 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:20.979969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed58aa4a-813f-4be6-8ba8-07c2e96e97c9 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:20.988647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed58aa4a-813f-4be6-8ba8-07c2e96e97c9 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:20.989255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed58aa4a-813f-4be6-8ba8-07c2e96e97c9 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:20.990217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed58aa4a-813f-4be6-8ba8-07c2e96e97c9 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.032799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed58aa4a-813f-4be6-8ba8-07c2e96e97c9 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:10:21.100780 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed58aa4a-813f-4be6-8ba8-07c2e96e97c9 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "POST /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2/action" status: 202 len: 0 microversion: 2.1 time: 0.124827 Oct 24 09:10:21.101716 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2124/4167] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:10:20 2022] POST /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:10:21.116019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:21.118006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:21.126659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.128060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.128707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.129840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.130440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.131573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.447277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:21.471017 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b5639c5-a51b-4679-9939-bd3437505205 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1514 microversion: 2.1 time: 0.615383 Oct 24 09:10:21.473980 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2044/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:20 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1514 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:21.494110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:21.494864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:21.500648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.501148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.501770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.502315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.503104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.503221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.520000 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:21.520251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:21.533206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b95897a1-befd-4fb7-8b4d-aa2d77c76584 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.422400 Oct 24 09:10:21.534557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2125/4169] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:21 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:21.574104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:21.580277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:21.608084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.609700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.611222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.613936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.615225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.616015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.759478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:21.767966 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e8c0a805-ce99-4494-99a2-516aee3969e9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1273 microversion: 2.1 time: 0.203314 Oct 24 09:10:21.788354 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2126/4170] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:21 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:21.793262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3f228b21-24f6-4d1a-b5a1-4fe904fe88af req-64436577-88a7-4f71-bd43-a3572508bfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc", "name": "network-vif-deleted", "tag": "829d3f45-b803-445e-b5a2-205b7ddf1ea4"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:21.815414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3f228b21-24f6-4d1a-b5a1-4fe904fe88af req-64436577-88a7-4f71-bd43-a3572508bfa3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:21.815917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3f228b21-24f6-4d1a-b5a1-4fe904fe88af req-64436577-88a7-4f71-bd43-a3572508bfa3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:21.816354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3f228b21-24f6-4d1a-b5a1-4fe904fe88af req-64436577-88a7-4f71-bd43-a3572508bfa3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:21.828744 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3f228b21-24f6-4d1a-b5a1-4fe904fe88af req-64436577-88a7-4f71-bd43-a3572508bfa3 service nova] Creating event network-vif-deleted:829d3f45-b803-445e-b5a2-205b7ddf1ea4 for instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc on n-h1-master-1 Oct 24 09:10:21.833542 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3f228b21-24f6-4d1a-b5a1-4fe904fe88af req-64436577-88a7-4f71-bd43-a3572508bfa3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043850 Oct 24 09:10:21.834166 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2127/4171] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:21.929949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-88daab1b-2fe7-432d-83ad-499b48fed3ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab04ae50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:21.988549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-88daab1b-2fe7-432d-83ad-499b48fed3ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/99fd70ce-17a5-4d3d-a83f-c52a03a28e15" status: 200 len: 662 microversion: 2.1 time: 0.062825 Oct 24 09:10:21.998659 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2128/4172] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:21 2022] GET /compute/v2.1/images/99fd70ce-17a5-4d3d-a83f-c52a03a28e15 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:10:22.005548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b718c68a-9037-4a7b-8cfb-cec462809e6e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4429d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:22.058477 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b718c68a-9037-4a7b-8cfb-cec462809e6e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/99fd70ce-17a5-4d3d-a83f-c52a03a28e15" status: 200 len: 662 microversion: 2.1 time: 0.058134 Oct 24 09:10:22.060189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2129/4173] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:21 2022] GET /compute/v2.1/images/99fd70ce-17a5-4d3d-a83f-c52a03a28e15 => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:22.405548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:22.415031 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-03acd65e-c29f-4fb2-8354-9b591a12d02f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.938805 Oct 24 09:10:22.417758 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2045/4174] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:21 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:22.496745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:22.497555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:22.522192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.522822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.523132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:22.523864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.524330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.524784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:22.560291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:22.560908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:22.582009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.582533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.582985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:22.583730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.584188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.584615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:22.620047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.625634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.627559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:22.629881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lazy-loading 'fault' on Instance uuid 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:22.821697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae455a2351c4cf9a32ca68e686d27d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:22.835501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-171ccac3-e715-4a8b-9e6e-90cbdb908c7b tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 200 len: 1308 microversion: 2.1 time: 0.343320 Oct 24 09:10:22.836254 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2130/4175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:22 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:22.841763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:22.842542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:22.848859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.849373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.850233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:22.851077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:22.851704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:22.852157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:23.028342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:23.036195 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55095f04-9de0-4c21-94bb-2af0de93fb37 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.480032 Oct 24 09:10:23.036919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2046/4176] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:22 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:23.452773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:23.454726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:23.464929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:23.466592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:23.467409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:23.468688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:23.469593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:23.470270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:23.848761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:23.869937 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49238c22-4e1a-4bb1-812c-70dc1d2f893f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.429450 Oct 24 09:10:23.870929 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2047/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:23 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:23.889932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb498823-a984-42e3-b66b-e28548934cfe tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8da9ef5940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:23.937056 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb498823-a984-42e3-b66b-e28548934cfe tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/8efd64ac-6666-4c83-96cc-42012f4f42ae" status: 200 len: 662 microversion: 2.1 time: 0.065145 Oct 24 09:10:23.949729 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2048/4178] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:23 2022] GET /compute/v2.1/images/8efd64ac-6666-4c83-96cc-42012f4f42ae => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:23.950834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:23.955642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:23.956357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:23.964549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:23.965204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:23.965825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:23.966472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f21fa8e-8d4d-4f34-a883-8b887f9b0d97 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 1.128890 Oct 24 09:10:23.967193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2131/4179] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:22 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:23.968373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:23.969083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:23.969773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:23.979956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cf3218a-68ce-4b7c-9b44-74fd1b85c4a6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf30dd30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.023347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] HTTP exception thrown: Instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc could not be found. Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Request method failure captured: Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc HTTP/1.1 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlXZ94qYG_hX5B3JFBfudYtRHlUNP7XUv5dy8g_a4eEKzB1leuE9qqLUIb962QT9ft3OV2yJacoeNdsjS6FQH2ifU2gxmHO_Dx_ryjtUBXJPvhfK66NEvuZzBVky92ne3JrLYAe4-TqGkU8HhsAEaGPRrYfExZdwgbegxLo8X1DDZGk Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}] Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 5ae455a2351c4cf9a32ca68e686d27d0 Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc could not be found. Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc'} Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc could not be found. Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc could not be found. Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.035649 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc could not be found. Oct 24 09:10:24.042089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.049661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Returning 404 to user: Instance 2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:10:24.049661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ba473e5-b408-4e83-b745-984d41bd8514 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc" status: 404 len: 111 microversion: 2.1 time: 0.098248 Oct 24 09:10:24.052686 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2049/4180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:23 2022] GET /compute/v2.1/servers/2e16fa4b-d0ca-48bb-ac3a-cbd5f6752bfc => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:24.063785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.064515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.073222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.074075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.074719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.075599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.076283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.076943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.099363 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4cf3218a-68ce-4b7c-9b44-74fd1b85c4a6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/8efd64ac-6666-4c83-96cc-42012f4f42ae" status: 200 len: 662 microversion: 2.1 time: 0.129579 Oct 24 09:10:24.100528 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2132/4181] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:23 2022] GET /compute/v2.1/images/8efd64ac-6666-4c83-96cc-42012f4f42ae => generated 662 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:24.110950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.112147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.130730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.132578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.133067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.136215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.137787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.139952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.188249 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] HTTP exception thrown: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Request method failure captured: Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 HTTP/1.1 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlXZ94qYG_hX5B3JFBfudYtRHlUNP7XUv5dy8g_a4eEKzB1leuE9qqLUIb962QT9ft3OV2yJacoeNdsjS6FQH2ifU2gxmHO_Dx_ryjtUBXJPvhfK66NEvuZzBVky92ne3JrLYAe4-TqGkU8HhsAEaGPRrYfExZdwgbegxLo8X1DDZGk Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}] Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 5ae455a2351c4cf9a32ca68e686d27d0 Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '80b6cab5-9253-4873-9fcd-5886c4472af9'} Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:10:24.193361 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.198159 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.199388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Returning 404 to user: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:10:24.203369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0cce6057-9354-4112-8f04-ea9ed47d7788 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 404 len: 111 microversion: 2.1 time: 0.098902 Oct 24 09:10:24.204137 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2133/4182] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:10:24 2022] DELETE /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:24.215450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.216261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 80b6cab5-9253-4873-9fcd-5886c4472af9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.223554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.224249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.225209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.226075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.226913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.227609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.243757 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] HTTP exception thrown: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Request method failure captured: Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 HTTP/1.1 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlXZ94qYG_hX5B3JFBfudYtRHlUNP7XUv5dy8g_a4eEKzB1leuE9qqLUIb962QT9ft3OV2yJacoeNdsjS6FQH2ifU2gxmHO_Dx_ryjtUBXJPvhfK66NEvuZzBVky92ne3JrLYAe4-TqGkU8HhsAEaGPRrYfExZdwgbegxLo8X1DDZGk Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}] Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 5ae455a2351c4cf9a32ca68e686d27d0 Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '80b6cab5-9253-4873-9fcd-5886c4472af9'} Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.247197 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. Oct 24 09:10:24.251702 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.252689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Returning 404 to user: Instance 80b6cab5-9253-4873-9fcd-5886c4472af9 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:10:24.254038 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bd5327e-86ed-40d5-9375-9ec044b91899 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9" status: 404 len: 111 microversion: 2.1 time: 0.044767 Oct 24 09:10:24.255670 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2134/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:24 2022] GET /compute/v2.1/servers/80b6cab5-9253-4873-9fcd-5886c4472af9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:10:24.269985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.273166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.290888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.292225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.294028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.296771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.298298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.299550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.319242 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] HTTP exception thrown: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Request method failure captured: Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e HTTP/1.1 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlXZ94qYG_hX5B3JFBfudYtRHlUNP7XUv5dy8g_a4eEKzB1leuE9qqLUIb962QT9ft3OV2yJacoeNdsjS6FQH2ifU2gxmHO_Dx_ryjtUBXJPvhfK66NEvuZzBVky92ne3JrLYAe4-TqGkU8HhsAEaGPRrYfExZdwgbegxLo8X1DDZGk Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}] Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 5ae455a2351c4cf9a32ca68e686d27d0 Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '3738b93f-63e5-4033-8466-b2ac2acf097e'} Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:10:24.321675 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.325229 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.330591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Returning 404 to user: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:10:24.331697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-affc6185-300d-442b-8465-e3f8ccd9595f tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 404 len: 111 microversion: 2.1 time: 0.071274 Oct 24 09:10:24.333185 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2135/4184] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:10:24 2022] DELETE /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:24.339678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0f86b602-bd3b-466d-86b7-868c1a5c3715 req-33e96888-bec5-483c-9cf4-faba93bbd3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02bae9c0-3fc3-4177-a609-de023af87318", "tag": "40e476b3-aff2-458a-9f2f-2cdc83220506"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:24.351753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0f86b602-bd3b-466d-86b7-868c1a5c3715 req-33e96888-bec5-483c-9cf4-faba93bbd3fa service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.352621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0f86b602-bd3b-466d-86b7-868c1a5c3715 req-33e96888-bec5-483c-9cf4-faba93bbd3fa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.353430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0f86b602-bd3b-466d-86b7-868c1a5c3715 req-33e96888-bec5-483c-9cf4-faba93bbd3fa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.375309 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0f86b602-bd3b-466d-86b7-868c1a5c3715 req-33e96888-bec5-483c-9cf4-faba93bbd3fa service nova] Creating event network-changed:40e476b3-aff2-458a-9f2f-2cdc83220506 for instance 02bae9c0-3fc3-4177-a609-de023af87318 on n-h1-master-1 Oct 24 09:10:24.381610 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0f86b602-bd3b-466d-86b7-868c1a5c3715 req-33e96888-bec5-483c-9cf4-faba93bbd3fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046510 Oct 24 09:10:24.382817 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2136/4185] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:24.389289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.390204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] [instance: 3738b93f-63e5-4033-8466-b2ac2acf097e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.399106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.399707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.400256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.401068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.402118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.402788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.419944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] HTTP exception thrown: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Request method failure captured: Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e HTTP/1.1 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlXZ94qYG_hX5B3JFBfudYtRHlUNP7XUv5dy8g_a4eEKzB1leuE9qqLUIb962QT9ft3OV2yJacoeNdsjS6FQH2ifU2gxmHO_Dx_ryjtUBXJPvhfK66NEvuZzBVky92ne3JrLYAe4-TqGkU8HhsAEaGPRrYfExZdwgbegxLo8X1DDZGk Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82888bc2bd7c40dcbae68a5e4fa6c4f2"}]}] Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 82888bc2bd7c40dcbae68a5e4fa6c4f2 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-958399319 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 5ae455a2351c4cf9a32ca68e686d27d0 Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerDiskConfigTestJSON-958399319-project Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '3738b93f-63e5-4033-8466-b2ac2acf097e'} Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:10:24.422531 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. Oct 24 09:10:24.426060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:10:24.428331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] Returning 404 to user: Instance 3738b93f-63e5-4033-8466-b2ac2acf097e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:10:24.429468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24cf69af-d0c3-427f-a778-560ca7929315 tempest-ServerDiskConfigTestJSON-958399319 tempest-ServerDiskConfigTestJSON-958399319-project] 10.222.0.25 "GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e" status: 404 len: 111 microversion: 2.1 time: 0.044932 Oct 24 09:10:24.430367 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2137/4186] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:24 2022] GET /compute/v2.1/servers/3738b93f-63e5-4033-8466-b2ac2acf097e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:24.495121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:24.503196 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3da62c07-9288-4851-b0d0-6e2f62f4960d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.446825 Oct 24 09:10:24.504387 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2050/4187] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:24 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:24.893446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.894297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.901831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.902757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.903201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.904065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.904675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.905281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.989202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:24.989863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:24.997724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:24.998213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:24.998641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:24.999767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:25.000697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:25.001267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:25.325326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:25.341171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c3f6450-fd44-4452-8dc0-bf411adf7823 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.451507 Oct 24 09:10:25.343501 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2138/4188] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:24 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:25.530177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:25.531469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:25.541750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:25.542255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:25.542711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:25.543472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:25.544531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:25.544531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:25.694477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:25.728821 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fbe8b4fd-6cbf-4c88-85a9-932f093eb604 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 0.742614 Oct 24 09:10:25.742551 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2051/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:24 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:25.750384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-eecae71e-23b9-4322-bf75-7f6ef93d7143 req-25770a0b-8d44-4315-9aa8-d6099c690e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b273911-e702-419e-92a1-9f18adb1ef82", "tag": "a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:25.783610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eecae71e-23b9-4322-bf75-7f6ef93d7143 req-25770a0b-8d44-4315-9aa8-d6099c690e4e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:25.785573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eecae71e-23b9-4322-bf75-7f6ef93d7143 req-25770a0b-8d44-4315-9aa8-d6099c690e4e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:25.787274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eecae71e-23b9-4322-bf75-7f6ef93d7143 req-25770a0b-8d44-4315-9aa8-d6099c690e4e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:25.812806 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-eecae71e-23b9-4322-bf75-7f6ef93d7143 req-25770a0b-8d44-4315-9aa8-d6099c690e4e service nova] Creating event network-changed:a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5 for instance 5b273911-e702-419e-92a1-9f18adb1ef82 on n-h1-master-1 Oct 24 09:10:25.820180 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-eecae71e-23b9-4322-bf75-7f6ef93d7143 req-25770a0b-8d44-4315-9aa8-d6099c690e4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080488 Oct 24 09:10:25.822669 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2052/4190] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:25.838802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb079978-1b12-4fc3-98ae-e8b34e47ed29 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf1894c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:25.888103 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb079978-1b12-4fc3-98ae-e8b34e47ed29 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/65843e3b-7d49-4791-a541-064b5fdb83b5" status: 200 len: 661 microversion: 2.1 time: 0.054163 Oct 24 09:10:25.889010 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2053/4191] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:25 2022] GET /compute/v2.1/images/65843e3b-7d49-4791-a541-064b5fdb83b5 => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:25.903229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9246005d-5909-467a-98d0-467929255125 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf1e4940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:25.973259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9246005d-5909-467a-98d0-467929255125 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/65843e3b-7d49-4791-a541-064b5fdb83b5" status: 200 len: 661 microversion: 2.1 time: 0.074015 Oct 24 09:10:25.974855 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2054/4192] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:25 2022] GET /compute/v2.1/images/65843e3b-7d49-4791-a541-064b5fdb83b5 => generated 661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:10:26.050827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1821521133", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:26.110372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:10:26.241085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:26.251311 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bb21c574-b6b1-417f-af22-d5e52e3f4365 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.726234 Oct 24 09:10:26.253803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2139/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:25 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:26.365386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:26.366779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:26.374476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:26.375441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:26.376211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:26.377220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:26.378164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:26.378959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:26.404746 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:26.722076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:26.734254 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d29bab6-9406-4f4c-9792-3c3762520c2e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.372787 Oct 24 09:10:26.735078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2140/4194] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:26 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:26.761701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:26.763212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:26.773447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:26.774543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:26.775269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:26.776145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:26.776761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:26.777428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:27.131183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:27.143124 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57bc1f03-4341-41f4-81c5-1df241a93824 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 0.391553 Oct 24 09:10:27.160717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2141/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:26 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:27.278925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:27.280013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:27.293933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:27.295121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:27.297372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:27.300464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:27.302641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:27.304151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:27.361574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:10:27.362130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:10:27.362629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:10:27.363815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:10:27.364388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:10:27.382329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:27.382826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:27.387334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:27.388282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:27.388838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:27.389286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:27.424972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Getting quotas for project 062ef54f319941dda2c197b8f71d2a7e. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:27.436899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Getting quotas for user af8778dae08a4ab6b012ceda5af5564e and project 062ef54f319941dda2c197b8f71d2a7e. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:27.462537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:10:27.467116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:27.539719 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea848a5a-ee49-4459-91b4-2b15f8b974eb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492655 Oct 24 09:10:27.541149 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2055/4196] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:10:27.632484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1103947290", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:27.723193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:10:27.729593 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:28.332974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:28.353023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1e21a7c-a3ea-416d-8efb-100579be4dc2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 1.078184 Oct 24 09:10:28.374442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2142/4197] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:27 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:28.386103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:28.388924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:28.397440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:28.398177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:28.398809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:28.399740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:28.401388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:28.402911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:28.803672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:10:28.804822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:10:28.805530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:10:28.806814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:10:28.808162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:10:28.836462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:28.837087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:28.838296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:28.840627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:28.841945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:28.854662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:28.887692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:28.904017 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f1d8f6f-9077-40fe-8fd2-98cbe444b5dc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.527769 Oct 24 09:10:28.905627 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2143/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:28 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:28.911341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:28.912816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:28.924445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Getting quotas for project 062ef54f319941dda2c197b8f71d2a7e. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:28.927554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:28.928908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:28.929755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:28.931411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:28.933646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:28.934748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Getting quotas for user af8778dae08a4ab6b012ceda5af5564e and project 062ef54f319941dda2c197b8f71d2a7e. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:28.935053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:28.966424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:10:28.968727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:29.024910 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eaac2906-7733-4d8c-ab22-fde41e4d865f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.399215 Oct 24 09:10:29.031951 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2056/4199] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:10:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:10:29.038950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-50df314d-d47d-4b1a-a29a-3f2cf27cb695 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:29.044257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-50df314d-d47d-4b1a-a29a-3f2cf27cb695 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:29.406992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-50df314d-d47d-4b1a-a29a-3f2cf27cb695 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:29.414714 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-50df314d-d47d-4b1a-a29a-3f2cf27cb695 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1218 microversion: 2.1 time: 0.380319 Oct 24 09:10:29.415376 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2057/4200] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:29 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1218 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:29.430061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c6020bde-fcab-4d06-9c8a-7ce27e29ccaa req-c8a78bc7-a333-4a4b-9099-a0bce39d7b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bae9c0-3fc3-4177-a609-de023af87318", "name": "network-vif-plugged", "status": "completed", "tag": "40e476b3-aff2-458a-9f2f-2cdc83220506"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:29.458390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c6020bde-fcab-4d06-9c8a-7ce27e29ccaa req-c8a78bc7-a333-4a4b-9099-a0bce39d7b8f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:29.459261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c6020bde-fcab-4d06-9c8a-7ce27e29ccaa req-c8a78bc7-a333-4a4b-9099-a0bce39d7b8f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:29.459909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c6020bde-fcab-4d06-9c8a-7ce27e29ccaa req-c8a78bc7-a333-4a4b-9099-a0bce39d7b8f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:29.483979 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c6020bde-fcab-4d06-9c8a-7ce27e29ccaa req-c8a78bc7-a333-4a4b-9099-a0bce39d7b8f service nova] Creating event network-vif-plugged:40e476b3-aff2-458a-9f2f-2cdc83220506 for instance 02bae9c0-3fc3-4177-a609-de023af87318 on n-h1-master-1 Oct 24 09:10:29.499926 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c6020bde-fcab-4d06-9c8a-7ce27e29ccaa req-c8a78bc7-a333-4a4b-9099-a0bce39d7b8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079725 Oct 24 09:10:29.505220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:29.509041 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2058/4201] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:29.516445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:29.517167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:29.519907 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44c7951e-2bdb-4a6a-b855-ba9ef0d78eb5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 0.612903 Oct 24 09:10:29.520515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2144/4202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:28 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:29.525942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:29.526440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:29.526879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:29.527638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:29.528178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:29.528610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:29.926523 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:29.927152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:29.940506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:29.941228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:29.941849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:29.942733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:29.943350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:29.945996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:30.199833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:30.214732 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d496211a-51df-44c9-aec8-02acf992964c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1314 microversion: 2.1 time: 0.291994 Oct 24 09:10:30.216033 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2145/4203] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:29 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:30.445437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:30.447087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:30.458116 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:30.463153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:30.463964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:30.465816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:30.466826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:30.468329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:30.469496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:30.519603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:30.530119 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7406fdd6-6921-4104-a387-8e0c312cf7c1 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 1.018960 Oct 24 09:10:30.530693 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2059/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:29 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:30.552408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:30.553199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:30.559812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:30.560562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:30.561148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:30.562192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:30.562821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:30.563392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:30.647980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:30.663954 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-416c2289-0998-4ebd-a7b2-a4eb39fe312f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1214 microversion: 2.1 time: 0.223218 Oct 24 09:10:30.664553 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2146/4205] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:30 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:31.242175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:31.242854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:31.245498 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:31.262184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.262694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.263379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.264102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.264712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.265258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.320270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:31.331407 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84259f16-68b7-4cc9-9565-fd145fefa5ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 0.787174 Oct 24 09:10:31.332816 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2060/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:30 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:31.413838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:31.423110 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b31775cd-9534-41df-bbad-a65edf7e8c18 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1499 microversion: 2.1 time: 0.185049 Oct 24 09:10:31.423777 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2147/4207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:31 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1499 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:31.447615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:31.450034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:31.457554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.458104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.458537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.459600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.460390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.460817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.491252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lazy-loading 'flavor' on Instance uuid 02bae9c0-3fc3-4177-a609-de023af87318 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:10:31.558776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:31.560364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:31.573413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.574635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.575326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.577160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.578210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.578985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.671582 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56ac96b7-09a2-42ab-9a7c-af8e98a91cc9 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "POST /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318/action" status: 200 len: 32 microversion: 2.1 time: 0.227937 Oct 24 09:10:31.680595 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2061/4208] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:10:31 2022] POST /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318/action => generated 32 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 09:10:31.690375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:31.692029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:31.705912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.707788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.708867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.709849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.710518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.711476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.906438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:31.915247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba8a5a65-aa93-4a19-832a-7c6cfe0b09ab tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1270 microversion: 2.1 time: 0.230321 Oct 24 09:10:31.917927 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2062/4209] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:31 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:31.923913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:31.929043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:31.939557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.940308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.940747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.941516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:31.942140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:31.942763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:31.956297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:31.969813 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7bf4401-c772-4534-8348-aae1f0246244 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.417150 Oct 24 09:10:31.973426 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2148/4210] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:31 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:32.357622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:32.358246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:32.365348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:32.366224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:32.366739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:32.367524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:32.368056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:32.368719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:32.735832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:32.741222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:32.749896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-322ab834-a910-4169-a49e-ef305beb1859 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.830447 Oct 24 09:10:32.750055 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7edd1a2c-55c4-42de-a581-b83ed30285c7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 0.396675 Oct 24 09:10:32.750535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2149/4211] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:32 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:32.751738 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2063/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:31 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:32.783672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a1c4b402-e841-4696-ab86-1a23bc71100c req-f428289a-fde8-48ac-a33e-07508fb7c272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b273911-e702-419e-92a1-9f18adb1ef82", "name": "network-vif-plugged", "status": "completed", "tag": "a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:32.798396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a1c4b402-e841-4696-ab86-1a23bc71100c req-f428289a-fde8-48ac-a33e-07508fb7c272 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:32.799119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a1c4b402-e841-4696-ab86-1a23bc71100c req-f428289a-fde8-48ac-a33e-07508fb7c272 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:32.799756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a1c4b402-e841-4696-ab86-1a23bc71100c req-f428289a-fde8-48ac-a33e-07508fb7c272 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:32.813117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a1c4b402-e841-4696-ab86-1a23bc71100c req-f428289a-fde8-48ac-a33e-07508fb7c272 service nova] Creating event network-vif-plugged:a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5 for instance 5b273911-e702-419e-92a1-9f18adb1ef82 on n-h1-master-1 Oct 24 09:10:32.819280 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a1c4b402-e841-4696-ab86-1a23bc71100c req-f428289a-fde8-48ac-a33e-07508fb7c272 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067265 Oct 24 09:10:32.820455 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2150/4213] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:32.942324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:32.943020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:32.961146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:32.961707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:32.963873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:32.965284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:32.969427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:32.971531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.000986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:33.001982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:33.015485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:33.016363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:33.017638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.020558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:33.021867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:33.023393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.231014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:33.242742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f57ae83f-8e85-44c5-a3ba-21a102511baa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1276 microversion: 2.1 time: 0.304579 Oct 24 09:10:33.244389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2064/4214] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:32 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:33.508093 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:33.518310 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-695489e3-0bc1-4bf5-a6e4-f9a34f14282c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.523644 Oct 24 09:10:33.519545 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2151/4215] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:32 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:33.772850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:33.773518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:33.782203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:33.784997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:33.785576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:33.786170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.787031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:33.789081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:33.791488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:33.794581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.806248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:33.806829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:33.807364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.808135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:33.808665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:33.809153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:33.958670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:33.968863 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ab63ba3-887d-43a3-ae4d-3578043f65f7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.190156 Oct 24 09:10:33.969492 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2152/4216] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:33 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:34.267724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:34.268439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:34.274462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:34.274950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:34.275382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:34.276071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:34.276514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:34.276932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:34.416851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:34.426379 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf9783bc-6eaf-499b-885a-1cd68c69230a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1276 microversion: 2.1 time: 0.162778 Oct 24 09:10:34.427378 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2153/4217] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:34 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:34.544772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:34.545634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:34.561348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:34.564180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:34.565894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:34.566835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:34.571571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:34.573684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:34.704734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:34.718041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87dc393e-e018-41dc-9842-bdb51663c6dc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1315 microversion: 2.1 time: 0.949870 Oct 24 09:10:34.718885 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2065/4218] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:33 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:34.993346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:34.995220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:35.012463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:35.012968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:35.018109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:35.021416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:35.028267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:35.029104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:35.357137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:35.365055 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-220bcec1-bfed-42ce-87ab-98463727dd6b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.826175 Oct 24 09:10:35.381971 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2154/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:34 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:35.464265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:35.466433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:35.489954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:35.492001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:35.492795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:35.498968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:35.499523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:35.499981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:35.659346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:35.668283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba41292f-e352-4314-93d2-72bb71e1e36e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.680036 Oct 24 09:10:35.690272 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2066/4220] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:34 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:35.746320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:35.747503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:35.761255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:35.762139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:35.762740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:35.764556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:35.765352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:35.768867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:35.780881 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:35.818359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:35.828048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0399d8cd-0d82-4f7c-822b-2781919f7457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.375171 Oct 24 09:10:35.847415 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2155/4221] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:35 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:36.347472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:36.358965 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a07644c4-e8f0-406f-b97e-9c3ef512b452 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1501 microversion: 2.1 time: 0.618621 Oct 24 09:10:36.370379 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2067/4222] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:35 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1501 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:36.384279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:36.385394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:36.394663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:36.397554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:36.398284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:36.398925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:36.400538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:36.402041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:36.402471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:36.404207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:36.428528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:36.429943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:36.430587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:36.433802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:36.438568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:36.439301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:36.961944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.network.security_group_api [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Removing security group 6031c22b-89c3-42bf-bf87-1663a661afa3 from port a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5 Oct 24 09:10:36.987114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:36.999182 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bade22a0-637f-4816-80ab-1a4ec8e48aa5 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1522 microversion: 2.1 time: 0.608616 Oct 24 09:10:37.003279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2068/4223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:36 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:37.015148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:37.016133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:37.030307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:37.035414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:37.039942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:37.042228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:37.042830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:37.043399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:37.574022 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d67bc57c-fd14-4123-85e0-cf0cc12bcf6a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82/action" status: 202 len: 0 microversion: 2.1 time: 1.193785 Oct 24 09:10:37.575564 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2156/4224] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:10:36 2022] POST /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82/action => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:10:37.581930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:37.583160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:37.594651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:37.595803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:37.597377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:37.598418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:37.600287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:37.601717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:37.858618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:37.861008 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:37.869828 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c2cf9cd-b48c-4706-8c2f-bd2a5cd29ae6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.292804 Oct 24 09:10:37.870430 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2157/4225] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:37 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:37.886276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:37.888205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:37.897222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:37.898050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:37.898684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:37.899537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:37.900268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:37.900903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.034636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:38.046068 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-82de4817-5956-480d-bda7-1e56e36bd00e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1459 microversion: 2.1 time: 0.168419 Oct 24 09:10:38.061664 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2158/4226] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:37 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1459 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:38.070524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-916f748c-74f7-403a-a459-36a59761f116 req-6309eb1c-5d13-4c97-828c-a64221267a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b273911-e702-419e-92a1-9f18adb1ef82", "tag": "a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:38.085285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-916f748c-74f7-403a-a459-36a59761f116 req-6309eb1c-5d13-4c97-828c-a64221267a67 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.088402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-916f748c-74f7-403a-a459-36a59761f116 req-6309eb1c-5d13-4c97-828c-a64221267a67 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.091754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-916f748c-74f7-403a-a459-36a59761f116 req-6309eb1c-5d13-4c97-828c-a64221267a67 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.104617 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-916f748c-74f7-403a-a459-36a59761f116 req-6309eb1c-5d13-4c97-828c-a64221267a67 service nova] Creating event network-changed:a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5 for instance 5b273911-e702-419e-92a1-9f18adb1ef82 on n-h1-master-1 Oct 24 09:10:38.116382 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-916f748c-74f7-403a-a459-36a59761f116 req-6309eb1c-5d13-4c97-828c-a64221267a67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052453 Oct 24 09:10:38.117452 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2159/4227] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:38.124530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-938a10e8-5d44-42f1-b93c-138c1102515f req-828ee310-4019-461a-b686-f560e98cb3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:38.138973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938a10e8-5d44-42f1-b93c-138c1102515f req-828ee310-4019-461a-b686-f560e98cb3ea service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.139624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938a10e8-5d44-42f1-b93c-138c1102515f req-828ee310-4019-461a-b686-f560e98cb3ea service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.140169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-938a10e8-5d44-42f1-b93c-138c1102515f req-828ee310-4019-461a-b686-f560e98cb3ea service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.169457 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-938a10e8-5d44-42f1-b93c-138c1102515f req-828ee310-4019-461a-b686-f560e98cb3ea service nova] Creating event network-changed:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:10:38.176040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-938a10e8-5d44-42f1-b93c-138c1102515f req-828ee310-4019-461a-b686-f560e98cb3ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056575 Oct 24 09:10:38.176528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:38.177598 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2160/4228] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:38.188745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:38.188972 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19ff49f6-f0c6-4b60-80d5-c6c765675219 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 1.183980 Oct 24 09:10:38.191311 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2069/4229] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:37 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:38.192310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:38.204698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:38.207285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:38.208833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.210578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.211151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.213393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.215089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.215822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.233809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.241312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.241746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.242506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.243138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.245629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.735092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:38.754053 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6d7b4fc-c5f0-42e5-9fbc-9df0867fecfc tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1499 microversion: 2.1 time: 0.569264 Oct 24 09:10:38.755711 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2161/4230] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:38 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1499 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:38.785994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:38.793318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:38.797925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:38.806682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.807435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.809737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.811542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:38.813368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:38.814171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:38.878604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:38.885175 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=16 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:38.959248 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-46404dfb-d51e-4fe9-adf2-9116b07d7a88 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.184853 Oct 24 09:10:38.963740 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2162/4231] 10.222.0.25 () {58 vars in 1154 bytes} [Mon Oct 24 09:10:38 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:10:38.977800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:38.980308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:38.986867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:38.995566 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97a346aa-a862-44c9-a38c-3289a0365787 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.802479 Oct 24 09:10:39.003635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2070/4232] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:38 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:39.025275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.025275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.025275 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:39.032374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ceff2469-c9e8-4160-a881-c9a26aa4138e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:39.033598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.034127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.034578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:39.049047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ceff2469-c9e8-4160-a881-c9a26aa4138e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.049756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ceff2469-c9e8-4160-a881-c9a26aa4138e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.050369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ceff2469-c9e8-4160-a881-c9a26aa4138e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:39.096426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ceff2469-c9e8-4160-a881-c9a26aa4138e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Going to try to start instance {{(pid=126919) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 09:10:39.162099 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ceff2469-c9e8-4160-a881-c9a26aa4138e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "POST /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2/action" status: 202 len: 0 microversion: 2.1 time: 0.141785 Oct 24 09:10:39.163552 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2071/4233] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:10:39 2022] POST /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:10:39.169690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:39.170716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:39.179252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.180894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.181819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:39.183185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.183940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.184755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:39.414135 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=24 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:39.865006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:39.875970 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3f792f4-4cc1-4e3b-839f-26f98a1d249b tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.708716 Oct 24 09:10:39.878555 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2072/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:39 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:39.891445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:39.892656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:39.900973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.901745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.902348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:39.903226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:39.903830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:39.904409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:40.174789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:40.190167 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c48b0c2-f363-4c91-aa51-b12b2ba3cfce tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 1.222693 Oct 24 09:10:40.190759 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2163/4235] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:38 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:40.205459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:40.205459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:40.209438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:40.210257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:40.210875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:40.214359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:40.215087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:40.215549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:40.940863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:40.958359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-49f74849-7a7c-4f84-b003-0ef4d43520c7 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.766513 Oct 24 09:10:40.975934 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2164/4236] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:40 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:40.981811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:40.983970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:40.994667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:40.995337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:40.995890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:40.996827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:40.997425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:40.997961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:41.294210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:41.345044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d8a7cd8f-8e3d-4ce4-96df-b212a6a7316d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1508 microversion: 2.1 time: 1.456882 Oct 24 09:10:41.346103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2073/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:39 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1508 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:41.352135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e48421e3-7a66-41ff-b1d0-4f1a1bffa489 req-d852cd03-f497-4210-97df-130c3c6d1932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382e3bdd-c519-41a4-9ebc-957c37059d41", "tag": "1cd1b987-13bb-4075-be4b-149af14dc5ee"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:41.381797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e48421e3-7a66-41ff-b1d0-4f1a1bffa489 req-d852cd03-f497-4210-97df-130c3c6d1932 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:41.383522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e48421e3-7a66-41ff-b1d0-4f1a1bffa489 req-d852cd03-f497-4210-97df-130c3c6d1932 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:41.386037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e48421e3-7a66-41ff-b1d0-4f1a1bffa489 req-d852cd03-f497-4210-97df-130c3c6d1932 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:41.409130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e48421e3-7a66-41ff-b1d0-4f1a1bffa489 req-d852cd03-f497-4210-97df-130c3c6d1932 service nova] Creating event network-changed:1cd1b987-13bb-4075-be4b-149af14dc5ee for instance 382e3bdd-c519-41a4-9ebc-957c37059d41 on n-h1-master-1 Oct 24 09:10:41.417282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e48421e3-7a66-41ff-b1d0-4f1a1bffa489 req-d852cd03-f497-4210-97df-130c3c6d1932 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067988 Oct 24 09:10:41.418669 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2074/4238] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:41.427980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:41.429252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:41.440263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:41.443241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:41.444633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:41.446235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:41.447339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:41.447941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:41.669121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:41.695441 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed3e7671-9abc-4651-a80e-8fb278ecb4ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.718066 Oct 24 09:10:41.696049 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2165/4239] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:40 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:41.741143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:41.741890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:41.751165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:41.754039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:41.754928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:41.756383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:41.756853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:41.758645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:42.050044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:42.059778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-be95487b-87c3-4c9a-918d-7dcc1916f1a2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.639570 Oct 24 09:10:42.061122 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2075/4240] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:41 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:42.066179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:42.067275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:42.074753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:42.075494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:42.076358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:42.078068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:42.078543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:42.078982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:42.388102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:42.400698 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9aca0597-c373-426b-a9dc-d4dfea286a92 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.338192 Oct 24 09:10:42.401219 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2076/4241] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:42 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:42.418332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:42.419213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:42.430624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:42.434847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:42.435570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:42.437948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:42.438711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:42.439041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:42.450637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:42.459746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cda27c54-a06f-4f59-b2e6-9e79e09b3847 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.745547 Oct 24 09:10:42.466466 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2166/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:41 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:42.653593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-580764459", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "cbf671c7-9a45-4411-9bbb-7fbeb13e5538"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:42.745676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] validate_networks() for [('cbf671c7-9a45-4411-9bbb-7fbeb13e5538', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:10:43.037095 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:43.046074 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-855be814-11a0-4a4d-a135-c01c3e161974 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1508 microversion: 2.1 time: 0.638810 Oct 24 09:10:43.051409 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2077/4243] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:42 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:43.089864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:43.094657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:43.115989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:43.116688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:43.117335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:43.118246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:43.119410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:43.120949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:43.960666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:44.026438 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4fa84b7b-66a9-4b4e-9dd8-4e7c76e3e13f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.946225 Oct 24 09:10:44.027175 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2078/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:43 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:44.047310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:44.048205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:44.054745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:44.055481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:44.056268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:44.057148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:44.057789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:44.058372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:44.682931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:44.694047 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea5a6ca8-513c-4122-8e5d-da81829cdd9b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.650591 Oct 24 09:10:44.701906 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2079/4245] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:44 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:44.718052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:44.718961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:44.735985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:44.736798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:44.737742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:44.738661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:44.739409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:44.740057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.164862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:45.173991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:10:45.175097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:10:45.175820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:10:45.177874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:10:45.178229 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-75c4a85e-4736-4916-9f8d-75b21cfec2bf tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1512 microversion: 2.1 time: 0.474191 Oct 24 09:10:45.179324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:10:45.187730 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2080/4246] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:44 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:45.192548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:45.197080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.197746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:45.198034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.199190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.200916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.201576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.202194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.212804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.213332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.213960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.214843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.221390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.222060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.234039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:45.242726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Getting quotas for user c703cc73a22749858ffe05500e52aa03 and project be8fffe9b0994ded9f07301735105917. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:45.264391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:10:45.267777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:45.359754 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63a377f4-1cbc-49d0-8140-65f3c9a87923 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.710222 Oct 24 09:10:45.361699 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2167/4247] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:10:45.368913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:45.375958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:45.376732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.servers [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Removing options 'limit' from query {{(pid=126920) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 09:10:45.380063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:45.382463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.383378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.385958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.387560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.388598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.389246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.392457 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71735320-d3bd-4be7-b007-981d66d3ddff tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029329 Oct 24 09:10:45.393748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2168/4248] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Oct 24 09:10:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:10:45.401517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01dd8794-430f-49f8-823e-2fbbc4287b00 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:45.402553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01dd8794-430f-49f8-823e-2fbbc4287b00 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:45.705577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:45.713673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9396bd4-a8b6-484a-af1f-eff0b0f450b8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.524755 Oct 24 09:10:45.715249 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2081/4249] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:45 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:45.725786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:45.726615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:45.740682 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:45.743053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.745548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.746179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.747067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.749868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.753044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.756216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01dd8794-430f-49f8-823e-2fbbc4287b00 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:45.764496 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01dd8794-430f-49f8-823e-2fbbc4287b00 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1214 microversion: 2.1 time: 0.369262 Oct 24 09:10:45.769160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2169/4250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:45 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:45.781656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:45.782558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:45.799030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.799943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.800637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:45.801964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:45.803762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:45.806509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:46.590766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:46.607543 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30a4dad1-9490-432c-8d97-646415a2d60b tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1512 microversion: 2.1 time: 0.885381 Oct 24 09:10:46.608839 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2082/4251] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:45 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1512 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:46.633308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:46.635158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:46.643997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:46.647127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:46.648128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:46.653541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:46.654373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:46.667018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:46.721664 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:47.093337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:47.107365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6c06c3d-fa20-4408-aa2c-620537038c16 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 1.336686 Oct 24 09:10:47.109628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2170/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:45 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:47.134767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:47.135557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:47.161569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:47.162180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:47.162642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:47.175946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:47.176498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:47.176958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:47.695820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:47.709587 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7084ce69-3eaf-4e63-821f-9fc4d7607a83 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.598038 Oct 24 09:10:47.729807 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2171/4253] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:47 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:47.743012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-bf4f61f3-67c6-460f-9e7d-4a50334d4c92 req-7db8003d-da26-4d61-b70f-9a5551e26db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "name": "network-vif-plugged", "status": "completed", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:47.772728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bf4f61f3-67c6-460f-9e7d-4a50334d4c92 req-7db8003d-da26-4d61-b70f-9a5551e26db4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:47.774328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bf4f61f3-67c6-460f-9e7d-4a50334d4c92 req-7db8003d-da26-4d61-b70f-9a5551e26db4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:47.777468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bf4f61f3-67c6-460f-9e7d-4a50334d4c92 req-7db8003d-da26-4d61-b70f-9a5551e26db4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:47.813907 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-bf4f61f3-67c6-460f-9e7d-4a50334d4c92 req-7db8003d-da26-4d61-b70f-9a5551e26db4 service nova] Creating event network-vif-plugged:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:10:47.826397 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-bf4f61f3-67c6-460f-9e7d-4a50334d4c92 req-7db8003d-da26-4d61-b70f-9a5551e26db4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094981 Oct 24 09:10:47.827035 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2172/4254] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:47.844671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:47.845933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:47.865818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:47.866343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:47.866789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:47.868343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:47.874122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:47.874122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:48.115143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:48.126497 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e043528-3100-4780-bfe9-7611b6fc653c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1272 microversion: 2.1 time: 0.297467 Oct 24 09:10:48.129439 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2173/4255] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:47 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:48.143116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:48.144001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:48.157182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:48.159948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:48.160572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:48.161504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:48.167782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:48.168406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:48.267614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:48.277250 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3e03595-91cd-49aa-8fa6-dfacafb3bfd4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 200 len: 1511 microversion: 2.1 time: 1.649306 Oct 24 09:10:48.283176 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2083/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:46 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 1511 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:48.308008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:48.309004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:48.323936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:48.324832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:48.325522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:48.326616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:48.327289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:48.327928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:48.560422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:48.571172 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c30ffb3-4db6-430e-b624-a7d47b43561e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.440170 Oct 24 09:10:48.573205 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2174/4257] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:48 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:48.736477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:48.736892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:48.748055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:48.748563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:48.753922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:48.754972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:48.755459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:48.755903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.050571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:49.066069 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b73bc8b-ec1f-4c73-83cc-6768c3601f36 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.330906 Oct 24 09:10:49.082171 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2175/4258] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:48 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:49.154048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:49.156280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:49.172947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:49.174167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:49.175187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.176393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:49.176969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:49.178022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.312183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:49.325514 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90cb0b5b-6cbe-4766-bfcc-c839cd64ccee tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1272 microversion: 2.1 time: 0.177076 Oct 24 09:10:49.337799 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2176/4259] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:49 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:49.346661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:49.357837 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0e2c6bd-c9ac-4659-bf67-69aa94c9284f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1512 microversion: 2.1 time: 1.053533 Oct 24 09:10:49.363558 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2084/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:48 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1512 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:10:49.391072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:49.405499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:49.406069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:49.595776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:49.596383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:49.608741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:49.610164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:49.611261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.612138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:49.612907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:49.613517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.700327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:49.700822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:49.701259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.702043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:49.702499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:49.702925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:49.861216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:49.991856 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4a0ef62-2244-4da7-88cc-38d9dc8fa6eb tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.605810 Oct 24 09:10:49.996270 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2177/4261] 10.222.0.25 () {58 vars in 1154 bytes} [Mon Oct 24 09:10:49 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:50.022729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:50.024324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:50.040087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.042491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.043180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.044209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.044831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.047160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.075696 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:50.351073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:50.361132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e8906a7-d0d9-4697-922f-72a41cee1917 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1512 microversion: 2.1 time: 0.352360 Oct 24 09:10:50.366529 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2178/4262] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:50 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:50.373746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:50.376283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:50.392832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.393528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.394101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.394911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.398692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.399337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.493184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:50.502123 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e7ee15d5-23e6-4d43-a2f1-f2bd15b6e031 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.910228 Oct 24 09:10:50.517835 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2085/4263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:49 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:50.532212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:50.532827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:50.543671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.544353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.544782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.545683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.546280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.554894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.658049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:50.676934 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0845103e-e277-45fc-af0c-6711015091ec tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.308491 Oct 24 09:10:50.678833 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2179/4264] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:50 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:50.690319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:50.691534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:50.703052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.706061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.708477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.709555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:50.710295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:50.710955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:50.739987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:50.752805 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f97df323-2dad-449b-a8b0-756524219273 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1272 microversion: 2.1 time: 0.231318 Oct 24 09:10:50.755011 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2086/4265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:50 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:51.026788 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:10:51.027923 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f (ip 10.222.0.25) !!! Oct 24 09:10:51.038488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:51.146783 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a766c65a-b151-477f-930c-9bafabf5a218 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 200 len: 1511 microversion: 2.1 time: 0.465830 Oct 24 09:10:51.147707 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2180/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:50 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:51.173922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:51.179756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:51.188106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:51.188650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:51.189102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:51.189860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:51.190321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:51.190752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:51.536050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:51.538004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:51.552693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:51.554144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:51.555375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:51.557216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:51.563199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:51.563937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:51.731264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:51.748228 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-194c8686-01df-4e55-a669-41b1d655af0d tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1512 microversion: 2.1 time: 0.576709 Oct 24 09:10:51.749507 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2087/4267] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:51 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1512 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:51.762725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:51.763761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:51.780359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:51.786512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:51.786999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:51.787762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:51.788260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:51.793949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:52.309526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:52.318508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28320b76-480a-40e0-b06a-769a74dc1cad tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.790033 Oct 24 09:10:52.319839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2181/4268] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:51 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:52.326107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-6372810f-aead-479a-b883-4ae39469bb72 req-a7489d67-226d-497c-9480-37a190e6100a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382e3bdd-c519-41a4-9ebc-957c37059d41", "name": "network-vif-plugged", "status": "completed", "tag": "1cd1b987-13bb-4075-be4b-149af14dc5ee"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:52.346568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6372810f-aead-479a-b883-4ae39469bb72 req-a7489d67-226d-497c-9480-37a190e6100a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:52.350507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6372810f-aead-479a-b883-4ae39469bb72 req-a7489d67-226d-497c-9480-37a190e6100a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:52.358914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6372810f-aead-479a-b883-4ae39469bb72 req-a7489d67-226d-497c-9480-37a190e6100a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:52.379977 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-6372810f-aead-479a-b883-4ae39469bb72 req-a7489d67-226d-497c-9480-37a190e6100a service nova] Creating event network-vif-plugged:1cd1b987-13bb-4075-be4b-149af14dc5ee for instance 382e3bdd-c519-41a4-9ebc-957c37059d41 on n-h1-master-1 Oct 24 09:10:52.396072 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-6372810f-aead-479a-b883-4ae39469bb72 req-a7489d67-226d-497c-9480-37a190e6100a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074452 Oct 24 09:10:52.396845 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2182/4269] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:52.407360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:52.425779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:52.427127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:52.440773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:52.441279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:52.441756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:52.442663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:52.443133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:52.443569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:52.537968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:52.612248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:52.629077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:52.630541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:52.631016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.037430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:53.055449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e7825373-eaaa-433e-8ebc-2cee2ae78687 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 1.304517 Oct 24 09:10:53.057373 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2088/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:51 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:53.064038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:53.065184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:53.079660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:53.082417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:53.083104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.084497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:53.085460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:53.086483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.436912 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e99c3a7-cf96-418b-aeb5-589fbf83dbc4 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.037403 Oct 24 09:10:53.440664 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2183/4271] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:10:52 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:53.470531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:53.472724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:53.484163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:53.487554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:53.488737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.491072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:53.492819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:53.494861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.512840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:53.531257 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1a9cd1a-cc7c-42ae-8c74-e5758feb1d5f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 0.471448 Oct 24 09:10:53.537038 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2089/4272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:53 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:53.560314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:53.577369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:53.584039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:53.952650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:53.954115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:53.957081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.963237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:53.965256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:53.968209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:53.968872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:53.983705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-158ec3bc-df9f-40c7-819f-1839da166db6 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.540978 Oct 24 09:10:53.999860 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2184/4273] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:53 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:54.150281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-77029450", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9f783ccd-f93e-494a-8956-7fbc33ffa507"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:54.333774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:54.486687 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-03749886-32a9-44d1-a6e8-9587d8490d7a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.930728 Oct 24 09:10:54.488809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2090/4274] 10.222.0.25 () {58 vars in 1150 bytes} [Mon Oct 24 09:10:53 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:54.504316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:54.514279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:54.547681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:54.552344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:54.555147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:54.556021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:54.559507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:54.560038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:54.647428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] validate_networks() for [('9f783ccd-f93e-494a-8956-7fbc33ffa507', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:10:55.101463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:55.115930 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-120e874d-b8da-49d4-863a-cbd21064732f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1318 microversion: 2.1 time: 0.615195 Oct 24 09:10:55.117368 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2091/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:54 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:55.128717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:55.146089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:55.149092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:55.155043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:55.155899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:55.156560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:55.157577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:55.158285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:55.159094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:55.364306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:55.544794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abeaa011-7388-4729-9978-7f48868ffd46 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.424966 Oct 24 09:10:55.545414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2092/4276] 10.222.0.25 () {58 vars in 1212 bytes} [Mon Oct 24 09:10:55 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:55.573611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:55.574570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:55.601523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:55.602472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:55.603607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:55.604519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:55.605120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:55.605739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.008663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:10:56.010430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:10:56.011159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:10:56.011747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:10:56.012339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:10:56.046774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:56.053447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:56.053985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.061129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:56.061129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:56.061129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.130323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Getting quotas for project a1021217d2904d5190dd4a82db7007fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:56.142933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Getting quotas for user af9c3d9be3f2494a8eb2394e48bdeca6 and project a1021217d2904d5190dd4a82db7007fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:56.152846 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:56.184416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Going to run 2 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:10:56.201767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: c54d4c00-2760-4acc-af52-6e8c7fd536a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:56.247909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=c54d4c00-2760-4acc-af52-6e8c7fd536a2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:10:56.248368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:56.258755 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-efe73f69-a359-4b79-b321-16f502ae9e0f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 0.703187 Oct 24 09:10:56.259296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2093/4277] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:55 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:56.269789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:56.273324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:56.293719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:56.306638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:56.307346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.308451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:56.309110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:56.309783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.425964 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71b04543-58d8-4070-a271-4ff85718faeb tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.417904 Oct 24 09:10:56.429765 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2185/4278] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:10:56.544374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98989651-b3fe-4b5a-a9d9-aaaeff53e308 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: .version_select at 0x7f8dab023280>, body: {"keypair": {"name": "tempest-keypair-658762735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYKUAH1JhRn7Td0e7jbM4XQFVxrQ0Du12XULYU4SGMf0ZbVT4VBgo11dFfuR1MnOVXVPVNb939NHCrwc2honSHDnh5/Kos+y1hCUbdnpKNSbLq1Gf1uyMUNfxcLe0YwGw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:56.583596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-98989651-b3fe-4b5a-a9d9-aaaeff53e308 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:10:56.597207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-98989651-b3fe-4b5a-a9d9-aaaeff53e308 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:10:56.661140 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98989651-b3fe-4b5a-a9d9-aaaeff53e308 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.226536 Oct 24 09:10:56.669507 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2186/4279] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:10:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:56.677710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:56.686257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:56.694326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:56.714727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:56.715962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:56.716712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.717870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:56.721957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:56.722731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:56.930038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:56.958529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:56.975201 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e24ab14-e623-472a-95d5-d786f5112658 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.710508 Oct 24 09:10:56.982998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2094/4280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:56 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:56.988511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8911999d-a8e5-401d-9edc-2e352c0462fa req-e547c9b6-2eb6-4d88-9901-7139a2247969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1578f62-252e-49eb-99ae-8f85cfc6490f", "tag": "16877e70-f3fd-4ebf-a699-15a920c89fd1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:57.014969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8911999d-a8e5-401d-9edc-2e352c0462fa req-e547c9b6-2eb6-4d88-9901-7139a2247969 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.020105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8911999d-a8e5-401d-9edc-2e352c0462fa req-e547c9b6-2eb6-4d88-9901-7139a2247969 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.020771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8911999d-a8e5-401d-9edc-2e352c0462fa req-e547c9b6-2eb6-4d88-9901-7139a2247969 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.065950 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8911999d-a8e5-401d-9edc-2e352c0462fa req-e547c9b6-2eb6-4d88-9901-7139a2247969 service nova] Creating event network-changed:16877e70-f3fd-4ebf-a699-15a920c89fd1 for instance a1578f62-252e-49eb-99ae-8f85cfc6490f on n-h2-master-1 Oct 24 09:10:57.080741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8911999d-a8e5-401d-9edc-2e352c0462fa req-e547c9b6-2eb6-4d88-9901-7139a2247969 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095663 Oct 24 09:10:57.082315 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2095/4281] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:57.092138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:57.092858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:57.111329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.112232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.113256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.114225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.114839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.115699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.145184 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d543361a-117a-4ddd-b634-215db8dbd36e tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.473123 Oct 24 09:10:57.145800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2187/4282] 10.222.0.25 () {58 vars in 1196 bytes} [Mon Oct 24 09:10:56 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:57.163516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:57.181631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:57.182609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Searching by: {'deleted': False, 'project_id': 'a1021217d2904d5190dd4a82db7007fd'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:57.229819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.234414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.235268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.236575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.238985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.239618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.299269 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a442990-ccb2-4b6f-a3b6-3539847d5af2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.139510 Oct 24 09:10:57.307336 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2188/4283] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:10:57 2022] GET /compute/v2.1/servers => generated 673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:57.312141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:57.335118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:57.335806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': '-204253645', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:57.355051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.355542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.355990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.357044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.357177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.357680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.635772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:57.849491 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4350ece3-5337-4f8f-96da-5d6bc796338c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-204253645" status: 200 len: 345 microversion: 2.1 time: 0.539423 Oct 24 09:10:57.850556 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2189/4284] 10.222.0.25 () {58 vars in 1156 bytes} [Mon Oct 24 09:10:57 2022] GET /compute/v2.1/servers?name=-204253645 => generated 345 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:57.857485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:57.857485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:57.864320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.865318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.865788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.866523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:57.866982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:57.867410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:57.922514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:57.933915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb141c63-9806-436b-9e5d-76c38fce7715 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1468 microversion: 2.1 time: 0.850966 Oct 24 09:10:57.935064 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2096/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:57 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1468 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:57.943824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f5d16a4-5520-41a1-b4ac-28e213e29ae9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:57.945593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f5d16a4-5520-41a1-b4ac-28e213e29ae9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:58.065536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f5d16a4-5520-41a1-b4ac-28e213e29ae9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:58.077467 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f5d16a4-5520-41a1-b4ac-28e213e29ae9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1218 microversion: 2.1 time: 0.140957 Oct 24 09:10:58.078563 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2097/4286] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:57 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:58.086408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:58.103436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:58.105895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:58.121672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:58.122458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:58.123134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:58.124219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:58.129140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:58.130163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:58.451924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:58.464325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dde80db3-d4a3-4527-b3bf-071e51763a91 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 0.612574 Oct 24 09:10:58.484417 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2190/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:57 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:58.492519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:58.499314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:58.510697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:58.511195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:58.511633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:58.515981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:58.521436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:58.522004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:58.867716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:58.882699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-755f9dd2-a9f1-481e-9784-24204df85f34 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1467 microversion: 2.1 time: 0.391008 Oct 24 09:10:58.883519 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2191/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:58 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1467 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:58.897423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:58.904068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:58.923761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:58.928431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:58.929532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:58.931877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:58.932982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:58.934928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.136926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:59.246851 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ccd1cac-d954-486d-8b89-d5fee503b33a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 1.166837 Oct 24 09:10:59.247837 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2098/4289] 10.222.0.25 () {58 vars in 1154 bytes} [Mon Oct 24 09:10:58 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:59.254387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1480358984"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:10:59.258058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:59.266378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.267290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.267936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.269111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.269984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.270659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.635153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:59.645413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a74f002a-3369-4d79-91e5-a370019f3cfe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.759691 Oct 24 09:10:59.647962 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2192/4290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:58 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:10:59.659476 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:59.662284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:59.663186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:59.676174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.676872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.677342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.678053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.678521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.678951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.716925 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8385fa34-fb7b-4c51-9242-4ff3497f9bd4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "POST /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0/action" status: 202 len: 0 microversion: 2.1 time: 0.466443 Oct 24 09:10:59.723251 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2099/4291] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:10:59 2022] POST /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:10:59.751770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:59.760168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:10:59.760995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-20425364', 'deleted': False, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:10:59.780075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.781332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.781927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.783417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.784428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.785133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.897879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:10:59.973195 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6e57fba-1699-4090-a9e7-f9cbef89bbb7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-20425364" status: 200 len: 345 microversion: 2.1 time: 0.248283 Oct 24 09:10:59.977738 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2100/4292] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Oct 24 09:10:59 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-20425364 => generated 345 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:10:59.982062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:10:59.982999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:10:59.990928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.991424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.992085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:10:59.992798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:10:59.993480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:10:59.993910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:00.406264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:00.415486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55ab6755-018c-4235-b7c8-ff290eaea04c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1270 microversion: 2.1 time: 0.765965 Oct 24 09:11:00.416284 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2193/4293] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:59 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1270 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:00.420967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a59b336-915c-48d1-928d-d7fe154c564e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab02a700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:00.483648 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a59b336-915c-48d1-928d-d7fe154c564e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.064719 Oct 24 09:11:00.484261 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2194/4294] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:00 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:00.489363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:00.490068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:00.497837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:00.498523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:00.499128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:00.500207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:00.500673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:00.501108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:00.529769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:00.655267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3649512c-4967-4f5b-acb4-a259cad2184c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 204 len: 0 microversion: 2.1 time: 0.169260 Oct 24 09:11:00.656003 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2195/4295] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:00 2022] DELETE /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:00.666401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:00.668100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:00.675800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:00.676537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:00.677817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:00.678617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:00.678972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:00.679397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:00.684616 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:00.750334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:00.765321 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aac3c259-be43-499b-b9dc-dbb69b6fb9d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 0.789483 Oct 24 09:11:00.766426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2101/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:10:59 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:00.771225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:00.777042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:00.785338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:00.785988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:00.792329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:00.793171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:00.793757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:00.794588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:01.084576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:01.102650 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aed7863f-3f9d-42b5-87ef-f415c6defbc3 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.334401 Oct 24 09:11:01.124040 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2102/4297] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:00 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:01.443477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:01.443729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:01.444104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:01.456494 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3e68e1a-7e2e-4f4e-8c7e-ef4c53d9ddd2 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1518 microversion: 2.1 time: 0.795712 Oct 24 09:11:01.462902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:01.463483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:01.464280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:01.465037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:01.465361 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2196/4298] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:00 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1518 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:01.465558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:01.466268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:01.499571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e92a10f6-d457-4737-8382-5ad55030f4a6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daafcddc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:01.563475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e92a10f6-d457-4737-8382-5ad55030f4a6 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.067966 Oct 24 09:11:01.564055 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2197/4299] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:01 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:01.606578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:01.615428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73bed503-3e38-4913-b9a4-077871e05f3f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1276 microversion: 2.1 time: 0.178026 Oct 24 09:11:01.628335 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2103/4300] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:01 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:01.791284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:01.792711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:01.802737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:01.803242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:01.803694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:01.804410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:01.804876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:01.805327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.133473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:02.134930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:02.168160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:02.175334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:02.180828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.187056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:02.187056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:02.187056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.440441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:02.452369 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc24430e-67b5-49b8-becf-96cfc9e6e626 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 0.666911 Oct 24 09:11:02.454079 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2198/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:01 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:02.482329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:02.483273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:02.492177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:02.497889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:02.498670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.499657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:02.500436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:02.501101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.614246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:02.622210 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6605c2be-a347-4e7a-8500-c235faef15fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.494249 Oct 24 09:11:02.622805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2104/4302] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:02 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:02.638543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-763d408a-0bbd-4695-b28f-cc80c530effe tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab462160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:02.716870 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-763d408a-0bbd-4695-b28f-cc80c530effe tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.092981 Oct 24 09:11:02.730070 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2105/4303] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:02 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:02.735178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:02.735920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:02.742424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:02.755988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:02.756866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.757882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:02.758582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:02.759731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:02.879178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:02.903702 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd9efb33-5d85-42ca-86c5-19e7ad6657c5 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1276 microversion: 2.1 time: 0.172363 Oct 24 09:11:02.910317 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2106/4304] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:02 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:03.213321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:03.229832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ffe5b451-5d1b-4c36-9ce6-962d222906ce tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 200 len: 1518 microversion: 2.1 time: 0.748476 Oct 24 09:11:03.231117 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2199/4305] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:02 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 1518 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:03.483605 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:03.485336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:03.527957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:03.532107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:03.542646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:03.546425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:03.548171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:03.548890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:03.647575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:03.648489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:03.671385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:03.671982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:03.672329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:03.673139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:03.673798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:03.674382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:04.041120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:04.066269 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4084051e-c6da-4f35-8dfa-c974043b7f47 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 0.422460 Oct 24 09:11:04.070101 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2200/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:03 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:04.081206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-070d894a-db3e-456a-9976-75341a38544c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daadf5790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:04.198144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-070d894a-db3e-456a-9976-75341a38544c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.126278 Oct 24 09:11:04.201021 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2201/4307] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:04 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:04.212590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1791872327", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcfcdb25-90f0-4d8a-8f56-0850a24cf320"}], "security_groups": [{"name": "tempest-securitygroup--176553193"}], "key_name": "tempest-keypair-658762735", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:04.500961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] validate_networks() for [('bcfcdb25-90f0-4d8a-8f56-0850a24cf320', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:11:04.605928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:04.633551 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afdf638b-1f15-4324-a0c3-eb713fdd4512 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 1.156451 Oct 24 09:11:04.638731 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2107/4308] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:03 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:04.667784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:04.668913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:04.726762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:04.730806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:04.732318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:04.734664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:04.737977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:04.738769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:05.795445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:05.820353 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2e1b0b0-cd89-4213-8e26-d4e714361530 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 1.158503 Oct 24 09:11:05.843771 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2108/4309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:04 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:05.851018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-91ffbdf2-db71-4e70-9503-a96d14250afd req-11324edf-a74b-4ce5-ad95-487a038ced7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1578f62-252e-49eb-99ae-8f85cfc6490f", "name": "network-vif-plugged", "status": "completed", "tag": "16877e70-f3fd-4ebf-a699-15a920c89fd1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:05.867023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-91ffbdf2-db71-4e70-9503-a96d14250afd req-11324edf-a74b-4ce5-ad95-487a038ced7c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:05.867912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-91ffbdf2-db71-4e70-9503-a96d14250afd req-11324edf-a74b-4ce5-ad95-487a038ced7c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:05.869594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-91ffbdf2-db71-4e70-9503-a96d14250afd req-11324edf-a74b-4ce5-ad95-487a038ced7c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:05.897070 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-91ffbdf2-db71-4e70-9503-a96d14250afd req-11324edf-a74b-4ce5-ad95-487a038ced7c service nova] Creating event network-vif-plugged:16877e70-f3fd-4ebf-a699-15a920c89fd1 for instance a1578f62-252e-49eb-99ae-8f85cfc6490f on n-h2-master-1 Oct 24 09:11:05.906961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-91ffbdf2-db71-4e70-9503-a96d14250afd req-11324edf-a74b-4ce5-ad95-487a038ced7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061476 Oct 24 09:11:05.908273 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2109/4310] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:05.918332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-68e8c385-d141-4107-bd00-1f2f31fdafb7 req-0154c262-b9b8-4e7b-a408-3a8cbf24d940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7dbc45-6db8-4932-963f-195b2d4e5f58", "name": "network-vif-deleted", "tag": "d8c3d946-fa76-4ee4-9df2-ded5ccff5a84"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:05.932768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-68e8c385-d141-4107-bd00-1f2f31fdafb7 req-0154c262-b9b8-4e7b-a408-3a8cbf24d940 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:05.934136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-68e8c385-d141-4107-bd00-1f2f31fdafb7 req-0154c262-b9b8-4e7b-a408-3a8cbf24d940 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:05.941996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-68e8c385-d141-4107-bd00-1f2f31fdafb7 req-0154c262-b9b8-4e7b-a408-3a8cbf24d940 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:05.975190 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-68e8c385-d141-4107-bd00-1f2f31fdafb7 req-0154c262-b9b8-4e7b-a408-3a8cbf24d940 service nova] Creating event network-vif-deleted:d8c3d946-fa76-4ee4-9df2-ded5ccff5a84 for instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 on n-h2-master-1 Oct 24 09:11:05.982001 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-68e8c385-d141-4107-bd00-1f2f31fdafb7 req-0154c262-b9b8-4e7b-a408-3a8cbf24d940 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071970 Oct 24 09:11:05.983103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2110/4311] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:05.988527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:05.989446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 3e7dbc45-6db8-4932-963f-195b2d4e5f58] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:05.998917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.006058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.006799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.007666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.008251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.009566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.060630 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] HTTP exception thrown: Instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 could not be found. Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Request method failure captured: Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 HTTP/1.1 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlZWaSsh682ijqqzfTighzo5cjDkdiAAdVqr6S8fqy6km4iPGnxE1H7Le_1af6EcXD5M2eev_l8LYDo-7BOpk7Yw8KzH_yVZJI3uTQWm9Zlz-ErGDwtN8JGxnVZH2UuJQoT-oBbuNQqgGjjA00uBZZFZ_U4VJLfqb06U7PB4rqHA0Lo Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 126c5b989a304f1cb217c95ebfbbd8b8 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/126c5b989a304f1cb217c95ebfbbd8b8"}]}] Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 126c5b989a304f1cb217c95ebfbbd8b8 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ListServerFiltersTestJSON-1199478823-project Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: abd944e891194ac498c21b55da9cb581 Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ListServerFiltersTestJSON-1199478823-project Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 could not be found. Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3e7dbc45-6db8-4932-963f-195b2d4e5f58'} Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 could not be found. Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 could not be found. Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:06.068747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 could not be found. Oct 24 09:11:06.073655 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:11:06.075487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Returning 404 to user: Instance 3e7dbc45-6db8-4932-963f-195b2d4e5f58 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:11:06.076594 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ebdaa857-6c6b-4faa-b177-74480218c356 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58" status: 404 len: 111 microversion: 2.1 time: 0.092297 Oct 24 09:11:06.077761 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2111/4312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:05 2022] GET /compute/v2.1/servers/3e7dbc45-6db8-4932-963f-195b2d4e5f58 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:11:06.086287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:06.086981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:06.105961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.107432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.107965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.108837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.109464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.110738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.474246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:11:06.478335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:11:06.479174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:11:06.479753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:11:06.480625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:11:06.497824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.498522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.499124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.500054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.501991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.506002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.528052 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=17 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:06.553875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:11:06.567069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:11:06.597586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:11:06.599954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:11:06.706037 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0025822c-d111-4c91-9ffc-5f7a96422ba4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.503595 Oct 24 09:11:06.708953 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2202/4313] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:11:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:11:06.724376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c51358aa-630f-4c43-bdf3-85ccbc8386a9 req-969fd7c4-0b7f-4ba8-9f3a-d226b4e408b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c54d4c00-2760-4acc-af52-6e8c7fd536a2", "tag": "ef9c1fe3-7c82-4577-89bf-fd048a647d38"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:06.741058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c51358aa-630f-4c43-bdf3-85ccbc8386a9 req-969fd7c4-0b7f-4ba8-9f3a-d226b4e408b1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.745093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c51358aa-630f-4c43-bdf3-85ccbc8386a9 req-969fd7c4-0b7f-4ba8-9f3a-d226b4e408b1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.745798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c51358aa-630f-4c43-bdf3-85ccbc8386a9 req-969fd7c4-0b7f-4ba8-9f3a-d226b4e408b1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.771632 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c51358aa-630f-4c43-bdf3-85ccbc8386a9 req-969fd7c4-0b7f-4ba8-9f3a-d226b4e408b1 service nova] Creating event network-changed:ef9c1fe3-7c82-4577-89bf-fd048a647d38 for instance c54d4c00-2760-4acc-af52-6e8c7fd536a2 on n-h1-master-1 Oct 24 09:11:06.787030 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c51358aa-630f-4c43-bdf3-85ccbc8386a9 req-969fd7c4-0b7f-4ba8-9f3a-d226b4e408b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071883 Oct 24 09:11:06.787663 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2203/4314] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:06.798855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a318901-fbd2-4864-8341-5ee6a7e9f767 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab029820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:06.931917 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a318901-fbd2-4864-8341-5ee6a7e9f767 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.142997 Oct 24 09:11:06.932822 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2204/4315] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:06 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:06.948008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:06.948850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:06.959492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.961389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.962413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:06.963169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:06.963686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:06.964087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:07.360974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:07.388783 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5913eab-258b-4675-b9e4-b2a20927a78e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1314 microversion: 2.1 time: 0.443678 Oct 24 09:11:07.389626 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2205/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:06 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:07.409558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:07.417636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:07.436712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:07.437219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:07.437719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:07.438433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:07.438887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:07.439308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:07.579467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:07.714389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:07.729106 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-185e878f-7134-40a4-a5c7-096bfb6b8c46 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1505 microversion: 2.1 time: 1.650033 Oct 24 09:11:07.730378 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2112/4317] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:06 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1505 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:07.766902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e82b2085-f02d-4c70-bccb-6e163c59f3df tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:07.767740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e82b2085-f02d-4c70-bccb-6e163c59f3df tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:07.815019 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fa12dd5-7438-45f0-b04d-ce8554a673a7 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 204 len: 0 microversion: 2.1 time: 0.423350 Oct 24 09:11:07.820493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2206/4318] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:07 2022] DELETE /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:07.829140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:07.830207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:07.843690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:07.844499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:07.845732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:07.846690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:07.848365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:07.849141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.073210 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:08.204590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e82b2085-f02d-4c70-bccb-6e163c59f3df tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:08.220224 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e82b2085-f02d-4c70-bccb-6e163c59f3df tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1241 microversion: 2.1 time: 0.487521 Oct 24 09:11:08.230142 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2113/4319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:07 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1241 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:08.235447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:08.237054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:08.245198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.246113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.255179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.266105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:08.270141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.272893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.273367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.278876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-78629e30-e8e2-4fa6-b0df-c7efcceac05b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 0.454585 Oct 24 09:11:08.279839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2207/4320] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:07 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:08.287404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f70530b-cebf-4820-8eaa-60b7e5fa02e4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaef1670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:08.422201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f70530b-cebf-4820-8eaa-60b7e5fa02e4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.138427 Oct 24 09:11:08.423355 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2208/4321] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:08 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:08.427951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1b5ed29f-6acb-46f6-91b0-761461ff5291 req-64e9350d-3792-4ed4-b236-11f265c469e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "326de161-d30f-4432-a3a9-a4a744914aba", "tag": "404fcfc4-331b-4dd7-9799-ca65fbe3b624"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:08.438266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1b5ed29f-6acb-46f6-91b0-761461ff5291 req-64e9350d-3792-4ed4-b236-11f265c469e4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.439153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1b5ed29f-6acb-46f6-91b0-761461ff5291 req-64e9350d-3792-4ed4-b236-11f265c469e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.439740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1b5ed29f-6acb-46f6-91b0-761461ff5291 req-64e9350d-3792-4ed4-b236-11f265c469e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.458624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1b5ed29f-6acb-46f6-91b0-761461ff5291 req-64e9350d-3792-4ed4-b236-11f265c469e4 service nova] Creating event network-changed:404fcfc4-331b-4dd7-9799-ca65fbe3b624 for instance 326de161-d30f-4432-a3a9-a4a744914aba on n-h2-master-1 Oct 24 09:11:08.484601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1b5ed29f-6acb-46f6-91b0-761461ff5291 req-64e9350d-3792-4ed4-b236-11f265c469e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059906 Oct 24 09:11:08.489276 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2209/4322] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:08.495363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e5f960a2-bc68-496e-bec8-abca2f5d4f85 req-cdaf299d-f5f5-4222-af8c-88168495b85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "name": "network-vif-plugged", "status": "completed", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:08.522498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e5f960a2-bc68-496e-bec8-abca2f5d4f85 req-cdaf299d-f5f5-4222-af8c-88168495b85c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.525375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e5f960a2-bc68-496e-bec8-abca2f5d4f85 req-cdaf299d-f5f5-4222-af8c-88168495b85c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.526109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e5f960a2-bc68-496e-bec8-abca2f5d4f85 req-cdaf299d-f5f5-4222-af8c-88168495b85c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.552752 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e5f960a2-bc68-496e-bec8-abca2f5d4f85 req-cdaf299d-f5f5-4222-af8c-88168495b85c service nova] Creating event network-vif-plugged:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:11:08.559331 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e5f960a2-bc68-496e-bec8-abca2f5d4f85 req-cdaf299d-f5f5-4222-af8c-88168495b85c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068260 Oct 24 09:11:08.560289 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2210/4323] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:08.570943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:08.574306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:08.591878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.593074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.593745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.594647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.595376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.595958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.821618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:08.831226 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4aeaf70b-2e57-41cf-b0af-e6031b125c26 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1501 microversion: 2.1 time: 0.268919 Oct 24 09:11:08.832461 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2211/4324] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:08 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:08.840524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:08.841614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:08.856785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:08.859336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.859897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.860411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.862689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.863252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.863753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.874060 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39bd6ad6-d93f-47e2-bfc7-6ce35cc5a69a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 200 len: 1517 microversion: 2.1 time: 0.642480 Oct 24 09:11:08.874661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2114/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:08 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 1517 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:08.898027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:08.898870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:08.905831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.906642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.907301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:08.908249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:08.909107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:08.909918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.044968 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e7fccf1-4efd-479c-8f7f-9d9495b0eddd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f/action" status: 202 len: 0 microversion: 2.1 time: 0.158217 Oct 24 09:11:09.051573 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2115/4326] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:11:08 2022] POST /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:11:09.103978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:09.113988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:09.141011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.144793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.145585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.146993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.152212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.152983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.338467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:09.351660 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-751ea1bf-0f46-443a-a805-70f4af52ad5b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1485 microversion: 2.1 time: 0.517525 Oct 24 09:11:09.354461 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2212/4327] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:08 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1485 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:09.370582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:09.371568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:09.407491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.409748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.410451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.412782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.413914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.416801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.553553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:09.587462 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-846a1a97-c1eb-4bf5-80e3-7c1d3cee4547 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1293 microversion: 2.1 time: 0.224167 Oct 24 09:11:09.601321 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2213/4328] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:09 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1293 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:09.601321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:09.601321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:09.617870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.619441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.619892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.620609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.621069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.621518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.664185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:09.678889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13c1c57f-df30-4d47-86d2-51f1482438f9 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1506 microversion: 2.1 time: 0.603428 Oct 24 09:11:09.682258 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2116/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:09 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:09.698330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc344fab-7fe8-43d9-87c9-cd40ce6ba719 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8da9de1e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:09.785290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc344fab-7fe8-43d9-87c9-cd40ce6ba719 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.101677 Oct 24 09:11:09.786161 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2117/4330] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:09 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:09.792868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-526144695", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:09.835657 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:09.910646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:09.923652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3c1863a-b396-4111-926d-78a4793aa1fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 0.332439 Oct 24 09:11:09.937691 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2214/4331] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:09 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:09.947882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] validate_networks() for [('132293ad-afe6-46fc-9635-403a133a69ac', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:11:09.955362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:09.955666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:09.963252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.963752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.964193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:09.964909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:09.965398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:09.965831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:10.263598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:10.272044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50fe2e9e-ad7f-4924-b720-5c4f270f913a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 200 len: 1517 microversion: 2.1 time: 0.333172 Oct 24 09:11:10.273092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2215/4332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:09 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:10.612881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:10.613635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:10.615730 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:10.622023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:10.634434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:10.635003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:10.635781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:10.636265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:10.636703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:10.796063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:10.811860 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ef2b389-c2bd-4c75-b7dc-1a5fa09ecbcb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1301 microversion: 2.1 time: 0.201544 Oct 24 09:11:10.824161 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2216/4333] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:10 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1301 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:10.828601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:10.829688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:10.841152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:10.845267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:10.845975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:10.847535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:10.849158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:10.850752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:11.480694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:11.482916 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:11.499595 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1f64cc1-ac66-4765-809e-765a0dd9a21f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1486 microversion: 2.1 time: 0.684960 Oct 24 09:11:11.514022 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2217/4334] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:10 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1486 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:11.514022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c68cf2dd-d616-4725-8985-4875e5c268bb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daadf5e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:11.567938 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c68cf2dd-d616-4725-8985-4875e5c268bb tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.066246 Oct 24 09:11:11.577841 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2218/4335] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:11 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:11.582948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:11.583783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:11.592190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:11.593355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:11.593969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:11.595525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:11.596609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:11.597203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:11.886510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:11.901849 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6722d43b-7865-4c7d-8c7a-356af8ed04ff tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 0.322503 Oct 24 09:11:11.918230 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2219/4336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:11 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:11.934332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:11.937147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:11.953921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:11.954466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:11.954916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:11.955642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:11.956103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:11.957187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.083564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:12.097438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06608156-416f-4c2f-92d2-f1cd0832ed86 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 200 len: 1475 microversion: 2.1 time: 0.177196 Oct 24 09:11:12.105421 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2220/4337] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:11 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 1475 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:12.112394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:12.113488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:12.120935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.122063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.123404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.124227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.124806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.125770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.153788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lazy-loading 'flavor' on Instance uuid a1578f62-252e-49eb-99ae-8f85cfc6490f {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:11:12.488225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:11:12.491187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:11:12.494257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:11:12.505604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:11:12.507191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:11:12.541406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb14d8bc-9a67-44e3-8bf6-db36c28ed5fe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f/action" status: 202 len: 0 microversion: 2.1 time: 0.434253 Oct 24 09:11:12.542596 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2221/4338] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:11:12 2022] POST /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:11:12.549324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:12.550289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:12.560955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.562184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.562810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.563039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.563532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.564548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.564861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.565135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.565840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.567624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.568456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.569466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.673689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Getting quotas for project d6c4858fe89d4bfb8b989aa476a58a84. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:11:12.685690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Getting quotas for user d271cce474064255b276e240e88bbe0c and project d6c4858fe89d4bfb8b989aa476a58a84. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:11:12.687341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:12.699964 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cdfdfb76-5ae8-4394-85b4-8482ab5f2404 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1299 microversion: 2.1 time: 0.154137 Oct 24 09:11:12.702995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2222/4339] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:12 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:12.705452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:11:12.709420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:11:12.719276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-caf39ab4-b777-4be5-b772-8eff02e61aab req-c523cc24-25e1-4d92-b7f5-3babbf275119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd02b56-a01e-4a1c-a415-0792683e903f", "name": "network-vif-deleted", "tag": "c9c69745-9562-4273-af8e-6072ebbe581b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:12.777425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-caf39ab4-b777-4be5-b772-8eff02e61aab req-c523cc24-25e1-4d92-b7f5-3babbf275119 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.778076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-caf39ab4-b777-4be5-b772-8eff02e61aab req-c523cc24-25e1-4d92-b7f5-3babbf275119 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.778524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-caf39ab4-b777-4be5-b772-8eff02e61aab req-c523cc24-25e1-4d92-b7f5-3babbf275119 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.793386 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6efa614d-d173-477e-a9aa-2ca1d59eb6d5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.006020 Oct 24 09:11:12.801606 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2118/4340] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:11:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:11:12.807662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:12.808582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:12.817939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.818901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.819619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.825983 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-caf39ab4-b777-4be5-b772-8eff02e61aab req-c523cc24-25e1-4d92-b7f5-3babbf275119 service nova] Creating event network-vif-deleted:c9c69745-9562-4273-af8e-6072ebbe581b for instance 6fd02b56-a01e-4a1c-a415-0792683e903f on n-h2-master-1 Oct 24 09:11:12.835602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:12.837555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:12.840164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:12.854058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-caf39ab4-b777-4be5-b772-8eff02e61aab req-c523cc24-25e1-4d92-b7f5-3babbf275119 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146895 Oct 24 09:11:12.858032 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2223/4341] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:12.866927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dde43676-2031-49b4-be06-0df7dfbbed92 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daae5e3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:12.981023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dde43676-2031-49b4-be06-0df7dfbbed92 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.116450 Oct 24 09:11:12.984028 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2224/4342] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:12 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:12.990734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-924a402e-7fba-4892-8716-ee00aac17c53 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:12.991771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-924a402e-7fba-4892-8716-ee00aac17c53 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:13.110211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-924a402e-7fba-4892-8716-ee00aac17c53 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:13.120353 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=27 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:13.122433 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-924a402e-7fba-4892-8716-ee00aac17c53 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1213 microversion: 2.1 time: 0.136730 Oct 24 09:11:13.137321 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2225/4343] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:12 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:13.137321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:13.137321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:13.156597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.157364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.157961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.158866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.159481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.160062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.590075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:13.611717 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8b9f966-713a-4c15-8eb1-2464630dc9a3 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 0.485405 Oct 24 09:11:13.621582 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2226/4344] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:13 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:13.635065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:13.637518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: 6fd02b56-a01e-4a1c-a415-0792683e903f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:13.659665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.661173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.662809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.666696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.668739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.669948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.699965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] HTTP exception thrown: Instance 6fd02b56-a01e-4a1c-a415-0792683e903f could not be found. Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Request method failure captured: Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f HTTP/1.1 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlZWaSsh682ijqqzfTighzo5cjDkdiAAdVqr6S8fqy6km4iPGnxE1H7Le_1af6EcXD5M2eev_l8LYDo-7BOpk7Yw8KzH_yVZJI3uTQWm9Zlz-ErGDwtN8JGxnVZH2UuJQoT-oBbuNQqgGjjA00uBZZFZ_U4VJLfqb06U7PB4rqHA0Lo Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 126c5b989a304f1cb217c95ebfbbd8b8 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/126c5b989a304f1cb217c95ebfbbd8b8"}]}] Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 126c5b989a304f1cb217c95ebfbbd8b8 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListServerFiltersTestJSON-1199478823-project Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: abd944e891194ac498c21b55da9cb581 Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListServerFiltersTestJSON-1199478823-project Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 6fd02b56-a01e-4a1c-a415-0792683e903f could not be found. Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6fd02b56-a01e-4a1c-a415-0792683e903f'} Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd02b56-a01e-4a1c-a415-0792683e903f could not be found. Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd02b56-a01e-4a1c-a415-0792683e903f could not be found. Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:13.702273 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd02b56-a01e-4a1c-a415-0792683e903f could not be found. Oct 24 09:11:13.707249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:13.708921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Returning 404 to user: Instance 6fd02b56-a01e-4a1c-a415-0792683e903f could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:11:13.710102 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd6503c2-5d2a-4e3b-9409-298ce94da74a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f" status: 404 len: 111 microversion: 2.1 time: 0.091276 Oct 24 09:11:13.711186 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2227/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:13 2022] GET /compute/v2.1/servers/6fd02b56-a01e-4a1c-a415-0792683e903f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:11:13.716612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-fcbbc89e-2043-45ea-b602-8a1b60bb71e9 req-7f13bb14-2b6d-42cf-bc2a-62a8770f3a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54d4c00-2760-4acc-af52-6e8c7fd536a2", "name": "network-vif-plugged", "status": "completed", "tag": "ef9c1fe3-7c82-4577-89bf-fd048a647d38"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:13.729978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fcbbc89e-2043-45ea-b602-8a1b60bb71e9 req-7f13bb14-2b6d-42cf-bc2a-62a8770f3a4a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.730695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fcbbc89e-2043-45ea-b602-8a1b60bb71e9 req-7f13bb14-2b6d-42cf-bc2a-62a8770f3a4a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.731927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fcbbc89e-2043-45ea-b602-8a1b60bb71e9 req-7f13bb14-2b6d-42cf-bc2a-62a8770f3a4a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.756062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-fcbbc89e-2043-45ea-b602-8a1b60bb71e9 req-7f13bb14-2b6d-42cf-bc2a-62a8770f3a4a service nova] Creating event network-vif-plugged:ef9c1fe3-7c82-4577-89bf-fd048a647d38 for instance c54d4c00-2760-4acc-af52-6e8c7fd536a2 on n-h1-master-1 Oct 24 09:11:13.764750 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-fcbbc89e-2043-45ea-b602-8a1b60bb71e9 req-7f13bb14-2b6d-42cf-bc2a-62a8770f3a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051733 Oct 24 09:11:13.765659 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2228/4346] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:13.771965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:13.772970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:13.783547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.784324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.784924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.785872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.787217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.787869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.802462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:13.812169 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-359fe366-b701-48a4-9656-bc33049d149e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1492 microversion: 2.1 time: 1.009116 Oct 24 09:11:13.816652 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2119/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:12 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1492 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:13.839258 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:13.839888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:13.847004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:13.855688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.856451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.857069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.857968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.858575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.859155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.879569 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:13.956046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d3da29e-f517-41e3-83dc-9a0482895e76 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 204 len: 0 microversion: 2.1 time: 0.188824 Oct 24 09:11:13.957269 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2229/4348] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:13 2022] DELETE /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:13.974636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:13.975906 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:13.995709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:13.996368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:13.996630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:13.997368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.002031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.002743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:14.271333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:14.280432 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cff7cf32-83e0-4595-bcdd-714e603c890f tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1518 microversion: 2.1 time: 0.318544 Oct 24 09:11:14.297623 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2230/4349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:13 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:14.302912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cd9dfdf-e37d-4673-ad84-6c234bcab237 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf131160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:14.372779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cd9dfdf-e37d-4673-ad84-6c234bcab237 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.073489 Oct 24 09:11:14.381651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2231/4350] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:14 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:14.388240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:14.388879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:14.397138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.398259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.398767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:14.399704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.400180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.400615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:14.489433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:14.497857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-758d0773-ab1b-4188-a09d-011de389095d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1299 microversion: 2.1 time: 0.679253 Oct 24 09:11:14.498449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2120/4351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:13 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1299 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:14.503220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:14.517990 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-071e05ee-5ddb-42e2-ba92-08475d100f31 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1265 microversion: 2.1 time: 0.137903 Oct 24 09:11:14.519494 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2232/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:14 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:14.642127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:14.643233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:14.676792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.677495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.678138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:14.681656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.683691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.685124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:14.848573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:14.849986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:14.869147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.869648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.870114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:14.870812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:14.873929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:14.874610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:15.412520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:15.424983 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf1f571d-c37b-4e77-9789-3c693abe1f5e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1513 microversion: 2.1 time: 0.584433 Oct 24 09:11:15.428581 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2233/4353] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:14 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1513 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:15.435910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:15.436779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:15.460298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:15.461132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:15.462312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:15.464081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:15.464727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:15.470817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:15.802423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:15.811659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e0b8fba-1301-4ef8-9e29-e05e1ea70485 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 1.176106 Oct 24 09:11:15.818392 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2121/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:14 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:15.846781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-667a020a-9c76-49e4-8a6d-1d4ebc04ecd8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa0e69d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:15.858563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:15.874886 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32e3e4d5-33a1-4701-8925-dc3736ad5227 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1518 microversion: 2.1 time: 0.443523 Oct 24 09:11:15.878466 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2234/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:15 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1518 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:15.920071 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-667a020a-9c76-49e4-8a6d-1d4ebc04ecd8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1451 microversion: 2.1 time: 0.088256 Oct 24 09:11:15.921025 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2122/4356] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:15 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1451 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:15.936621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:15.937650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:15.937943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:15.938715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:15.940394 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:15.948958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:15.949840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:15.950547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:15.951495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:15.953876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:15.955401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:15.966802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:15.967316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:15.967764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:15.976805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:15.977485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:15.977941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:16.162608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:16.177937 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a493a3f-edaf-4c06-9602-2549a3eca026 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1271 microversion: 2.1 time: 0.252810 Oct 24 09:11:16.184593 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2123/4357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:15 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:16.200128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1d074311-5db8-4e32-a664-6521c39343ae req-d692809c-d899-477d-a408-93fdcb31538f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326de161-d30f-4432-a3a9-a4a744914aba", "name": "network-vif-plugged", "status": "completed", "tag": "404fcfc4-331b-4dd7-9799-ca65fbe3b624"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:16.224274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1d074311-5db8-4e32-a664-6521c39343ae req-d692809c-d899-477d-a408-93fdcb31538f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:16.224775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1d074311-5db8-4e32-a664-6521c39343ae req-d692809c-d899-477d-a408-93fdcb31538f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:16.225218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1d074311-5db8-4e32-a664-6521c39343ae req-d692809c-d899-477d-a408-93fdcb31538f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:16.248252 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1d074311-5db8-4e32-a664-6521c39343ae req-d692809c-d899-477d-a408-93fdcb31538f service nova] Creating event network-vif-plugged:404fcfc4-331b-4dd7-9799-ca65fbe3b624 for instance 326de161-d30f-4432-a3a9-a4a744914aba on n-h2-master-1 Oct 24 09:11:16.254082 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1d074311-5db8-4e32-a664-6521c39343ae req-d692809c-d899-477d-a408-93fdcb31538f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064398 Oct 24 09:11:16.258961 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2124/4358] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:16.418316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:16.428108 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbab1e49-d172-4dad-ae95-29a1c478e5d1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 0.546718 Oct 24 09:11:16.431921 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2235/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:15 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:16.453108 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:16.454512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:16.478237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:16.479291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:16.479626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:16.481792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:16.482798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:16.483454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:16.853954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:16.854958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:16.858594 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:16.870253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:16.876316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:16.878040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:16.878819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:16.882113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:16.882930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:17.126566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:17.129218 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:17.141222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5fb672f-ed6a-4c7f-b6c0-eefd95ba5587 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1318 microversion: 2.1 time: 0.289651 Oct 24 09:11:17.145510 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2236/4360] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:16 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:17.163351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:17.164303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:17.179097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:17.179983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:17.181248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:17.182209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:17.182986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:17.183595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:17.473909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:17.490562 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97c6230b-4df8-43f2-8f77-cbe2b4ad7c4a tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1518 microversion: 2.1 time: 0.341534 Oct 24 09:11:17.494366 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2237/4361] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:17 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1518 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:17.513150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a514977-848d-4efe-b0bf-9b2b79644043 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab0295e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:18.612783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:18.631282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7087e198-12a4-435d-99aa-045726d969a7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 2.176923 Oct 24 09:11:18.632602 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2125/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:16 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:18.658766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:18.659665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:18.672839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:18.673352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:18.673795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:18.682463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:18.686737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:18.687633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:19.475128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:19.489004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1439560b-6424-42bc-a6e9-5a529c28da09 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1271 microversion: 2.1 time: 0.855044 Oct 24 09:11:19.491544 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2126/4363] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:18 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1271 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:19.501270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:19.506452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:19.523065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:19.524862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:19.526834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:19.528738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:19.530261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:19.530812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:20.593831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:20.607715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7520a292-5b38-4c34-92b3-6716181a29bb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 1.112504 Oct 24 09:11:20.611572 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2127/4364] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:19 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:20.626691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:20.627826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:20.659127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:20.662090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:20.663481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:20.675426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:20.683027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:20.688711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:21.619943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:21.647817 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-927db595-7999-4997-90ea-b7277e0a2924 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 200 len: 1506 microversion: 2.1 time: 1.030835 Oct 24 09:11:21.651668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2128/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:20 2022] GET /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 1506 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:21.666709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-47142078-3c42-4925-86ab-bce07a300d41 req-2325e63d-de28-4729-9562-8bbc39b65ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1578f62-252e-49eb-99ae-8f85cfc6490f", "name": "network-vif-plugged", "status": "completed", "tag": "16877e70-f3fd-4ebf-a699-15a920c89fd1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:21.694178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-47142078-3c42-4925-86ab-bce07a300d41 req-2325e63d-de28-4729-9562-8bbc39b65ef7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:21.694668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-47142078-3c42-4925-86ab-bce07a300d41 req-2325e63d-de28-4729-9562-8bbc39b65ef7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:21.695103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-47142078-3c42-4925-86ab-bce07a300d41 req-2325e63d-de28-4729-9562-8bbc39b65ef7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:21.732092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-47142078-3c42-4925-86ab-bce07a300d41 req-2325e63d-de28-4729-9562-8bbc39b65ef7 service nova] Creating event network-vif-plugged:16877e70-f3fd-4ebf-a699-15a920c89fd1 for instance a1578f62-252e-49eb-99ae-8f85cfc6490f on n-h2-master-1 Oct 24 09:11:21.753454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-47142078-3c42-4925-86ab-bce07a300d41 req-2325e63d-de28-4729-9562-8bbc39b65ef7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100089 Oct 24 09:11:21.754341 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2129/4366] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:21.771059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:21.776929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:21.799746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:21.809123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:21.810953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:21.811946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:21.815575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:21.816047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:21.936510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:21.937044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:21.937610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:21.938071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lazy-loading 'fault' on Instance uuid ce2b1175-4979-4bdb-9a4d-f511169dd1e2 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:11:22.119932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd944e891194ac498c21b55da9cb581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c5b989a304f1cb217c95ebfbbd8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:22.137644 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-540b37bf-d540-4b31-ba5c-b9ea72dd1e8c tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 200 len: 1310 microversion: 2.1 time: 0.381446 Oct 24 09:11:22.138334 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2130/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:21 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 1310 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:22.148610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:22.153242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:22.167223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:22.174045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:22.174675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:22.175567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:22.176328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:22.176916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:22.630672 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:22.696826 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:23.108813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:23.118785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41c2d57e-697f-4759-baa2-0b3b1cdb1d41 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 0.978155 Oct 24 09:11:23.130696 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2131/4368] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:22 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:23.133691 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:23.140830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:23.141773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:23.166264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:23.167403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:23.176173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:23.181658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:23.182442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:23.185432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:23.704579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:23.713370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-48bdc3bb-6e84-4333-8911-d5eedbc6c64d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.581202 Oct 24 09:11:23.733701 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2132/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:23 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:23.745446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b499ac54-6e12-4d40-a4c1-e7a60cec6205 req-faec8f09-7afa-42b9-b45e-33082a4752c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2b1175-4979-4bdb-9a4d-f511169dd1e2", "name": "network-vif-deleted", "tag": "33589a3e-17eb-4df5-b074-931636a6e195"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:23.767241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b499ac54-6e12-4d40-a4c1-e7a60cec6205 req-faec8f09-7afa-42b9-b45e-33082a4752c4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:23.767999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b499ac54-6e12-4d40-a4c1-e7a60cec6205 req-faec8f09-7afa-42b9-b45e-33082a4752c4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:23.769201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b499ac54-6e12-4d40-a4c1-e7a60cec6205 req-faec8f09-7afa-42b9-b45e-33082a4752c4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:23.792991 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b499ac54-6e12-4d40-a4c1-e7a60cec6205 req-faec8f09-7afa-42b9-b45e-33082a4752c4 service nova] Creating event network-vif-deleted:33589a3e-17eb-4df5-b074-931636a6e195 for instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 on n-h1-master-1 Oct 24 09:11:23.807767 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b499ac54-6e12-4d40-a4c1-e7a60cec6205 req-faec8f09-7afa-42b9-b45e-33082a4752c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072299 Oct 24 09:11:23.809018 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2133/4370] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:23.814380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:23.824024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:23.837167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:23.837937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:23.838571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:23.839446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:23.840063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:23.840652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:24.666172 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:24.678158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1c4bd31-ea92-4420-b7cc-beb86524afc4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 0.867668 Oct 24 09:11:24.678772 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2134/4371] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:23 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:24.684129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:24.690060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: c54d4c00-2760-4acc-af52-6e8c7fd536a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:24.709218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:24.710474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:24.711081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:24.711989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:24.712600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:24.713192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:24.859624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a514977-848d-4efe-b0bf-9b2b79644043 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1460 microversion: 2.1 time: 7.362994 Oct 24 09:11:24.860362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2238/4372] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:17 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1460 bytes in 7364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:24.884135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:24.885216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] [instance: ce2b1175-4979-4bdb-9a4d-f511169dd1e2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:24.894465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:24.895281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:24.895964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:24.897597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:24.899474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:24.900811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:24.919244 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] HTTP exception thrown: Instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 could not be found. Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Request method failure captured: Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 HTTP/1.1 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlZWaSsh682ijqqzfTighzo5cjDkdiAAdVqr6S8fqy6km4iPGnxE1H7Le_1af6EcXD5M2eev_l8LYDo-7BOpk7Yw8KzH_yVZJI3uTQWm9Zlz-ErGDwtN8JGxnVZH2UuJQoT-oBbuNQqgGjjA00uBZZFZ_U4VJLfqb06U7PB4rqHA0Lo Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 126c5b989a304f1cb217c95ebfbbd8b8 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/126c5b989a304f1cb217c95ebfbbd8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/126c5b989a304f1cb217c95ebfbbd8b8"}]}] Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 126c5b989a304f1cb217c95ebfbbd8b8 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1199478823 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListServerFiltersTestJSON-1199478823-project Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: abd944e891194ac498c21b55da9cb581 Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListServerFiltersTestJSON-1199478823-project Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: exception: Instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 could not be found. Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ce2b1175-4979-4bdb-9a4d-f511169dd1e2'} Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 could not be found. Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 could not be found. Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:24.921690 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 could not be found. Oct 24 09:11:24.927416 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:24.930720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] Returning 404 to user: Instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:11:24.932088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99bc3bd8-310f-4fcc-9e6c-6bcbf3124850 tempest-ListServerFiltersTestJSON-1199478823 tempest-ListServerFiltersTestJSON-1199478823-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2" status: 404 len: 111 microversion: 2.1 time: 0.064518 Oct 24 09:11:24.933956 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2239/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:24 2022] GET /compute/v2.1/servers/ce2b1175-4979-4bdb-9a4d-f511169dd1e2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:11:24.940989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-80bfd489-6dd0-4770-a61d-c43c3b490565 req-494280e7-278b-4f1a-80cd-2e707ea5bb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2b1175-4979-4bdb-9a4d-f511169dd1e2", "name": "network-vif-unplugged", "status": "completed", "tag": "33589a3e-17eb-4df5-b074-931636a6e195"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:24.953225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80bfd489-6dd0-4770-a61d-c43c3b490565 req-494280e7-278b-4f1a-80cd-2e707ea5bb6d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:24.954120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80bfd489-6dd0-4770-a61d-c43c3b490565 req-494280e7-278b-4f1a-80cd-2e707ea5bb6d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:24.954821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80bfd489-6dd0-4770-a61d-c43c3b490565 req-494280e7-278b-4f1a-80cd-2e707ea5bb6d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:24.969113 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-80bfd489-6dd0-4770-a61d-c43c3b490565 req-494280e7-278b-4f1a-80cd-2e707ea5bb6d service nova] Creating event network-vif-unplugged:33589a3e-17eb-4df5-b074-931636a6e195 for instance ce2b1175-4979-4bdb-9a4d-f511169dd1e2 on n-h1-master-1 Oct 24 09:11:24.975257 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-80bfd489-6dd0-4770-a61d-c43c3b490565 req-494280e7-278b-4f1a-80cd-2e707ea5bb6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039596 Oct 24 09:11:24.981017 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2240/4374] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:24.994073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:24.996543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:25.009887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.012047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.012808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.015566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.016353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.017043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.074533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:25.083482 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f2b1268-8826-4d94-b35d-b360c92fc08d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/c54d4c00-2760-4acc-af52-6e8c7fd536a2" status: 200 len: 1506 microversion: 2.1 time: 0.403442 Oct 24 09:11:25.086717 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2135/4375] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:24 2022] GET /compute/v2.1/servers/c54d4c00-2760-4acc-af52-6e8c7fd536a2 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:25.097340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:25.097968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:25.119822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.122592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.135847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.139773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.140472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.146932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.729679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:25.747248 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f85e8599-4e12-45d3-b127-16c461939cd3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 0.759923 Oct 24 09:11:25.749314 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2241/4376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:24 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:25.768589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7fbfb44a-6857-4ad8-98a6-7bddd3a58b05 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa5b0c10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:25.829451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:25.846469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ee2b941-40eb-4c55-8595-5569a58daa6d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.758407 Oct 24 09:11:25.848822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2136/4377] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:25 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:25.867049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:25.868394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: c54d4c00-2760-4acc-af52-6e8c7fd536a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:25.887072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.888406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.888877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.889523 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7fbfb44a-6857-4ad8-98a6-7bddd3a58b05 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 200 len: 1460 microversion: 2.1 time: 0.135568 Oct 24 09:11:25.892373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.894247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.894712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.899687 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2242/4378] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:25 2022] GET /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 1460 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:25.904633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:25.905258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:25.923481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.924279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.930735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.932165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:25.932807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:25.933427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:25.976611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: c54d4c00-2760-4acc-af52-6e8c7fd536a2] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:26.193829 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e545ce4-e628-4162-b56e-c81db2e8690b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c54d4c00-2760-4acc-af52-6e8c7fd536a2" status: 204 len: 0 microversion: 2.1 time: 0.342258 Oct 24 09:11:26.195349 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2137/4379] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:25 2022] DELETE /compute/v2.1/servers/c54d4c00-2760-4acc-af52-6e8c7fd536a2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:26.218380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfabd2e-75fe-4a89-aec7-6fd8ea26db90", "tag": "dceceead-1051-41fa-b542-01ff4e6ec4b8"}, {"name": "network-changed", "server_uuid": "dddc3de5-226a-43ae-837b-3895d26cfbf4", "tag": "3eb13690-24d0-45b8-8a4a-0f89b06d45c3"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:26.229818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.230697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.231907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.238622 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:26.251458 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] Creating event network-changed:dceceead-1051-41fa-b542-01ff4e6ec4b8 for instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 on n-h1-master-1 Oct 24 09:11:26.252095 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] Creating event network-changed:3eb13690-24d0-45b8-8a4a-0f89b06d45c3 for instance dddc3de5-226a-43ae-837b-3895d26cfbf4 on n-h2-master-1 Oct 24 09:11:26.264916 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-da784477-95bb-42b8-b1f2-a9c10f7ed77a req-0478a38a-d90a-44f9-bd2c-f083588a2b94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065943 Oct 24 09:11:26.265956 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2138/4380] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:26.271756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:26.273505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:26.281253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.282004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.282547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.283374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.284064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.284589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.499948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:26.513992 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6284fced-d436-40e9-a53e-34d068d21c42 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 0.613112 Oct 24 09:11:26.515447 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2243/4381] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:25 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:26.527687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:26.534223 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:26.552853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.553784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.556521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.557561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.561170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.561871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.653583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 326de161-d30f-4432-a3a9-a4a744914aba] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:26.799704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:26.826186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-162cb191-eb03-4cd9-bbd3-11dcbfd61a54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1467 microversion: 2.1 time: 0.557290 Oct 24 09:11:26.830842 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2139/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:26 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1467 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:26.853460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:26.854090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:26.881458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.881636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.882045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.885945 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb1e5cd3-a775-4bd0-a554-6ecf6c59a97d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba" status: 204 len: 0 microversion: 2.1 time: 0.369008 Oct 24 09:11:26.886536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2244/4383] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:26 2022] DELETE /compute/v2.1/servers/326de161-d30f-4432-a3a9-a4a744914aba => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:26.889470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.890282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.895927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1541077309"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:26.897132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.918378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:26.943667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.951717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.952395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:26.953317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:26.957055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:26.957691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:27.227408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:27.244894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b2e3511-7ad0-4b27-b6f1-888633125796 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 0.406663 Oct 24 09:11:27.247278 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2140/4384] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:26 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:27.261908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:27.265855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:27.278381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:27.281851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:27.282506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:27.283652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:27.286565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:27.287343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:27.427880 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29c58947-22bf-447c-a663-b5e2ee8d7efa tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "POST /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41/action" status: 202 len: 0 microversion: 2.1 time: 0.535738 Oct 24 09:11:27.429176 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2245/4385] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:11:26 2022] POST /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:11:27.435960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1338071076", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9f783ccd-f93e-494a-8956-7fbc33ffa507"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:27.560232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] validate_networks() for [('9f783ccd-f93e-494a-8956-7fbc33ffa507', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:11:27.808319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:27.822974 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47ee982f-267b-4690-8c92-c2a54f41799d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.572047 Oct 24 09:11:27.824159 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2141/4386] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:27 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:27.854186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cefa3158-f13f-40b4-848c-6b473dd41596 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8da9f65940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:27.959868 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cefa3158-f13f-40b4-848c-6b473dd41596 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.130430 Oct 24 09:11:27.960474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2142/4387] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:27 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:27.974337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:27.977788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:27.989750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:27.991613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:27.994476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:27.995228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:27.995694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:27.999093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:28.495073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:28.503240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25b5f3fb-f074-471a-8383-33b7575e1b07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 0.532604 Oct 24 09:11:28.513707 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2143/4388] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:27 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:28.518644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:28.519304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:28.533760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:28.534274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:28.534779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:28.535512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:28.535973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:28.536414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.090236 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:11:29.090798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:11:29.091131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:11:29.091724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:11:29.092297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:11:29.107907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:29.113638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:29.114479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.116353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:29.117001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:29.117663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.179857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Getting quotas for project a1021217d2904d5190dd4a82db7007fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:11:29.194470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Getting quotas for user af9c3d9be3f2494a8eb2394e48bdeca6 and project a1021217d2904d5190dd4a82db7007fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:11:29.238160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Going to run 2 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:11:29.247207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:11:29.357720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=47b0ac49-fd1f-4eb2-bd38-1bbd0309a391,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:11:29.496437 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-871dd6a9-38c7-4625-860b-897ce11fe9cd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.065706 Oct 24 09:11:29.499657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2246/4389] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:11:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 2070 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 24 09:11:29.515449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:29.516083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:29.545674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:29.546250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:29.546706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.548266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:29.549904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:29.550415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.586411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:29.606596 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9784ae5c-afe5-4829-9b2b-e60309ccfafa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 1.091665 Oct 24 09:11:29.612894 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2144/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:28 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:29.636987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd500131-dd11-4a13-b597-ffa90eab6d60 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daae6aca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:29.733157 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd500131-dd11-4a13-b597-ffa90eab6d60 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.112659 Oct 24 09:11:29.734215 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2145/4391] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:29 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:29.750426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:29.760519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:29.766577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Searching by: {'deleted': False, 'project_id': 'a1021217d2904d5190dd4a82db7007fd'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:11:29.816098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:29.822846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:29.829189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.830320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:29.843465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:29.849119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:29.910250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:11:30.001538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19fe4f7b-941e-464c-9b84-1fa7c5ac7b07 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.263840 Oct 24 09:11:30.016092 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2146/4392] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:11:29 2022] GET /compute/v2.1/servers => generated 1333 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:30.018896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:30.019462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:30.043130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:30.043491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:30.044044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:30.044746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:30.046622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:30.047154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:31.284993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:31.310454 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4829e41c-dfeb-4abf-9a55-3ecb8563bbaa tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 1.808717 Oct 24 09:11:31.313651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2247/4393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:29 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:31.338063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:31.338924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:31.389187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:31.398063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:31.399702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:31.404590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:31.405218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:31.405798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:31.727644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:31.739809 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e09c800b-ffc9-4cc8-b4d5-c944791e1b6f tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1222 microversion: 2.1 time: 0.425016 Oct 24 09:11:31.740933 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2248/4394] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:31 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1222 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:32.051184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:32.059833 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ef901951-fc60-4cfb-a99b-507a07578978 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 2.044978 Oct 24 09:11:32.065674 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2147/4395] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:30 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:32.083892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:32.085519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:32.107827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b95301a4-95da-4a9a-bff8-d9176ce7a826 req-16e932db-9596-4579-a34e-6b4d7952a1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54d4c00-2760-4acc-af52-6e8c7fd536a2", "name": "network-vif-deleted", "tag": "ef9c1fe3-7c82-4577-89bf-fd048a647d38"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:32.137492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:32.138535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:32.139232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:32.142826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b95301a4-95da-4a9a-bff8-d9176ce7a826 req-16e932db-9596-4579-a34e-6b4d7952a1dc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:32.157973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:32.158977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:32.159646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:32.160530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b95301a4-95da-4a9a-bff8-d9176ce7a826 req-16e932db-9596-4579-a34e-6b4d7952a1dc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:32.163978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b95301a4-95da-4a9a-bff8-d9176ce7a826 req-16e932db-9596-4579-a34e-6b4d7952a1dc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:32.198277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b95301a4-95da-4a9a-bff8-d9176ce7a826 req-16e932db-9596-4579-a34e-6b4d7952a1dc service nova] Creating event network-vif-deleted:ef9c1fe3-7c82-4577-89bf-fd048a647d38 for instance c54d4c00-2760-4acc-af52-6e8c7fd536a2 on n-h1-master-1 Oct 24 09:11:32.212847 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b95301a4-95da-4a9a-bff8-d9176ce7a826 req-16e932db-9596-4579-a34e-6b4d7952a1dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.470309 Oct 24 09:11:32.217148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2249/4396] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:32.225550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-337bf384-3e0f-4249-a0f1-ad987b5319d7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa5c3af0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:32.364779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-337bf384-3e0f-4249-a0f1-ad987b5319d7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.146239 Oct 24 09:11:32.372769 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2250/4397] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:32 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:32.388673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-04809506-5667-4ff0-ad15-41b15f5a1d90 req-d1db8c87-d72d-4427-ae86-8b6e7af502dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "name": "network-vif-unplugged", "status": "completed", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:32.413352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-04809506-5667-4ff0-ad15-41b15f5a1d90 req-d1db8c87-d72d-4427-ae86-8b6e7af502dd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:32.421071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-04809506-5667-4ff0-ad15-41b15f5a1d90 req-d1db8c87-d72d-4427-ae86-8b6e7af502dd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:32.429340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-04809506-5667-4ff0-ad15-41b15f5a1d90 req-d1db8c87-d72d-4427-ae86-8b6e7af502dd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:32.453763 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-04809506-5667-4ff0-ad15-41b15f5a1d90 req-d1db8c87-d72d-4427-ae86-8b6e7af502dd service nova] Creating event network-vif-unplugged:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:11:32.464402 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-04809506-5667-4ff0-ad15-41b15f5a1d90 req-d1db8c87-d72d-4427-ae86-8b6e7af502dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089952 Oct 24 09:11:32.471658 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2251/4398] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:32.481856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:32.482817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:32.497757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:32.501937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:32.502625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:32.503599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:32.504460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:32.505442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:33.132465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:33.143351 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0465428d-f36f-4a0a-978f-964b43aa6455 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 1.074290 Oct 24 09:11:33.150203 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2148/4399] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:32 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:33.331481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6ccd035b-8e5e-4765-be64-7ca8cde515d6 req-38710cc7-4fed-4ab4-b0c6-bfd67d246f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326de161-d30f-4432-a3a9-a4a744914aba", "name": "network-vif-deleted", "tag": "404fcfc4-331b-4dd7-9799-ca65fbe3b624"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:33.358980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6ccd035b-8e5e-4765-be64-7ca8cde515d6 req-38710cc7-4fed-4ab4-b0c6-bfd67d246f61 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:33.362400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6ccd035b-8e5e-4765-be64-7ca8cde515d6 req-38710cc7-4fed-4ab4-b0c6-bfd67d246f61 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:33.363388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6ccd035b-8e5e-4765-be64-7ca8cde515d6 req-38710cc7-4fed-4ab4-b0c6-bfd67d246f61 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:33.395057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6ccd035b-8e5e-4765-be64-7ca8cde515d6 req-38710cc7-4fed-4ab4-b0c6-bfd67d246f61 service nova] Creating event network-vif-deleted:404fcfc4-331b-4dd7-9799-ca65fbe3b624 for instance 326de161-d30f-4432-a3a9-a4a744914aba on n-h2-master-1 Oct 24 09:11:33.414049 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6ccd035b-8e5e-4765-be64-7ca8cde515d6 req-38710cc7-4fed-4ab4-b0c6-bfd67d246f61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262246 Oct 24 09:11:33.423712 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2149/4400] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:33.440787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:33.443225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:33.462638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:33.465340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:33.465830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:33.466573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:33.467043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:33.471742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:33.640951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:33.649995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac1fbd2d-fcf4-4a8a-bfff-c39e17a9c7e2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 1.175373 Oct 24 09:11:33.653846 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2252/4401] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:32 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:33.660430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:33.666677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:33.678387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:33.692995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:33.693724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:33.695997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:33.696657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:33.704570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:33.836875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:33.846179 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7f21ef8-e418-415c-b11e-1b88f9fa835c tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1278 microversion: 2.1 time: 0.416464 Oct 24 09:11:33.853228 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2150/4402] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:33 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1278 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:33.873126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e1a4249-7404-45ea-bba1-9bb16a82f862 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daafad5e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:34.695797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:34.703692 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0fe0b132-d5b2-45af-ab9e-090a9cad70d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 1.048557 Oct 24 09:11:34.717227 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2253/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:33 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:34.732607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:34.738596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:34.769385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:34.769945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:34.770471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:34.771274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:34.774605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:34.778942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:35.717678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:35.730746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-78dd1461-41e9-462e-bcfb-ea9cc7d44734 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 1.001976 Oct 24 09:11:35.732362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2254/4404] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:34 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:35.747616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:35.750079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:35.767045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:35.772687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:35.773491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:35.777159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:35.778080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:35.778676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:36.632084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:36.645833 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9d43bca-86ce-43dc-ad5c-404e724fb4c8 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.911225 Oct 24 09:11:36.661475 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2255/4405] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:35 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:36.661475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:36.682936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:36.830333 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:36.856985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:36.860550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:36.866019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:36.875492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:36.887804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:36.888559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:37.456017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:37.458688 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:37.474044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7fa5f970-8f6e-4b80-be4b-8c7d0f39bd83 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1318 microversion: 2.1 time: 0.818127 Oct 24 09:11:37.478877 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2256/4406] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:36 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1318 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:37.489751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ee513228-b336-474b-b159-7e9927aa568b req-ffeb52d8-e769-4cf0-84b0-af78c0d54e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfabd2e-75fe-4a89-aec7-6fd8ea26db90", "name": "network-vif-plugged", "status": "completed", "tag": "dceceead-1051-41fa-b542-01ff4e6ec4b8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:37.530487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ee513228-b336-474b-b159-7e9927aa568b req-ffeb52d8-e769-4cf0-84b0-af78c0d54e63 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:37.530487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ee513228-b336-474b-b159-7e9927aa568b req-ffeb52d8-e769-4cf0-84b0-af78c0d54e63 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:37.555664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ee513228-b336-474b-b159-7e9927aa568b req-ffeb52d8-e769-4cf0-84b0-af78c0d54e63 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:37.609705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ee513228-b336-474b-b159-7e9927aa568b req-ffeb52d8-e769-4cf0-84b0-af78c0d54e63 service nova] Creating event network-vif-plugged:dceceead-1051-41fa-b542-01ff4e6ec4b8 for instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 on n-h1-master-1 Oct 24 09:11:37.630060 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ee513228-b336-474b-b159-7e9927aa568b req-ffeb52d8-e769-4cf0-84b0-af78c0d54e63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145880 Oct 24 09:11:37.631318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2257/4407] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:37.643315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:37.653686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:37.683025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:37.683878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:37.689603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:37.690731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:37.691842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:37.692733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:38.674153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:38.683688 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb3d5f52-17f7-4a35-86e1-7fce95584e4b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1366 microversion: 2.1 time: 1.047301 Oct 24 09:11:38.694482 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2258/4408] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:37 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1366 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:38.991513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1314837209", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:39.161134 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:39.204280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:11:39.204741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:11:39.205426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:11:39.205612 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e1a4249-7404-45ea-bba1-9bb16a82f862 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 5.350858 Oct 24 09:11:39.206207 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2151/4409] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:33 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 5352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:39.206829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:11:39.207611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:11:39.220061 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:39.225024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:39.225751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:39.231529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:39.232286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:39.233805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:39.236394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:39.237050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:39.241860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:39.248162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:39.248850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:39.249885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:39.250875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:39.253911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:39.254581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:39.286412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Getting quotas for project d0f667f944db47a5868be25e2e771c9a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:11:39.297288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Getting quotas for user 5683b4795abc4111aa9fcf809652c979 and project d0f667f944db47a5868be25e2e771c9a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:11:39.314607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:11:39.317676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:11:39.381864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58745043-5c91-440b-a142-3de449c8c8ac tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.685218 Oct 24 09:11:39.392622 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2259/4410] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:11:39.407834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:39.409102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:39.434860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:39.436066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:39.436679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:39.437601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:39.438220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:39.438804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:39.863890 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:40.218048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:40.229577 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a35301ce-053f-4517-b4f9-060a776eb74a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.835455 Oct 24 09:11:40.232755 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2260/4411] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:39 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:40.243086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:40.243975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:40.256015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.256516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.257430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.258131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.258756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.259347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.457873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:40.487831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-264d9fd7-3219-4313-b41c-7d2b2bfc0a35 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1508 microversion: 2.1 time: 1.277279 Oct 24 09:11:40.497121 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2152/4412] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:39 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1508 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:40.504465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4cc0eb3c-978a-405d-aabb-50fcc0345c21 req-cd8e9d0d-0335-4533-a551-f6b72780c575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5733a2-75d9-4b36-9503-011b72caaba3", "tag": "7c45bb8d-0cfa-4984-b276-a24ae45281e8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:40.561829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4cc0eb3c-978a-405d-aabb-50fcc0345c21 req-cd8e9d0d-0335-4533-a551-f6b72780c575 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.562342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4cc0eb3c-978a-405d-aabb-50fcc0345c21 req-cd8e9d0d-0335-4533-a551-f6b72780c575 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.562782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4cc0eb3c-978a-405d-aabb-50fcc0345c21 req-cd8e9d0d-0335-4533-a551-f6b72780c575 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.604671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:40.622284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-17306f85-1621-40ff-b5d0-acfd9d728ee9 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1318 microversion: 2.1 time: 0.388173 Oct 24 09:11:40.623141 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2261/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:40 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:40.639065 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4cc0eb3c-978a-405d-aabb-50fcc0345c21 req-cd8e9d0d-0335-4533-a551-f6b72780c575 service nova] Creating event network-changed:7c45bb8d-0cfa-4984-b276-a24ae45281e8 for instance 2c5733a2-75d9-4b36-9503-011b72caaba3 on n-h2-master-1 Oct 24 09:11:40.643162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:40.643813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:40.658811 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4cc0eb3c-978a-405d-aabb-50fcc0345c21 req-cd8e9d0d-0335-4533-a551-f6b72780c575 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159773 Oct 24 09:11:40.662936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2153/4414] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:40.665586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.666167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.666961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.667897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.668576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.669165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.676197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382e3bdd-c519-41a4-9ebc-957c37059d41", "name": "network-vif-plugged", "status": "completed", "tag": "1cd1b987-13bb-4075-be4b-149af14dc5ee"}, {"server_uuid": "dddc3de5-226a-43ae-837b-3895d26cfbf4", "name": "network-vif-plugged", "status": "completed", "tag": "3eb13690-24d0-45b8-8a4a-0f89b06d45c3"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:40.704011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.706192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.707100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.728415 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] Creating event network-vif-plugged:1cd1b987-13bb-4075-be4b-149af14dc5ee for instance 382e3bdd-c519-41a4-9ebc-957c37059d41 on n-h1-master-1 Oct 24 09:11:40.729765 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] Creating event network-vif-plugged:3eb13690-24d0-45b8-8a4a-0f89b06d45c3 for instance dddc3de5-226a-43ae-837b-3895d26cfbf4 on n-h2-master-1 Oct 24 09:11:40.739494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f51d5529-7395-4508-b6cc-c181a6925f0e req-81d77b1e-ca11-410b-a987-f18f546f7e3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071810 Oct 24 09:11:40.740855 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2154/4415] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:40.748270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:40.749252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:40.756949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.758171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.758892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.759776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:40.760233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:40.760821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:40.775675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:40.785971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:40.788536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:40.790472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac05922d-e411-4ea8-a866-1c638732d0d1 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1333 microversion: 2.47 time: 0.151671 Oct 24 09:11:40.791481 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2262/4416] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:40 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1333 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:40.796878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-373d31db-9eaa-4a83-8b78-7d2e95695be1 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa490550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:40.861784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-373d31db-9eaa-4a83-8b78-7d2e95695be1 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.069078 Oct 24 09:11:40.862442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2263/4417] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:40 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:41.194843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:41.206413 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9772f08-3487-4646-964c-2fb91475f7b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1556 microversion: 2.1 time: 0.464109 Oct 24 09:11:41.222426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2155/4418] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:40 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1556 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:41.233226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:41.233925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:41.243761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.244549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.245343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.246299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.246994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.247653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.256436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:41.257434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:41.271260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.272156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.274308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.275307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.276127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.279319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.544444 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7cc35983-9142-42c5-a31a-e37b46bdf1d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.314886 Oct 24 09:11:41.546066 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2264/4419] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:11:41 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-interface => generated 284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:41.557903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:41.558943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:41.566609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.567630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.568268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.569388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.570088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.571191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.809940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:41.821281 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-def003fd-da03-4732-b1d4-7f7aa0f88752 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.568589 Oct 24 09:11:41.834979 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2156/4420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:41 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:41.840118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:41.841008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:41.848756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.859117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.859977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:41.860962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:41.861715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:41.862394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:42.070339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:42.098413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1483a00-f7ea-4456-bf49-52438214c9c0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1505 microversion: 2.1 time: 0.545736 Oct 24 09:11:42.098957 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2265/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:41 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:42.119680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:42.120307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:42.127725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:42.128823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:42.129453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:42.130579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:42.131328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:42.132050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:42.249037 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:42.273141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:42.276463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:42.279782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9cc965af-9587-4e1f-8840-438f94f2957b tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1339 microversion: 2.47 time: 0.177356 Oct 24 09:11:42.281532 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2266/4422] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:42 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:42.286327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68bbac1c-e02b-4d20-828d-5b9fc8d6459e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa5c80d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:42.368561 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-68bbac1c-e02b-4d20-828d-5b9fc8d6459e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.081488 Oct 24 09:11:42.378756 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2267/4423] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:42 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:42.384705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8b572c4a-3742-4d95-a7e3-1b2d1f7d07c1 req-0f05268d-1581-42e4-8700-f5dec71f29c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b0ac49-fd1f-4eb2-bd38-1bbd0309a391", "tag": "9fddc3d0-9792-43e7-a7ac-435b7b53d0f3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:42.397109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8b572c4a-3742-4d95-a7e3-1b2d1f7d07c1 req-0f05268d-1581-42e4-8700-f5dec71f29c3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:42.397837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8b572c4a-3742-4d95-a7e3-1b2d1f7d07c1 req-0f05268d-1581-42e4-8700-f5dec71f29c3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:42.399192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8b572c4a-3742-4d95-a7e3-1b2d1f7d07c1 req-0f05268d-1581-42e4-8700-f5dec71f29c3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:42.418924 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8b572c4a-3742-4d95-a7e3-1b2d1f7d07c1 req-0f05268d-1581-42e4-8700-f5dec71f29c3 service nova] Creating event network-changed:9fddc3d0-9792-43e7-a7ac-435b7b53d0f3 for instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 on n-h1-master-1 Oct 24 09:11:42.426041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8b572c4a-3742-4d95-a7e3-1b2d1f7d07c1 req-0f05268d-1581-42e4-8700-f5dec71f29c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045122 Oct 24 09:11:42.427238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2268/4424] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:42.674185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:42.682896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-991a72a1-5fa2-465b-95e6-d853808c1ecd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1318 microversion: 2.1 time: 0.846442 Oct 24 09:11:42.700819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2157/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:41 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1318 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:42.861703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:42.862695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:42.873012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:42.880291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:42.889531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:42.890867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:42.891368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:42.892175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.114821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:43.123532 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a22718e-c854-42b8-bfc3-b1b0955406ef tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1313 microversion: 2.1 time: 0.268373 Oct 24 09:11:43.123778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:43.124326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:43.126528 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2269/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:42 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:43.152437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:43.154271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:43.154875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.156380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:43.157016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:43.158272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.309001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:43.310440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:43.317628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:43.318591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:43.319268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.320258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:43.320967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:43.321656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.422058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:43.431997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:43.434166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:43.436137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32686f84-fbf2-427f-a86f-b8f4966dcea4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1339 microversion: 2.47 time: 0.131099 Oct 24 09:11:43.450032 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2270/4427] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:43 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:43.462888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da79bf0a-c093-47b5-87de-2586b5166266 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf2d1ee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:43.513612 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da79bf0a-c093-47b5-87de-2586b5166266 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.062052 Oct 24 09:11:43.514894 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2271/4428] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:43 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:43.714912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:43.717663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:43.724712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:43.725517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:43.726157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.729941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:43.730831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:43.731478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:43.925680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:43.935182 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b348acdb-e5af-4365-9306-00671adadeca tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1318 microversion: 2.1 time: 0.227976 Oct 24 09:11:43.935932 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2272/4429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:43 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:44.062682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0b764948-4fc2-45ec-97dd-1e7669e8f47e req-36e6a109-aa2b-4c60-aa4e-0d75877eb296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1578f62-252e-49eb-99ae-8f85cfc6490f", "name": "network-vif-unplugged", "status": "completed", "tag": "16877e70-f3fd-4ebf-a699-15a920c89fd1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:44.081600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0b764948-4fc2-45ec-97dd-1e7669e8f47e req-36e6a109-aa2b-4c60-aa4e-0d75877eb296 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.082088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0b764948-4fc2-45ec-97dd-1e7669e8f47e req-36e6a109-aa2b-4c60-aa4e-0d75877eb296 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.082526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0b764948-4fc2-45ec-97dd-1e7669e8f47e req-36e6a109-aa2b-4c60-aa4e-0d75877eb296 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.114267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0b764948-4fc2-45ec-97dd-1e7669e8f47e req-36e6a109-aa2b-4c60-aa4e-0d75877eb296 service nova] Creating event network-vif-unplugged:16877e70-f3fd-4ebf-a699-15a920c89fd1 for instance a1578f62-252e-49eb-99ae-8f85cfc6490f on n-h2-master-1 Oct 24 09:11:44.130980 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0b764948-4fc2-45ec-97dd-1e7669e8f47e req-36e6a109-aa2b-4c60-aa4e-0d75877eb296 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073041 Oct 24 09:11:44.133118 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2273/4430] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:11:44.157903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:44.161635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:44.206313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.207407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.208089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.209200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.210007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.210720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.299919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:44.318058 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b860fb69-6c16-49c1-a719-9d1a1376cd05 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1505 microversion: 2.1 time: 1.198047 Oct 24 09:11:44.318856 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2158/4431] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:43 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1505 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:44.422090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:44.430125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0bab7d18-7977-4844-b2d9-39d61a5c40ff tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1499 microversion: 2.1 time: 0.280138 Oct 24 09:11:44.431365 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2274/4432] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:44 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1499 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:44.459171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:44.465309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:44.465943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:44.466906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:44.477173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.477698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.478143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.478856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.479316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.479748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.485218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.486140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.487195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.490912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.491707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.492902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.548866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lazy-loading 'flavor' on Instance uuid dddc3de5-226a-43ae-837b-3895d26cfbf4 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:11:44.586816 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:44.595962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:44.606888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:44.610365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:44.612143 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a0d8b208-1945-4290-a5df-e091d5eed159 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1339 microversion: 2.47 time: 0.151421 Oct 24 09:11:44.627668 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2275/4433] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:44 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:44.637245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06792cc1-5afc-4416-b588-a09ec50ff62f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4900d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:44.678590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-653418ee-03ba-4d33-8007-69c8a3b00aea tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "POST /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4/action" status: 200 len: 32 microversion: 2.1 time: 0.224680 Oct 24 09:11:44.693421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2159/4434] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:11:44 2022] POST /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:11:44.713039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:44.715424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:44.735153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.736347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.737709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.740630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.742694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.743222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.824934 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06792cc1-5afc-4416-b588-a09ec50ff62f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.197819 Oct 24 09:11:44.825769 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2276/4435] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:44 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:44.959883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:44.960562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:44.972253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.972253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.972253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:44.972253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:44.972253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:44.972838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:45.271180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:45.290315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0eab2a59-9220-4a91-8416-d5ba4d5cc8c2 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1318 microversion: 2.1 time: 0.334294 Oct 24 09:11:45.293148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2277/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:44 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:45.347414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:45.348658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:45.350020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:45.362774 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35cbc69d-8f33-4da3-8247-14e6ebcb356c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.661299 Oct 24 09:11:45.364966 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2160/4437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:44 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:45.370921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:45.371755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:45.376884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:45.378000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:45.381803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:45.384332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:45.644493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:45.645673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:45.659741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:45.660700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:45.661548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:45.663094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:45.664838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:45.665554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:45.970413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:45.984969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:45.989109 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:45.995909 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4f00d6d9-65e6-43cb-9b94-dbc28672fcdb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1360 microversion: 2.47 time: 0.351615 Oct 24 09:11:46.024618 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2161/4438] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:45 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1360 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:11:46.037953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6e44f8c-780d-4300-beb3-390432804083 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf189dc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:46.113674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6e44f8c-780d-4300-beb3-390432804083 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.087646 Oct 24 09:11:46.115419 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2162/4439] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:46 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:46.122050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f88d8ea2-ba00-460c-bbef-3f9518dc22ee req-97086439-23fb-4ed5-be51-95a0bb8ffd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfabd2e-75fe-4a89-aec7-6fd8ea26db90", "tag": "dceceead-1051-41fa-b542-01ff4e6ec4b8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:46.137091 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:46.140763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f88d8ea2-ba00-460c-bbef-3f9518dc22ee req-97086439-23fb-4ed5-be51-95a0bb8ffd2b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.141563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f88d8ea2-ba00-460c-bbef-3f9518dc22ee req-97086439-23fb-4ed5-be51-95a0bb8ffd2b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.142227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f88d8ea2-ba00-460c-bbef-3f9518dc22ee req-97086439-23fb-4ed5-be51-95a0bb8ffd2b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.160409 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f88d8ea2-ba00-460c-bbef-3f9518dc22ee req-97086439-23fb-4ed5-be51-95a0bb8ffd2b service nova] Creating event network-changed:dceceead-1051-41fa-b542-01ff4e6ec4b8 for instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 on n-h1-master-1 Oct 24 09:11:46.166565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f88d8ea2-ba00-460c-bbef-3f9518dc22ee req-97086439-23fb-4ed5-be51-95a0bb8ffd2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049246 Oct 24 09:11:46.167796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2163/4440] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:46.178741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1481976992"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:46.182851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:46.190565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.192848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.194218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.198161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.201919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.203241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.260738 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:46.273551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aef165b9-bebf-4569-9687-b67875a58dce tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1505 microversion: 2.1 time: 0.933186 Oct 24 09:11:46.276562 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2278/4441] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:45 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1505 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:46.289973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b5626dec-7302-4d03-aa67-03cd8e681d41 req-6be7d131-86fb-4903-b3bf-2143200bd55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5733a2-75d9-4b36-9503-011b72caaba3", "name": "network-vif-plugged", "status": "completed", "tag": "7c45bb8d-0cfa-4984-b276-a24ae45281e8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:46.327336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b5626dec-7302-4d03-aa67-03cd8e681d41 req-6be7d131-86fb-4903-b3bf-2143200bd55a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.330460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b5626dec-7302-4d03-aa67-03cd8e681d41 req-6be7d131-86fb-4903-b3bf-2143200bd55a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.330934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b5626dec-7302-4d03-aa67-03cd8e681d41 req-6be7d131-86fb-4903-b3bf-2143200bd55a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.370492 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b5626dec-7302-4d03-aa67-03cd8e681d41 req-6be7d131-86fb-4903-b3bf-2143200bd55a service nova] Creating event network-vif-plugged:7c45bb8d-0cfa-4984-b276-a24ae45281e8 for instance 2c5733a2-75d9-4b36-9503-011b72caaba3 on n-h2-master-1 Oct 24 09:11:46.391790 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b5626dec-7302-4d03-aa67-03cd8e681d41 req-6be7d131-86fb-4903-b3bf-2143200bd55a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113748 Oct 24 09:11:46.396913 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2279/4442] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:46.423620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:46.425550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:46.507961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.514826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.515894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.519767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.520640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.521657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.677339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a6b8438-dc9e-4afd-bd7e-4a51cc29b10c tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "POST /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c/action" status: 202 len: 52 microversion: 2.47 time: 0.502811 Oct 24 09:11:46.689932 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2164/4443] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:11:46 2022] POST /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c/action => generated 52 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 24 09:11:46.696771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:46.697999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:46.708588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.710338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.711638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:46.712675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:46.713484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:46.714167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.397601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:47.407014 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88d9bddc-aac9-43d4-aa0d-96b50a312b3e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.715241 Oct 24 09:11:47.427689 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2165/4444] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:46 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:47.433229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:47.433755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:47.458989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:47.459627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:47.460121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.460864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:47.461342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:47.461773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.524572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:47.543438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:47.565333 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29e95603-8a84-4355-9d87-22cccc7daccf tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1318 microversion: 2.1 time: 1.154505 Oct 24 09:11:47.566184 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2280/4445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:46 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1318 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:47.587800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9d48fcd-96f5-40b9-88f5-7c2764493d97 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaf07ee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:47.708332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9d48fcd-96f5-40b9-88f5-7c2764493d97 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.139466 Oct 24 09:11:47.716787 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2281/4446] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:47 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:47.728355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:47.730194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:47.739943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c360a01-4db7-40c9-9295-09f7ff85c7fb tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 204 len: 0 microversion: 2.47 time: 0.309666 Oct 24 09:11:47.748828 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2166/4447] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:11:47 2022] DELETE /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:11:47.760720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:47.761231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:47.763909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:47.764690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.766341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:47.766837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:47.767278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.774649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:47.805638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:47.806133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:47.806567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.811287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:47.811772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:47.821638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:47.851016 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:48.701168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:48.713044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b6c756a4-8715-448b-8e3d-c08e51c5fcfe tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 200 len: 1448 microversion: 2.1 time: 1.002564 Oct 24 09:11:48.738279 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2282/4448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:47 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 1448 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:48.752194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:48.753023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:48.777016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:48.777823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:48.779740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:48.780614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:48.781773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:48.787121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:49.042724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:49.063115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:49.064829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:49.066361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-412ab6c0-150b-42b7-a4fc-3e6e8559732f tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1366 microversion: 2.47 time: 1.314448 Oct 24 09:11:49.067192 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2167/4449] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:47 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1366 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:49.079518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:49.080483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:49.096844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:49.098147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:49.099166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:49.100012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:49.100775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:49.101409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:49.258866 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:49.308115 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:49.507248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:49.516979 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53e8662d-22e9-4455-8116-0ad394777772 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.777338 Oct 24 09:11:49.521147 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2283/4450] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:48 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:49.528500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73475c30-1957-4a93-9a22-7f3a7875a628 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4ff280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:49.638716 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73475c30-1957-4a93-9a22-7f3a7875a628 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.113680 Oct 24 09:11:49.642638 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2284/4451] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:49 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:49.651556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:49.652835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:49.661875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:49.663525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:49.664183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:49.665172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:49.665823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:49.666915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:49.733626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:49.759033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-514606fa-439b-43e1-a0c9-f433ecac2440 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1507 microversion: 2.1 time: 0.669079 Oct 24 09:11:49.764504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2168/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:49 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1507 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:49.785677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:49.786656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:49.808778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:49.816886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:49.817488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:49.818349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:49.818932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:49.819487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.277637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:50.287127 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-632b0d5c-4ab6-4ae7-b27d-6364820b221d tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1318 microversion: 2.1 time: 0.505191 Oct 24 09:11:50.302269 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2169/4453] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:49 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:50.317755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:50.318646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:50.330317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:50.336299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.337124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.340410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.341481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.341982 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-004b51c2-6094-4102-a3c8-be28fe95d29c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.698052 Oct 24 09:11:50.342417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.342575 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2285/4454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:49 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:50.343163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.372175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:50.373055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:50.386851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.387603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.388289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.389163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.389804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.390391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.476414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:50.487120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:50.490199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:50.491547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0adf300a-43c3-465a-8d16-33b561c65580 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1366 microversion: 2.47 time: 0.187931 Oct 24 09:11:50.493346 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2170/4455] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:50 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:50.555949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:50.556705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:50.586171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.587636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.588336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.589776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.590130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.590835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.799301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:50.808286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-318adad9-d57c-417f-a2e7-baebecf949fc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.439845 Oct 24 09:11:50.812110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2286/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:50 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:50.819040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f2317be-a33f-4f0c-af68-2459525594d4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4f01f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:50.899716 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f2317be-a33f-4f0c-af68-2459525594d4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.086137 Oct 24 09:11:50.902521 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2287/4457] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:50 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:50.911285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:50.913364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:50.940210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.940718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.941153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:50.941908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:50.942369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:50.947613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.096979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:51.114651 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78fe100b-df72-4beb-a69f-aafdb7293c82 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.564071 Oct 24 09:11:51.116030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2171/4458] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:50 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:51.316127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:51.317825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:51.323308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:51.332560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:51.333445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:51.334314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.336459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d752230d-d69f-4e4b-94a8-fb483e7c1a7c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.430131 Oct 24 09:11:51.345402 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2288/4459] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:50 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:51.354134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:51.354804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:51.355361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.362954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:51.363598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:51.375286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:51.375788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:51.385774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.386618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:51.392261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:51.396602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.670740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:51.688578 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e86bd751-cfcd-4827-8013-9a49bb06aa09 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1318 microversion: 2.1 time: 0.377343 Oct 24 09:11:51.702421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2172/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:51 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:51.717575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:51.719603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:51.734629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:51.735992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:51.739367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.740471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:51.741137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:51.741759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:51.798684 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:51.929147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:51.942833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:51.949139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:51.953668 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1c21673-7734-4d48-a9f5-5efdf5f946db tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1366 microversion: 2.47 time: 0.248938 Oct 24 09:11:51.970846 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2173/4461] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:51 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:11:51.993768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-338d4080-119a-4cad-bebc-4d94c1856580 req-134994fc-806f-4905-9d49-dc425beabc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b0ac49-fd1f-4eb2-bd38-1bbd0309a391", "name": "network-vif-plugged", "status": "completed", "tag": "9fddc3d0-9792-43e7-a7ac-435b7b53d0f3"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:52.025420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-338d4080-119a-4cad-bebc-4d94c1856580 req-134994fc-806f-4905-9d49-dc425beabc26 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.026172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-338d4080-119a-4cad-bebc-4d94c1856580 req-134994fc-806f-4905-9d49-dc425beabc26 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.029406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-338d4080-119a-4cad-bebc-4d94c1856580 req-134994fc-806f-4905-9d49-dc425beabc26 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.064397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-338d4080-119a-4cad-bebc-4d94c1856580 req-134994fc-806f-4905-9d49-dc425beabc26 service nova] Creating event network-vif-plugged:9fddc3d0-9792-43e7-a7ac-435b7b53d0f3 for instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 on n-h1-master-1 Oct 24 09:11:52.080046 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-338d4080-119a-4cad-bebc-4d94c1856580 req-134994fc-806f-4905-9d49-dc425beabc26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107389 Oct 24 09:11:52.085168 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2174/4462] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:11:52.101465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:52.109947 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95319ac6-ad08-4412-a9ae-d0c8616da461 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.752509 Oct 24 09:11:52.114437 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2289/4463] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:51 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:52.133690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-def81103-dac3-4287-9c8b-c3cfd5c584dc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daafad430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:52.140111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87abbe03-87a5-4db5-93e0-435ceb0c4474 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:52.170086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87abbe03-87a5-4db5-93e0-435ceb0c4474 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.171480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87abbe03-87a5-4db5-93e0-435ceb0c4474 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.174176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87abbe03-87a5-4db5-93e0-435ceb0c4474 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.235261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87abbe03-87a5-4db5-93e0-435ceb0c4474 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:11:52.239264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-def81103-dac3-4287-9c8b-c3cfd5c584dc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.152294 Oct 24 09:11:52.246396 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2175/4464] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:52 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:52.257037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:52.269888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:52.295138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.295627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.296078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.296838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.297348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.297766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.405947 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87abbe03-87a5-4db5-93e0-435ceb0c4474 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.251761 Oct 24 09:11:52.411348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2290/4465] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:11:52 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:11:52.433351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:52.434239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:52.460978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.468696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.469158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.475678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.477446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.480196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.858563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:52.868883 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f63d00d-2e67-4eba-b00d-e98dc6c4eb69 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.621521 Oct 24 09:11:52.872501 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2176/4466] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:52 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:52.884048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:52.884709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:52.901619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.902134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.905558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.906340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:52.909797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:52.910265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:52.928677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:52.938773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94ee8e7a-8905-4c2b-8389-4c246f496233 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.523244 Oct 24 09:11:52.960930 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2291/4467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:52 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:52.984163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:52.984780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:53.000381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.000875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.004868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:53.006789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.007381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.007758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:53.073704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.074531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.075167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:53.075874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lazy-loading 'fault' on Instance uuid 841f8cd3-4f63-40a4-855d-871253ae6c2c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:11:53.317214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:53.326452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:53.329496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5683b4795abc4111aa9fcf809652c979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f667f944db47a5868be25e2e771c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:53.332674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a7ae33a-665b-4a26-8320-20513c5f70f2 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 200 len: 1371 microversion: 2.47 time: 0.351415 Oct 24 09:11:53.332674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2292/4468] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:52 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:11:53.365449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c7360d1-c539-4e4a-838e-05be2779f68a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4f0f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:53.414617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:53.427286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49967170-4100-4e36-8f2e-9b716d032b56 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1318 microversion: 2.1 time: 0.550832 Oct 24 09:11:53.428073 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2177/4469] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:52 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:53.455865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c7360d1-c539-4e4a-838e-05be2779f68a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.122651 Oct 24 09:11:53.457076 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2293/4470] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:53 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:53.895847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:53.896654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:53.903300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.914458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.915878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:53.918038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.918825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.919487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:53.970234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:53.971101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:53.980182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.982440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.988164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:53.990391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:53.993557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:53.994007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:54.612789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:54.626564 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d70978cd-d908-4c86-b5ef-7e34d5f7774e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.660563 Oct 24 09:11:54.627149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2294/4471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:53 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:54.641945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:54.642563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] [instance: 841f8cd3-4f63-40a4-855d-871253ae6c2c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:54.659658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:54.660150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:54.660651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:54.661391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:54.661854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:54.662598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:54.702443 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] HTTP exception thrown: Instance 841f8cd3-4f63-40a4-855d-871253ae6c2c could not be found. Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Request method failure captured: Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c HTTP/1.1 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlbHOb80AMfftuCGvqLfYC-CPGuejcPPGtp3NoiWWU17CdCTs9Tx0YSQJ8kwiGoMeLG-CRZpHy-hHIoIVnJZ0_rRztydbLiCiHtLH3khV3p8k7w2lVrO9A8D_z8Kg3AYMGj9SF77JHANGeuhTKDYKuti-1aMRdSh6g_MdssDIQOMPf4 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.47 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d0f667f944db47a5868be25e2e771c9a Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAaction247Test-1046058571 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0f667f944db47a5868be25e2e771c9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0f667f944db47a5868be25e2e771c9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0f667f944db47a5868be25e2e771c9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0f667f944db47a5868be25e2e771c9a"}]}] Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAaction247Test-1046058571 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d0f667f944db47a5868be25e2e771c9a Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAaction247Test-1046058571 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAaction247Test-1046058571-project Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 5683b4795abc4111aa9fcf809652c979 Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAaction247Test-1046058571-project Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 841f8cd3-4f63-40a4-855d-871253ae6c2c could not be found. Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '841f8cd3-4f63-40a4-855d-871253ae6c2c'} Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841f8cd3-4f63-40a4-855d-871253ae6c2c could not be found. Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841f8cd3-4f63-40a4-855d-871253ae6c2c could not be found. Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:54.704394 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841f8cd3-4f63-40a4-855d-871253ae6c2c could not be found. Oct 24 09:11:54.709156 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:11:54.714623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] Returning 404 to user: Instance 841f8cd3-4f63-40a4-855d-871253ae6c2c could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:11:54.715686 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9bf05cc9-9e91-4add-b52d-1fc41cbb4cb4 tempest-ServersAaction247Test-1046058571 tempest-ServersAaction247Test-1046058571-project] 10.222.0.25 "GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c" status: 404 len: 111 microversion: 2.47 time: 0.087615 Oct 24 09:11:54.716413 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2295/4472] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:11:54 2022] GET /compute/v2.1/servers/841f8cd3-4f63-40a4-855d-871253ae6c2c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:11:54.728952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:54.729852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:54.742014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:54.745926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:54.746876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:54.747765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:54.754114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:54.754834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:54.883829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:54.903745 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ccf62b93-a788-4a9f-8b24-9f56056f6a9f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 1.011202 Oct 24 09:11:54.906752 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2178/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:53 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:54.915667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df55ce0d-f002-4c9b-a814-03da99754d88 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab0d0ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:55.072228 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df55ce0d-f002-4c9b-a814-03da99754d88 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1451 microversion: 2.1 time: 0.164036 Oct 24 09:11:55.073683 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2179/4474] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:54 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:55.275926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:55.288077 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe1a234a-774d-42b9-9d23-8853d4a0b72b tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1507 microversion: 2.1 time: 0.570466 Oct 24 09:11:55.310559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2296/4475] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:54 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1507 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:55.329795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:55.331325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:55.349232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.354989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.355745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.356678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.357549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.358230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.415414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:55.573446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a539e7b-2356-4144-a9c9-344cebbb9bb7 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 204 len: 0 microversion: 2.1 time: 0.258578 Oct 24 09:11:55.574469 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2180/4476] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:55 2022] DELETE /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:55.596623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:55.600311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:55.607307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.608006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.608459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.609166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.609651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.610083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.649218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:11:55.654042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:55.655296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:55.666711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.667208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.671334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.672902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.673780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.674474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.796045 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e61391a-2eca-4600-8185-cde9b26cff06 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 204 len: 0 microversion: 2.1 time: 0.216103 Oct 24 09:11:55.797332 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2297/4477] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:11:55 2022] DELETE /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:11:55.808168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:55.810314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:55.820947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.822198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.822829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:55.823755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:55.824372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:55.826198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:56.012021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:56.021894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-395b73b9-0551-473e-a13b-f9087ee5f205 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.373195 Oct 24 09:11:56.043100 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2181/4478] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:55 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:56.043100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:56.043100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:56.065357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:56.066116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:56.066788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:56.068790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:56.069607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:56.070480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:56.266267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:56.295532 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32d0d0be-2047-4486-8a7c-0587b3f10d4e tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1513 microversion: 2.1 time: 0.493399 Oct 24 09:11:56.299843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2298/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:55 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:56.324957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89c4c5c1-2ba1-4999-8aec-5073e579de4e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4f01f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:56.418575 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89c4c5c1-2ba1-4999-8aec-5073e579de4e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1460 microversion: 2.1 time: 0.115571 Oct 24 09:11:56.434344 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2299/4480] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:56 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1460 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:56.440177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e15b12b-7e0e-4906-8748-0ae2eaa42869 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab0233a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:56.523410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:56.528897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e15b12b-7e0e-4906-8748-0ae2eaa42869 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 200 len: 1460 microversion: 2.1 time: 0.091893 Oct 24 09:11:56.530382 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2300/4481] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:56 2022] GET /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 1460 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:56.540506 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1aad9c3b-cd09-49e6-84c8-f9a78a94bec5 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.509561 Oct 24 09:11:56.546928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:56.550131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:56.553745 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2182/4482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:56 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:56.561026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:56.561603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:56.562051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:56.562763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:56.563227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:56.563658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:56.585458 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:56.857075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:56.872138 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c055b67-cba6-4659-a5f3-96b6d7614766 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1481 microversion: 2.1 time: 0.332026 Oct 24 09:11:56.888344 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2301/4483] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:56 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1481 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:57.064413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:57.065669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:57.075263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.077265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.078222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.080224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.080926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.083019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.318937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:57.319733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:57.332679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.336185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.336744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.339317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.340012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.340674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.731459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:57.749396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79bb6b5d-0302-4ecd-bb1f-2d0a62b3d382 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1513 microversion: 2.1 time: 0.434033 Oct 24 09:11:57.752095 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2302/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:57 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1513 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:11:57.765200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:57.766784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:57.779460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.780058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.780580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.781485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.782131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.782645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.878776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:57.890156 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd0a847a-540a-406a-bbef-1bea51cf9f95 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.836711 Oct 24 09:11:57.908634 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2183/4485] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:57 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:57.917753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:57.918776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:57.925610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.926471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.927646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:57.928624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:57.929411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:57.930117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:58.177865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:58.187353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e606144-d27b-4548-989b-786dbff271fe tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.433811 Oct 24 09:11:58.188330 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2303/4486] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:57 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:58.541099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:58.549509 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e0de552-1e4a-4147-a5e7-f5ad4ea2362e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1468 microversion: 2.1 time: 0.639253 Oct 24 09:11:58.566350 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2184/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:57 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1468 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:58.575010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1449731781"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:11:58.578029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:58.588004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:58.588588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:58.590038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:58.590863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:58.591415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:58.592111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:58.780065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:58.781133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:58.793782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:58.802098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:58.803481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:58.804933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:58.805835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:58.806505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:58.922263 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ad40783-98c0-423f-92b2-0e7fd2be19cc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "POST /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0/action" status: 202 len: 0 microversion: 2.1 time: 0.351573 Oct 24 09:11:58.929531 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2304/4488] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:11:58 2022] POST /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 24 09:11:58.935279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:58.936149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:58.942682 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:58.945457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:58.946442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:58.947271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:58.948405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:58.949532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:58.950854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:59.498724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:59.511559 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d6c1aef-2643-4417-9ef1-c99591cff622 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.580527 Oct 24 09:11:59.518486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2305/4489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:58 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:59.524522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5dd310ba-8391-4698-8470-af26efc2c6f8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4ff430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:59.657252 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5dd310ba-8391-4698-8470-af26efc2c6f8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.093639 Oct 24 09:11:59.660311 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2306/4490] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:59 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:11:59.684668 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:11:59.691119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:11:59.715199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:59.717028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:59.717739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:59.720266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:11:59.721887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:11:59.728599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:11:59.969860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:11:59.979138 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0cc70177-dd0b-454a-8368-5d480dd844fd tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 200 len: 1513 microversion: 2.1 time: 1.203120 Oct 24 09:11:59.984804 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2185/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:58 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 1513 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:00.000336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-19edaca4-1c7f-4d97-9b56-2a9ecffacbb0 req-82608271-c17e-492a-b570-ea91a4330043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382e3bdd-c519-41a4-9ebc-957c37059d41", "name": "network-vif-unplugged", "status": "completed", "tag": "1cd1b987-13bb-4075-be4b-149af14dc5ee"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:00.029182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-19edaca4-1c7f-4d97-9b56-2a9ecffacbb0 req-82608271-c17e-492a-b570-ea91a4330043 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:00.029799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-19edaca4-1c7f-4d97-9b56-2a9ecffacbb0 req-82608271-c17e-492a-b570-ea91a4330043 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:00.030310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-19edaca4-1c7f-4d97-9b56-2a9ecffacbb0 req-82608271-c17e-492a-b570-ea91a4330043 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:00.056242 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-19edaca4-1c7f-4d97-9b56-2a9ecffacbb0 req-82608271-c17e-492a-b570-ea91a4330043 service nova] Creating event network-vif-unplugged:1cd1b987-13bb-4075-be4b-149af14dc5ee for instance 382e3bdd-c519-41a4-9ebc-957c37059d41 on n-h1-master-1 Oct 24 09:12:00.079315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-19edaca4-1c7f-4d97-9b56-2a9ecffacbb0 req-82608271-c17e-492a-b570-ea91a4330043 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092977 Oct 24 09:12:00.080970 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2186/4492] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:00.094391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-edb6fe0e-bdd2-46d9-81a3-165261ff3ce2 req-64b1a897-a9a8-456d-a0ff-00491cb90f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5733a2-75d9-4b36-9503-011b72caaba3", "name": "network-vif-deleted", "tag": "7c45bb8d-0cfa-4984-b276-a24ae45281e8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:00.131278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-edb6fe0e-bdd2-46d9-81a3-165261ff3ce2 req-64b1a897-a9a8-456d-a0ff-00491cb90f41 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:00.133476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-edb6fe0e-bdd2-46d9-81a3-165261ff3ce2 req-64b1a897-a9a8-456d-a0ff-00491cb90f41 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:00.135897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-edb6fe0e-bdd2-46d9-81a3-165261ff3ce2 req-64b1a897-a9a8-456d-a0ff-00491cb90f41 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:00.165135 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-edb6fe0e-bdd2-46d9-81a3-165261ff3ce2 req-64b1a897-a9a8-456d-a0ff-00491cb90f41 service nova] Creating event network-vif-deleted:7c45bb8d-0cfa-4984-b276-a24ae45281e8 for instance 2c5733a2-75d9-4b36-9503-011b72caaba3 on n-h2-master-1 Oct 24 09:12:00.180234 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-edb6fe0e-bdd2-46d9-81a3-165261ff3ce2 req-64b1a897-a9a8-456d-a0ff-00491cb90f41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094255 Oct 24 09:12:00.183397 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2187/4493] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:00.548146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:00.549260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:00.561147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:00.563056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:00.563518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:00.567745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:00.568454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:00.571512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:00.790536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:00.814322 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7af252fa-8b07-4f49-ad88-4ad2d7b3876a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 1.144140 Oct 24 09:12:00.831648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2307/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:11:59 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:00.837453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a199c697-2bcc-493e-a7ad-ef9699d31457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa5c33a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:00.896293 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a199c697-2bcc-493e-a7ad-ef9699d31457 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.063231 Oct 24 09:12:00.897605 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2308/4495] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:00 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:01.014808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:01.016344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:01.031191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.034071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.035878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.037074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.040195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.042038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.056808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:01.067560 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-201d7681-ce14-4344-bc27-6f46f8873d0e tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.524859 Oct 24 09:12:01.068157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2188/4496] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:00 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:01.088520 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] HTTP exception thrown: Instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 could not be found. Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Request method failure captured: Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 HTTP/1.1 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVladOCZ8x3J1M4-cIuf2lfvuk6nHbZHEYr7rRBqNqAwwGJ-HCyNMkIOGxXrnnUVtQpgTxirzfbuWk2J3tt5T4Hs9cwaYJVWIj8Bg-zpRSdC9MU5jiibZMs-_0dVGBxiVrZT6KfEdNKTJK6abCEIDo434Jk0EkhDa4YUIrNm7twU7GDA Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a1021217d2904d5190dd4a82db7007fd Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-MultipleCreateTestJSON-960432793 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1021217d2904d5190dd4a82db7007fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a1021217d2904d5190dd4a82db7007fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1021217d2904d5190dd4a82db7007fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a1021217d2904d5190dd4a82db7007fd"}]}] Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-MultipleCreateTestJSON-960432793 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a1021217d2904d5190dd4a82db7007fd Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-MultipleCreateTestJSON-960432793 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-MultipleCreateTestJSON-960432793-project Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: af9c3d9be3f2494a8eb2394e48bdeca6 Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-MultipleCreateTestJSON-960432793-project Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 could not be found. Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '47b0ac49-fd1f-4eb2-bd38-1bbd0309a391'} Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 could not be found. Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 could not be found. Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:01.090725 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 could not be found. Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:01.095346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Returning 404 to user: Instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:01.097639 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-830daaea-b362-4b41-8eee-aa4fab73ec33 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391" status: 404 len: 111 microversion: 2.1 time: 0.087800 Oct 24 09:12:01.102046 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2309/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:01 2022] GET /compute/v2.1/servers/47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:01.107940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:01.108933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:01.119868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.121533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.125089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.126152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.126931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.127663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.187726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.189324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.190317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.191413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lazy-loading 'fault' on Instance uuid 2c5733a2-75d9-4b36-9503-011b72caaba3 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:01.310589 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c3d9be3f2494a8eb2394e48bdeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1021217d2904d5190dd4a82db7007fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:01.318720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3b3386f-daf5-4304-8592-c756f5004275 tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 200 len: 1308 microversion: 2.1 time: 0.215258 Oct 24 09:12:01.319980 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2189/4498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:01 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:01.838818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:01.839453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:01.848035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.848546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.848997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.849765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:01.850232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:01.850667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:01.912539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb64a749-2215-47d6-8103-f0bd387359dc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab590040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:01.985830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb64a749-2215-47d6-8103-f0bd387359dc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.077099 Oct 24 09:12:01.986959 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2190/4499] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:01 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:02.045900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:02.064153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35c266a9-6bae-4537-ac63-6b35aa77e73d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.229373 Oct 24 09:12:02.079672 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2310/4500] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:01 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:02.092716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:02.094216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:02.104292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:02.105118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:02.105819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:02.106739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:02.107404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:02.108053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:02.208773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7fdbf192-fe58-413c-a1db-c1aa5e99fa49 req-cdc2e135-82c4-425f-b3c4-94a7bd8b6afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b0ac49-fd1f-4eb2-bd38-1bbd0309a391", "name": "network-vif-deleted", "tag": "9fddc3d0-9792-43e7-a7ac-435b7b53d0f3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:02.225093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7fdbf192-fe58-413c-a1db-c1aa5e99fa49 req-cdc2e135-82c4-425f-b3c4-94a7bd8b6afc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:02.226480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7fdbf192-fe58-413c-a1db-c1aa5e99fa49 req-cdc2e135-82c4-425f-b3c4-94a7bd8b6afc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:02.227189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7fdbf192-fe58-413c-a1db-c1aa5e99fa49 req-cdc2e135-82c4-425f-b3c4-94a7bd8b6afc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:02.243023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7fdbf192-fe58-413c-a1db-c1aa5e99fa49 req-cdc2e135-82c4-425f-b3c4-94a7bd8b6afc service nova] Creating event network-vif-deleted:9fddc3d0-9792-43e7-a7ac-435b7b53d0f3 for instance 47b0ac49-fd1f-4eb2-bd38-1bbd0309a391 on n-h1-master-1 Oct 24 09:12:02.248942 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7fdbf192-fe58-413c-a1db-c1aa5e99fa49 req-cdc2e135-82c4-425f-b3c4-94a7bd8b6afc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044384 Oct 24 09:12:02.251747 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2311/4501] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:02.348271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:02.349102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] [instance: 2c5733a2-75d9-4b36-9503-011b72caaba3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:02.356502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:02.357086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:02.357629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:02.358402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:02.358957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:02.359458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:02.377193 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] HTTP exception thrown: Instance 2c5733a2-75d9-4b36-9503-011b72caaba3 could not be found. Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Request method failure captured: Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 HTTP/1.1 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVladOCZ8x3J1M4-cIuf2lfvuk6nHbZHEYr7rRBqNqAwwGJ-HCyNMkIOGxXrnnUVtQpgTxirzfbuWk2J3tt5T4Hs9cwaYJVWIj8Bg-zpRSdC9MU5jiibZMs-_0dVGBxiVrZT6KfEdNKTJK6abCEIDo434Jk0EkhDa4YUIrNm7twU7GDA Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a1021217d2904d5190dd4a82db7007fd Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-MultipleCreateTestJSON-960432793 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1021217d2904d5190dd4a82db7007fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a1021217d2904d5190dd4a82db7007fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a1021217d2904d5190dd4a82db7007fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a1021217d2904d5190dd4a82db7007fd"}]}] Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-MultipleCreateTestJSON-960432793 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a1021217d2904d5190dd4a82db7007fd Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-MultipleCreateTestJSON-960432793 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-MultipleCreateTestJSON-960432793-project Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: af9c3d9be3f2494a8eb2394e48bdeca6 Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-MultipleCreateTestJSON-960432793-project Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 2c5733a2-75d9-4b36-9503-011b72caaba3 could not be found. Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '2c5733a2-75d9-4b36-9503-011b72caaba3'} Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5733a2-75d9-4b36-9503-011b72caaba3 could not be found. Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5733a2-75d9-4b36-9503-011b72caaba3 could not be found. Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:02.379556 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5733a2-75d9-4b36-9503-011b72caaba3 could not be found. Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] Returning 404 to user: Instance 2c5733a2-75d9-4b36-9503-011b72caaba3 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f19db6f1-ec22-43cb-80e1-2dfd9a755e3a tempest-MultipleCreateTestJSON-960432793 tempest-MultipleCreateTestJSON-960432793-project] 10.222.0.25 "GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3" status: 404 len: 111 microversion: 2.1 time: 0.042351 Oct 24 09:12:02.388293 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2312/4502] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:02 2022] GET /compute/v2.1/servers/2c5733a2-75d9-4b36-9503-011b72caaba3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:02.559851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:02.575419 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31cafccf-170c-48d3-ab32-f5232ced88fa tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1678 microversion: 2.1 time: 0.486812 Oct 24 09:12:02.576826 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2191/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:02 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1678 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:03.012959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb234cc5-1ded-490e-a5e3-33c9ee2136e3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4f0430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:03.093283 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb234cc5-1ded-490e-a5e3-33c9ee2136e3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.093993 Oct 24 09:12:03.093780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:03.095000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:03.102949 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2313/4504] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:02 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:03.110461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:03.112023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:03.112869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:03.114230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:03.116024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:03.117337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:03.603097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:03.603741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:03.633514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:03.633831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:03.634280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:03.635016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:03.635461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:03.636082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:04.012388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:04.025779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c3ab945-f5b2-485d-9d12-c7af185ecce0 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1655 microversion: 2.1 time: 0.426846 Oct 24 09:12:04.026725 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2314/4505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:03 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1655 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:04.051435 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c64fff5e-a17e-4ce9-a9d7-0f329806f3ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:04.064268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c64fff5e-a17e-4ce9-a9d7-0f329806f3ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:04.064773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c64fff5e-a17e-4ce9-a9d7-0f329806f3ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:04.065220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c64fff5e-a17e-4ce9-a9d7-0f329806f3ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:04.129485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c64fff5e-a17e-4ce9-a9d7-0f329806f3ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Going to try to start instance {{(pid=126920) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 09:12:04.237507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:04.238183 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c64fff5e-a17e-4ce9-a9d7-0f329806f3ef tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.189888 Oct 24 09:12:04.239292 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2315/4506] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:12:04 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:12:04.249061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d68f26e-d60e-48c4-b1fe-ca332b4f3c7e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa569ca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:04.290729 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-624d0e6e-fcf1-4d28-af16-be9f9dd3cf67 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 1.201775 Oct 24 09:12:04.303924 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2192/4507] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:03 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:04.333874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:04.338210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:04.366615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:04.367255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:04.369880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:04.377996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:04.379035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:04.381640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d68f26e-d60e-48c4-b1fe-ca332b4f3c7e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.140758 Oct 24 09:12:04.382980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:04.388002 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:04.390888 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2316/4508] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:04 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:05.328647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:05.329416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:05.354435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:05.358603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:05.362652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:05.368595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:05.371705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:05.372771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:05.743284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:05.756284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c59e32bb-d60d-4e3d-9b20-640aba3d9d99 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.432553 Oct 24 09:12:05.758337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2317/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:05 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:05.770041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03280431-1479-4f32-9d9a-f25676a1ff13 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaef18b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:05.846838 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03280431-1479-4f32-9d9a-f25676a1ff13 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.086759 Oct 24 09:12:05.847743 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2318/4510] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:05 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:05.857834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:05.875417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82703839-cf4b-4429-9834-69e0c6fbacbf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1664 microversion: 2.1 time: 1.566178 Oct 24 09:12:05.890902 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2193/4511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:04 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1664 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:06.788653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:06.789946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:06.804711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:06.807963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:06.808636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:06.812985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:06.813892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:06.814510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:06.863504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3838b037-d3ee-4120-a72f-72a4cae43fff tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab3ee040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:06.963176 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3838b037-d3ee-4120-a72f-72a4cae43fff tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.103713 Oct 24 09:12:06.965599 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2194/4512] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:06 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:06.970600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:06.982267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:06.994402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:06.995783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:06.996400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:07.006393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:07.007703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:07.008342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:08.178182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:08.193952 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fd0c464-8579-4709-94cd-8fb14b63b5a2 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 1.411784 Oct 24 09:12:08.198018 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2319/4513] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:06 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:08.270596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:08.284274 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c158ddb5-98a8-4ab8-b189-b18b561abe4c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1664 microversion: 2.1 time: 1.317409 Oct 24 09:12:08.289558 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2195/4514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:06 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1664 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:08.310495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6de389d-a7a1-40d2-a1b5-ffc9fb01d515 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab488b80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:08.457102 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6de389d-a7a1-40d2-a1b5-ffc9fb01d515 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.162319 Oct 24 09:12:08.457875 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2196/4515] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:08 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:08.588287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-fdc1e620-1f91-4ffd-be2e-7a46f8abeea0 req-fb8aa412-d24d-45ec-b90b-2c2146453710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "name": "network-vif-plugged", "status": "completed", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:08.620846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fdc1e620-1f91-4ffd-be2e-7a46f8abeea0 req-fb8aa412-d24d-45ec-b90b-2c2146453710 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:08.621830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fdc1e620-1f91-4ffd-be2e-7a46f8abeea0 req-fb8aa412-d24d-45ec-b90b-2c2146453710 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:08.622606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-fdc1e620-1f91-4ffd-be2e-7a46f8abeea0 req-fb8aa412-d24d-45ec-b90b-2c2146453710 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:08.637174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-fdc1e620-1f91-4ffd-be2e-7a46f8abeea0 req-fb8aa412-d24d-45ec-b90b-2c2146453710 service nova] Creating event network-vif-plugged:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:12:08.643414 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-fdc1e620-1f91-4ffd-be2e-7a46f8abeea0 req-fb8aa412-d24d-45ec-b90b-2c2146453710 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.443825 Oct 24 09:12:08.652473 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2320/4516] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:09.225264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:09.226343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:09.271344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:09.275382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:09.279033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:09.284355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:09.285134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:09.287039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:09.321739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:09.322535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:09.335938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:09.345034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:09.345755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:09.347582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:09.349577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:09.350979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:09.756584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:09.766001 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc40f05e-c94b-4b09-93ba-6eb7513fdefc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.547589 Oct 24 09:12:09.776401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2197/4517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:09 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:09.803720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e21378f2-7ca6-4041-9c84-3a75296afe7e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab0d0160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:09.930521 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e21378f2-7ca6-4041-9c84-3a75296afe7e tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.151455 Oct 24 09:12:09.931285 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2198/4518] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:09 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:09.954594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:09.966750 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-388fbf5f-f176-41e1-bef1-2c2e82b6f9a8 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1664 microversion: 2.1 time: 0.658068 Oct 24 09:12:09.971752 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2321/4519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:09 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1664 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:10.803287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:10.807911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:10.834684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:10.838507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:10.840370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:10.843173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:10.852185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:10.853915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:10.948711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd563dae-d0c6-4162-ba20-9d63a7d289e2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa480670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:11.039083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd563dae-d0c6-4162-ba20-9d63a7d289e2 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.090958 Oct 24 09:12:11.047406 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2322/4520] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:10 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:11.068445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:11.072278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:11.104845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:11.109692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:11.112823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:11.115737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:11.118849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:11.120478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:11.608788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:11.619742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a812174-1de6-4121-a906-7daca3b2b44a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1485 microversion: 2.1 time: 0.821561 Oct 24 09:12:11.624904 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2199/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:10 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1485 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:11.781467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5f50ae7-4279-4f22-96a3-59791a37c963 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Action: 'create', calling method: .version_select at 0x7f8dab488b80>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-713434793", "policies": ["affinity"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:11.836064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d5f50ae7-4279-4f22-96a3-59791a37c963 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:11.857075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d5f50ae7-4279-4f22-96a3-59791a37c963 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:11.964363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d5f50ae7-4279-4f22-96a3-59791a37c963 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:11.964586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:11.979502 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04458fe6-339e-4f5b-9450-769ab59138fd tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.929501 Oct 24 09:12:11.980075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d5f50ae7-4279-4f22-96a3-59791a37c963 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:11.988315 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:12.027710 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2323/4522] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:11 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:12.033174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5f50ae7-4279-4f22-96a3-59791a37c963 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.399010 Oct 24 09:12:12.035028 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2200/4523] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:12:11 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:12.044511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:12.045084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:12.050164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:12.052838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:12.067785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.068297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.068740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.070795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.071419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.072970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.073481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.074603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.076294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.077080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.079325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.080691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.119233 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:12.265135 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03d50ebf-9047-4a57-b9ac-ef7f3d8e1753 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "POST /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4/action" status: 202 len: 0 microversion: 2.1 time: 0.235398 Oct 24 09:12:12.273588 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2324/4524] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:12:12 2022] POST /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:12:12.283364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cb55ba1-d647-46a2-8156-bf2cfeb315b4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Action: 'create', calling method: .version_select at 0x7f8daa3715e0>, body: {"server_group": {"name": "tempest-server-group-353177301", "policies": ["affinity"]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:12.357450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8cb55ba1-d647-46a2-8156-bf2cfeb315b4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:12.379880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8cb55ba1-d647-46a2-8156-bf2cfeb315b4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:12.441946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:12.461235 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22d40658-fd30-469c-bc9e-1f3f5948e0c2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.420504 Oct 24 09:12:12.463780 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2201/4525] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:12 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:12.472645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6330017-03b8-4533-8881-d1ad7d701b6f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab359f70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:12.490913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8cb55ba1-d647-46a2-8156-bf2cfeb315b4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:12.497719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8cb55ba1-d647-46a2-8156-bf2cfeb315b4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:12.516622 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8cb55ba1-d647-46a2-8156-bf2cfeb315b4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.240251 Oct 24 09:12:12.517696 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2325/4526] 10.222.0.25 () {60 vars in 1173 bytes} [Mon Oct 24 09:12:12 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:12.529147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:12.530665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:12.543784 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6330017-03b8-4533-8881-d1ad7d701b6f tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.078728 Oct 24 09:12:12.544741 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2202/4527] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:12 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:12.552659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.553474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.554630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.555233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:12.556196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.557597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:12.558620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.560598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.572554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.575466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.576121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:12.577056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:12.577708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:12.579309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:13.427532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:13.439008 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69db7ff6-bd56-4415-9b37-9101a342b25c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.892934 Oct 24 09:12:13.439926 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2203/4528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:12 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:13.447453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-580f9f77-e5db-44b1-a37b-e5e9961cfcd1 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Action: 'create', calling method: .version_select at 0x7f8dab359820>, body: {"server_group": {"name": "tempest-server-group-353177301", "policies": ["affinity"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:13.477084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-580f9f77-e5db-44b1-a37b-e5e9961cfcd1 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:13.484289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-580f9f77-e5db-44b1-a37b-e5e9961cfcd1 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:13.553706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-580f9f77-e5db-44b1-a37b-e5e9961cfcd1 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:13.560431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-580f9f77-e5db-44b1-a37b-e5e9961cfcd1 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:13.576888 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-580f9f77-e5db-44b1-a37b-e5e9961cfcd1 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.135638 Oct 24 09:12:13.577921 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2204/4529] 10.222.0.25 () {60 vars in 1173 bytes} [Mon Oct 24 09:12:13 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:13.584765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:13.585971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:13.593820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:13.594401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:13.594968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:13.595918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:13.596467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:13.602226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:13.964363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:13.985169 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31538527-c811-4a80-9a03-dd9bdd2cdd0c tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1493 microversion: 2.1 time: 1.466057 Oct 24 09:12:13.986440 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2326/4530] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:12 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1493 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:13.992910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4084aa04-7f50-4e4d-80d8-ddcb7b506a4c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab0299d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.023804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:14.032145 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0efd95b7-91eb-4f2b-a582-a9046c64afe7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.453155 Oct 24 09:12:14.032930 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2205/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:13 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:14.065059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1015c651-49cb-4baf-8fa1-e05e1f7759b9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.075029 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4084aa04-7f50-4e4d-80d8-ddcb7b506a4c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.087027 Oct 24 09:12:14.079855 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2327/4532] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:13 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:14.093615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.097189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:14.120773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:14.122030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:14.123987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:14.124960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:14.126328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:14.127155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:14.136833 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1015c651-49cb-4baf-8fa1-e05e1f7759b9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/a0c14a39-6e14-41b0-b5c3-e31af12550d6" status: 204 len: 0 microversion: 2.1 time: 0.102944 Oct 24 09:12:14.140192 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2206/4533] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:14 2022] DELETE /compute/v2.1/os-server-groups/a0c14a39-6e14-41b0-b5c3-e31af12550d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:14.164115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.164708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:14.188497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:14.189017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:14.191734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:14.192511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:14.197975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:14.198509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:14.263636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c2119b3-f9dc-4160-b0cd-39aaf1c60726 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/ips" status: 200 len: 149 microversion: 2.1 time: 0.120186 Oct 24 09:12:14.271607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2207/4534] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:12:14 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/ips => generated 149 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:14.276150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9092ede8-6e74-4660-8b46-196bacb7f872 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.319302 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9092ede8-6e74-4660-8b46-196bacb7f872 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.051568 Oct 24 09:12:14.322011 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2208/4535] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:12:14 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:14.333691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e5de4fc-0f16-480b-9d25-bff778563517 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.396107 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e5de4fc-0f16-480b-9d25-bff778563517 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/b875ab75-f21d-40a1-a072-67d3d568951a" status: 204 len: 0 microversion: 2.1 time: 0.065960 Oct 24 09:12:14.400437 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2209/4536] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:14 2022] DELETE /compute/v2.1/os-server-groups/b875ab75-f21d-40a1-a072-67d3d568951a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:12:14.407101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2eaa4f28-ac1d-4799-8526-5a4d0c84cda5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.427835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2eaa4f28-ac1d-4799-8526-5a4d0c84cda5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025836 Oct 24 09:12:14.438630 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2210/4537] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:12:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:14.445050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87e77000-b7ff-4979-ba24-06423a1c3bb3 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Action: 'create', calling method: .version_select at 0x7f8dab0bae50>, body: {"server_group": {"name": "tempest-server-group-561086111", "policies": ["affinity"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:14.467860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-87e77000-b7ff-4979-ba24-06423a1c3bb3 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:14.474950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-87e77000-b7ff-4979-ba24-06423a1c3bb3 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:14.545521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-87e77000-b7ff-4979-ba24-06423a1c3bb3 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:14.553162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-87e77000-b7ff-4979-ba24-06423a1c3bb3 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:14.576423 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87e77000-b7ff-4979-ba24-06423a1c3bb3 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.135392 Oct 24 09:12:14.577092 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2211/4538] 10.222.0.25 () {60 vars in 1173 bytes} [Mon Oct 24 09:12:14 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:14.592287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db4418b2-c875-4aef-866a-7d9a5544f1cb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.653815 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db4418b2-c875-4aef-866a-7d9a5544f1cb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e855b107-cc1c-42ee-882d-9a9058b5b3a0" status: 204 len: 0 microversion: 2.1 time: 0.066440 Oct 24 09:12:14.657920 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2212/4539] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:14 2022] DELETE /compute/v2.1/os-server-groups/e855b107-cc1c-42ee-882d-9a9058b5b3a0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:14.670533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4c31f2c-857e-444d-a0bd-cf8993208be7 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:14.703098 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4c31f2c-857e-444d-a0bd-cf8993208be7 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042454 Oct 24 09:12:14.711292 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2213/4540] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:12:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:14.723312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-401a871d-6188-49d8-88c3-6586f4fa7cf8 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Action: 'create', calling method: .version_select at 0x7f8dab0d01f0>, body: {"server_group": {"name": "tempest-server-group-2144973263", "policies": ["anti-affinity"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:14.771623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-401a871d-6188-49d8-88c3-6586f4fa7cf8 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:14.779502 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:14.791301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-401a871d-6188-49d8-88c3-6586f4fa7cf8 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:14.918348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-401a871d-6188-49d8-88c3-6586f4fa7cf8 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:14.928155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-401a871d-6188-49d8-88c3-6586f4fa7cf8 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:14.956887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-401a871d-6188-49d8-88c3-6586f4fa7cf8 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.244289 Oct 24 09:12:14.966683 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2214/4541] 10.222.0.25 () {60 vars in 1173 bytes} [Mon Oct 24 09:12:14 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:14.978072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc2fc38d-4e1c-43e3-a6ef-d33c6389391a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:15.029046 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc2fc38d-4e1c-43e3-a6ef-d33c6389391a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/7cc9f805-e55c-4d70-b6fe-b96beb2891c3" status: 204 len: 0 microversion: 2.1 time: 0.060907 Oct 24 09:12:15.033012 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2215/4542] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:14 2022] DELETE /compute/v2.1/os-server-groups/7cc9f805-e55c-4d70-b6fe-b96beb2891c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:15.044891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:15.044891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:15.064262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:15.066970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:15.067465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:15.068220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:15.076509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:15.077011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:16.035353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:16.048665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:16.054499 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ff9469a-c855-4b54-93b4-15101ba2d3d6 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.972823 Oct 24 09:12:16.058318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2328/4543] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:14 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:16.065082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db5567ed-d9e4-4bde-8ce2-5655fa743c6a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:16.095869 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a8d2ede-6548-4877-a00f-7a56e1bb5f9d tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1493 microversion: 2.1 time: 1.058247 Oct 24 09:12:16.097178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2216/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:15 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1493 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:16.105160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b8ff2520-c051-4c9b-b24c-55e6ef069632 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaf7f790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:16.128521 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db5567ed-d9e4-4bde-8ce2-5655fa743c6a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068926 Oct 24 09:12:16.153147 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2329/4545] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:12:16 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:16.185945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:16.186600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:16.212090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:16.212676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:16.213137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:16.213911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:16.234805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:16.235448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:16.251898 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b8ff2520-c051-4c9b-b24c-55e6ef069632 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.153355 Oct 24 09:12:16.252866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2217/4546] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:16 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:16.318736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lazy-loading 'flavor' on Instance uuid 29e407b5-a14a-4395-a9ac-771605f5ecd3 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:16.332666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1906664468", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "c2960fcb-a5a6-422b-b5f3-82ecebe386b7"}]}, "os:scheduler_hints": {"group": "47afd99c-8fef-4d4a-901e-b65c113409c8"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:16.500910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] validate_networks() for [('c2960fcb-a5a6-422b-b5f3-82ecebe386b7', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:12:16.554044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f587b7d6-6263-4879-86cf-49c817ea56d5 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.399538 Oct 24 09:12:16.558904 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2330/4547] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:12:16 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:12:16.567551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:16.574490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:16.593230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:16.594057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:16.594835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:16.596224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:16.596941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:16.597868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:17.134626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:17.165901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73cf96d6-ee33-4909-98de-876d4d0a1378 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1676 microversion: 2.1 time: 0.604264 Oct 24 09:12:17.173282 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2331/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:16 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1676 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:17.186448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:17.191209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:17.219096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:17.219960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:17.224215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:17.226514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:17.227197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:17.232378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:17.429741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:12:17.430291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:12:17.430631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:12:17.431210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:12:17.431778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:12:17.463692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:17.464195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:17.464639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:17.465424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:17.465884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:17.466309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:17.521284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:17.548217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:17.581636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:12:17.590580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:12:17.650130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:17.663864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f422b887-dbc8-4854-821f-673848e2c05e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1493 microversion: 2.1 time: 0.485862 Oct 24 09:12:17.666232 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2332/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:17 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1493 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:17.679673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a41c6048-e5bd-4ece-ace3-f701b9372f85 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa569670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:17.806791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:17.821726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a41c6048-e5bd-4ece-ace3-f701b9372f85 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.154362 Oct 24 09:12:17.833116 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2333/4550] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:17 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:17.849979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:17.967188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:17.985028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Getting quotas for user c8cc22ca64db4c86827f1262cdddf2d7 and project 0a93a7edd7324574b19ec5c7847f9f03. Resources: {'server_group_members'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:18.073664 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32de76bf-fe0a-4e65-983e-5e61f22c8e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.745402 Oct 24 09:12:18.082246 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2218/4551] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:12:18.091480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c96fad8d-3e22-4f0c-a4f4-5685fcd9dcc9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:18.092103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c96fad8d-3e22-4f0c-a4f4-5685fcd9dcc9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:18.197276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:18.198664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:18.214822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:18.216709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:18.235843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:18.238563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:18.241532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:18.243632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:18.719844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c96fad8d-3e22-4f0c-a4f4-5685fcd9dcc9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:18.729170 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c96fad8d-3e22-4f0c-a4f4-5685fcd9dcc9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1213 microversion: 2.1 time: 0.645519 Oct 24 09:12:18.731518 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2334/4552] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:18 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1213 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:18.753652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c089808f-f24b-401e-8245-13fae8746018"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:18.768128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:18.798543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:18.800601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:18.803218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:18.804362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:18.805966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:18.808677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:19.464588 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f12b731-2fb8-453a-add4-4399363165c0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717157 Oct 24 09:12:19.470802 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2335/4553] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:12:18 2022] POST /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:19.490005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:19.491053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:19.515257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:19.515762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:19.516208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:19.516907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:19.517399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:19.517838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:19.897070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:19.905265 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d3e798e-6920-49c6-a806-06b8c90d2b0a tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1499 microversion: 2.1 time: 0.432860 Oct 24 09:12:19.912479 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2336/4554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:19 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1499 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:19.917247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b5bb20a-ae3c-4cfe-abae-fb019827b341 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa480dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:19.998271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:20.007478 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad788328-5ee7-4e5b-ad3b-41bc5363effc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1676 microversion: 2.1 time: 1.815244 Oct 24 09:12:20.021691 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2219/4555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:18 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1676 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:20.035988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:20.036854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:20.048469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:20.062829 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b5bb20a-ae3c-4cfe-abae-fb019827b341 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.149154 Oct 24 09:12:20.063612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2337/4556] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:19 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:20.077212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:20.078041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:20.078493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:20.079245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:20.079694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:20.081081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:20.085798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:20.104103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:20.104637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:20.105085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:20.112184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:20.112695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:20.113150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:20.196344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:20.328601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-157540a8-5497-436a-8b49-dfdc3b30f76e tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 204 len: 0 microversion: 2.1 time: 0.263314 Oct 24 09:12:20.330091 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2338/4557] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:20 2022] DELETE /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:20.345581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:20.348877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:20.364904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:20.365654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:20.367323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:20.370789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:20.371800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:20.372467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:20.492599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:20.517034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3c0b4a9-4d4a-4ded-9bb5-27665c3ec773 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1265 microversion: 2.1 time: 0.486486 Oct 24 09:12:20.540726 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2220/4558] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:20 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1265 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:20.695411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:20.714629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e59239cc-55dd-45e9-afcd-568ce520ca7b tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.378881 Oct 24 09:12:20.723156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2339/4559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:20 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:21.034890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:21.036166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:21.063204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:21.065230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:21.068486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:21.079708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7c7ebc9-c18b-440a-9944-cbad16d565bf tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa569820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:21.087282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:21.087990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:21.088590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:21.181055 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7c7ebc9-c18b-440a-9944-cbad16d565bf tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.078017 Oct 24 09:12:21.198150 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2340/4560] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:21 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:21.549264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:21.550064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:21.585567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:21.586285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:21.586923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:21.587875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:21.589110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:21.591037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:21.843413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:21.851893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5d57c82-f399-4768-a09d-9cf0f00436fa tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1271 microversion: 2.1 time: 0.311721 Oct 24 09:12:21.852483 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2341/4561] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:21 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:21.868504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:21.869132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:21.909722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:21.910219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:21.910670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:21.911392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:21.911844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:21.916920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:21.996761 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:22.046711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:22.062373 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e1ce228-c0bc-4654-9813-ec5874093c81 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1659 microversion: 2.1 time: 1.031241 Oct 24 09:12:22.063500 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2221/4562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:21 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1659 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:22.089267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:22.094128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:22.103168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:22.108666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:22.109452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:22.112704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:22.113465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:22.115429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:22.327692 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44d77160-cba1-4f46-ae17-8b7543aab69f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action" status: 202 len: 0 microversion: 2.1 time: 0.242048 Oct 24 09:12:22.335628 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2222/4563] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:12:22 2022] POST /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:12:22.348548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53f6c1c1-3552-4183-b424-dd9b88002fff tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab3c5af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:22.460721 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53f6c1c1-3552-4183-b424-dd9b88002fff tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.123631 Oct 24 09:12:22.465770 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2223/4564] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:22 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:22.475177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:22.480242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:22.504424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:22.506460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:22.510659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:22.523186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:22.529233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:22.531854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:22.683826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:22.703861 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65474e8d-570d-4111-86c6-639087bea876 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 0.842423 Oct 24 09:12:22.705593 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2342/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:21 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:22.882601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:22.884632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:22.904954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:22.905904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:22.910604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:22.912535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:22.914417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:22.914942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:23.145076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:23.171566 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d321fd47-f240-4e2a-82cb-a175a0e2eacc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1665 microversion: 2.1 time: 0.704247 Oct 24 09:12:23.176184 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2224/4566] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:22 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1665 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:23.376739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:23.391481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87813546-2f7f-4575-9f97-b9fa320479e9 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1271 microversion: 2.1 time: 0.514503 Oct 24 09:12:23.395429 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2343/4567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:22 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1271 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:23.482642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5888a0e-c324-425f-be47-1199cf74266d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaef0550>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:23.596589 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5888a0e-c324-425f-be47-1199cf74266d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.118504 Oct 24 09:12:23.599771 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2225/4568] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:23 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:23.733895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:23.735014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:23.754344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:23.754894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:23.755612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:23.756338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:23.761633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:23.762221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:24.214413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:24.216056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:24.252006 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:24.257151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:24.257980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:24.261710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:24.265961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:24.268333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:25.126444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:25.158320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7de40a3-c8bd-4ba8-8285-64701b0d05b0 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 1.428619 Oct 24 09:12:25.161661 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2344/4569] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:23 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:25.176768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:25.177695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:25.188117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:25.189196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:25.189892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:25.191316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:25.192012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:25.192979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:25.980709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:25.995180 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f54512e8-96ab-4741-8df6-b75d393f8abc tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1665 microversion: 2.1 time: 1.786350 Oct 24 09:12:26.012506 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2226/4570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:24 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1665 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:26.019193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0a809a5-1c02-478c-ba63-5ca5d70b0814 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa676040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:26.102631 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d0a809a5-1c02-478c-ba63-5ca5d70b0814 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.088448 Oct 24 09:12:26.110796 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2227/4571] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:26 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:26.187090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:26.187984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:26.201239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:26.201911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:26.202461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:26.203311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:26.203882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:26.204418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:26.711602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:26.721781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc8ff6c7-e207-40d6-a7ec-7e832c091e54 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 1.556144 Oct 24 09:12:26.736048 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2345/4572] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:25 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:27.019983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:27.020601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:27.037217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:27.042579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:27.043274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:27.044243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:27.047178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:27.047904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:27.290763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:27.298586 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:27.315323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e1aec9a-662e-40a8-a24b-88ead4a22c26 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1505 microversion: 2.1 time: 1.118155 Oct 24 09:12:27.317585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2228/4573] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:26 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1505 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:27.343882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1aa770d0-b504-461f-9be5-fe64a6c47120 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab596700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:27.444574 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1aa770d0-b504-461f-9be5-fe64a6c47120 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.119435 Oct 24 09:12:27.445472 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2229/4574] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:27 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:27.631753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:27.639920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e0c1c4f9-1fda-45b2-9e94-bae548ea9bb3 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1665 microversion: 2.1 time: 0.623681 Oct 24 09:12:27.648484 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2346/4575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:27 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1665 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:27.759021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:27.760141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:27.762428 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:27.794100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:27.797075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:27.797858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:27.798748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:27.801968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:27.802855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:28.007795 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=46 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:28.343974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:28.348090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:28.370879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:28.372299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:28.376485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:28.377530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:28.386694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:28.387430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:28.540914 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:28.544653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:28.552005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:28.555697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:28.556420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lazy-loading 'fault' on Instance uuid dddc3de5-226a-43ae-837b-3895d26cfbf4 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:28.723896 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:28.809473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:28.822784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cdefd72-f19a-4537-aa38-0bd00371ee85 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 200 len: 1303 microversion: 2.1 time: 0.482579 Oct 24 09:12:28.831192 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2347/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:28 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 1303 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:28.850645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4aaba26-b992-4f1d-bb54-9a0e772a4e64 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daadc0f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:28.936985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4aaba26-b992-4f1d-bb54-9a0e772a4e64 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.093956 Oct 24 09:12:28.938093 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2348/4577] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:28 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:28.969146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-bdf89d6a-55a0-4d86-bc9b-ad4a0de63200 req-991ace34-7bc3-427a-ae4b-dbbc20069d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddc3de5-226a-43ae-837b-3895d26cfbf4", "name": "network-vif-deleted", "tag": "3eb13690-24d0-45b8-8a4a-0f89b06d45c3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:29.038919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bdf89d6a-55a0-4d86-bc9b-ad4a0de63200 req-991ace34-7bc3-427a-ae4b-dbbc20069d4c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:29.039463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bdf89d6a-55a0-4d86-bc9b-ad4a0de63200 req-991ace34-7bc3-427a-ae4b-dbbc20069d4c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:29.039907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bdf89d6a-55a0-4d86-bc9b-ad4a0de63200 req-991ace34-7bc3-427a-ae4b-dbbc20069d4c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:29.098945 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-bdf89d6a-55a0-4d86-bc9b-ad4a0de63200 req-991ace34-7bc3-427a-ae4b-dbbc20069d4c service nova] Creating event network-vif-deleted:3eb13690-24d0-45b8-8a4a-0f89b06d45c3 for instance dddc3de5-226a-43ae-837b-3895d26cfbf4 on n-h2-master-1 Oct 24 09:12:29.138610 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-bdf89d6a-55a0-4d86-bc9b-ad4a0de63200 req-991ace34-7bc3-427a-ae4b-dbbc20069d4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194265 Oct 24 09:12:29.139275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2349/4578] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:29.164777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:29.169184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:29.191810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:29.192369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:29.192821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:29.193573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:29.207105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:29.207497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.015288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:30.036803 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5148bb15-4d5c-4ad2-9603-282aaaefe54c tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 0.896206 Oct 24 09:12:30.040906 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2350/4579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:29 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:30.056013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:30.056998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: dddc3de5-226a-43ae-837b-3895d26cfbf4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:30.079224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.080096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.089575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.090620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.091316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.091966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.125702 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] HTTP exception thrown: Instance dddc3de5-226a-43ae-837b-3895d26cfbf4 could not be found. Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Request method failure captured: Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 HTTP/1.1 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlZxkkME4yJEi1ifgx0zrHFGzcBKcYdMXfMhZ6ocDPB0cvddmInxYW4mJZEqNsHk5DTIP48y5GbEQqp2Q_xEr8pXV36HYPlwdAw7WfnHOW5GRN4XTd6XDbqDuhsT8xpUePvzudisrPNc-JUjwNbA-D1XeSeqAt8oqAxfNQ8TGHzFXPw Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d6c4858fe89d4bfb8b989aa476a58a84 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueTestJSON-1649835141 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6c4858fe89d4bfb8b989aa476a58a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6c4858fe89d4bfb8b989aa476a58a84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6c4858fe89d4bfb8b989aa476a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6c4858fe89d4bfb8b989aa476a58a84"}]}] Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueTestJSON-1649835141 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d6c4858fe89d4bfb8b989aa476a58a84 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueTestJSON-1649835141 Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerRescueTestJSON-1649835141-project Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d271cce474064255b276e240e88bbe0c Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueTestJSON-1649835141-project Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: exception: Instance dddc3de5-226a-43ae-837b-3895d26cfbf4 could not be found. Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'dddc3de5-226a-43ae-837b-3895d26cfbf4'} Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dddc3de5-226a-43ae-837b-3895d26cfbf4 could not be found. Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dddc3de5-226a-43ae-837b-3895d26cfbf4 could not be found. Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:30.128253 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dddc3de5-226a-43ae-837b-3895d26cfbf4 could not be found. Oct 24 09:12:30.133622 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:30.135848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Returning 404 to user: Instance dddc3de5-226a-43ae-837b-3895d26cfbf4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:30.136958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77ef31b2-93b4-4981-ba1b-7605c7b41649 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4" status: 404 len: 111 microversion: 2.1 time: 0.091285 Oct 24 09:12:30.148148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2351/4580] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:30 2022] GET /compute/v2.1/servers/dddc3de5-226a-43ae-837b-3895d26cfbf4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:30.153410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-649b96ad-0ddc-412d-a5aa-83e8e01991c7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa5c88b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:30.238213 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-649b96ad-0ddc-412d-a5aa-83e8e01991c7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.088687 Oct 24 09:12:30.239181 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2352/4581] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:30 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:30.248183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:30.254264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:30.279342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.280209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.280901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.281867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.282546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.283205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.480251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:30.502061 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-001e8a6b-4dcc-4d9c-89aa-f6e3ae6ddb05 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 2.747324 Oct 24 09:12:30.520285 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2230/4582] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:27 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:30.537343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:30.546553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:30.557338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.570276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.571137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.572114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.572795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.579124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.661687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:30.909142 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-131b3256-f83f-4b83-bb44-c036590d4900 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 204 len: 0 microversion: 2.1 time: 0.387152 Oct 24 09:12:30.914312 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2231/4583] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:30 2022] DELETE /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:30.934669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:30.946631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:30.965208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.970920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.971743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:30.974827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:30.975602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:30.976286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:31.616409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:31.625598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b975acd5-dd7c-43b9-b33f-df52777af3fc tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1491 microversion: 2.1 time: 0.708060 Oct 24 09:12:31.632197 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2232/4584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:30 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1491 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:31.655516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cec2928-5d6d-49cb-a3bd-d8f2b3ead22c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf24c1f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:31.765062 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cec2928-5d6d-49cb-a3bd-d8f2b3ead22c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.113503 Oct 24 09:12:31.765874 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2233/4585] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:31 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:31.777454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:31.789838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:31.797261 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:31.830664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:31.847361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:31.848048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:31.848928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:31.849549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:31.850668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:32.012807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:32.028151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3353862c-a8ed-4410-a116-646274be02bf tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1668 microversion: 2.1 time: 1.787533 Oct 24 09:12:32.036481 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2353/4586] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:30 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1668 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:32.044242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1652ecd7-cbd7-4ea4-ba1b-9be1726518a1 req-12a1f6d1-e5be-4952-bd2e-563504b5092a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a89b67-84a8-4db6-91b5-8fee01aa2cde", "tag": "0595c8fb-9aef-49d8-88f3-3520640918fc"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:32.085869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1652ecd7-cbd7-4ea4-ba1b-9be1726518a1 req-12a1f6d1-e5be-4952-bd2e-563504b5092a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:32.086720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1652ecd7-cbd7-4ea4-ba1b-9be1726518a1 req-12a1f6d1-e5be-4952-bd2e-563504b5092a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:32.087323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1652ecd7-cbd7-4ea4-ba1b-9be1726518a1 req-12a1f6d1-e5be-4952-bd2e-563504b5092a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:32.105957 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1652ecd7-cbd7-4ea4-ba1b-9be1726518a1 req-12a1f6d1-e5be-4952-bd2e-563504b5092a service nova] Creating event network-changed:0595c8fb-9aef-49d8-88f3-3520640918fc for instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde on n-h1-master-1 Oct 24 09:12:32.114277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1652ecd7-cbd7-4ea4-ba1b-9be1726518a1 req-12a1f6d1-e5be-4952-bd2e-563504b5092a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075801 Oct 24 09:12:32.118696 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2354/4587] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:32.148313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:32.150104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:32.172767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:32.175628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:32.176114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:32.176855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:32.177335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:32.177768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:32.293120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:32.299973 n-d-master-1 devstack@n-api.service[126920]: INFO nova.compute.api [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Working on deleting snapshot fe29bf42-9314-4c99-a90d-30f3c714c047 from shelved instance... Oct 24 09:12:32.625124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:32.635809 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e44cfb0-cce6-480d-b4da-67066e7af939 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.868167 Oct 24 09:12:32.655380 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2234/4588] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:31 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:32.663442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:32.664386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:32.672787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:32.673665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:32.674454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:32.675671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:32.676371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:32.677426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:33.703137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Doing local delete in cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) {{(pid=126920) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 24 09:12:33.703914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:33.707129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:33.707585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:33.708784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.compute.api [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 24 09:12:33.721593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] deallocate_for_instance() {{(pid=126920) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 24 09:12:34.033905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:34.045836 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-40fde5ef-b403-4913-9c53-663152269f1f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1491 microversion: 2.1 time: 1.388731 Oct 24 09:12:34.064908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2235/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:32 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1491 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:34.071623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa582345-08af-48bd-b938-81bd526dcc57 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab4f7160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:34.351359 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa582345-08af-48bd-b938-81bd526dcc57 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1451 microversion: 2.1 time: 0.284779 Oct 24 09:12:34.421374 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2236/4590] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:34 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1451 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:34.432845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:34.435987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:34.482485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:34.483248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:34.483854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:34.484750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:34.485584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:34.486442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:36.478854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Updating instance_info_cache with network_info: [] {{(pid=126920) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 09:12:36.641270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:36.661744 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0cb2197-4fdf-4c00-a104-31d5bca51690 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 2.238440 Oct 24 09:12:36.663307 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2237/4591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:34 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:36.669614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:36.670747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:36.700082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:36.705195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:36.707218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:36.710879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:36.713404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:36.714158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.040822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:37.074180 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15531025-bbdb-4ca0-bba6-db535af5d596 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1449 microversion: 2.1 time: 0.409461 Oct 24 09:12:37.090879 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2238/4592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:36 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1449 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:37.097778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71c362e8-a000-4718-82f9-c16a7043ecfd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8da9e06a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.173922 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71c362e8-a000-4718-82f9-c16a7043ecfd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1460 microversion: 2.1 time: 0.081448 Oct 24 09:12:37.178809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2239/4593] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:37 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:37.192368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ad315ec4-1e1b-4a63-a9ff-625e9b08f6f8 req-c865bec0-d01b-4c2e-bce0-53868029bddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1578f62-252e-49eb-99ae-8f85cfc6490f", "name": "network-vif-deleted", "tag": "16877e70-f3fd-4ebf-a699-15a920c89fd1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:37.224799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ad315ec4-1e1b-4a63-a9ff-625e9b08f6f8 req-c865bec0-d01b-4c2e-bce0-53868029bddd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.226099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ad315ec4-1e1b-4a63-a9ff-625e9b08f6f8 req-c865bec0-d01b-4c2e-bce0-53868029bddd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.226545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ad315ec4-1e1b-4a63-a9ff-625e9b08f6f8 req-c865bec0-d01b-4c2e-bce0-53868029bddd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.258601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.server_external_events [req-ad315ec4-1e1b-4a63-a9ff-625e9b08f6f8 req-c865bec0-d01b-4c2e-bce0-53868029bddd service nova] Unable to find a host for instance a1578f62-252e-49eb-99ae-8f85cfc6490f. Dropping event network-vif-deleted {{(pid=126919) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 09:12:37.259111 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30c10523-2e09-483a-8df0-8227b4217b9a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 204 len: 0 microversion: 2.1 time: 5.129143 Oct 24 09:12:37.260308 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2355/4594] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:32 2022] DELETE /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 0 bytes in 5132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:37.261651 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ad315ec4-1e1b-4a63-a9ff-625e9b08f6f8 req-c865bec0-d01b-4c2e-bce0-53868029bddd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.078785 Oct 24 09:12:37.263462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2240/4595] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 09:12:37.267998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3ee30f83-3f8d-416f-8b47-3248beb9cda3 req-6a11cfe2-f9fa-418d-acfc-ff87b5779093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bae9c0-3fc3-4177-a609-de023af87318", "name": "network-vif-deleted", "tag": "40e476b3-aff2-458a-9f2f-2cdc83220506"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:37.276467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f322b3d-93c3-455e-8ca3-3ec621d24cdc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daafad0d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.321251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ee30f83-3f8d-416f-8b47-3248beb9cda3 req-6a11cfe2-f9fa-418d-acfc-ff87b5779093 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.321962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ee30f83-3f8d-416f-8b47-3248beb9cda3 req-6a11cfe2-f9fa-418d-acfc-ff87b5779093 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.322567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3ee30f83-3f8d-416f-8b47-3248beb9cda3 req-6a11cfe2-f9fa-418d-acfc-ff87b5779093 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.342093 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3ee30f83-3f8d-416f-8b47-3248beb9cda3 req-6a11cfe2-f9fa-418d-acfc-ff87b5779093 service nova] Creating event network-vif-deleted:40e476b3-aff2-458a-9f2f-2cdc83220506 for instance 02bae9c0-3fc3-4177-a609-de023af87318 on n-h1-master-1 Oct 24 09:12:37.349054 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3ee30f83-3f8d-416f-8b47-3248beb9cda3 req-6a11cfe2-f9fa-418d-acfc-ff87b5779093 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086047 Oct 24 09:12:37.351069 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2356/4596] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:37.357628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.358899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: a1578f62-252e-49eb-99ae-8f85cfc6490f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:37.366171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.366856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.367554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.369403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.371288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.371920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.379273 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:37.383683 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f322b3d-93c3-455e-8ca3-3ec621d24cdc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 200 len: 1460 microversion: 2.1 time: 0.119121 Oct 24 09:12:37.385273 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2241/4597] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:37 2022] GET /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 1460 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:37.400110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.400581 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] HTTP exception thrown: Instance a1578f62-252e-49eb-99ae-8f85cfc6490f could not be found. Oct 24 09:12:37.400948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Request method failure captured: Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f HTTP/1.1 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlT-Gwl-QL4RmTnmqxij31goZNj1DohdSNDs5nmArEp82KeeRin_XKj9vYVMxI3moiVuuii5bAUuyG1jpFWdoiqWSoqjt-4f9s2X2R4RFGpH0ZkRJguuLpkyMcWuw0UfdTx6-vCaFDNZCH4c5yQQZrz2t_yj87_WXCyQAVc2NSrsZrE Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be8fffe9b0994ded9f07301735105917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be8fffe9b0994ded9f07301735105917"}]}] Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c703cc73a22749858ffe05500e52aa03 Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a1578f62-252e-49eb-99ae-8f85cfc6490f could not be found. Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a1578f62-252e-49eb-99ae-8f85cfc6490f'} Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1578f62-252e-49eb-99ae-8f85cfc6490f could not be found. Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1578f62-252e-49eb-99ae-8f85cfc6490f could not be found. Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:37.402888 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1578f62-252e-49eb-99ae-8f85cfc6490f could not be found. Oct 24 09:12:37.407624 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:37.408995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Returning 404 to user: Instance a1578f62-252e-49eb-99ae-8f85cfc6490f could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:37.410522 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7917ee14-76f3-4347-a4a5-cd9e0ffb245a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f" status: 404 len: 111 microversion: 2.1 time: 0.057751 Oct 24 09:12:37.411677 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2357/4598] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:37 2022] GET /compute/v2.1/servers/a1578f62-252e-49eb-99ae-8f85cfc6490f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:37.412805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.413321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.415084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.417570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.419117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.420533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.421759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.422326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:37.434604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.435193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.435764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.446714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.447395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.448163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.479707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:37.587905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d2deabf-057a-4eb7-a6db-8daa186757da tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 204 len: 0 microversion: 2.1 time: 0.170769 Oct 24 09:12:37.590557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2358/4599] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:37 2022] DELETE /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:37.599389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.600598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:37.608373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.609259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.609970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.610962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.612006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.613097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.811061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:37.820042 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a663438-da36-4c65-846d-882709c4ecab tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1465 microversion: 2.1 time: 0.225140 Oct 24 09:12:37.821323 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2359/4600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:37 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:37.826405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:37.827400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:37.834052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.835011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.835692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:37.836676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:37.837428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:37.838190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:38.131644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:38.141665 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3ee048c-9ab6-4ddb-b9fb-3d94addfb279 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1467 microversion: 2.1 time: 0.747092 Oct 24 09:12:38.166809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2242/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:37 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1467 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:38.194517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:38.194517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:38.195058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:38.195723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:38.196317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:38.197183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:38.197835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:38.198411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:38.270331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:38.270828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:38.271277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:38.271772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lazy-loading 'fault' on Instance uuid 02bae9c0-3fc3-4177-a609-de023af87318 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:38.355051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd271cce474064255b276e240e88bbe0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c4858fe89d4bfb8b989aa476a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:38.366987 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3364379-13fe-43e8-906b-47123c71a640 tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 200 len: 1304 microversion: 2.1 time: 0.198195 Oct 24 09:12:38.367098 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2243/4602] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:38 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:38.382366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4983fa2-ee87-4b10-8d53-614e60ac5267 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf22d0d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:38.605064 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4983fa2-ee87-4b10-8d53-614e60ac5267 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-10-24T09%3A10%3A24Z" status: 200 len: 2376 microversion: 2.1 time: 0.236847 Oct 24 09:12:38.613360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2244/4603] 10.222.0.25 () {58 vars in 1199 bytes} [Mon Oct 24 09:12:38 2022] GET /compute/v2.1/images?changes-since=2022-10-24T09%3A10%3A24Z => generated 2376 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:38.643758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35ea6228-bae8-4523-b7ab-9d0022e38931 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab361a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:38.715486 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35ea6228-bae8-4523-b7ab-9d0022e38931 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1163033683" status: 200 len: 485 microversion: 2.1 time: 0.096140 Oct 24 09:12:38.716441 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2245/4604] 10.222.0.25 () {58 vars in 1231 bytes} [Mon Oct 24 09:12:38 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1163033683 => generated 485 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:38.729614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a58bcee9-1d32-4453-bfa4-9bdc87666f03 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaf14310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:38.769725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:38.781601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-27ca2b0d-c2a1-4754-88b3-7d236c819261 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.958821 Oct 24 09:12:38.785105 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2360/4605] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:37 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:38.844533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:38.875252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:38.907493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:38.913965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:38.914477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:38.921081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:38.923472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:38.924875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:38.942200 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a58bcee9-1d32-4453-bfa4-9bdc87666f03 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?server=205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 958 microversion: 2.1 time: 0.216419 Oct 24 09:12:38.945059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2246/4606] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 09:12:38 2022] GET /compute/v2.1/images?server=205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 958 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:38.958925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4160be7-19f8-41e9-ba4b-2b13de9a6c54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab361b80>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.038715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4160be7-19f8-41e9-ba4b-2b13de9a6c54 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 485 microversion: 2.1 time: 0.084218 Oct 24 09:12:39.039814 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2247/4607] 10.222.0.25 () {58 vars in 1317 bytes} [Mon Oct 24 09:12:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 485 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:12:39.054170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5e51844-4a86-432b-8a14-9af73fcbd298 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab817e50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.163347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:39.172300 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7795a9c-9c54-4f8d-9d81-90af28eb0bb7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1465 microversion: 2.1 time: 0.332463 Oct 24 09:12:39.177044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5e51844-4a86-432b-8a14-9af73fcbd298 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 485 microversion: 2.1 time: 0.128598 Oct 24 09:12:39.178352 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2361/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:38 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1465 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:39.189662 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2248/4609] 10.222.0.25 () {58 vars in 1303 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 485 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:39.207188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7cc30e32-d05a-4657-863f-7267dcbec1a4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab029820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.393256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.394265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] [instance: 02bae9c0-3fc3-4177-a609-de023af87318] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:39.406697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:39.410165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:39.411382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:39.413270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:39.416279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:39.416879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:39.425084 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7cc30e32-d05a-4657-863f-7267dcbec1a4 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.222842 Oct 24 09:12:39.426260 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2362/4610] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:39.444170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-49d91f94-1f6c-4008-8581-f6f45f914ae7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf2bc040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.454021 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] HTTP exception thrown: Instance 02bae9c0-3fc3-4177-a609-de023af87318 could not be found. Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Request method failure captured: Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 HTTP/1.1 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlZxkkME4yJEi1ifgx0zrHFGzcBKcYdMXfMhZ6ocDPB0cvddmInxYW4mJZEqNsHk5DTIP48y5GbEQqp2Q_xEr8pXV36HYPlwdAw7WfnHOW5GRN4XTd6XDbqDuhsT8xpUePvzudisrPNc-JUjwNbA-D1XeSeqAt8oqAxfNQ8TGHzFXPw Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d6c4858fe89d4bfb8b989aa476a58a84 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueTestJSON-1649835141 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6c4858fe89d4bfb8b989aa476a58a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6c4858fe89d4bfb8b989aa476a58a84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6c4858fe89d4bfb8b989aa476a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6c4858fe89d4bfb8b989aa476a58a84"}]}] Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueTestJSON-1649835141 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d6c4858fe89d4bfb8b989aa476a58a84 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueTestJSON-1649835141 Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueTestJSON-1649835141-project Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d271cce474064255b276e240e88bbe0c Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueTestJSON-1649835141-project Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 02bae9c0-3fc3-4177-a609-de023af87318 could not be found. Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '02bae9c0-3fc3-4177-a609-de023af87318'} Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02bae9c0-3fc3-4177-a609-de023af87318 could not be found. Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02bae9c0-3fc3-4177-a609-de023af87318 could not be found. Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:39.459314 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02bae9c0-3fc3-4177-a609-de023af87318 could not be found. Oct 24 09:12:39.463699 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:39.465479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] Returning 404 to user: Instance 02bae9c0-3fc3-4177-a609-de023af87318 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:39.466516 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5433a71d-eccb-408a-a7f9-4c8e25e9419f tempest-ServerRescueTestJSON-1649835141 tempest-ServerRescueTestJSON-1649835141-project] 10.222.0.25 "GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318" status: 404 len: 111 microversion: 2.1 time: 0.078346 Oct 24 09:12:39.467260 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2249/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/servers/02bae9c0-3fc3-4177-a609-de023af87318 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:12:39.542467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-49d91f94-1f6c-4008-8581-f6f45f914ae7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.104195 Oct 24 09:12:39.544428 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2363/4612] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:39.561172 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c7fe5ba-7a1c-406e-b990-acfa07cec675 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf22d430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.643152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c7fe5ba-7a1c-406e-b990-acfa07cec675 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.087582 Oct 24 09:12:39.648973 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2250/4613] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:12:39.663727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a8a8211-7121-449f-a98c-127cb8f79ddd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daad6b700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.783957 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a8a8211-7121-449f-a98c-127cb8f79ddd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-10-24T09%3A10%3A20Z" status: 200 len: 6323 microversion: 2.1 time: 0.126288 Oct 24 09:12:39.786049 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2364/4614] 10.222.0.25 () {58 vars in 1220 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-24T09%3A10%3A20Z => generated 6323 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:39.808324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abd27387-3a1e-4e68-8828-288bb4f82431 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab817790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.833797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.835206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:39.874189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:39.874972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:39.877890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:39.878904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:39.879676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:39.882684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abd27387-3a1e-4e68-8828-288bb4f82431 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1163033683" status: 200 len: 665 microversion: 2.1 time: 0.078406 Oct 24 09:12:39.883155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:39.887534 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2251/4615] 10.222.0.25 () {58 vars in 1252 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1163033683 => generated 665 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:12:39.913737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1b1116e1-3f46-4445-906a-39af8e405d4b tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf22d310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:39.991408 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1b1116e1-3f46-4445-906a-39af8e405d4b tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1463 microversion: 2.1 time: 0.086972 Oct 24 09:12:39.992725 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2252/4616] 10.222.0.25 () {58 vars in 1338 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1463 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:40.012592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-311280bc-0424-4eeb-88dc-a23a34d55f65 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daafad430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:40.117846 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-311280bc-0424-4eeb-88dc-a23a34d55f65 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1463 microversion: 2.1 time: 0.109815 Oct 24 09:12:40.118435 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2253/4617] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Oct 24 09:12:40 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:40.137196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2daf5f8a-29cf-4dc8-b10b-f91857c4437c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab0171f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:40.331774 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2daf5f8a-29cf-4dc8-b10b-f91857c4437c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7098 microversion: 2.1 time: 0.198532 Oct 24 09:12:40.332713 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2254/4618] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 09:12:40 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7098 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:40.337545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:40.338150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:40.362205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:40.362905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:40.363508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:40.365115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:40.366667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:40.373015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:40.511697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:40.522549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e21f6199-271c-49e6-9fa6-d41be69f7150 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.707400 Oct 24 09:12:40.533665 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2365/4619] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:39 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:40.539137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92740c77-8996-43f9-984f-cf6aff50d20c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daadf5280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:40.645565 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92740c77-8996-43f9-984f-cf6aff50d20c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4365 microversion: 2.1 time: 0.104804 Oct 24 09:12:40.651435 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2366/4620] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 09:12:40 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:40.656349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ecbf7fd4-fab0-4530-8985-f9956202e31d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: .version_select at 0x7f8daa2ee9d0>, body: {"keypair": {"name": "tempest-keypair-1593124204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBRY8yqjMsuB1zE2Iv6NfD1hI10kqMTdOwPFAXOVEeqwD9S7sUZniomJHkTnZEwUfNGHitXjYFfHfBxvEKWRVisyy/0A3XFzkoBjRDRqk8xk/CnDersaT2N1i+IefGAXw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:40.716575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ecbf7fd4-fab0-4530-8985-f9956202e31d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:40.722765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ecbf7fd4-fab0-4530-8985-f9956202e31d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:40.766897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:40.777123 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f29eddf3-ceac-46e3-81ca-80c83b6c70a4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1465 microversion: 2.1 time: 0.443050 Oct 24 09:12:40.797405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2255/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:40 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1465 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:40.797630 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ecbf7fd4-fab0-4530-8985-f9956202e31d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134510 Oct 24 09:12:40.797630 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2367/4622] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:12:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:40.798145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b0657a9-b0f1-4b10-a46f-d5ded6e6fe7a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab2291f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:40.850612 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b0657a9-b0f1-4b10-a46f-d5ded6e6fe7a tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2" status: 200 len: 784 microversion: 2.1 time: 0.064421 Oct 24 09:12:40.851217 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2256/4623] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:40 2022] GET /compute/v2.1/images/a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2 => generated 784 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:40.866235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5adf30a-0a54-47e4-afa0-a4f2c310d250 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daad6bc10>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:41.067149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5adf30a-0a54-47e4-afa0-a4f2c310d250 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1607 microversion: 2.1 time: 0.204775 Oct 24 09:12:41.068229 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2368/4624] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 09:12:40 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1607 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:41.084053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29dbea4e-e2a6-46b4-8639-8076a3da4190 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daf22d3a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:41.549539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:41.550167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:41.571832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:41.572527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:41.573219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:41.574733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:41.579730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:41.580459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:41.961865 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29dbea4e-e2a6-46b4-8639-8076a3da4190 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc" status: 204 len: 0 microversion: 2.1 time: 0.881667 Oct 24 09:12:41.964044 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2257/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:41 2022] DELETE /compute/v2.1/images/9ed8b129-15e3-4151-a4a4-a2b9e53b02bc => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:41.970536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:41.971454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:42.000817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:42.001337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:42.001779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:42.002513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:42.002953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:42.003380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:42.294289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:42.303831 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f59bf047-7510-46c9-93ff-6ef9c400ae75 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.758399 Oct 24 09:12:42.310150 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2369/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:41 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:42.331305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2e28a1a-e8de-4627-a143-f5da61395495 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daad6b160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:42.458166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:42.469147 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d8cd96a-535d-4674-a0a6-5a9cc78de141 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1465 microversion: 2.1 time: 0.502335 Oct 24 09:12:42.470260 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2258/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:41 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1465 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:42.481543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5dcc9c2c-ad11-4cb5-99f1-6a8dd138ace7 req-d397f496-c74b-49f6-81f6-21d9e62ad0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "name": "network-vif-unplugged", "status": "completed", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:42.528019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5dcc9c2c-ad11-4cb5-99f1-6a8dd138ace7 req-d397f496-c74b-49f6-81f6-21d9e62ad0f3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:42.528508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5dcc9c2c-ad11-4cb5-99f1-6a8dd138ace7 req-d397f496-c74b-49f6-81f6-21d9e62ad0f3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:42.531201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5dcc9c2c-ad11-4cb5-99f1-6a8dd138ace7 req-d397f496-c74b-49f6-81f6-21d9e62ad0f3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:42.559908 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5dcc9c2c-ad11-4cb5-99f1-6a8dd138ace7 req-d397f496-c74b-49f6-81f6-21d9e62ad0f3 service nova] Creating event network-vif-unplugged:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:12:42.577876 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5dcc9c2c-ad11-4cb5-99f1-6a8dd138ace7 req-d397f496-c74b-49f6-81f6-21d9e62ad0f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101156 Oct 24 09:12:42.578775 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2259/4628] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:42.981621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bce282b3-1247-42f1-af93-2d41e47aad68 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Action: 'create', calling method: .version_select at 0x7f8dab115a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:43.043743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bce282b3-1247-42f1-af93-2d41e47aad68 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Getting quotas for project 1d3b5e6b605e4c109a407f253b5aac17. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:43.051010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bce282b3-1247-42f1-af93-2d41e47aad68 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Getting quotas for user 32660741092146d490982e08873cfb04 and project 1d3b5e6b605e4c109a407f253b5aac17. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:43.178660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bce282b3-1247-42f1-af93-2d41e47aad68 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Getting quotas for project 1d3b5e6b605e4c109a407f253b5aac17. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:43.190561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bce282b3-1247-42f1-af93-2d41e47aad68 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Getting quotas for user 32660741092146d490982e08873cfb04 and project 1d3b5e6b605e4c109a407f253b5aac17. Resources: {'server_groups'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:43.254461 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2e28a1a-e8de-4627-a143-f5da61395495 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a" status: 204 len: 0 microversion: 2.1 time: 0.927354 Oct 24 09:12:43.255978 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2370/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:42 2022] DELETE /compute/v2.1/images/f9c8c507-5090-442a-925c-4fdca52fd99a => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:43.260088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bce282b3-1247-42f1-af93-2d41e47aad68 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.679089 Oct 24 09:12:43.260977 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2260/4630] 10.222.0.25 () {62 vars in 1214 bytes} [Mon Oct 24 09:12:42 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:12:43.264387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b0be107-aecf-42c9-b2ea-4179e9789df0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daa4b7ee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:43.273204 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e0ce42d-b882-4781-bc74-2b0f0904a398 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:43.336849 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e0ce42d-b882-4781-bc74-2b0f0904a398 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.067869 Oct 24 09:12:43.338276 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2261/4631] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Oct 24 09:12:43 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:12:43.352697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:43.356271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:43.372095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:43.372847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:43.373759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:43.375162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:43.376241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:43.376834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:43.841927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:43.860177 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd183b50-069e-4123-b669-c6e54bf8d263 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.515342 Oct 24 09:12:43.862002 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2262/4632] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:43 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:43.882061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db1ce1c3-d2db-4dbf-b7a2-c6f89ac39f8d tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:43.903434 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db1ce1c3-d2db-4dbf-b7a2-c6f89ac39f8d tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2" status: 200 len: 235 microversion: 2.64 time: 0.036618 Oct 24 09:12:43.916828 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2263/4633] 10.222.0.25 () {60 vars in 1304 bytes} [Mon Oct 24 09:12:43 2022] GET /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2 => generated 235 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:12:43.923447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:43.924936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:43.939227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:43.939851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:43.940402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:43.941207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:43.942096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:43.942744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:43.991720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:43.993078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:43.993856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:43.994677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lazy-loading 'fault' on Instance uuid 5b273911-e702-419e-92a1-9f18adb1ef82 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:44.093939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:44.111086 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e60dd751-3725-440a-b68e-e2a76985a3ff tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 200 len: 1305 microversion: 2.1 time: 0.192801 Oct 24 09:12:44.111981 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2264/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:43 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:44.116645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0d15a214-8562-46bd-a2e1-eae4ba34cb89 req-c633799d-9b12-482d-a38e-d520e199a007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b273911-e702-419e-92a1-9f18adb1ef82", "name": "network-vif-deleted", "tag": "a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:44.127182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d15a214-8562-46bd-a2e1-eae4ba34cb89 req-c633799d-9b12-482d-a38e-d520e199a007 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.127893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d15a214-8562-46bd-a2e1-eae4ba34cb89 req-c633799d-9b12-482d-a38e-d520e199a007 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.128527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d15a214-8562-46bd-a2e1-eae4ba34cb89 req-c633799d-9b12-482d-a38e-d520e199a007 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.148225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b0be107-aecf-42c9-b2ea-4179e9789df0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45" status: 204 len: 0 microversion: 2.1 time: 0.886093 Oct 24 09:12:44.151380 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:44.152237 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2371/4635] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:43 2022] DELETE /compute/v2.1/images/ee03fba6-98d8-4e42-8059-6ac8ae35df45 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:12:44.158163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c98fc7be-ff8e-4efe-9f43-f015731810aa tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:44.160634 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0d15a214-8562-46bd-a2e1-eae4ba34cb89 req-c633799d-9b12-482d-a38e-d520e199a007 service nova] Creating event network-vif-deleted:a4e6ba42-6d60-4b1e-be4c-e485d5af2fb5 for instance 5b273911-e702-419e-92a1-9f18adb1ef82 on n-h1-master-1 Oct 24 09:12:44.179481 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0d15a214-8562-46bd-a2e1-eae4ba34cb89 req-c633799d-9b12-482d-a38e-d520e199a007 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066103 Oct 24 09:12:44.180690 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2265/4636] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:44.186221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:44.186815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:44.207554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.208072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.208565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.210233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.210702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.211146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.217614 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c98fc7be-ff8e-4efe-9f43-f015731810aa tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2" status: 204 len: 0 microversion: 2.64 time: 0.063985 Oct 24 09:12:44.226042 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2372/4637] 10.222.0.25 () {60 vars in 1307 bytes} [Mon Oct 24 09:12:44 2022] DELETE /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:12:44.234732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c7ed7d2-23ad-4bce-af1b-a13744304162 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:44.248095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8c7ed7d2-23ad-4bce-af1b-a13744304162 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] HTTP exception thrown: Instance group 1184e411-45ac-43a6-a51c-f5889468f5b2 could not be found. Oct 24 09:12:44.262001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c7ed7d2-23ad-4bce-af1b-a13744304162 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Request method failure captured: Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2 HTTP/1.1 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlcK8ePh5hBkriF6PWallvA1WjsiOXAQccL4V_VPM_BIx0cmKQWZ6SkS9I27TVA9pvR12lqBdSkvmkP4YCKzctRI0ORIgE4Rk3mHEBGriU3xZ3Q-TYP8DMPzoFNIzb-jalr_Lg-8VN8v29YOF5UwlElsolv6sc2hHiQnv90r_qrTAe4 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.64 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 1d3b5e6b605e4c109a407f253b5aac17 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerGroup264TestJSON-816875637 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d3b5e6b605e4c109a407f253b5aac17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1d3b5e6b605e4c109a407f253b5aac17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1d3b5e6b605e4c109a407f253b5aac17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1d3b5e6b605e4c109a407f253b5aac17"}]}] Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerGroup264TestJSON-816875637 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 1d3b5e6b605e4c109a407f253b5aac17 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerGroup264TestJSON-816875637 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerGroup264TestJSON-816875637-project Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 32660741092146d490982e08873cfb04 Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerGroup264TestJSON-816875637-project Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: exception: Instance group 1184e411-45ac-43a6-a51c-f5889468f5b2 could not be found. Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1184e411-45ac-43a6-a51c-f5889468f5b2'} Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1184e411-45ac-43a6-a51c-f5889468f5b2 could not be found. Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1184e411-45ac-43a6-a51c-f5889468f5b2 could not be found. Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:44.275578 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:44.280001 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:44.280001 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:44.280001 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:44.280001 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:44.280001 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1184e411-45ac-43a6-a51c-f5889468f5b2 could not be found. Oct 24 09:12:44.280001 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:44.281899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c7ed7d2-23ad-4bce-af1b-a13744304162 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] Returning 404 to user: Instance group 1184e411-45ac-43a6-a51c-f5889468f5b2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:44.283096 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c7ed7d2-23ad-4bce-af1b-a13744304162 tempest-ServerGroup264TestJSON-816875637 tempest-ServerGroup264TestJSON-816875637-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2" status: 404 len: 117 microversion: 2.64 time: 0.055316 Oct 24 09:12:44.284041 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2373/4638] 10.222.0.25 () {60 vars in 1307 bytes} [Mon Oct 24 09:12:44 2022] DELETE /compute/v2.1/os-server-groups/1184e411-45ac-43a6-a51c-f5889468f5b2 => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:12:44.477913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8da8d518-0d83-493e-97d7-069e9c8d36da tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 204 len: 0 microversion: 2.1 time: 0.294129 Oct 24 09:12:44.479757 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2266/4639] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:44 2022] DELETE /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:44.498446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:44.499370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:44.518431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.519816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.520503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.522460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.524003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.524756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.613759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c7d416d4-a275-4c5b-89fb-523287017464 req-ecddb5ed-f16e-4871-966d-eb70fd8f537c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a89b67-84a8-4db6-91b5-8fee01aa2cde", "name": "network-vif-plugged", "status": "completed", "tag": "0595c8fb-9aef-49d8-88f3-3520640918fc"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:44.634039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7d416d4-a275-4c5b-89fb-523287017464 req-ecddb5ed-f16e-4871-966d-eb70fd8f537c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.634578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7d416d4-a275-4c5b-89fb-523287017464 req-ecddb5ed-f16e-4871-966d-eb70fd8f537c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.635026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7d416d4-a275-4c5b-89fb-523287017464 req-ecddb5ed-f16e-4871-966d-eb70fd8f537c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.668567 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c7d416d4-a275-4c5b-89fb-523287017464 req-ecddb5ed-f16e-4871-966d-eb70fd8f537c service nova] Creating event network-vif-plugged:0595c8fb-9aef-49d8-88f3-3520640918fc for instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde on n-h1-master-1 Oct 24 09:12:44.677523 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c7d416d4-a275-4c5b-89fb-523287017464 req-ecddb5ed-f16e-4871-966d-eb70fd8f537c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067677 Oct 24 09:12:44.678718 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2267/4640] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:44.889550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:44.890416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:44.905902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.906434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.906997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:44.909557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:44.910080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:44.910745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.298600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:45.312041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb3ae627-3c32-4e94-ad21-3a2e8c52e718 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1474 microversion: 2.1 time: 0.825032 Oct 24 09:12:45.312836 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2374/4641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:44 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1474 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:45.329870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:45.330844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 5b273911-e702-419e-92a1-9f18adb1ef82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:45.340721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:45.341231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:45.341708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.342710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:45.342898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:45.343327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.391676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] HTTP exception thrown: Instance 5b273911-e702-419e-92a1-9f18adb1ef82 could not be found. Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Request method failure captured: Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 HTTP/1.1 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlT-Gwl-QL4RmTnmqxij31goZNj1DohdSNDs5nmArEp82KeeRin_XKj9vYVMxI3moiVuuii5bAUuyG1jpFWdoiqWSoqjt-4f9s2X2R4RFGpH0ZkRJguuLpkyMcWuw0UfdTx6-vCaFDNZCH4c5yQQZrz2t_yj87_WXCyQAVc2NSrsZrE Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be8fffe9b0994ded9f07301735105917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be8fffe9b0994ded9f07301735105917"}]}] Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c703cc73a22749858ffe05500e52aa03 Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 5b273911-e702-419e-92a1-9f18adb1ef82 could not be found. Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '5b273911-e702-419e-92a1-9f18adb1ef82'} Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b273911-e702-419e-92a1-9f18adb1ef82 could not be found. Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b273911-e702-419e-92a1-9f18adb1ef82 could not be found. Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:45.393307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b273911-e702-419e-92a1-9f18adb1ef82 could not be found. Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:45.397324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Returning 404 to user: Instance 5b273911-e702-419e-92a1-9f18adb1ef82 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:45.401154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ff83ccb-dff3-4a9c-9666-2790f7413948 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82" status: 404 len: 111 microversion: 2.1 time: 0.085041 Oct 24 09:12:45.405418 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2375/4642] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:45 2022] GET /compute/v2.1/servers/5b273911-e702-419e-92a1-9f18adb1ef82 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:45.416580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:45.417325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:45.433648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:45.436253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:45.441333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.442338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:45.442827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:45.443761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.488177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:45.650026 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f83b5fa8-afe8-42fa-940a-5ad367e30a80 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 204 len: 0 microversion: 2.1 time: 0.243005 Oct 24 09:12:45.650820 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2376/4643] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:45 2022] DELETE /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:45.660361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:45.666487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:45.677355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:45.678380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:45.678833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.679554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:45.680021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:45.680457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:45.857554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:45.866118 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33f88e12-4d17-47cc-b59e-ad4078527646 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.984354 Oct 24 09:12:45.870061 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2268/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:44 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:46.336622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:46.337232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:46.351135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:46.351627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:46.352063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:46.352376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:46.352861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:46.353206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:46.353650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:46.368447 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-235d0004-c2ab-42be-8e96-e7a24aa498df tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1507 microversion: 2.1 time: 0.712373 Oct 24 09:12:46.371502 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2377/4645] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:45 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1507 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:46.896650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:46.896839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:46.913061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:46.913604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:46.914273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:46.915877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:46.917773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:46.921526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:47.014763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:47.047561 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7665b044-12b0-4c6f-ae28-06f7ce9dedf3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1474 microversion: 2.1 time: 0.715141 Oct 24 09:12:47.050222 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2269/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:46 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1474 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:47.394932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:47.396464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:47.427454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:47.428631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:47.429465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:47.430726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:47.433272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:47.433998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:48.086351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:48.096706 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce502f5f-b97f-4c68-b05f-7a3c10718b17 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 1.204444 Oct 24 09:12:48.111971 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2378/4647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:46 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:48.111971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:48.112569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:48.131744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:48.132546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:48.133861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:48.135648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:48.145369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:48.146126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:48.575855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:48.588459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01d64cb4-ff13-45c1-b83f-7c7dbecd43bc tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1474 microversion: 2.1 time: 0.488590 Oct 24 09:12:48.590144 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2379/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:48 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1474 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:49.123823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:49.125355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:49.155326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:49.160892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:49.162208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:49.169162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:49.170189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:49.171214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:49.479611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:49.488586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37853c71-f4f6-4f22-b8b5-f1e445cffb1f tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1507 microversion: 2.1 time: 2.097909 Oct 24 09:12:49.489287 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2270/4649] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:47 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1507 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:49.522911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1955615336", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcfcdb25-90f0-4d8a-8f56-0850a24cf320"}], "security_groups": [{"name": "tempest-securitygroup--900830139"}], "key_name": "tempest-keypair-1593124204", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:49.576060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:49.585575 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbd48c58-f7d4-45d8-a799-ca0762379166 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1313 microversion: 2.1 time: 0.467468 Oct 24 09:12:49.589885 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2380/4650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:49 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:49.624549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:49.628291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:49.640596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:49.641430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:49.642092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:49.643005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:49.643664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:49.644310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:50.043762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] validate_networks() for [('bcfcdb25-90f0-4d8a-8f56-0850a24cf320', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:12:50.195843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:50.208480 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:50.251812 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-51250ba1-a5de-45c5-b4da-fef0e524cb23 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 200 len: 1474 microversion: 2.1 time: 0.639282 Oct 24 09:12:50.253208 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2381/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:49 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 1474 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:50.515841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:50.516801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:50.532525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:50.533040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:50.533520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:50.535105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:50.535749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:50.536666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:50.739160 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:51.213350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:51.236747 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ffdbbe4-53ca-4924-8676-2276dae6306d tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 200 len: 1465 microversion: 2.1 time: 0.724581 Oct 24 09:12:51.243251 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2382/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:50 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 1465 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:51.249846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a21626ca-bad0-4092-9b46-ea4027373f21 req-a8560ea3-2f14-4362-84cf-585a802473f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382e3bdd-c519-41a4-9ebc-957c37059d41", "name": "network-vif-deleted", "tag": "1cd1b987-13bb-4075-be4b-149af14dc5ee"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:51.275979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a21626ca-bad0-4092-9b46-ea4027373f21 req-a8560ea3-2f14-4362-84cf-585a802473f6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:51.276604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a21626ca-bad0-4092-9b46-ea4027373f21 req-a8560ea3-2f14-4362-84cf-585a802473f6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:51.279919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a21626ca-bad0-4092-9b46-ea4027373f21 req-a8560ea3-2f14-4362-84cf-585a802473f6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:51.297233 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a21626ca-bad0-4092-9b46-ea4027373f21 req-a8560ea3-2f14-4362-84cf-585a802473f6 service nova] Creating event network-vif-deleted:1cd1b987-13bb-4075-be4b-149af14dc5ee for instance 382e3bdd-c519-41a4-9ebc-957c37059d41 on n-h1-master-1 Oct 24 09:12:51.305904 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a21626ca-bad0-4092-9b46-ea4027373f21 req-a8560ea3-2f14-4362-84cf-585a802473f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059173 Oct 24 09:12:51.307615 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2383/4653] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:51.313185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:51.314393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:51.323849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:51.326068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:51.327077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:51.328156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:51.328892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:51.330248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:51.801024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:51.814637 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d01e86f9-5837-46bc-862d-06bbe703afe4 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1498 microversion: 2.1 time: 0.505558 Oct 24 09:12:51.817806 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2384/4654] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:51 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1498 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:51.853170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:51.854071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 382e3bdd-c519-41a4-9ebc-957c37059d41] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:51.870251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:51.875786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:51.876960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:51.881531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:51.882230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:51.882856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:51.913816 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] HTTP exception thrown: Instance 382e3bdd-c519-41a4-9ebc-957c37059d41 could not be found. Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Request method failure captured: Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 HTTP/1.1 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlZ799N7bdsdR6L5L7pxfvnEbP5jneeqIycfzAiybS_fOVqCB8BtEgCBL4mnbbR3q4JJEF7nUCspxA0SihyN1IPc0iDctXk81fny8z8VRh5DBHABEghkwbsVfxxVk3MTwj7EaGGhRfnhlIP-qbhLVj1dnDltgqoFDFnTxIHVAu1uksg Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 062ef54f319941dda2c197b8f71d2a7e Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListImageFiltersTestJSON-92290805 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/062ef54f319941dda2c197b8f71d2a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_062ef54f319941dda2c197b8f71d2a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/062ef54f319941dda2c197b8f71d2a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/062ef54f319941dda2c197b8f71d2a7e"}]}] Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListImageFiltersTestJSON-92290805 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 062ef54f319941dda2c197b8f71d2a7e Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-92290805 Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListImageFiltersTestJSON-92290805-project Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: af8778dae08a4ab6b012ceda5af5564e Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListImageFiltersTestJSON-92290805-project Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 382e3bdd-c519-41a4-9ebc-957c37059d41 could not be found. Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '382e3bdd-c519-41a4-9ebc-957c37059d41'} Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 382e3bdd-c519-41a4-9ebc-957c37059d41 could not be found. Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 382e3bdd-c519-41a4-9ebc-957c37059d41 could not be found. Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:51.917705 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 382e3bdd-c519-41a4-9ebc-957c37059d41 could not be found. Oct 24 09:12:51.924393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:51.927879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Returning 404 to user: Instance 382e3bdd-c519-41a4-9ebc-957c37059d41 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:51.929710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb2eaf0a-84f4-4dff-9679-06c2bfa207d0 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41" status: 404 len: 111 microversion: 2.1 time: 0.109963 Oct 24 09:12:51.933971 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2385/4655] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:51 2022] GET /compute/v2.1/servers/382e3bdd-c519-41a4-9ebc-957c37059d41 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:51.952155 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-948734d7-fe77-4291-b891-93ff415f4203 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:51.969533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_groups [None req-948734d7-fe77-4291-b891-93ff415f4203 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Querying cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) for 1 instances {{(pid=126920) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 09:12:51.970613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-948734d7-fe77-4291-b891-93ff415f4203 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:51.974105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-948734d7-fe77-4291-b891-93ff415f4203 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:51.974799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-948734d7-fe77-4291-b891-93ff415f4203 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.010942 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-948734d7-fe77-4291-b891-93ff415f4203 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/47afd99c-8fef-4d4a-901e-b65c113409c8" status: 200 len: 221 microversion: 2.1 time: 0.075725 Oct 24 09:12:52.012153 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2386/4656] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:12:51 2022] GET /compute/v2.1/os-server-groups/47afd99c-8fef-4d4a-901e-b65c113409c8 => generated 221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:52.018025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:52.018873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:52.025810 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:52.029059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.030013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.030756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.032061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.032989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.033731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.091745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:52.214964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:12:52.215560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:12:52.216175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:12:52.216868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:12:52.217504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:12:52.248677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.251664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.252266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.256822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.260570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.261686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.342235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:52.350267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:12:52.351582 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c27c586-044c-4f4d-aadf-1fe7b6ade3df tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 204 len: 0 microversion: 2.1 time: 0.337649 Oct 24 09:12:52.352394 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2387/4657] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:52 2022] DELETE /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:52.360649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:52.361253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:52.373749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.374262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.374768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.375206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:12:52.379078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:12:52.381127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.381748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.382213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.438350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:52.445951 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96d58442-1a94-4732-89cf-8208ccf84e62 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.931837 Oct 24 09:12:52.447841 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2271/4658] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:12:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:12:52.457256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:52.457903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: d345468d-80a3-4cc4-a6c7-d25cabb0c9b8] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:52.465105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.465621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.466060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.466786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.467232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.467654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.484033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] HTTP exception thrown: Instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 could not be found. Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Request method failure captured: Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 HTTP/1.1 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlT-Gwl-QL4RmTnmqxij31goZNj1DohdSNDs5nmArEp82KeeRin_XKj9vYVMxI3moiVuuii5bAUuyG1jpFWdoiqWSoqjt-4f9s2X2R4RFGpH0ZkRJguuLpkyMcWuw0UfdTx6-vCaFDNZCH4c5yQQZrz2t_yj87_WXCyQAVc2NSrsZrE Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be8fffe9b0994ded9f07301735105917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be8fffe9b0994ded9f07301735105917"}]}] Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c703cc73a22749858ffe05500e52aa03 Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: exception: Instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 could not be found. Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'd345468d-80a3-4cc4-a6c7-d25cabb0c9b8'} Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 could not be found. Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 could not be found. Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:52.486124 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 could not be found. Oct 24 09:12:52.490719 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:52.492092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Returning 404 to user: Instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:52.493251 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-696bc066-3b27-45d1-aa38-f18043829256 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8" status: 404 len: 111 microversion: 2.1 time: 0.044130 Oct 24 09:12:52.494495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2272/4659] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:52 2022] GET /compute/v2.1/servers/d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:52.501179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:52.502217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:52.510510 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:52.513067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.514500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.515147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.516025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.516805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.517405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.653453 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b1c2345-bf7e-48fd-a029-b33b5cce6973 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 204 len: 0 microversion: 2.1 time: 0.294016 Oct 24 09:12:52.654149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2388/4660] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:52 2022] DELETE /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:52.675188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15abd257-1e22-4503-b5a5-c21d371daac3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:52.682635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-15abd257-1e22-4503-b5a5-c21d371daac3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:52.804336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-15abd257-1e22-4503-b5a5-c21d371daac3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:52.822051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15abd257-1e22-4503-b5a5-c21d371daac3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1242 microversion: 2.1 time: 0.157501 Oct 24 09:12:52.824425 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2389/4661] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:52 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:52.844821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:52.845642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:52.885418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.886179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.887102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.888019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:52.888641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:52.890069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:52.960997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:52.976014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:53.011760 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f90a461-73bb-47dc-b67e-ed022c1e1ac7 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1473 microversion: 2.1 time: 0.512215 Oct 24 09:12:53.019078 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2273/4662] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:52 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1473 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:53.049446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:53.050489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:53.063281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.064115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.065219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.066181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.066804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.067398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.289109 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cda2798c-f147-46f7-ad44-61bc1ad843d4 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 204 len: 0 microversion: 2.1 time: 0.462121 Oct 24 09:12:53.295619 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2390/4663] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:52 2022] DELETE /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:53.316616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:53.322029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:53.340727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.342530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.344538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.347723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.348447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.350935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.519691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:53.529755 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2eb729fd-93b1-462e-87d0-0ab2a5242edb tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1504 microversion: 2.1 time: 0.508719 Oct 24 09:12:53.530352 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2274/4664] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:53 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:53.556171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1c0beb21-2a8f-4136-9911-49a4965621c6 req-1c551b17-5639-418d-8840-40f7d4aeb443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d345468d-80a3-4cc4-a6c7-d25cabb0c9b8", "name": "network-vif-deleted", "tag": "9924c37c-e0ea-4b2b-85c3-193d00b9de74"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:53.566089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1c0beb21-2a8f-4136-9911-49a4965621c6 req-1c551b17-5639-418d-8840-40f7d4aeb443 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.566859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1c0beb21-2a8f-4136-9911-49a4965621c6 req-1c551b17-5639-418d-8840-40f7d4aeb443 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.567468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1c0beb21-2a8f-4136-9911-49a4965621c6 req-1c551b17-5639-418d-8840-40f7d4aeb443 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.580405 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1c0beb21-2a8f-4136-9911-49a4965621c6 req-1c551b17-5639-418d-8840-40f7d4aeb443 service nova] Creating event network-vif-deleted:9924c37c-e0ea-4b2b-85c3-193d00b9de74 for instance d345468d-80a3-4cc4-a6c7-d25cabb0c9b8 on n-h2-master-1 Oct 24 09:12:53.586859 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1c0beb21-2a8f-4136-9911-49a4965621c6 req-1c551b17-5639-418d-8840-40f7d4aeb443 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035146 Oct 24 09:12:53.587961 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2275/4665] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:53.850707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:53.851425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:53.861101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.861626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.862067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.865918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:53.866399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:53.866842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:53.897716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:53.914097 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b6c7ab5-ef47-4a30-9a7f-c914f6f7ba8a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1494 microversion: 2.1 time: 0.616055 Oct 24 09:12:53.914838 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2391/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:53 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1494 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:53.988713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:53.997661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78573190-b01d-4af0-b225-f64d6ad77542 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1246 microversion: 2.1 time: 0.153170 Oct 24 09:12:53.998948 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2276/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:53 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1246 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:54.035585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:54.036205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:54.049198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:54.050141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:54.050905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:54.052902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:54.053583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:54.054638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:54.560238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:54.561547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:54.571555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:54.572447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:54.573280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:54.574425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:54.575157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:54.575810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:54.941260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:54.961839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-654efb5f-db6f-4ed1-8d41-5216af2d71f3 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1473 microversion: 2.1 time: 0.921975 Oct 24 09:12:54.978024 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2392/4668] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:54 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1473 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:54.997226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:54.998229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:55.012148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:55.034312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:55.034772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:55.035612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:55.036256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:55.037255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:55.667064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:55.675840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd772864-2ccf-4f7b-bef4-ddeec8dc10a2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1494 microversion: 2.1 time: 0.696093 Oct 24 09:12:55.688771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2393/4669] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:54 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1494 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:55.699840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:55.700546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:55.706836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:55.707332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:55.707776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:55.708484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:55.709562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:55.709997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:55.891367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:55.901022 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca4a56f9-4c86-4aea-88bd-0e17f56def26 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1300 microversion: 2.1 time: 0.206464 Oct 24 09:12:55.912749 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2394/4670] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:55 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:55.988858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:55.989713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:55.999218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:55.999844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.001353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.004124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.004866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.007018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.027767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:56.042400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2949daf9-8d0e-4b3c-aabe-2157318ad8a2 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1504 microversion: 2.1 time: 1.487858 Oct 24 09:12:56.057322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2277/4671] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:54 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1504 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:12:56.259382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c4305d37-da19-4717-a569-ae90d392fb53 req-ce7a0b6f-8d21-4e2f-9a37-5dc9399bfa3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2129433-b09b-4e75-93cc-db0ee3d987f1", "name": "network-vif-deleted", "tag": "713963e9-7e12-49dc-a9c2-8143e0d22a2f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:56.292645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c4305d37-da19-4717-a569-ae90d392fb53 req-ce7a0b6f-8d21-4e2f-9a37-5dc9399bfa3c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.293245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c4305d37-da19-4717-a569-ae90d392fb53 req-ce7a0b6f-8d21-4e2f-9a37-5dc9399bfa3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.293796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c4305d37-da19-4717-a569-ae90d392fb53 req-ce7a0b6f-8d21-4e2f-9a37-5dc9399bfa3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.315694 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c4305d37-da19-4717-a569-ae90d392fb53 req-ce7a0b6f-8d21-4e2f-9a37-5dc9399bfa3c service nova] Creating event network-vif-deleted:713963e9-7e12-49dc-a9c2-8143e0d22a2f for instance c2129433-b09b-4e75-93cc-db0ee3d987f1 on n-h1-master-1 Oct 24 09:12:56.322142 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c4305d37-da19-4717-a569-ae90d392fb53 req-ce7a0b6f-8d21-4e2f-9a37-5dc9399bfa3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077544 Oct 24 09:12:56.323279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2278/4672] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:12:56.643200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:56.657156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0bce4442-096f-496d-8220-8bbeea3a6535 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1473 microversion: 2.1 time: 0.675150 Oct 24 09:12:56.658204 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2395/4673] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:55 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1473 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:56.704484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:56.705493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:56.712226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.713376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.714077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.715077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.715749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.716404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.762350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.763036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.763634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.765353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lazy-loading 'fault' on Instance uuid c2129433-b09b-4e75-93cc-db0ee3d987f1 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:56.924747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:56.925705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:56.933050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.934086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.934782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.935814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:56.936521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:56.937277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:56.944674 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:57.052633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:57.069360 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5755527-43f1-4ac8-955f-ef1d90d341ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1300 microversion: 2.1 time: 0.148982 Oct 24 09:12:57.088110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2396/4674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:56 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1300 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:57.099047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:57.105339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:57.106207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:57.115815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:57.117264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:57.117788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:57.119853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:57.120332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:57.120855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:57.123609 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d89b4485-1089-4c8b-b0f9-1d8714a2908a tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 200 len: 1304 microversion: 2.1 time: 0.423478 Oct 24 09:12:57.144827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2279/4675] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:56 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 1304 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:57.682007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:57.683304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:57.707246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:57.707929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:57.708390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:57.717040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:57.717574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:57.718121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:57.872585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cc22ca64db4c86827f1262cdddf2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a93a7edd7324574b19ec5c7847f9f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:57.883815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:57.898149 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65d46e77-3f94-49cf-9769-99955e8018a8 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1431 microversion: 2.1 time: 0.221545 Oct 24 09:12:57.898756 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2280/4676] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:57 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1431 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:57.911558 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e34681d-3a03-4cff-96fa-495b6900e48d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 200 len: 1504 microversion: 2.1 time: 0.804870 Oct 24 09:12:57.911558 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2397/4677] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:57 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 1504 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:58.103315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:58.110198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:58.117146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.117900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.118545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.119488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.120148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.120779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.150521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:58.151404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: c2129433-b09b-4e75-93cc-db0ee3d987f1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:58.168485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.171810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.174535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.175409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.175897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.176338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.235514 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] HTTP exception thrown: Instance c2129433-b09b-4e75-93cc-db0ee3d987f1 could not be found. Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Request method failure captured: Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 HTTP/1.1 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlT-Gwl-QL4RmTnmqxij31goZNj1DohdSNDs5nmArEp82KeeRin_XKj9vYVMxI3moiVuuii5bAUuyG1jpFWdoiqWSoqjt-4f9s2X2R4RFGpH0ZkRJguuLpkyMcWuw0UfdTx6-vCaFDNZCH4c5yQQZrz2t_yj87_WXCyQAVc2NSrsZrE Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be8fffe9b0994ded9f07301735105917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be8fffe9b0994ded9f07301735105917"}]}] Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c703cc73a22749858ffe05500e52aa03 Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c2129433-b09b-4e75-93cc-db0ee3d987f1 could not be found. Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c2129433-b09b-4e75-93cc-db0ee3d987f1'} Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2129433-b09b-4e75-93cc-db0ee3d987f1 could not be found. Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2129433-b09b-4e75-93cc-db0ee3d987f1 could not be found. Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:58.239069 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2129433-b09b-4e75-93cc-db0ee3d987f1 could not be found. Oct 24 09:12:58.243437 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:58.245613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Returning 404 to user: Instance c2129433-b09b-4e75-93cc-db0ee3d987f1 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:58.253284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c460aa17-2818-407b-9e66-ab6947100f48 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1" status: 404 len: 111 microversion: 2.1 time: 0.107213 Oct 24 09:12:58.253917 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2281/4678] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:58 2022] GET /compute/v2.1/servers/c2129433-b09b-4e75-93cc-db0ee3d987f1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:12:58.262422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:58.267094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:58.285138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.290143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.291455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.292408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.294336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.295605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.365067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:12:58.488055 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:58.543671 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15480756-17a7-4aba-91a3-eaa39847a0d2 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 204 len: 0 microversion: 2.1 time: 0.284344 Oct 24 09:12:58.546597 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2282/4679] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:58 2022] DELETE /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:12:58.556443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a89b67-84a8-4db6-91b5-8fee01aa2cde", "name": "network-vif-deleted", "tag": "0595c8fb-9aef-49d8-88f3-3520640918fc"}, {"server_uuid": "205af3f7-8221-43a4-bbbf-8d792ed081c0", "name": "network-vif-deleted", "tag": "5c3b4357-5427-442d-b1fa-01a2b7d726c3"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:58.569414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:58.573522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.574132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.574668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.583347 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-343e0239-9368-4548-823f-66233a9c0c00 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1300 microversion: 2.1 time: 0.488539 Oct 24 09:12:58.586121 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2398/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:58 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1300 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:58.603090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:58.604890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:58.608984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] Creating event network-vif-deleted:0595c8fb-9aef-49d8-88f3-3520640918fc for instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde on n-h1-master-1 Oct 24 09:12:58.609620 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] Creating event network-vif-deleted:5c3b4357-5427-442d-b1fa-01a2b7d726c3 for instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 on n-h2-master-1 Oct 24 09:12:58.620109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.620928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.621623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.622583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.622996 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4e152757-c166-45b5-9e13-2bd3d33df053 req-4a45a9b4-8174-4872-bd6f-4e5cd112225b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075257 Oct 24 09:12:58.623491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.623919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2283/4681] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:58.624464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.931260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:58.932307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:58.943613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.945020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.945868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:58.946798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:58.947975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:58.948657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.048057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.048638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.049212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.049764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lazy-loading 'fault' on Instance uuid 205af3f7-8221-43a4-bbbf-8d792ed081c0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:12:59.132927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8778dae08a4ab6b012ceda5af5564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ef54f319941dda2c197b8f71d2a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:59.158128 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bcc666f5-b2cb-4786-b21d-11936ff5c7dd tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 200 len: 1308 microversion: 2.1 time: 0.231995 Oct 24 09:12:59.179315 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2284/4682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:58 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:59.188014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.188645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:59.196105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:12:59.198229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.198726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.199160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.199989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.200451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.200881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.210170 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23e0324e-0616-4806-a7d4-b94219663f61 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1674 microversion: 2.1 time: 0.611574 Oct 24 09:12:59.214245 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2399/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:58 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1674 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:12:59.237087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde HTTP/1.1 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b2a89b67-84a8-4db6-91b5-8fee01aa2cde'} Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.239779 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-741cc2f3-9432-4ad3-a23b-1d1764dc3011 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 404 len: 111 microversion: 2.1 time: 0.059359 Oct 24 09:12:59.249457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2285/4684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:59 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:59.253794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b23f481-0844-4d53-9e10-eaae6e691a57 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.270145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_groups [None req-0b23f481-0844-4d53-9e10-eaae6e691a57 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Querying cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) for 1 instances {{(pid=126920) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 09:12:59.270872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b23f481-0844-4d53-9e10-eaae6e691a57 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.271355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b23f481-0844-4d53-9e10-eaae6e691a57 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.271791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b23f481-0844-4d53-9e10-eaae6e691a57 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.294616 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b23f481-0844-4d53-9e10-eaae6e691a57 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.045528 Oct 24 09:12:59.295211 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2400/4685] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:12:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:59.308550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f09bad12-fd45-4b3d-bfa2-543b56a5a760 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.355419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.server_groups [None req-f09bad12-fd45-4b3d-bfa2-543b56a5a760 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Querying cell 49a311bb-62b1-4843-b101-e8316c1df8dd(cell1) for 1 instances {{(pid=126919) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 09:12:59.359884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09bad12-fd45-4b3d-bfa2-543b56a5a760 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.361775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09bad12-fd45-4b3d-bfa2-543b56a5a760 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.362233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09bad12-fd45-4b3d-bfa2-543b56a5a760 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.376130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f09bad12-fd45-4b3d-bfa2-543b56a5a760 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/47afd99c-8fef-4d4a-901e-b65c113409c8" status: 200 len: 183 microversion: 2.1 time: 0.071518 Oct 24 09:12:59.384311 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2286/4686] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:12:59 2022] GET /compute/v2.1/os-server-groups/47afd99c-8fef-4d4a-901e-b65c113409c8 => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:12:59.388840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.389441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:59.402401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.402816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.403257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.408445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.408946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.409419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.436324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde HTTP/1.1 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b2a89b67-84a8-4db6-91b5-8fee01aa2cde'} Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:59.438064 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.442134 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.450674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.451802 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c573dfe-05d6-4cad-ae3b-a3a6166db5e6 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 404 len: 111 microversion: 2.1 time: 0.067285 Oct 24 09:12:59.455269 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2401/4687] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:12:59 2022] DELETE /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:59.460600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.461220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] [instance: b2a89b67-84a8-4db6-91b5-8fee01aa2cde] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:59.482585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.483102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.483553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.484284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.484748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.485574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.510050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde HTTP/1.1 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b2a89b67-84a8-4db6-91b5-8fee01aa2cde'} Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.511635 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance b2a89b67-84a8-4db6-91b5-8fee01aa2cde could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d8abd1c-b607-4158-9c6e-7d6e3134e7f5 tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde" status: 404 len: 111 microversion: 2.1 time: 0.056400 Oct 24 09:12:59.520703 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2287/4688] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:59 2022] GET /compute/v2.1/servers/b2a89b67-84a8-4db6-91b5-8fee01aa2cde => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:12:59.522695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51c37de9-3b60-4ae0-a212-19cd7c83f53a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.533509 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-51c37de9-3b60-4ae0-a212-19cd7c83f53a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance group 7cc9f805-e55c-4d70-b6fe-b96beb2891c3 could not be found. Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51c37de9-3b60-4ae0-a212-19cd7c83f53a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-server-groups/7cc9f805-e55c-4d70-b6fe-b96beb2891c3 HTTP/1.1 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: exception: Instance group 7cc9f805-e55c-4d70-b6fe-b96beb2891c3 could not be found. Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7cc9f805-e55c-4d70-b6fe-b96beb2891c3'} Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7cc9f805-e55c-4d70-b6fe-b96beb2891c3 could not be found. Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7cc9f805-e55c-4d70-b6fe-b96beb2891c3 could not be found. Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.535082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.539504 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.539504 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.539504 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.539504 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.539504 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7cc9f805-e55c-4d70-b6fe-b96beb2891c3 could not be found. Oct 24 09:12:59.539504 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.547659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51c37de9-3b60-4ae0-a212-19cd7c83f53a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance group 7cc9f805-e55c-4d70-b6fe-b96beb2891c3 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.548867 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-51c37de9-3b60-4ae0-a212-19cd7c83f53a tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/7cc9f805-e55c-4d70-b6fe-b96beb2891c3" status: 404 len: 117 microversion: 2.1 time: 0.031084 Oct 24 09:12:59.549667 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2402/4689] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:59 2022] DELETE /compute/v2.1/os-server-groups/7cc9f805-e55c-4d70-b6fe-b96beb2891c3 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:59.559085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b76509c5-bda2-4914-952f-a7f7c378c72d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.570630 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b76509c5-bda2-4914-952f-a7f7c378c72d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance group e855b107-cc1c-42ee-882d-9a9058b5b3a0 could not be found. Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b76509c5-bda2-4914-952f-a7f7c378c72d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-server-groups/e855b107-cc1c-42ee-882d-9a9058b5b3a0 HTTP/1.1 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: exception: Instance group e855b107-cc1c-42ee-882d-9a9058b5b3a0 could not be found. Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e855b107-cc1c-42ee-882d-9a9058b5b3a0'} Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e855b107-cc1c-42ee-882d-9a9058b5b3a0 could not be found. Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e855b107-cc1c-42ee-882d-9a9058b5b3a0 could not be found. Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.572900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e855b107-cc1c-42ee-882d-9a9058b5b3a0 could not be found. Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b76509c5-bda2-4914-952f-a7f7c378c72d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance group e855b107-cc1c-42ee-882d-9a9058b5b3a0 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b76509c5-bda2-4914-952f-a7f7c378c72d tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e855b107-cc1c-42ee-882d-9a9058b5b3a0" status: 404 len: 117 microversion: 2.1 time: 0.020543 Oct 24 09:12:59.582138 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2288/4690] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:59 2022] DELETE /compute/v2.1/os-server-groups/e855b107-cc1c-42ee-882d-9a9058b5b3a0 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:59.584140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e4e2aef9-93e3-44dc-91c0-f7403056536f tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.594215 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e4e2aef9-93e3-44dc-91c0-f7403056536f tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance group b875ab75-f21d-40a1-a072-67d3d568951a could not be found. Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e4e2aef9-93e3-44dc-91c0-f7403056536f tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-server-groups/b875ab75-f21d-40a1-a072-67d3d568951a HTTP/1.1 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: exception: Instance group b875ab75-f21d-40a1-a072-67d3d568951a could not be found. Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b875ab75-f21d-40a1-a072-67d3d568951a'} Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b875ab75-f21d-40a1-a072-67d3d568951a could not be found. Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b875ab75-f21d-40a1-a072-67d3d568951a could not be found. Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.596238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b875ab75-f21d-40a1-a072-67d3d568951a could not be found. Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e4e2aef9-93e3-44dc-91c0-f7403056536f tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance group b875ab75-f21d-40a1-a072-67d3d568951a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.600888 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e4e2aef9-93e3-44dc-91c0-f7403056536f tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/b875ab75-f21d-40a1-a072-67d3d568951a" status: 404 len: 117 microversion: 2.1 time: 0.017882 Oct 24 09:12:59.604442 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2289/4691] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:59 2022] DELETE /compute/v2.1/os-server-groups/b875ab75-f21d-40a1-a072-67d3d568951a => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:59.611930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49408d03-b732-4189-aa99-a375239e15cc tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.652396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-49408d03-b732-4189-aa99-a375239e15cc tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] HTTP exception thrown: Instance group a0c14a39-6e14-41b0-b5c3-e31af12550d6 could not be found. Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49408d03-b732-4189-aa99-a375239e15cc tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Request method failure captured: Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-server-groups/a0c14a39-6e14-41b0-b5c3-e31af12550d6 HTTP/1.1 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlbrisOxkeZFkPB-EosI15D8clrVTsc8rlbKtu59AHqKqSt1ClM40d8quIwmKOymRUZ-SbeK_J4342A4g13RI_h2ofYINkNw4MF9__PY2zex6ZroK-fkrB5FLydsDUTPFz3LFHgKdu2cbO6wjpa-KCMKVnzGwlqFV5cBVR7eZGqrZiY Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a93a7edd7324574b19ec5c7847f9f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a93a7edd7324574b19ec5c7847f9f03"}]}] Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 0a93a7edd7324574b19ec5c7847f9f03 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerGroupTestJSON-1446626564 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c8cc22ca64db4c86827f1262cdddf2d7 Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerGroupTestJSON-1446626564-project Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: exception: Instance group a0c14a39-6e14-41b0-b5c3-e31af12550d6 could not be found. Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a0c14a39-6e14-41b0-b5c3-e31af12550d6'} Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a0c14a39-6e14-41b0-b5c3-e31af12550d6 could not be found. Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a0c14a39-6e14-41b0-b5c3-e31af12550d6 could not be found. Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.654171 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:12:59.658684 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:12:59.658684 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:12:59.658684 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:12:59.658684 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:12:59.658684 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a0c14a39-6e14-41b0-b5c3-e31af12550d6 could not be found. Oct 24 09:12:59.658684 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:12:59.660048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49408d03-b732-4189-aa99-a375239e15cc tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Returning 404 to user: Instance group a0c14a39-6e14-41b0-b5c3-e31af12550d6 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:12:59.662763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49408d03-b732-4189-aa99-a375239e15cc tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/a0c14a39-6e14-41b0-b5c3-e31af12550d6" status: 404 len: 117 microversion: 2.1 time: 0.057106 Oct 24 09:12:59.665434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2290/4692] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:12:59 2022] DELETE /compute/v2.1/os-server-groups/a0c14a39-6e14-41b0-b5c3-e31af12550d6 => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:59.673685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:12:59.674527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:12:59.684436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.691672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.692851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.697064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.697894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.698494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.808128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-842696022", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:12:59.888873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:12:59.890034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:12:59.890539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:12:59.890956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:12:59.891407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:12:59.912459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.913605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.919246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.920255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:12:59.920745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:12:59.921407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:12:59.988782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Getting quotas for project 4d6d22d767ae45c5a743f1ea344a3d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:12:59.995679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:00.006337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Getting quotas for user f80f666981ad4c04b1122d6d640065e8 and project 4d6d22d767ae45c5a743f1ea344a3d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:00.011675 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25821c35-d85d-43dd-9950-8aa24d9ca1af tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.343210 Oct 24 09:13:00.014223 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2291/4693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:12:59 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:00.022610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-043b8364-f1b1-40eb-86de-83892683cb7e tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:00.037778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:13:00.043211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:13:00.090283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-043b8364-f1b1-40eb-86de-83892683cb7e tempest-ServerGroupTestJSON-1446626564 tempest-ServerGroupTestJSON-1446626564-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/47afd99c-8fef-4d4a-901e-b65c113409c8" status: 204 len: 0 microversion: 2.1 time: 0.072208 Oct 24 09:13:00.091870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2292/4694] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:13:00 2022] DELETE /compute/v2.1/os-server-groups/47afd99c-8fef-4d4a-901e-b65c113409c8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:13:00.134680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72320236-a1de-4fb4-9591-8c5c7c01770a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.559371 Oct 24 09:13:00.137579 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2403/4695] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 24 09:13:00.147998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1b312a83-4eb9-4679-aeb4-6cf8982672e3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:00.148879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1b312a83-4eb9-4679-aeb4-6cf8982672e3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:00.185021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:00.186085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] [instance: 205af3f7-8221-43a4-bbbf-8d792ed081c0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:00.195055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:00.195798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:00.196428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:00.198120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:00.198754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:00.199360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:00.216340 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] HTTP exception thrown: Instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 could not be found. Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Request method failure captured: Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 HTTP/1.1 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlZ799N7bdsdR6L5L7pxfvnEbP5jneeqIycfzAiybS_fOVqCB8BtEgCBL4mnbbR3q4JJEF7nUCspxA0SihyN1IPc0iDctXk81fny8z8VRh5DBHABEghkwbsVfxxVk3MTwj7EaGGhRfnhlIP-qbhLVj1dnDltgqoFDFnTxIHVAu1uksg Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 062ef54f319941dda2c197b8f71d2a7e Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ListImageFiltersTestJSON-92290805 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/062ef54f319941dda2c197b8f71d2a7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_062ef54f319941dda2c197b8f71d2a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/062ef54f319941dda2c197b8f71d2a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/062ef54f319941dda2c197b8f71d2a7e"}]}] Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ListImageFiltersTestJSON-92290805 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 062ef54f319941dda2c197b8f71d2a7e Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-92290805 Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ListImageFiltersTestJSON-92290805-project Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: af8778dae08a4ab6b012ceda5af5564e Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ListImageFiltersTestJSON-92290805-project Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 could not be found. Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '205af3f7-8221-43a4-bbbf-8d792ed081c0'} Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 could not be found. Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 could not be found. Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:00.218846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 could not be found. Oct 24 09:13:00.223701 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:00.224989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Returning 404 to user: Instance 205af3f7-8221-43a4-bbbf-8d792ed081c0 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:13:00.226272 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-129c39d7-4bdd-4b93-809c-8702f2d71a1d tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0" status: 404 len: 111 microversion: 2.1 time: 0.046982 Oct 24 09:13:00.227946 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2404/4696] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:00 2022] GET /compute/v2.1/servers/205af3f7-8221-43a4-bbbf-8d792ed081c0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:13:00.235716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-deb4d61f-acc9-4809-877b-2291aa8bc37c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daae8c160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:00.324983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1b312a83-4eb9-4679-aeb4-6cf8982672e3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:00.334874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1b312a83-4eb9-4679-aeb4-6cf8982672e3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:00.336320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1b312a83-4eb9-4679-aeb4-6cf8982672e3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:00.342088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1b312a83-4eb9-4679-aeb4-6cf8982672e3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1277 microversion: 2.54 time: 0.198910 Oct 24 09:13:00.358300 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2293/4697] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:00 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:00.372029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:00.372663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:00.386728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:00.391522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:00.392018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:00.392770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:00.393240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:00.393993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:00.845324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-deb4d61f-acc9-4809-877b-2291aa8bc37c tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/images/65843e3b-7d49-4791-a541-064b5fdb83b5" status: 204 len: 0 microversion: 2.1 time: 0.613050 Oct 24 09:13:00.849763 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2405/4698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:00 2022] DELETE /compute/v2.1/images/65843e3b-7d49-4791-a541-064b5fdb83b5 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:13:00.854979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be98db16-5b13-407b-a693-f839cb2b8353 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8dab04a700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:01.226472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be98db16-5b13-407b-a693-f839cb2b8353 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/images/8efd64ac-6666-4c83-96cc-42012f4f42ae" status: 204 len: 0 microversion: 2.1 time: 0.375333 Oct 24 09:13:01.227768 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2406/4699] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:00 2022] DELETE /compute/v2.1/images/8efd64ac-6666-4c83-96cc-42012f4f42ae => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:13:01.232939 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:01.233620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:01.254527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:01.257269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:01.258461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:01.265244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:01.266085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:01.266675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:01.530639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:01.539128 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e2a8fbd-8932-4bd1-8013-5565a1ad25f7 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1674 microversion: 2.1 time: 1.179653 Oct 24 09:13:01.539723 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2294/4700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:00 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1674 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:01.550195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f066342-dbdb-4f51-9866-0bed90b7ffd5 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] Calling method '.version_select at 0x7f8daaf75430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:01.836138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:01.845763 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb288d79-de76-43a5-905d-b86ae294edfa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.616536 Oct 24 09:13:01.851469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2407/4701] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:01 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:01.870100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:01.872695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:01.878488 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f066342-dbdb-4f51-9866-0bed90b7ffd5 tempest-ListImageFiltersTestJSON-92290805 tempest-ListImageFiltersTestJSON-92290805-project] 10.222.0.25 "DELETE /compute/v2.1/images/99fd70ce-17a5-4d3d-a83f-c52a03a28e15" status: 204 len: 0 microversion: 2.1 time: 0.331765 Oct 24 09:13:01.879330 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2295/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:01 2022] DELETE /compute/v2.1/images/99fd70ce-17a5-4d3d-a83f-c52a03a28e15 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:13:01.895569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:01.895947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:01.896942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:01.897780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:01.898243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:01.898759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:02.482622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:02.497847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:02.510180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:02.512880 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a1cdc8f-53c8-4575-90fc-876b0226bb1f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1337 microversion: 2.54 time: 0.659138 Oct 24 09:13:02.531524 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2408/4703] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:01 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1337 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:02.560704 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:02.567708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:02.568885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:02.576588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:02.577289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:02.578073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:02.579606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:02.580274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:02.581013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:02.873283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:02.875159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:02.890569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:02.891714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:02.894435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:02.895492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:02.896949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:02.898853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:02.976653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:02.986471 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e3f9223-0a01-4942-bc18-698bdb3c6e51 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1674 microversion: 2.1 time: 0.427464 Oct 24 09:13:02.987505 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2296/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:02 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1674 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:03.188437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-068dcd41-4853-4fa8-a8b0-417c3c5cd49a req-b65e7826-cdfd-46fd-984a-1010b416696f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc7944c-aa41-4bfa-9fdd-989138db06a2", "tag": "17a56738-b821-4f86-9193-6e61a75bd3bd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:03.213945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-068dcd41-4853-4fa8-a8b0-417c3c5cd49a req-b65e7826-cdfd-46fd-984a-1010b416696f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:03.215009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-068dcd41-4853-4fa8-a8b0-417c3c5cd49a req-b65e7826-cdfd-46fd-984a-1010b416696f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:03.215585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-068dcd41-4853-4fa8-a8b0-417c3c5cd49a req-b65e7826-cdfd-46fd-984a-1010b416696f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:03.235649 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-068dcd41-4853-4fa8-a8b0-417c3c5cd49a req-b65e7826-cdfd-46fd-984a-1010b416696f service nova] Creating event network-changed:17a56738-b821-4f86-9193-6e61a75bd3bd for instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 on n-h2-master-1 Oct 24 09:13:03.244400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-068dcd41-4853-4fa8-a8b0-417c3c5cd49a req-b65e7826-cdfd-46fd-984a-1010b416696f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062272 Oct 24 09:13:03.246138 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2297/4705] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:03.521763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-59fca6bc-d540-456c-a6a2-4ae8c7d0e743 req-068e2204-519d-46d3-aa00-c8dc58888577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e407b5-a14a-4395-a9ac-771605f5ecd3", "name": "network-vif-deleted", "tag": "91f5f704-5060-4162-9983-430b39e46216"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:03.545090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-59fca6bc-d540-456c-a6a2-4ae8c7d0e743 req-068e2204-519d-46d3-aa00-c8dc58888577 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:03.547927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-59fca6bc-d540-456c-a6a2-4ae8c7d0e743 req-068e2204-519d-46d3-aa00-c8dc58888577 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:03.548380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-59fca6bc-d540-456c-a6a2-4ae8c7d0e743 req-068e2204-519d-46d3-aa00-c8dc58888577 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:03.592128 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-59fca6bc-d540-456c-a6a2-4ae8c7d0e743 req-068e2204-519d-46d3-aa00-c8dc58888577 service nova] Creating event network-vif-deleted:91f5f704-5060-4162-9983-430b39e46216 for instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 on n-h2-master-1 Oct 24 09:13:03.614271 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-59fca6bc-d540-456c-a6a2-4ae8c7d0e743 req-068e2204-519d-46d3-aa00-c8dc58888577 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094803 Oct 24 09:13:03.618153 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2298/4706] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:03.648325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:03.649305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:03.659173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:03.664711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:03.664711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:03.682013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:03.683677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:03.684450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:03.815117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:03.839089 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2b94706-5816-40da-b146-4a1755295fea tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.966621 Oct 24 09:13:03.840823 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2409/4707] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:02 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:03.924184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:03.940211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:03.949547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:03.952510 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cdcc6948-79d2-4e74-aa3d-8a27f9073558 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1335 microversion: 2.54 time: 0.330337 Oct 24 09:13:03.955820 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2299/4708] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:03 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1335 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:04.015029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:04.016362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:04.029228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:04.029904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:04.033261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:04.035083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:04.036368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:04.038979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:04.126933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:04.127425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:04.127860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:04.128328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lazy-loading 'fault' on Instance uuid 29e407b5-a14a-4395-a9ac-771605f5ecd3 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:13:04.260381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c703cc73a22749858ffe05500e52aa03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fffe9b0994ded9f07301735105917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:04.276126 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fdfaba11-0507-4295-8519-863376c5e095 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 200 len: 1328 microversion: 2.1 time: 0.268069 Oct 24 09:13:04.278341 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2410/4709] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:04 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 1328 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:04.866515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:04.867887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:04.879773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:04.881415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:04.882346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:04.883442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:04.884380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:04.885113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:04.983956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:04.985219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:04.997989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:04.998488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:05.007778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:05.008923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:05.009607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:05.010226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:05.581140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:05.594038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:05.597755 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-54e8a8b4-0ad8-4f43-a909-925fc926e68e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.733703 Oct 24 09:13:05.603056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:05.605480 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2300/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:04 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:05.609467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:05.610939 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0baef704-4272-4ef8-8130-275b50defd92 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1356 microversion: 2.54 time: 0.631000 Oct 24 09:13:05.614272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2411/4711] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:04 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1356 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:05.632207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:05.645506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] [instance: 29e407b5-a14a-4395-a9ac-771605f5ecd3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:05.658278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:05.662281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:05.663447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:05.664320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:05.667133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:05.667910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:05.700223 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] HTTP exception thrown: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 could not be found. Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Request method failure captured: Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 HTTP/1.1 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlT-Gwl-QL4RmTnmqxij31goZNj1DohdSNDs5nmArEp82KeeRin_XKj9vYVMxI3moiVuuii5bAUuyG1jpFWdoiqWSoqjt-4f9s2X2R4RFGpH0ZkRJguuLpkyMcWuw0UfdTx6-vCaFDNZCH4c5yQQZrz2t_yj87_WXCyQAVc2NSrsZrE Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be8fffe9b0994ded9f07301735105917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be8fffe9b0994ded9f07301735105917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be8fffe9b0994ded9f07301735105917"}]}] Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: be8fffe9b0994ded9f07301735105917 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-1843943229 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c703cc73a22749858ffe05500e52aa03 Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-1843943229-project Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 could not be found. Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '29e407b5-a14a-4395-a9ac-771605f5ecd3'} Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 could not be found. Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 could not be found. Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:05.704998 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 could not be found. Oct 24 09:13:05.709782 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:05.713849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Returning 404 to user: Instance 29e407b5-a14a-4395-a9ac-771605f5ecd3 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:13:05.715088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97623a71-c80b-49d0-97d7-4f60fbfae042 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3" status: 404 len: 111 microversion: 2.1 time: 0.107531 Oct 24 09:13:05.715906 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2301/4712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:05 2022] GET /compute/v2.1/servers/29e407b5-a14a-4395-a9ac-771605f5ecd3 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:13:05.729750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56dabcac-c5f5-4691-ba61-60ad61f6b93e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Action: 'create', calling method: .version_select at 0x7f8daf22ddc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1053420115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMSkCgndv83he4T1pkZFZmh5JVDDkQ7ROFJG+21TYEROGbQLsVsW1MC6ig/xpiXs74oBXQSLq9x9qBFnO9OoCA72ts4I6uOie8Ff4oFLkjI3Th7kXjjQzQDqZ/tFu4/hA=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:05.768195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-56dabcac-c5f5-4691-ba61-60ad61f6b93e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Getting quotas for project 4d6d22d767ae45c5a743f1ea344a3d9e. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:05.785872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-56dabcac-c5f5-4691-ba61-60ad61f6b93e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Getting quotas for user f80f666981ad4c04b1122d6d640065e8 and project 4d6d22d767ae45c5a743f1ea344a3d9e. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:05.840371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56dabcac-c5f5-4691-ba61-60ad61f6b93e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.118628 Oct 24 09:13:05.848428 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2302/4713] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 09:13:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 09:13:05.859509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ca08490-3cf0-422a-8fae-ce7b0a129ec1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] Calling method '.version_select at 0x7f8dab0eb820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:05.906659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ca08490-3cf0-422a-8fae-ce7b0a129ec1 tempest-ServerActionsTestJSON-1843943229 tempest-ServerActionsTestJSON-1843943229-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108780880" status: 202 len: 0 microversion: 2.1 time: 0.049988 Oct 24 09:13:05.907478 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2303/4714] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108780880 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:05.914858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1053420115", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:05.922561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:05.931048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae227439-da0c-4dac-91eb-f9c9e16e276e tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Action: 'create', calling method: .version_select at 0x7f8daf30d5e0>, body: {"keypair": {"name": "tempest-keypair-1524550439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIDry5s8bbrTjuGKl9DuUbjYPAzUMcf+PWjW9sy4BND20b+ePJ1j5RmI6ND4Z30wbl3fJJ+1wDY4CEsk/KHAr8kBB1Y6CuYE6vt1cXXlhrQ6qfZWscsghQHCtSQMVhm8w=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:05.934739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:05.935545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:05.936290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:05.937258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:05.937947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:05.938698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:05.964913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ae227439-da0c-4dac-91eb-f9c9e16e276e tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:05.978708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ae227439-da0c-4dac-91eb-f9c9e16e276e tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for user c32503ad06d54903aa2eaec5b53bc3b0 and project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:06.010706 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae227439-da0c-4dac-91eb-f9c9e16e276e tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.394511 Oct 24 09:13:06.012867 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2412/4715] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:06.024118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dac4a561-43ae-4e48-8c9a-50ddf6fee935 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8dab0b7790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.044805 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dac4a561-43ae-4e48-8c9a-50ddf6fee935 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1524550439" status: 200 len: 498 microversion: 2.1 time: 0.025361 Oct 24 09:13:06.052849 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2413/4716] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:13:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1524550439 => generated 498 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:06.059491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-491b36e7-a959-4252-8a84-356f4e78c5ed tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8daa4b7310>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.069765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:13:06.070198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:13:06.070796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:13:06.071205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:13:06.071888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:13:06.076282 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:06.088362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-491b36e7-a959-4252-8a84-356f4e78c5ed tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524550439" status: 202 len: 0 microversion: 2.1 time: 0.034037 Oct 24 09:13:06.089914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2414/4717] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524550439 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:06.101728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb2b9596-138a-49c4-b5b3-4d0cbbbb4e49 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Action: 'create', calling method: .version_select at 0x7f8dab04a8b0>, body: {"keypair": {"name": "tempest-keypair-376784309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFcEVx2BaGyGX8xHOTBSA5ItVb2BixXdZf22/XzQY0Nwa0E6f2d9/Hk+hPIy7S0lifQJ/M961Xmfi/D9OyQ1qKF53UukGBUWpq7+wHOEYk96ZcJZOw2hS67CibjRjm/+g=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:06.131543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-fb2b9596-138a-49c4-b5b3-4d0cbbbb4e49 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:06.143143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-fb2b9596-138a-49c4-b5b3-4d0cbbbb4e49 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for user c32503ad06d54903aa2eaec5b53bc3b0 and project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:06.171308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:06.181353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:06.182249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:06.182856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:06.183732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:06.184627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:06.185226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:06.196475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb2b9596-138a-49c4-b5b3-4d0cbbbb4e49 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094544 Oct 24 09:13:06.197897 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2415/4718] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:06.214421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9ffd4c1-127f-461d-a6a0-bc8dd869bb2b tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8daae8f9d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.222519 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ed33bad-87f3-473e-a2f7-7467055bd9f1 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "POST /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928/action" status: 202 len: 1139 microversion: 2.54 time: 0.313713 Oct 24 09:13:06.237580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2304/4719] 10.222.0.25 () {62 vars in 1320 bytes} [Mon Oct 24 09:13:05 2022] POST /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928/action => generated 1139 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 09:13:06.245831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.246742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:06.250262 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:06.255532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:06.258492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:06.261287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:06.262262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:06.262882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:06.264792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:06.279631 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9ffd4c1-127f-461d-a6a0-bc8dd869bb2b tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376784309" status: 202 len: 0 microversion: 2.1 time: 0.072618 Oct 24 09:13:06.284211 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2416/4720] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376784309 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:06.295485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9f249af-c0f6-4a6b-8d43-0dfc2fdff8b3 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Action: 'create', calling method: .version_select at 0x7f8daf1318b0>, body: {"keypair": {"name": "tempest-keypair-135843387", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:06.358770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e9f249af-c0f6-4a6b-8d43-0dfc2fdff8b3 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:06.371826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e9f249af-c0f6-4a6b-8d43-0dfc2fdff8b3 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for user c32503ad06d54903aa2eaec5b53bc3b0 and project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:06.391061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:06.400960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:06.407558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:06.411262 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9f249af-c0f6-4a6b-8d43-0dfc2fdff8b3 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.123352 Oct 24 09:13:06.413324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2417/4721] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:06 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:06.420352 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8494aada-b46d-4195-8f7c-8ca573365e7e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.178864 Oct 24 09:13:06.420996 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2305/4722] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:06 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:13:06.424519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d8c4baf-71b2-4f78-a56d-68bc753f830f tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8daafcda60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.461958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d8c4baf-71b2-4f78-a56d-68bc753f830f tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135843387" status: 202 len: 0 microversion: 2.1 time: 0.042383 Oct 24 09:13:06.463528 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2418/4723] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135843387 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:06.475259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af3d0448-c821-4b93-977e-c242171a43f9 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Action: 'create', calling method: .version_select at 0x7f8daf24df70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1088142797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj0yz6NbA97BnD8qeCrnXE1wG0GVTHa92k6tatYLbUzPJs09OqkmSVpQFzvP7MO2WzU5BFE0KU9cBESZK6G3VKQ+3WEBBRbrISn+vint7UJlEz8j9iUxHqOauabypkA8g=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:06.494295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-af3d0448-c821-4b93-977e-c242171a43f9 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:06.503953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-af3d0448-c821-4b93-977e-c242171a43f9 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for user c32503ad06d54903aa2eaec5b53bc3b0 and project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:06.564242 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af3d0448-c821-4b93-977e-c242171a43f9 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.092535 Oct 24 09:13:06.585533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0573fec-634a-4d66-9ca6-bcdef062c70d tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Action: 'create', calling method: .version_select at 0x7f8dab0a2d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1334466563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmftVto8TPgkWKB64sSNkB7pL+oQi62izdIeiyJphn+xGwG3M7j1BA7DoHITpYkmyjsx1m6KkQ6ZMNyYhbyKzW3M746SaomVoNb2W/HT4T+vedSf2O9TZE2yLPsCRQTEA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:06.590069 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2306/4724] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:06.611487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d0573fec-634a-4d66-9ca6-bcdef062c70d tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:06.618773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-d0573fec-634a-4d66-9ca6-bcdef062c70d tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for user c32503ad06d54903aa2eaec5b53bc3b0 and project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:06.630169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.631311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:06.644030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:06.648906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:06.649457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:06.650306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:06.650757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:06.651187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:06.713726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0573fec-634a-4d66-9ca6-bcdef062c70d tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.134665 Oct 24 09:13:06.715297 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2419/4725] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:06.754959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4585ab1a-3741-4f6f-a7a7-bd1a6ca2d89a tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Action: 'create', calling method: .version_select at 0x7f8daae8f790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1758266170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKes0vAB9oe0oGlf9sQk54dQdY7rC1H4J0bDhKVtf4A0DXPqJrgWv70q5askoqunRPpatLEequi91vnX9RowdY/LIbAEo9dBiOcbpo7m4XkWaFnxFtpVfUqh+XIS53DhQA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:06.792405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4585ab1a-3741-4f6f-a7a7-bd1a6ca2d89a tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:06.801961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4585ab1a-3741-4f6f-a7a7-bd1a6ca2d89a tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Getting quotas for user c32503ad06d54903aa2eaec5b53bc3b0 and project 302e20a71db842a38a9621bac995e083. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:06.843714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4585ab1a-3741-4f6f-a7a7-bd1a6ca2d89a tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.100921 Oct 24 09:13:06.850134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2420/4726] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:06.855794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a671fe90-d0eb-482b-925e-fe488dc52c36 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8dab08e0d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.859955 n-d-master-1 devstack@n-api.service[126920]: WARNING oslo_db.sqlalchemy.utils [None req-a671fe90-d0eb-482b-925e-fe488dc52c36 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 09:13:06.868508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a671fe90-d0eb-482b-925e-fe488dc52c36 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.015114 Oct 24 09:13:06.875195 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2421/4727] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:13:06 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:06.883159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03f18c18-c674-4f83-948d-5285a746c1f7 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8dab02a820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.908273 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03f18c18-c674-4f83-948d-5285a746c1f7 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1758266170" status: 202 len: 0 microversion: 2.1 time: 0.031595 Oct 24 09:13:06.912457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2422/4728] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1758266170 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:06.920797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-304f70b2-31fe-40b3-bb71-d65007994a22 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8daae8c700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:06.970345 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-304f70b2-31fe-40b3-bb71-d65007994a22 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1334466563" status: 202 len: 0 microversion: 2.1 time: 0.054703 Oct 24 09:13:06.971968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2423/4729] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1334466563 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:06.982269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-600f5a62-f06e-4884-87e0-b2458bc960c7 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] Calling method '.version_select at 0x7f8daa582430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:07.022407 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-600f5a62-f06e-4884-87e0-b2458bc960c7 tempest-KeyPairsV2TestJSON-2120649037 tempest-KeyPairsV2TestJSON-2120649037-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1088142797" status: 202 len: 0 microversion: 2.1 time: 0.045561 Oct 24 09:13:07.023502 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2424/4730] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1088142797 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:13:07.053608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:07.063090 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ae8d17b-af4f-4f3d-aa87-4e478ecc2c0c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.437140 Oct 24 09:13:07.076272 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2307/4731] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:06 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:07.451926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:07.452649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:07.466086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:07.466837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:07.468012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:07.469229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:07.469879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:07.470475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:07.676923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:07.693658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:07.696112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:07.701461 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc4f364c-baab-4e7d-bf94-5c6ec8a16aa0 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.252734 Oct 24 09:13:07.702075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2425/4732] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:07 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:08.092249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:08.093239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:08.105070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:08.107132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:08.108242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:08.110352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:08.112487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:08.113034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:08.454168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:08.465503 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a597ab1-7b92-473a-a609-1a91e0d90a0e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.378606 Oct 24 09:13:08.466451 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2308/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:08 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:08.728585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:08.731115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:08.746670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:08.747462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:08.748079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:08.750104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:08.750840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:08.752683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:09.106900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:09.154516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:09.156165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:09.165708 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22f5aa67-4752-472c-9e6d-a4dc8716a12b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.433382 Oct 24 09:13:09.167108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2426/4734] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:08 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:09.490620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:09.491531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:09.502303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:09.503135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:09.503980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:09.506610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:09.507435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:09.510111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:10.194334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:10.194952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:10.204146 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:10.218217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:10.219009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:10.219715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:10.220698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:10.221348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:10.222243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:10.287557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:10.299111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee8ea42f-a10f-4917-9e9d-542d70d2763f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.812319 Oct 24 09:13:10.302626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2309/4735] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:09 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:10.399492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:10.407774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:10.409226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:10.410456 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ad87e71-16d7-4eb2-a99d-66d8713dab42 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.220663 Oct 24 09:13:10.411039 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2427/4736] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:10 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:13:11.325795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:11.326491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:11.341941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:11.342782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:11.343694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:11.348357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:11.349915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:11.350432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:11.410519 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:11.441770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:11.443244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:11.456637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:11.459596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:11.460306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:11.461602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:11.464723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:11.465725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:11.641261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:11.653235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:11.658259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:11.666334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8063a1b-f3e8-4ee2-9a09-598a0193a60e tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.228172 Oct 24 09:13:11.667296 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2428/4737] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:11 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:12.483487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:12.499548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99851ba5-e201-4228-aa8b-0ab45998bd6b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 1.177914 Oct 24 09:13:12.501934 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2310/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:11 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:12.575162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5a667973-68d7-4dfe-b564-87a92d97b57f req-a59f7e75-9f87-4090-ae9a-6afd2ee1959f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc7944c-aa41-4bfa-9fdd-989138db06a2", "name": "network-vif-plugged", "status": "completed", "tag": "17a56738-b821-4f86-9193-6e61a75bd3bd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:12.597632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5a667973-68d7-4dfe-b564-87a92d97b57f req-a59f7e75-9f87-4090-ae9a-6afd2ee1959f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:12.598134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5a667973-68d7-4dfe-b564-87a92d97b57f req-a59f7e75-9f87-4090-ae9a-6afd2ee1959f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:12.598584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5a667973-68d7-4dfe-b564-87a92d97b57f req-a59f7e75-9f87-4090-ae9a-6afd2ee1959f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:12.639609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5a667973-68d7-4dfe-b564-87a92d97b57f req-a59f7e75-9f87-4090-ae9a-6afd2ee1959f service nova] Creating event network-vif-plugged:17a56738-b821-4f86-9193-6e61a75bd3bd for instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 on n-h2-master-1 Oct 24 09:13:12.650077 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5a667973-68d7-4dfe-b564-87a92d97b57f req-a59f7e75-9f87-4090-ae9a-6afd2ee1959f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079108 Oct 24 09:13:12.654895 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2429/4739] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:12.696853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:12.697574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:12.707471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:12.711349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:12.712953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:12.715298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:12.717625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:12.719166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:12.973124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:12.987787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:12.992609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:12.996099 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8dc1803-2a13-461d-b461-73ade12c0b2c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.303588 Oct 24 09:13:12.999807 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2311/4740] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:12 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:13.542494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:13.543431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:13.566044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:13.566958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:13.567580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:13.568508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:13.571003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:13.572104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:14.027097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:14.028274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:14.037253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:14.039794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:14.040431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:14.041401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:14.041876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:14.042309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:14.223805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:14.243703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:14.245424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:14.250374 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-750360b7-744e-4b99-a6b7-5d4085e9a55a tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.226919 Oct 24 09:13:14.252186 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2312/4741] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:14 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:13:14.340417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:14.349184 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0457c989-0fb1-4b21-b8df-2cca4df70d38 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1367 microversion: 2.1 time: 0.824056 Oct 24 09:13:14.350601 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2430/4742] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:13 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1367 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:15.283270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:15.283891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:15.291241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:15.291938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:15.293282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:15.294218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:15.294859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:15.295447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:15.372658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:15.374216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:15.382266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:15.383006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:15.383646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:15.384684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:15.385467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:15.387246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:15.436660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:15.445829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:15.447621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:15.449060 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba67b458-6c90-4f98-860c-5aa943ad5bd8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.170298 Oct 24 09:13:15.449901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2313/4743] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:15 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:16.118199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1837694736", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:16.224400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] validate_networks() for [('69e5eae1-6162-4ad6-b272-9cffcd4d20cb', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:13:16.331089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:16.336625 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:16.375168 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ce8cb4f-a5fb-4eb0-a9f0-edce799b83b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1557 microversion: 2.1 time: 1.006811 Oct 24 09:13:16.385657 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2431/4744] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:15 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1557 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:16.402105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:16.403502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:16.418491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:16.419014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:16.420427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:16.421174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:16.423973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:16.424415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:16.526568 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=24 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:16.817088 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=28 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:17.299994 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-becb102d-58b2-42c4-add5-c3431198b23a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.902339 Oct 24 09:13:17.301270 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2432/4745] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:13:16 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/os-interface => generated 284 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:17.307084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:17.309580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:17.339911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:17.344906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:17.345906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:17.347214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:17.347700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:17.348137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:17.624202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:17.647295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:17.650402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:17.658108 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-194df105-03af-41c7-b1dd-a5e02d8bdfbe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.355304 Oct 24 09:13:17.658736 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2433/4746] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:17 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:18.307612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:13:18.311333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:13:18.315683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:13:18.316820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:13:18.319811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:13:18.343628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:18.344128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:18.344786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:18.345561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:18.346052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:18.346487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:18.403852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Getting quotas for project 5a7f312d12224117b8c8a1f167d901b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:18.419021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Getting quotas for user 79772a24d13244809f7dad6e8d29bd7f and project 5a7f312d12224117b8c8a1f167d901b8. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:18.448567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:13:18.451747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:13:18.534519 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6043192b-d2db-4e9e-a881-5549b51327f2 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.645754 Oct 24 09:13:18.535848 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2314/4747] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:13:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:13:18.557200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca84ce41-429b-4808-a9f5-37228321319e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:18.557982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca84ce41-429b-4808-a9f5-37228321319e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:18.688329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:18.688936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:18.699244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:18.699745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:18.700186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:18.704532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:18.709192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:18.709671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:18.848944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:18.867396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:18.870881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:18.872456 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e080f652-c96c-460a-b7a8-5161f298b6f3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.188267 Oct 24 09:13:18.873986 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2315/4748] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:18 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:13:18.895085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca84ce41-429b-4808-a9f5-37228321319e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:18.907594 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca84ce41-429b-4808-a9f5-37228321319e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1223 microversion: 2.1 time: 0.363885 Oct 24 09:13:18.908814 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2434/4749] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:18 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1223 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:19.902527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:19.903139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:19.913042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:19.918208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:19.919809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:19.924827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:19.927933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:19.930901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:19.939792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:19.940483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:19.979064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:19.979594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:19.980209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:19.985967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:19.986482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:19.989078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:20.113519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:20.126550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:20.128257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:20.133560 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-45b159c8-d1e3-4179-9792-62347fab2ad8 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.235118 Oct 24 09:13:20.134699 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2316/4750] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:19 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:20.328267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:20.342553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a254b69e-238c-4826-ad64-ac06e41d3f23 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1275 microversion: 2.1 time: 0.414686 Oct 24 09:13:20.345628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2435/4751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:19 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1275 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:21.166356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:21.167552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:21.179061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:21.179806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:21.180429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:21.181337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:21.182027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:21.182618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:21.358503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:21.373309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:21.376151 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:21.377705 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb430d08-938e-4614-9396-7f104df0b0ec tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.215194 Oct 24 09:13:21.377981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:21.378630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:21.379198 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2317/4752] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:21 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:21.391445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:21.411544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:21.412185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:21.413913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:21.415015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:21.424840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:21.941551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:21.954724 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95d5c22a-38f5-45f6-a7f5-59aa58a729a5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1281 microversion: 2.1 time: 0.581998 Oct 24 09:13:21.973219 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2436/4753] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:21 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1281 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:22.408185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:22.408959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:22.416247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:22.416931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:22.417481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:22.418305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:22.418875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:22.419443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:22.550846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:22.568990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:22.570815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:22.574366 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17b14267-1438-4443-bbeb-cf17076853c2 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.170114 Oct 24 09:13:22.579318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2318/4754] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:22 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:22.992256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:22.993612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:23.001839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:23.002642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:23.003267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:23.004210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:23.005807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:23.006537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:23.155996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:23.165042 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-708d77e4-b571-4eed-a6fa-281b8aa8628e tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1281 microversion: 2.1 time: 0.182385 Oct 24 09:13:23.165687 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2437/4755] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:22 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:23.610167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:23.610793 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:23.623904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:23.632044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:23.632502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:23.633251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:23.633744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:23.634167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:23.842490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:23.852260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:23.865006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:23.867635 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-755e4d30-fd1a-45a1-a136-d6618d11a89f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.261627 Oct 24 09:13:23.871873 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2319/4756] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:23 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:13:23.945074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f279e980-00c7-46e9-8db1-00decb1afb65 req-31fd8241-0cf7-4184-a12f-c2e0b317e590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc7944c-aa41-4bfa-9fdd-989138db06a2", "tag": "17a56738-b821-4f86-9193-6e61a75bd3bd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:23.955277 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:23.978265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f279e980-00c7-46e9-8db1-00decb1afb65 req-31fd8241-0cf7-4184-a12f-c2e0b317e590 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:23.978761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f279e980-00c7-46e9-8db1-00decb1afb65 req-31fd8241-0cf7-4184-a12f-c2e0b317e590 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:23.979207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f279e980-00c7-46e9-8db1-00decb1afb65 req-31fd8241-0cf7-4184-a12f-c2e0b317e590 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:24.027084 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f279e980-00c7-46e9-8db1-00decb1afb65 req-31fd8241-0cf7-4184-a12f-c2e0b317e590 service nova] Creating event network-changed:17a56738-b821-4f86-9193-6e61a75bd3bd for instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 on n-h2-master-1 Oct 24 09:13:24.038065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f279e980-00c7-46e9-8db1-00decb1afb65 req-31fd8241-0cf7-4184-a12f-c2e0b317e590 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097638 Oct 24 09:13:24.042195 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2438/4757] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:24.189798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:24.190592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:24.205311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:24.206680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:24.207272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:24.209195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:24.211559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:24.217695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:24.528511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:24.537929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a02a98c-a764-44b9-a4ad-f3f0631e3581 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1281 microversion: 2.1 time: 0.353440 Oct 24 09:13:24.542015 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2320/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:24 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1281 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:24.902142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:24.903815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:24.922050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:24.922959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:24.923583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:24.924479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:24.925111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:24.925760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:25.553145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:25.563969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:25.564642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:25.571154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:25.572627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:25.579878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:25.580378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:25.580826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:25.581565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:25.582027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:25.582460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:25.590174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f32f93f-f424-4869-93db-e065cfbca60c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.694484 Oct 24 09:13:25.597636 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2439/4759] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:24 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:26.316804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:26.324872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47256d63-a07e-49b5-ac7c-bc65e3c01b08 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.764766 Oct 24 09:13:26.329626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2321/4760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:25 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:26.623136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:26.623905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:26.636170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:26.636684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:26.637167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:26.639291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:26.640922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:26.641827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:26.861358 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:26.881730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:26.884192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:26.885923 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-435f714f-b051-468f-b504-cfca530116fa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.267562 Oct 24 09:13:26.887500 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2440/4761] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:26 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:27.355671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:27.357333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:27.372659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:27.373585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:27.374260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:27.375191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:27.375847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:27.376475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:27.887092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:27.901795 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aedd8d24-8af7-4e3d-8721-ad6c885f73a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.553021 Oct 24 09:13:27.914494 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2322/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:27 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:27.922325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:27.922959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:27.937118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:27.937650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:27.943701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:27.947351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:27.947875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:27.948334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:28.195284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-747f66da-0763-40b9-b223-907a42cf2f8a req-99f4deaa-7229-40b6-97f8-9dddcb1706e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:28.213568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-747f66da-0763-40b9-b223-907a42cf2f8a req-99f4deaa-7229-40b6-97f8-9dddcb1706e6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:28.214484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-747f66da-0763-40b9-b223-907a42cf2f8a req-99f4deaa-7229-40b6-97f8-9dddcb1706e6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:28.215144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-747f66da-0763-40b9-b223-907a42cf2f8a req-99f4deaa-7229-40b6-97f8-9dddcb1706e6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:28.229695 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-747f66da-0763-40b9-b223-907a42cf2f8a req-99f4deaa-7229-40b6-97f8-9dddcb1706e6 service nova] Creating event network-changed:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:13:28.242443 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-747f66da-0763-40b9-b223-907a42cf2f8a req-99f4deaa-7229-40b6-97f8-9dddcb1706e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052165 Oct 24 09:13:28.245629 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2323/4763] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:28.254224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:28.266063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:28.267957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:28.269378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddf07e9a-c7b5-4085-a214-19c7fbee586c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.357196 Oct 24 09:13:28.270486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2441/4764] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:27 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:28.928079 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:28.929141 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:28.935982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:28.936814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:28.962770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:28.963275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:28.963730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:28.964457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:28.964913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:28.971108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:29.298875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:29.303331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:29.313159 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:29.317035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:29.317899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:29.320132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:29.321260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:29.322256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:29.323241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:29.474425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:29.487251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:29.490243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:29.492764 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2505a36-63b5-428d-8bae-e7e8eb5d3bd9 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.201099 Oct 24 09:13:29.494090 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2442/4765] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:29 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:13:29.567876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:29.579794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46bb8f1a-4b16-4935-befb-fbe03f55780f tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.652561 Oct 24 09:13:29.598370 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2324/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:28 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:30.529479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:30.530118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:30.550260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:30.552536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:30.559820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:30.562103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:30.562768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:30.565349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:30.613983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:30.615411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:30.634625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:30.637961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:30.638605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:30.640186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:30.642637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:30.643731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:30.996559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:31.025231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:31.028733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:31.033071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96a7a53b-b9ef-4844-946c-fbd0f29be65d tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.505731 Oct 24 09:13:31.033726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2443/4767] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:30 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:31.297714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:31.314396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-89e9dee1-53d8-4cd6-aa9e-2f78f8efcc04 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.704747 Oct 24 09:13:31.316728 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2325/4768] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:30 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:32.074801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:32.076557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:32.088818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:32.089677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:32.092135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:32.093065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:32.093839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:32.095820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:32.353904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:32.354509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:32.356528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:32.364598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:32.365092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:32.365551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:32.366262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:32.366718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:32.367145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:32.369612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:32.374202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:32.379005 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7622f498-cabc-4edd-ad59-8541039aecfa tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1408 microversion: 2.54 time: 0.315971 Oct 24 09:13:32.397321 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2444/4769] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:32 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:33.066210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:33.080158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3cc0a28a-b71a-4ac6-b925-e93524bbd78d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.730362 Oct 24 09:13:33.081389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2326/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:32 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:33.416573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:33.417936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:33.437469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:33.438234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:33.438877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:33.439833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:33.440642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:33.441592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:33.600227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:33.617510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:33.624007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:33.625249 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-562f0c2a-726d-4b5f-8400-141949978e45 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1414 microversion: 2.54 time: 0.213204 Oct 24 09:13:33.631751 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2445/4771] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:33 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1414 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:34.109209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:34.109866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:34.123630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:34.125640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:34.126455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:34.128735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:34.131387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:34.132103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:34.235404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ca597048-af7d-4fd4-ae99-0324e94f9b17 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: .version_select at 0x7f8daa0c1d30>, body: {"keypair": {"name": "tempest-keypair-767674656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUxz5sPei64d0OJeiiSq3Bzv5DFktdXUsfgdhBnLl0OMq+nSTFk9ZJgT9A3b7jKX7eZ0h3LJkX7v0u6yWLzAPIDEYnOo7FwBDUJsACyLIBHvXE69OsOSPMS+38G3+A2BQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:34.292884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-ca597048-af7d-4fd4-ae99-0324e94f9b17 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for project 7ee7511c75374ba599216666ba191e9e. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:34.311841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-ca597048-af7d-4fd4-ae99-0324e94f9b17 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for user de6929c304ff4260b9e7c4d469b71a0d and project 7ee7511c75374ba599216666ba191e9e. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:34.389831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ca597048-af7d-4fd4-ae99-0324e94f9b17 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.680121 Oct 24 09:13:34.391401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2327/4772] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:13:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:34.446010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:34.466180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79d2ad7d-d429-484b-a169-2c683ec2a948 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.353106 Oct 24 09:13:34.483654 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2446/4773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:34 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:34.656207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:34.656854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:34.675847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:34.676494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:34.679792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:34.680584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:34.688882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:34.693129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:34.929967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:34.955004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:34.964509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:34.975342 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7daa7ef9-b448-4b68-9a41-c537cff8a56f tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1414 microversion: 2.54 time: 0.324733 Oct 24 09:13:34.980438 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2328/4774] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:34 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1414 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:35.492723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:35.494128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:35.508137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:35.509501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:35.510122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:35.512290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:35.513641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:35.514594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.006712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:36.007331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:36.016562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:36.017054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:36.017521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.018230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:36.018688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:36.019118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.055250 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:36.154238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.179587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.185651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.194008 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-066e1b6a-168f-40e6-a400-e86b1ef13afe tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1399 microversion: 2.54 time: 0.191477 Oct 24 09:13:36.197901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2329/4775] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:36 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1399 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:36.227039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98e7f121-8bcc-4bd1-ac44-cf7781f491c3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '.version_select at 0x7f8daa0c1ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:36.268443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.285611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6124648e-6e6c-4de9-842b-809bb9df46f6 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.797434 Oct 24 09:13:36.291397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98e7f121-8bcc-4bd1-ac44-cf7781f491c3 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1053420115" status: 204 len: 0 microversion: 2.54 time: 0.068822 Oct 24 09:13:36.292002 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2330/4776] 10.222.0.25 () {60 vars in 1319 bytes} [Mon Oct 24 09:13:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1053420115 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 09:13:36.313339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2447/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:35 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:36.318665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:36.319262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:36.321222 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:36.331403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:36.331900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:36.332342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.333088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:36.333589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:36.338926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.454841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:13:36.660370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3217dba0-f248-4ad7-bc0b-dbd9daeafdb6 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 204 len: 0 microversion: 2.54 time: 0.356114 Oct 24 09:13:36.666444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2331/4778] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:13:36 2022] DELETE /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:13:36.671726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:36.673167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:36.689023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:36.689829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:36.690720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.693583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:36.694229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:36.697530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:36.912158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.926586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.937971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:36.939314 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9f534cc-6418-4622-b571-1be6fd306238 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1405 microversion: 2.54 time: 0.271541 Oct 24 09:13:36.940242 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2448/4779] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:36 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:37.310547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-381042318", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "775100ad-fe00-474a-b5a2-7395a879731b"}, {"uuid": "fe8cacab-16de-46cc-851a-cf60098612d4"}, {"uuid": "775100ad-fe00-474a-b5a2-7395a879731b"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:37.320659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:37.321309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:37.333326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:37.334080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:37.334694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:37.335581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:37.336206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:37.346394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:37.430262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] validate_networks() for [('775100ad-fe00-474a-b5a2-7395a879731b', None, None, None, None, None), ('fe8cacab-16de-46cc-851a-cf60098612d4', None, None, None, None, None), ('775100ad-fe00-474a-b5a2-7395a879731b', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:13:37.873343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:37.884665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f88f17d3-bceb-48d4-9688-da2980a1afa1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.568363 Oct 24 09:13:37.900278 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2449/4780] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:37 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:37.975870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:37.976752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:37.986819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:37.987673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:37.993802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:37.995059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:37.995709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:37.996309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:38.044516 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:38.210507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:38.226932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:38.235123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:38.246843 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3dbdb36-e00b-4d0f-aa70-c794c69ac98c tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1405 microversion: 2.54 time: 0.270182 Oct 24 09:13:38.248182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2450/4781] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:37 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:38.907334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:38.908204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:38.931269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:38.931789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:38.932237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:38.938313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:38.938839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:38.939279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:39.451460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:39.466182 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85c079c8-2f35-45d0-94f6-fc454afbde3b tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.562735 Oct 24 09:13:39.467287 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2451/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:38 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:39.474462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:39.476032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:39.484372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:39.485474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:39.486254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:39.487409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:39.488350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:39.489644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:39.622671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:39.623487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:39.624308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:39.625053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lazy-loading 'fault' on Instance uuid 2ac63e52-152d-4b2a-a4d7-914f5595f928 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:13:39.721279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:39.732388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:39.747688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f80f666981ad4c04b1122d6d640065e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6d22d767ae45c5a743f1ea344a3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:39.748952 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4ae7adbd-6cd1-4bb1-bfea-2f71d06ca010 tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 200 len: 1410 microversion: 2.54 time: 0.280493 Oct 24 09:13:39.766645 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2452/4783] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:39 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 1410 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:13:40.528698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1517910666", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:40.619310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] validate_networks() for [('cbeac627-52f1-42f1-88ba-a954cfcc5da3', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:13:40.987251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:13:40.987894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:13:40.988276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:13:40.988863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:13:40.989280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:13:41.031159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.031752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.032388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:41.034105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.034741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.035329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:41.094534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Getting quotas for project a4329719ac6b4fc0894b1f642a068376. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:41.110463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Getting quotas for user d9ac971da2614beab2e4598795ed9583 and project a4329719ac6b4fc0894b1f642a068376. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:41.154388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:13:41.164419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:13:41.291455 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7de6a4cd-547d-4b34-b2ae-b15b5fb76e5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.985346 Oct 24 09:13:41.299743 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2332/4784] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:13:41.311494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1914947317", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8307514-b798-47d6-a1cc-4ea023d1539d"}], "security_groups": [{"name": "tempest-securitygroup--81584391"}], "key_name": "tempest-keypair-767674656", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:41.500586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:13:41.502355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:13:41.502855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:13:41.503283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:13:41.503709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:13:41.516307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.516904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.517377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:41.518126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.518588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.523133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:41.554796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Getting quotas for project 154609c5bdf3461aaab4bd699351fb12. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:41.566574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Getting quotas for user 8cfd0f5d7dcd444a9414c69b41044a0a and project 154609c5bdf3461aaab4bd699351fb12. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:41.602572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:13:41.610356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:13:41.619413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] validate_networks() for [('e8307514-b798-47d6-a1cc-4ea023d1539d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:13:41.772729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3991d5cf-9251-447a-8410-161f84852028 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779079 Oct 24 09:13:41.783804 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2453/4785] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:13:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:13:41.807062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3bede6df-7cec-49be-a687-2f624b14109c req-b931c3a0-0303-4d2d-99ce-cfb9fa017ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "name": "network-vif-plugged", "status": "completed", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:41.853999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bede6df-7cec-49be-a687-2f624b14109c req-b931c3a0-0303-4d2d-99ce-cfb9fa017ad1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.855416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bede6df-7cec-49be-a687-2f624b14109c req-b931c3a0-0303-4d2d-99ce-cfb9fa017ad1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.859283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bede6df-7cec-49be-a687-2f624b14109c req-b931c3a0-0303-4d2d-99ce-cfb9fa017ad1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:41.885912 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3bede6df-7cec-49be-a687-2f624b14109c req-b931c3a0-0303-4d2d-99ce-cfb9fa017ad1 service nova] Creating event network-vif-plugged:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:13:41.902106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3bede6df-7cec-49be-a687-2f624b14109c req-b931c3a0-0303-4d2d-99ce-cfb9fa017ad1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116462 Oct 24 09:13:41.903308 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2454/4786] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:41.937798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:41.938842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:41.947935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.948443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.949075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:41.952380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:41.956671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:41.957405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.388606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:13:42.390980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:13:42.392438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:13:42.392931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:13:42.393279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:13:42.403745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:42.404387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:42.405395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:42.406410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.407347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:42.407971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:42.408686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.418052 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c17a48b-2c86-4f19-acb1-97005378f632 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.513258 Oct 24 09:13:42.429049 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2455/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:41 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:42.434196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for project 7ee7511c75374ba599216666ba191e9e. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:13:42.440828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for user de6929c304ff4260b9e7c4d469b71a0d and project 7ee7511c75374ba599216666ba191e9e. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:13:42.458571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:13:42.461206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:13:42.462319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:42.463174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] [instance: 2ac63e52-152d-4b2a-a4d7-914f5595f928] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:42.481369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:42.482190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:42.482838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.486754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:42.487851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:42.489273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.559449 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] HTTP exception thrown: Instance 2ac63e52-152d-4b2a-a4d7-914f5595f928 could not be found. Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Request method failure captured: Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 HTTP/1.1 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlcbY-GwAkr5LoeX6rCH4LhZYPK0iykQ2qXc0Ho7U46JxruEVmDJ1lhWXPnF7lGzx7TUOjAX2-ksrRuE52OIU4yXnbwrm07_UwzbxnyPWI-F69WSL821-999a8xqN8X-EGYB-Ag980NtQ-fC624BvhVAq0JcTWNbnOZS3XJiWxpOAwg Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.54 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4d6d22d767ae45c5a743f1ea344a3d9e Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerShowV254Test-734099226 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d6d22d767ae45c5a743f1ea344a3d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d6d22d767ae45c5a743f1ea344a3d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d6d22d767ae45c5a743f1ea344a3d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d6d22d767ae45c5a743f1ea344a3d9e"}]}] Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerShowV254Test-734099226 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4d6d22d767ae45c5a743f1ea344a3d9e Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerShowV254Test-734099226 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerShowV254Test-734099226-project Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f80f666981ad4c04b1122d6d640065e8 Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerShowV254Test-734099226-project Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 2ac63e52-152d-4b2a-a4d7-914f5595f928 could not be found. Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '2ac63e52-152d-4b2a-a4d7-914f5595f928'} Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac63e52-152d-4b2a-a4d7-914f5595f928 could not be found. Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac63e52-152d-4b2a-a4d7-914f5595f928 could not be found. Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:42.565219 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac63e52-152d-4b2a-a4d7-914f5595f928 could not be found. Oct 24 09:13:42.571467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:13:42.574395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] Returning 404 to user: Instance 2ac63e52-152d-4b2a-a4d7-914f5595f928 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:13:42.574395 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cacacf85-7997-4864-b596-e337a60f0d5b tempest-ServerShowV254Test-734099226 tempest-ServerShowV254Test-734099226-project] 10.222.0.25 "GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928" status: 404 len: 111 microversion: 2.54 time: 0.139040 Oct 24 09:13:42.578011 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2456/4788] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:13:42 2022] GET /compute/v2.1/servers/2ac63e52-152d-4b2a-a4d7-914f5595f928 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:13:42.601825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:42.603873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:42.609845 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e003033-9a73-4162-94fe-815708a03695 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.308379 Oct 24 09:13:42.611679 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2333/4789] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:13:41 2022] POST /compute/v2.1/servers => generated 400 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:13:42.618952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:42.620911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:42.626086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a10fc80b-308f-48df-88c0-36c5b828b677 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:42.626640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.628244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a10fc80b-308f-48df-88c0-36c5b828b677 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:42.629682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:42.632277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:42.633843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:42.821159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a10fc80b-308f-48df-88c0-36c5b828b677 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:42.829709 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a10fc80b-308f-48df-88c0-36c5b828b677 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1224 microversion: 2.1 time: 0.216727 Oct 24 09:13:42.830434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2334/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:42 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1224 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:42.842332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a94503b5-f876-442a-bf79-0a1027a44387 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:42.851675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a94503b5-f876-442a-bf79-0a1027a44387 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:42.859520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:42.884623 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-205e9f68-b8c2-467e-bb4b-be60b488f971 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1216 microversion: 2.1 time: 0.302202 Oct 24 09:13:42.885259 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2457/4791] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:42 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1216 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:43.059291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a94503b5-f876-442a-bf79-0a1027a44387 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:43.086264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a94503b5-f876-442a-bf79-0a1027a44387 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1237 microversion: 2.1 time: 0.249846 Oct 24 09:13:43.102075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2335/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:42 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1237 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:43.458732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:43.460856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:43.505722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:43.509854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:43.511883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:43.514396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:43.516448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:43.518029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:43.803702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:43.826422 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b57b2599-ea15-4aa5-94b2-401ce79a1835 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1323 microversion: 2.1 time: 0.374645 Oct 24 09:13:43.828027 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2458/4793] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:43 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:43.858979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:43.859761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:43.912615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:43.913513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:43.917788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:43.920686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:43.928239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:43.933844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:43.944361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:43.944361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:43.946707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:43.949147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:43.952037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:43.955227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:43.956461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:43.976204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:44.209667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:44.239217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07533059-9529-4b68-80ec-d60cebc88c54 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1272 microversion: 2.1 time: 0.327710 Oct 24 09:13:44.243588 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2459/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:43 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:44.263102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:44.269757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:44.294715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:44.296344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:44.297737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:44.299852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:44.301319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:44.302727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:44.387293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:44.401475 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dacf0aef-9340-4ddc-bbe6-0b19957a1622 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1276 microversion: 2.1 time: 0.545378 Oct 24 09:13:44.420919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2336/4795] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:43 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1276 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:44.549811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:44.560675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d9630091-6bcd-48a0-84c5-604a8575bbfd tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1241 microversion: 2.1 time: 0.315325 Oct 24 09:13:44.561761 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2460/4796] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:44 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1241 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:44.857019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:44.859196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:44.879151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:44.881921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:44.882792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:44.884416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:44.888072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:44.892785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.280755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:45.281413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:45.302067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:45.302886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:45.304791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.306440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:45.309065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:45.310393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.544478 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:45.563385 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd812e23-7dd0-4a52-b307-8a826dc40df5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1270 microversion: 2.1 time: 0.284426 Oct 24 09:13:45.563385 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2461/4797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:45 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:45.587550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:45.588588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:45.603417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:45.604327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:45.605848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.606853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:45.618763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:45.621315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.779594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:45.795306 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c10d5814-9e6e-45b2-aa71-95c5b700a8c7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1282 microversion: 2.1 time: 0.226774 Oct 24 09:13:45.799536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2462/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:45 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:45.807101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:45.807918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:45.823193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:45.825332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:45.826800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.828685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:45.830732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:45.831562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:45.947107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:45.958144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-931007ae-0b87-423c-bffe-343c0acad1df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1297 microversion: 2.1 time: 0.156691 Oct 24 09:13:45.997489 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2463/4799] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:45 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1297 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:46.589672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:46.594167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:46.612202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:46.618812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:46.620191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:46.626732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:46.632951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:46.635962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:46.783750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:46.811330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92c796de-daaf-48d6-8fde-fb59ed27888e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1270 microversion: 2.1 time: 0.222590 Oct 24 09:13:46.822437 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2464/4800] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:46 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:46.822437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:46.822437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:46.847889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:46.849398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:46.858573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:46.859898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:46.860544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:46.861389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:46.989734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:47.001815 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9bfae8bd-0526-4be2-a196-8d56d31d8e2a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1282 microversion: 2.1 time: 0.185702 Oct 24 09:13:47.018539 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2465/4801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:46 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:47.034965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:47.036610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:47.047499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.048609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.049206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.050193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.052260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.052878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.204356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:47.217236 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-228b9038-4c85-4189-8ec9-deaf016a4f27 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1295 microversion: 2.1 time: 0.190681 Oct 24 09:13:47.226967 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2466/4802] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:47 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1295 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:47.358787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:47.371597 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ef0fbf7a-e3fe-4095-886f-28773d2a1f59 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1517 microversion: 2.1 time: 2.523938 Oct 24 09:13:47.374186 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2337/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:44 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1517 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:47.400929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:47.404859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:47.412045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.413002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.414594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.415802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.416700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.417586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.463316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lazy-loading 'flavor' on Instance uuid 1e564297-0244-4225-98df-604a17f8c518 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:13:47.533206 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:47.601353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d1b48f4-adc3-4f01-ade1-6c8f156fbd16 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action" status: 200 len: 32 microversion: 2.1 time: 0.208240 Oct 24 09:13:47.603604 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2467/4804] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:13:47 2022] POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:13:47.614977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:47.627655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:47.644359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.647416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.647975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.650371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.651106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.653204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.842867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:47.843585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:47.883130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.883646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.884099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:47.889538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:47.890036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:47.890486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:48.126913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:48.142337 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5a0f718f-19a6-429b-a813-e29c91967151 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1270 microversion: 2.1 time: 0.302285 Oct 24 09:13:48.143421 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2468/4805] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:47 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1270 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:48.156310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:48.177391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:48.206273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:48.208744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:48.209373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:48.212459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:48.215211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:48.218384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:48.418048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:48.428772 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-deb1696f-724b-47ce-bae3-dd4163152447 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.818795 Oct 24 09:13:48.450757 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2338/4806] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:47 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:48.461477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:48.462367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:48.482937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:48.485112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:48.485803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:48.486713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:48.487363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:48.487982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:48.650538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:48.667772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:48.669587 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c678c74-81ca-49d8-80cc-c0175eefb935 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1295 microversion: 2.1 time: 0.210304 Oct 24 09:13:48.670354 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2339/4807] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:48 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1295 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:48.682652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee2ab6bb-c71b-4086-bdda-2439d648db05 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1282 microversion: 2.1 time: 0.535295 Oct 24 09:13:48.687187 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2469/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:48 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1282 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:49.086563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:49.087142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:49.106649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.107368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.107835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.108541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.108992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.126099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.193024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:49.193024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:49.251067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ddf422a-5fbb-447f-a625-e9b43fcdb7a6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/ips" status: 200 len: 149 microversion: 2.1 time: 0.169852 Oct 24 09:13:49.263015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.264355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.264971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.265918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.266542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.274895 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2340/4809] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:13:49 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/ips => generated 149 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:49.276268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.285143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c089808f-f24b-401e-8245-13fae8746018"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:49.330132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:49.355063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.355780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.356233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.357004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.357499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.357922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.593122 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Invalid volume: volume c089808f-f24b-401e-8245-13fae8746018 is already attached to instances: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/os-volume_attachments HTTP/1.1 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 74 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "c089808f-f24b-401e-8245-13fae8746018"}} Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid volume: volume c089808f-f24b-401e-8245-13fae8746018 is already attached to instances: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '9fc7944c-aa41-4bfa-9fdd-989138db06a2', 'body': {'volumeAttachment': {'volumeId': 'c089808f-f24b-401e-8245-13fae8746018'}}} Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c089808f-f24b-401e-8245-13fae8746018 is already attached to instances: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:13:49.595678 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c089808f-f24b-401e-8245-13fae8746018 is already attached to instances: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c089808f-f24b-401e-8245-13fae8746018 is already attached to instances: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 Oct 24 09:13:49.601278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:49.605482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 400 to user: Invalid volume: volume c089808f-f24b-401e-8245-13fae8746018 is already attached to instances: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:13:49.607574 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5c7ad86-9591-4ef8-ae21-ce8ad2030021 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.331303 Oct 24 09:13:49.613921 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2341/4810] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:13:49 2022] POST /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2/os-volume_attachments => generated 174 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:13:49.624565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:49.631961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:49.646847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.647980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.649059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.653937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.655023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.656470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.693313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:49.704109 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06fbabca-cead-4ad0-a5f8-cad6d6770af3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1312 microversion: 2.1 time: 0.532868 Oct 24 09:13:49.717328 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2470/4811] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:49 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1312 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:49.717328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:49.717328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:49.718271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.718922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.719487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.722830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.722830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.722830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.757025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:13:49.885667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b9d5f8a-f405-48bc-963a-0fb6d8f73910 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 204 len: 0 microversion: 2.1 time: 0.178961 Oct 24 09:13:49.886568 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2471/4812] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:13:49 2022] DELETE /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:13:49.893102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:49.893873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:49.901592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.902513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.903131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:49.904212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:49.905673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:49.906274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.041208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:50.052744 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da03ff2a-4a60-4bd3-9cd0-489aae8d4fd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1295 microversion: 2.1 time: 0.163506 Oct 24 09:13:50.064052 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2472/4813] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:49 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1295 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:50.086339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:50.087364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:50.106884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:50.109495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:50.110410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.114999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:50.117723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:50.118443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.376449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:50.385176 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d2125d5-27fc-4669-b003-38d16ab55e40 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.305181 Oct 24 09:13:50.388573 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2473/4814] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:50 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:50.397020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:50.402160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:50.423924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:50.425161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:50.425871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.427686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:50.429107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:50.429823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.445891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:50.454227 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8658c74d-6829-47fa-b108-a7ba7bfcfb6c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.836559 Oct 24 09:13:50.461665 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2342/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:49 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:50.731039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:50.734409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:50.752296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:50.756806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:50.757511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.758990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:50.759621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:50.765089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:50.824630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:50.835189 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5703441-894a-4c34-9835-f802fb12c858 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1681 microversion: 2.1 time: 0.444818 Oct 24 09:13:50.835803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2474/4816] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:50 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1681 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:51.090867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:51.091507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:51.102415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:51.102932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:51.103381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:51.108554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:51.109085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:51.109538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:51.471844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:51.484475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a51e5f5c-81dd-4603-9e0b-017b57a8b50e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.397782 Oct 24 09:13:51.485080 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2475/4817] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:51 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:51.501624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:51.502270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:51.534024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:51.534024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:51.534024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:51.534024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:51.534024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:51.534024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:51.604131 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:51.606909 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:52.252199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:52.262377 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b619d319-7561-49d1-ad01-50832fb37a23 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1312 microversion: 2.1 time: 1.535603 Oct 24 09:13:52.273590 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2343/4818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:50 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1312 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:52.288053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:52.290624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:52.300381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:52.301214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:52.302001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:52.303577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:52.304663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:52.305754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:52.424134 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:52.643580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:52.657585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-317dc55a-648d-4994-9011-37a79518c2f7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 1.167430 Oct 24 09:13:52.658874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2476/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:51 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:52.667452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:52.669497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:52.680212 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:52.690684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:52.693465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:52.698400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:52.700425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:52.703848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:52.705600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:53.064909 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=20 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:53.391305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:53.404021 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-781f2fb5-a025-4e0c-9873-9a324cfd4fc1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1681 microversion: 2.1 time: 0.743877 Oct 24 09:13:53.404622 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2477/4820] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:52 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1681 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:53.409402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:53.409953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:53.428038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:53.428825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:53.430457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:53.431408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:53.436766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:53.439437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:53.815566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:53.833380 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf0b89ce-6b20-4b5d-aa86-8e9bdbf72800 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.427577 Oct 24 09:13:53.845991 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2478/4821] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:53 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:53.848278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:53.849458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:53.862584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:53.866198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:53.866976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:53.867909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:53.868544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:53.873743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.258388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:54.286053 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5f1fede-7482-4bce-af57-d8e0931f1266 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 2.014394 Oct 24 09:13:54.319906 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2344/4822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:52 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:54.354322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:54.360275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:54.373275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.373637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.380635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.385625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.388435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.390978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.417079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:54.426800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95b19a62-2822-4900-b104-54ff40a55b4a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1333 microversion: 2.1 time: 0.591151 Oct 24 09:13:54.432276 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2479/4823] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:53 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1333 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:54.445467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:54.449250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:54.465042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.466587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.468207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.472824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.474355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.476992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.699551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:54.714430 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b943319d-64dc-4fd2-9f62-9b5d98ca5e9f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 200 len: 1614 microversion: 2.1 time: 0.280742 Oct 24 09:13:54.717624 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2480/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:54 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 1614 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:54.766306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c4ce8cc3-146e-4109-a48c-45b26fae5050 req-d652b8f3-995c-4683-a473-2df4455714a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc7944c-aa41-4bfa-9fdd-989138db06a2", "name": "network-vif-deleted", "tag": "17a56738-b821-4f86-9193-6e61a75bd3bd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:54.798746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4ce8cc3-146e-4109-a48c-45b26fae5050 req-d652b8f3-995c-4683-a473-2df4455714a2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.799322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4ce8cc3-146e-4109-a48c-45b26fae5050 req-d652b8f3-995c-4683-a473-2df4455714a2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.800057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4ce8cc3-146e-4109-a48c-45b26fae5050 req-d652b8f3-995c-4683-a473-2df4455714a2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.828010 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c4ce8cc3-146e-4109-a48c-45b26fae5050 req-d652b8f3-995c-4683-a473-2df4455714a2 service nova] Creating event network-vif-deleted:17a56738-b821-4f86-9193-6e61a75bd3bd for instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 on n-h2-master-1 Oct 24 09:13:54.834660 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c4ce8cc3-146e-4109-a48c-45b26fae5050 req-d652b8f3-995c-4683-a473-2df4455714a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072031 Oct 24 09:13:54.839205 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2481/4825] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:13:54.867999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:54.870394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:54.889208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.890776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.891878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.894122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:54.896813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:54.897325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:54.934288 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:55.243766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:55.252635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cbef2325-01a5-41fa-997c-23f485391076 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.396374 Oct 24 09:13:55.255013 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2482/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:54 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:55.346361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:55.347294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:55.358376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:55.359172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:55.359795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:55.360673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:55.361443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:55.362036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:55.721926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:55.733501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76839b45-0417-4d18-a260-48b8af644857 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.391465 Oct 24 09:13:55.734968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2483/4827] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:55 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:55.741168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:55.742778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:55.751285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:55.751973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:55.752575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:55.753462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:55.754265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:55.754857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:55.930087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:55.942118 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4beb4949-57b9-4b9e-9875-40ad6d2b59b0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 1.615981 Oct 24 09:13:55.951888 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2345/4828] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:54 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:55.969490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:55.970455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:55.985118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:55.986047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:55.986665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:55.987544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:55.988151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:55.989252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:56.029098 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 HTTP/1.1 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9fc7944c-aa41-4bfa-9fdd-989138db06a2'} Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:13:56.030930 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:13:56.035932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:13:56.037263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:13:56.046430 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-819dfeb9-9cf4-4829-8b5e-98a6c0b4ca84 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 404 len: 111 microversion: 2.1 time: 0.090134 Oct 24 09:13:56.047752 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2346/4829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:55 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:13:56.058596 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c8a9bd8-042b-4572-b667-b11eb975b0c4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '.version_select at 0x7f8daa0f6c10>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:56.097326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c8a9bd8-042b-4572-b667-b11eb975b0c4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593124204" status: 202 len: 0 microversion: 2.1 time: 0.044021 Oct 24 09:13:56.099040 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2347/4830] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593124204 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:13:56.238031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:56.282856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:56.283465 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-310066fd-91e5-4e4c-89f5-0f49f50876db tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1333 microversion: 2.1 time: 0.547134 Oct 24 09:13:56.283867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:56.288156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2484/4831] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:55 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1333 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:56.304995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:56.308266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:56.312348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:56.317071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:56.317699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:56.318955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:56.774931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:56.777413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:56.790436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:56.793256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:56.794113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:56.795035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:56.795502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:56.796123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:57.352184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:57.366523 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b96f2ed-ae5f-4cf0-9158-ee90964a3e20 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.592184 Oct 24 09:13:57.367639 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2485/4832] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:56 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:13:57.378086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:57.381239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:57.411328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:57.411847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:57.412307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:57.428630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:57.429101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:57.429557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:57.814095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:57.831235 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e6696bb-17f3-4831-9162-ea59e9e908fa tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.462138 Oct 24 09:13:57.847600 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2486/4833] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:57 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:57.862699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-517bdfa3-91ac-4900-ba96-8ed7afda063e req-cdb75bfe-3166-4a28-9942-f7ad190db701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2b6d56-bf9c-4300-a63a-22b7634d1251", "tag": "3aabc950-9435-422f-80dc-5721c35c7f22"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:57.883860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-517bdfa3-91ac-4900-ba96-8ed7afda063e req-cdb75bfe-3166-4a28-9942-f7ad190db701 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:57.884392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-517bdfa3-91ac-4900-ba96-8ed7afda063e req-cdb75bfe-3166-4a28-9942-f7ad190db701 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:57.884852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-517bdfa3-91ac-4900-ba96-8ed7afda063e req-cdb75bfe-3166-4a28-9942-f7ad190db701 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:57.919150 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-517bdfa3-91ac-4900-ba96-8ed7afda063e req-cdb75bfe-3166-4a28-9942-f7ad190db701 service nova] Creating event network-changed:3aabc950-9435-422f-80dc-5721c35c7f22 for instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 on n-h1-master-1 Oct 24 09:13:57.938316 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-517bdfa3-91ac-4900-ba96-8ed7afda063e req-cdb75bfe-3166-4a28-9942-f7ad190db701 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089158 Oct 24 09:13:57.939991 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2487/4834] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:57.948194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:57.948795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:57.949718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:57.958007 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-861954b9-739e-4242-b0e6-3c1f4a59f09b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 1.679342 Oct 24 09:13:57.959537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:57.960976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:57.961725 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2348/4835] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:56 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:57.961998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:57.963133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:57.963908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:57.964499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:58.366943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:58.377979 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98cb6447-81c3-487c-ad49-5c64d2ff47b3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1333 microversion: 2.1 time: 0.434045 Oct 24 09:13:58.379394 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2488/4836] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:57 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1333 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:58.392266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:58.392831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:58.407444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:58.415467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:58.416204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:58.417898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:58.418515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:58.419266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:58.612588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:58.613088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:58.628026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:58.628536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:58.629067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:58.629800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:58.631105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:58.631691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:58.812449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lazy-loading 'services' on Instance uuid 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:13:58.951608 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd5dcf90-1591-4860-bb3a-0d128945b6dd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments/c089808f-f24b-401e-8245-13fae8746018" status: 202 len: 0 microversion: 2.1 time: 0.341863 Oct 24 09:13:58.952707 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2489/4837] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:13:58 2022] DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments/c089808f-f24b-401e-8245-13fae8746018 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:13:58.959221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:58.960218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:58.978451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:58.982044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:58.982787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:58.984981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:58.985666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:58.986309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.021940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:59.035221 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d0a18d7-2a94-4535-98f1-c58d74d474cb tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.645181 Oct 24 09:13:59.057955 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2349/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:58 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:59.063375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:59.070795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:59.092472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.097085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.098555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.099747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.100451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.101038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.176218 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:59.192473 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32283345-69e8-472f-b07b-a5d669452259 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133010 Oct 24 09:13:59.198035 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2350/4839] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:13:59 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:13:59.203774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:59.206008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:59.219504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.221963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.223718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.224650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.227160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.227776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.410998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:59.422530 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b64c9d7-ea63-4280-a0e3-e893a2d02c77 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.467172 Oct 24 09:13:59.423891 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2490/4840] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:58 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:59.430950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:13:59.433687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:13:59.456605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.461252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.461977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.462934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.463496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.464029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:13:59.726641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:13:59.746584 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b64a668-f6b4-4b54-845c-6524bd4e18d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.320254 Oct 24 09:13:59.751297 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2491/4841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:59 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:13:59.973121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-18038303-c8f8-42be-b239-8583fc2babe0 req-d7467434-4dae-4cf0-80b7-d36ef03d8b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1484921f-2743-4293-8612-41bed0f98326", "tag": "3d46ea9a-e148-4594-96ff-ddfb2f8110aa"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:13:59.998281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-18038303-c8f8-42be-b239-8583fc2babe0 req-d7467434-4dae-4cf0-80b7-d36ef03d8b9b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:13:59.999322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-18038303-c8f8-42be-b239-8583fc2babe0 req-d7467434-4dae-4cf0-80b7-d36ef03d8b9b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:13:59.999846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-18038303-c8f8-42be-b239-8583fc2babe0 req-d7467434-4dae-4cf0-80b7-d36ef03d8b9b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.041135 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-18038303-c8f8-42be-b239-8583fc2babe0 req-d7467434-4dae-4cf0-80b7-d36ef03d8b9b service nova] Creating event network-changed:3d46ea9a-e148-4594-96ff-ddfb2f8110aa for instance 1484921f-2743-4293-8612-41bed0f98326 on n-h1-master-1 Oct 24 09:14:00.058413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-18038303-c8f8-42be-b239-8583fc2babe0 req-d7467434-4dae-4cf0-80b7-d36ef03d8b9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090240 Oct 24 09:14:00.060538 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2492/4842] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:00.063134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:00.073881 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7ba8601-047f-46b4-a315-87bccd4b8e4b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.874480 Oct 24 09:14:00.074457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2351/4843] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:13:59 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:00.090612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:00.091242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:00.110221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.110669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.111126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.111856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.112402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.112841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.218954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:00.221871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:00.238202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.239550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.241953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.242892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.246264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.247216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.317861 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1cc646e-2887-49be-9b4c-ef1839cdcd99 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104688 Oct 24 09:14:00.323607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2493/4844] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:00 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:14:00.446600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:00.447923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:00.458120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.461676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.462390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.463303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.463990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.466348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.653348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:00.665943 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ffb8603-bc85-49be-af8e-74eb3bcd329f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.223135 Oct 24 09:14:00.667092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2494/4845] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:00 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:00.774969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:00.775564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:00.784461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.784973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.789929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.790679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:00.791175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:00.794115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:00.805409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:00.814038 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f2210e6-4315-4178-abac-bf5fa55a8602 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.738562 Oct 24 09:14:00.834575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2352/4846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:00 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:01.024398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:01.033132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ca55dd2-c6f5-4b4d-b979-bee807602b2a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.262887 Oct 24 09:14:01.056143 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2495/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:00 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:01.097340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:01.099154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:01.115794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.116586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.117187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.118102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.118745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.119229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.331499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:01.341948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:01.363577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.367317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.367834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.368810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.373793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.374437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.491232 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-75965455-be6e-4b09-bb4f-b04cf0059960 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159500 Oct 24 09:14:01.495647 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2496/4848] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:01 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:01.667126 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:01.695428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:01.696258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:01.710840 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8844317-0829-4248-8363-8f87f49c420c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.611527 Oct 24 09:14:01.718152 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2353/4849] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:01 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:01.718393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.735973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.736860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.737837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.742566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.743439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.842946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:01.843817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:01.853204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.853985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.854602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:01.858150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:01.858812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:01.859339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:02.136596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:02.147392 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04d1a092-cfea-455e-9f35-3aaba70e0cc4 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.459615 Oct 24 09:14:02.157725 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2497/4850] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:01 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:02.171359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:02.172318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:02.181326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:02.182551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:02.183252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:02.184897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:02.185670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:02.186345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:02.457580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:02.471727 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4a0208f-4540-40ee-96e2-8023cd8d2422 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.632570 Oct 24 09:14:02.481742 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2354/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:01 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:02.510788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:02.513202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:02.534938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:02.540116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:02.545928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:02.546887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:02.554262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:02.555511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:02.667928 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c34ae36b-6476-4142-9635-7102cb8667dc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160783 Oct 24 09:14:02.674482 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2355/4852] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:02 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:02.684164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:02.702059 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-570a2c59-b6be-4c61-a684-53e8963aca28 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.535136 Oct 24 09:14:02.703643 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2498/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:02 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:02.742212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:02.742824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:02.755673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:02.756449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:02.757032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:02.757931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:02.758527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:02.759105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.172146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:03.173075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:03.184998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.185542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.185991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.186718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.189600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.190045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.526572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:03.529146 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:03.543372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cdc61488-aef2-4a68-b67f-0014c0cdd44d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.375068 Oct 24 09:14:03.544744 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2499/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:03 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:03.550036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:03.557234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:03.578016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.578601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.579118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.579972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.580436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.580926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.763216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:03.777329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0655a613-f6c9-40fe-88ca-77242b2f5c83 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 1.038811 Oct 24 09:14:03.804978 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2356/4855] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:02 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:03.842749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:03.848165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:03.878274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.881135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.884486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.886052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.886691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.888390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.889519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:03.902508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59a4de37-70ae-4240-a406-ddc8afbf8cba tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.356007 Oct 24 09:14:03.907408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2500/4856] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:03 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:03.922588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:03.924778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:03.932443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.933202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.935170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.936330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:03.938334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:03.942419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:03.994446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9124c03a-d71a-4fa9-8e45-87685264d097 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186918 Oct 24 09:14:03.995414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2357/4857] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:03 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:04.008562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e04252ed-5e33-41d8-9b44-0684bd71bd14 req-bd85abe0-aa43-49e8-8006-72beb721aaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "tag": "dee07267-85af-44d8-8f4f-b744c74a44a8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:04.030606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e04252ed-5e33-41d8-9b44-0684bd71bd14 req-bd85abe0-aa43-49e8-8006-72beb721aaf4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:04.031457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e04252ed-5e33-41d8-9b44-0684bd71bd14 req-bd85abe0-aa43-49e8-8006-72beb721aaf4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:04.033309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e04252ed-5e33-41d8-9b44-0684bd71bd14 req-bd85abe0-aa43-49e8-8006-72beb721aaf4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:04.073527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e04252ed-5e33-41d8-9b44-0684bd71bd14 req-bd85abe0-aa43-49e8-8006-72beb721aaf4 service nova] Creating event network-changed:dee07267-85af-44d8-8f4f-b744c74a44a8 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:04.085707 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e04252ed-5e33-41d8-9b44-0684bd71bd14 req-bd85abe0-aa43-49e8-8006-72beb721aaf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087800 Oct 24 09:14:04.086983 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2358/4858] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:04.509657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:04.519897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-69a278af-4869-4f3e-baf4-df100c1e55b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.611046 Oct 24 09:14:04.520596 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2501/4859] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:03 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:04.569283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:04.570241 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:04.583127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:04.588083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:04.589569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:04.601194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:04.602022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:04.602473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:04.821177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:04.822438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:04.835581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:04.836433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:04.837111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:04.838175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:04.839369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:04.841502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:05.122652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:05.132820 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9deaebea-00f1-45e5-8eb5-f1c8638e8f92 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.315962 Oct 24 09:14:05.164103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2502/4860] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:04 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:05.169174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:05.174646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:05.186353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:05.192652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:05.193114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:05.193928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:05.194912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:05.194912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:05.739925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:05.750149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-045f5106-87fa-49a3-b3a1-5149486415de tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.584655 Oct 24 09:14:05.750947 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2503/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:05 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:05.772218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:05.774835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:05.781846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:05.782539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:05.783150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:05.783758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:05.784584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:05.785264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:05.786069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:05.795776 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58be4902-0832-44d6-b6cf-835798978f3b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 1.230919 Oct 24 09:14:05.806292 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2359/4862] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:04 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:05.811292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:05.818501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:05.822205 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:05.843827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:05.857799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:05.860974 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-048692c7-5cd6-4db0-b3b9-15ed447a4ea2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089441 Oct 24 09:14:05.862000 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2504/4863] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:05 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:05.868327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:05.869958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:05.875085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:05.875912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:06.168467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:06.170219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:06.178801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:06.186373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:06.192272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:06.193243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:06.197148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:06.200477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:06.447052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:06.455879 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee62fa63-f986-412c-8dff-b5377cd23d79 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.648204 Oct 24 09:14:06.477729 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2360/4864] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:05 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:06.677013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:06.694479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-27904dc5-e880-4769-9a4f-19e37fd706e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.529764 Oct 24 09:14:06.699404 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2505/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:06 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:06.775738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:06.776760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:06.790805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:06.792324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:06.793003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:06.796545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:06.797269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:06.797952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:06.830126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:06.830759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:06.849483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:06.852768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:06.854704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:06.855708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:06.857743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:06.859569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.221539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:07.234991 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1d352b3-1c3a-408c-a96f-a964c880e3d8 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.408658 Oct 24 09:14:07.247790 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2506/4866] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:06 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:07.259605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:07.263356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:07.271301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.272119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.272810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.273899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.274611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.275297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.403355 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb9e3ab5-459e-46d9-833d-3eff09b94d4a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152376 Oct 24 09:14:07.405177 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2507/4867] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:07 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:07.412276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ce6be8fc-697e-456b-be79-77fc4a003cbb req-db29dcd0-a304-407f-a6f7-7fff495cbe9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1484921f-2743-4293-8612-41bed0f98326", "name": "network-vif-plugged", "status": "completed", "tag": "3d46ea9a-e148-4594-96ff-ddfb2f8110aa"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:07.442941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ce6be8fc-697e-456b-be79-77fc4a003cbb req-db29dcd0-a304-407f-a6f7-7fff495cbe9c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.443614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ce6be8fc-697e-456b-be79-77fc4a003cbb req-db29dcd0-a304-407f-a6f7-7fff495cbe9c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.444059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ce6be8fc-697e-456b-be79-77fc4a003cbb req-db29dcd0-a304-407f-a6f7-7fff495cbe9c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.481581 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ce6be8fc-697e-456b-be79-77fc4a003cbb req-db29dcd0-a304-407f-a6f7-7fff495cbe9c service nova] Creating event network-vif-plugged:3d46ea9a-e148-4594-96ff-ddfb2f8110aa for instance 1484921f-2743-4293-8612-41bed0f98326 on n-h1-master-1 Oct 24 09:14:07.498402 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ce6be8fc-697e-456b-be79-77fc4a003cbb req-db29dcd0-a304-407f-a6f7-7fff495cbe9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090652 Oct 24 09:14:07.502960 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2508/4868] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:07.515265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:07.515992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:07.538151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.540786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.541652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.542415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.542892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.543327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.904735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:07.918840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0572eeb9-f659-4e55-9d60-4c968041bae5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.413704 Oct 24 09:14:07.921863 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2509/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:07 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:07.946725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:07.947781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:07.977623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.980903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.983797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:07.985794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:07.992159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:07.992744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:08.351610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:08.361267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03458d39-b2cb-4344-86f1-a7f52ddaf202 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.436645 Oct 24 09:14:08.365875 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2510/4870] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:07 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:08.372119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:08.374329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:08.397406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:08.398037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:08.403224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:08.404456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:08.407468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:08.409280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:08.867515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:08.876090 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf3ddc8d-51b0-4070-99c8-123491383eaf tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.508218 Oct 24 09:14:08.898643 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2511/4871] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:08 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:08.908202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:08.911029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:08.954671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:08.964653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:08.965117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:08.965955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:08.966420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:08.966851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.049122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5b378ec-b42d-4c02-8616-aedc444d803a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149006 Oct 24 09:14:09.050548 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2512/4872] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:14:08 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:14:09.055619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:09.070289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:09.083694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:09.087753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.088469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.089082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.091804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.092471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.093218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.097390 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e29a287b-50d9-43ba-9201-ed7f030caa2d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 2.325785 Oct 24 09:14:09.097996 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2361/4873] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:06 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:09.178987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:09.179497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:09.185691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.186175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.186615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.192517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.193000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.193473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.266090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:14:09.429361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db04465a-0809-4cb7-ae3c-94aa08133d05 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 204 len: 0 microversion: 2.1 time: 0.253994 Oct 24 09:14:09.444666 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2362/4874] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:14:09 2022] DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:14:09.459975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:09.462600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:09.486496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.488798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.490315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.492986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.493498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.495833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:09.498126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.508720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3b2b565-b3cb-4ec5-b814-347a5d8f02ef tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.455780 Oct 24 09:14:09.510699 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2513/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:09 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:09.516209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:09.517061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:09.523873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.524539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.525136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.528739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.529571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.530259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.841056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:09.855469 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed9323be-c78f-4e7c-8e1b-1a93a89790c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1680 microversion: 2.1 time: 0.341776 Oct 24 09:14:09.865400 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2514/4876] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:09 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1680 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:09.865400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-01b7f4d3-bdea-4932-a46f-b4ecda3ddf4b req-0381fcc7-c0de-4237-8737-193b021bec5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2b6d56-bf9c-4300-a63a-22b7634d1251", "name": "network-vif-plugged", "status": "completed", "tag": "3aabc950-9435-422f-80dc-5721c35c7f22"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:09.876523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-01b7f4d3-bdea-4932-a46f-b4ecda3ddf4b req-0381fcc7-c0de-4237-8737-193b021bec5f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.887993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-01b7f4d3-bdea-4932-a46f-b4ecda3ddf4b req-0381fcc7-c0de-4237-8737-193b021bec5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.888702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-01b7f4d3-bdea-4932-a46f-b4ecda3ddf4b req-0381fcc7-c0de-4237-8737-193b021bec5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.896324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:09.905684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4d979ef-06ad-40a1-9338-4cfcf9a52df4 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.458026 Oct 24 09:14:09.906492 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2363/4877] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:09 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:09.917480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:09.921651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:09.922686 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-01b7f4d3-bdea-4932-a46f-b4ecda3ddf4b req-0381fcc7-c0de-4237-8737-193b021bec5f service nova] Creating event network-vif-plugged:3aabc950-9435-422f-80dc-5721c35c7f22 for instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 on n-h1-master-1 Oct 24 09:14:09.927986 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-01b7f4d3-bdea-4932-a46f-b4ecda3ddf4b req-0381fcc7-c0de-4237-8737-193b021bec5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069101 Oct 24 09:14:09.932106 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2515/4878] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:09.934200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.939323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.939970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:09.942338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:09.943233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:09.949646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.012791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e16ed8d4-d841-4456-a78c-80361e3805da req-b12b1da9-2f0d-4a7e-805e-da240830bb6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "tag": "7830950a-8d90-481e-92a9-37a31d84da64"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:10.032926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e16ed8d4-d841-4456-a78c-80361e3805da req-b12b1da9-2f0d-4a7e-805e-da240830bb6f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.034657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e16ed8d4-d841-4456-a78c-80361e3805da req-b12b1da9-2f0d-4a7e-805e-da240830bb6f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.035158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e16ed8d4-d841-4456-a78c-80361e3805da req-b12b1da9-2f0d-4a7e-805e-da240830bb6f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.065488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e16ed8d4-d841-4456-a78c-80361e3805da req-b12b1da9-2f0d-4a7e-805e-da240830bb6f service nova] Creating event network-changed:7830950a-8d90-481e-92a9-37a31d84da64 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:10.072222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e16ed8d4-d841-4456-a78c-80361e3805da req-b12b1da9-2f0d-4a7e-805e-da240830bb6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066355 Oct 24 09:14:10.073233 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2516/4879] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:10.131669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:10.132396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:10.153020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.153912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.154382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.155191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.155687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.156327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.312426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:10.324040 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55ab13c4-2479-4825-91eb-600d0013575d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.414658 Oct 24 09:14:10.324635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2364/4880] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:09 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:10.337912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:10.348125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67482781-296c-4824-8560-e3e7a7136513 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.228475 Oct 24 09:14:10.349030 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2517/4881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:10 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:10.534655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:10.536247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:10.561319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.562511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.562972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.563743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.564208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.564641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.883113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:10.884476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:10.897387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.898752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.906748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.907912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:10.908743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:10.909316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:10.952188 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:11.015471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:11.024097 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea72b763-573e-4e21-be3e-a718ac4d4a35 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.495964 Oct 24 09:14:11.043559 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2365/4882] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:10 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:11.055967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:11.056629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:11.077541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:11.080859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:11.081133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:11.082650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:11.083281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:11.084080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:11.110146 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:11.288811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:11.300318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-806fa2ef-0838-4a09-800c-402e759a294f tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1680 microversion: 2.1 time: 0.420073 Oct 24 09:14:11.304109 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2518/4883] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:10 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1680 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:11.318882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:11.333111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11229494-5f79-4c8e-ace7-0736210f1e16 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1361 microversion: 2.1 time: 0.288266 Oct 24 09:14:11.334387 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2366/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:11 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:11.357211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:11.358150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:11.367758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:11.372240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:11.372851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:11.373374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:11.375644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:11.376645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:11.378457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:11.379711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:11.382525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:11.383017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:11.389063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:11.389860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:11.390341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:11.390781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:11.960230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:11.974240 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23259476-c04f-422e-9315-e12e1c84c774 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.619590 Oct 24 09:14:11.974847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2519/4885] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:11 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:12.049981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:12.051237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:12.064101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:12.064612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:12.065056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:12.065812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:12.066304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:12.066734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:12.115482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:12.125446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-485ba86e-d6ea-4709-9678-8a117386b66d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.757188 Oct 24 09:14:12.128223 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2367/4886] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:11 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:12.330668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:12.331308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:12.341109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:12.341640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:12.347132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:12.348035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:12.348526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:12.348974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:12.372778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:12.383142 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62324817-e5c0-41c8-8720-c0e4491a4dc2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.336995 Oct 24 09:14:12.386733 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2520/4887] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:12 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:12.405684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:12.405902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:12.443584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:12.444103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:12.444555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:12.454190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:12.454704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:12.455156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.185439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:13.197632 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3de474a9-3ef7-48df-9043-1254d6d19d68 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1680 microversion: 2.1 time: 0.868837 Oct 24 09:14:13.198455 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2368/4888] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:12 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1680 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:13.211860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:13.214113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:13.228849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:13.230834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:13.231449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.236480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:13.237324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:13.240087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.482988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:13.495656 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c5f5a08-5578-4032-9e01-62c9f5da1338 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1546 microversion: 2.1 time: 1.098010 Oct 24 09:14:13.510065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2521/4889] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:12 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1546 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:13.524765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:13.525650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:13.549941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:13.550893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:13.551844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.552942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:13.557021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:13.557720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.748805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:13.758736 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-519de57b-6ac7-4b9e-aa58-2b3c3f67a522 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1324 microversion: 2.1 time: 0.558169 Oct 24 09:14:13.762414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2369/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:13 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:13.778421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:13.779225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:13.798267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:13.800794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:13.801453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.805319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:13.807145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:13.807764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:13.970087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:13.983726 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0040e87a-2ed0-46fd-84da-8e99b8de4186 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.469056 Oct 24 09:14:13.984383 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2522/4891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:13 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:14.022506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:14.023375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:14.029998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.030822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.031543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:14.032487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.033172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.033847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:14.560612 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ceec7b5-7491-480c-907a-b45625adcded tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.553530 Oct 24 09:14:14.568800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2523/4892] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:14:13 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-interface => generated 284 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:14.568800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-16abd761-ccd7-4eae-951a-b14b9536d2b4 req-5cf688eb-e8cc-4f4e-ae60-d342ca618491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "tag": "3584e91b-3d34-480f-b361-a551e84771a2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:14.593520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-16abd761-ccd7-4eae-951a-b14b9536d2b4 req-5cf688eb-e8cc-4f4e-ae60-d342ca618491 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.599510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-16abd761-ccd7-4eae-951a-b14b9536d2b4 req-5cf688eb-e8cc-4f4e-ae60-d342ca618491 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.600215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-16abd761-ccd7-4eae-951a-b14b9536d2b4 req-5cf688eb-e8cc-4f4e-ae60-d342ca618491 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:14.638939 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-16abd761-ccd7-4eae-951a-b14b9536d2b4 req-5cf688eb-e8cc-4f4e-ae60-d342ca618491 service nova] Creating event network-changed:3584e91b-3d34-480f-b361-a551e84771a2 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:14.656901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-16abd761-ccd7-4eae-951a-b14b9536d2b4 req-5cf688eb-e8cc-4f4e-ae60-d342ca618491 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094043 Oct 24 09:14:14.658685 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2524/4893] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:14.676540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:14.677683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:14.699619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.700143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.700591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:14.701384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.701842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.714058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:14.810467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:14.829441 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6be5d4ba-ab49-4378-a10c-afabc4a1830a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 1.063446 Oct 24 09:14:14.837638 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2370/4894] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:13 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:14.856642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:14.861517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:14.883242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.888463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.889196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:14.892579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:14.899472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:14.900222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:15.158689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:15.173646 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52ec87a4-fc37-46dd-b958-994a8c0e7661 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1613 microversion: 2.1 time: 0.513403 Oct 24 09:14:15.174261 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2525/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:14 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1613 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:15.186652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:15.187283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:15.206365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:15.207009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:15.207458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:15.213336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:15.213860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:15.214298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:15.537856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:15.559768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-826e3191-a946-41d6-97c0-4851c002c80a tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1520 microversion: 2.1 time: 0.720711 Oct 24 09:14:15.561336 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2371/4896] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:14 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1520 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:15.780702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:15.800549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7e011c1-bba9-4143-bb54-41ff0e6b1ead tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.625178 Oct 24 09:14:15.807035 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2526/4897] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:15 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:15.860291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:15.861044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:15.877577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-321aca8d-9ec6-40cc-ae19-a4fcf826ff9d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1645778021", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:15.893928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:15.894988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:15.895422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:15.896129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:15.896622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:15.897009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-321aca8d-9ec6-40cc-ae19-a4fcf826ff9d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 243 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1645778021", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1645778021', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'cbeac627-52f1-42f1-88ba-a954cfcc5da3'}]}}} Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:15.899909 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-321aca8d-9ec6-40cc-ae19-a4fcf826ff9d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:15.904833 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-321aca8d-9ec6-40cc-ae19-a4fcf826ff9d tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.028145 Oct 24 09:14:15.921626 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2527/4898] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:15 2022] POST /compute/v2.1/servers => generated 175 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:14:15.953156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-510e75c2-0c9c-4b31-83fb-ad60061d2788 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:15.953708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-510e75c2-0c9c-4b31-83fb-ad60061d2788 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: a0bca90f-d4d0-4b8f-82a2-44665211d7d0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:15.986009 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:15.991413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-510e75c2-0c9c-4b31-83fb-ad60061d2788 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] HTTP exception thrown: Instance a0bca90f-d4d0-4b8f-82a2-44665211d7d0 could not be found. Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-510e75c2-0c9c-4b31-83fb-ad60061d2788 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/a0bca90f-d4d0-4b8f-82a2-44665211d7d0/metadata HTTP/1.1 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a0bca90f-d4d0-4b8f-82a2-44665211d7d0 could not be found. Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: action_args: {'server_id': 'a0bca90f-d4d0-4b8f-82a2-44665211d7d0'} Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bca90f-d4d0-4b8f-82a2-44665211d7d0 could not be found. Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bca90f-d4d0-4b8f-82a2-44665211d7d0 could not be found. Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:15.998890 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.004390 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:16.004390 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:16.004390 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bca90f-d4d0-4b8f-82a2-44665211d7d0 could not be found. Oct 24 09:14:16.004390 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.005952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-510e75c2-0c9c-4b31-83fb-ad60061d2788 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 404 to user: Instance a0bca90f-d4d0-4b8f-82a2-44665211d7d0 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:16.006994 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-510e75c2-0c9c-4b31-83fb-ad60061d2788 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/a0bca90f-d4d0-4b8f-82a2-44665211d7d0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.084282 Oct 24 09:14:16.008068 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2528/4899] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:14:15 2022] GET /compute/v2.1/servers/a0bca90f-d4d0-4b8f-82a2-44665211d7d0/metadata => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:16.128106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-537950ab-643e-4c9f-b006-7dd6bdd5a278 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-856610180", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-537950ab-643e-4c9f-b006-7dd6bdd5a278 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 498 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-856610180", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-856610180', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cbeac627-52f1-42f1-88ba-a954cfcc5da3'}]}}} Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:14:16.140429 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.143605 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.150644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-537950ab-643e-4c9f-b006-7dd6bdd5a278 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:16.155044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-537950ab-643e-4c9f-b006-7dd6bdd5a278 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.030941 Oct 24 09:14:16.160476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2529/4900] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:16 2022] POST /compute/v2.1/servers => generated 687 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:14:16.203357 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:16.204237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:16.231495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:16.234004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:16.234851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:16.235738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:16.240738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:16.241901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:16.571349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:16.586069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a083ec94-febc-444e-8443-13ac7579515c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.729748 Oct 24 09:14:16.590781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2372/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:15 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:16.596584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:16.605846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b25a7892-7dfb-4ffa-93a1-e5bd97e66658 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1613 microversion: 2.1 time: 0.407490 Oct 24 09:14:16.606431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2530/4902] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:16 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1613 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a895d153-a4bd-43e4-81b4-97144ac163d7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2137921673", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a895d153-a4bd-43e4-81b4-97144ac163d7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 500 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2137921673", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2137921673', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cbeac627-52f1-42f1-88ba-a954cfcc5da3'}]}}} Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:14:16.621739 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.624455 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.627395 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a895d153-a4bd-43e4-81b4-97144ac163d7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:16.627395 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a895d153-a4bd-43e4-81b4-97144ac163d7 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.027353 Oct 24 09:14:16.635988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-af35ba25-8155-4e90-a6aa-602c06954cd2 req-b8eadf7b-a49f-49ee-bacb-1f046daffb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfabd2e-75fe-4a89-aec7-6fd8ea26db90", "name": "network-vif-deleted", "tag": "dceceead-1051-41fa-b542-01ff4e6ec4b8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:16.642692 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2373/4903] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:16 2022] POST /compute/v2.1/servers => generated 689 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:14:16.646728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-af35ba25-8155-4e90-a6aa-602c06954cd2 req-b8eadf7b-a49f-49ee-bacb-1f046daffb17 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:16.647518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-af35ba25-8155-4e90-a6aa-602c06954cd2 req-b8eadf7b-a49f-49ee-bacb-1f046daffb17 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:16.648322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-af35ba25-8155-4e90-a6aa-602c06954cd2 req-b8eadf7b-a49f-49ee-bacb-1f046daffb17 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:16.663898 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-af35ba25-8155-4e90-a6aa-602c06954cd2 req-b8eadf7b-a49f-49ee-bacb-1f046daffb17 service nova] Creating event network-vif-deleted:dceceead-1051-41fa-b542-01ff4e6ec4b8 for instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 on n-h1-master-1 Oct 24 09:14:16.670355 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-af35ba25-8155-4e90-a6aa-602c06954cd2 req-b8eadf7b-a49f-49ee-bacb-1f046daffb17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037806 Oct 24 09:14:16.672085 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2531/4904] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:16.730475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d492487-e72f-4c41-9a2d-ee948f91d5a0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-566569311", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d492487-e72f-4c41-9a2d-ee948f91d5a0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 753 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-566569311", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-566569311', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cbeac627-52f1-42f1-88ba-a954cfcc5da3'}]}}} Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:14:16.739196 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:14:16.742563 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:14:16.746190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.746190 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.746190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d492487-e72f-4c41-9a2d-ee948f91d5a0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:16.746190 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d492487-e72f-4c41-9a2d-ee948f91d5a0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.018750 Oct 24 09:14:16.782375 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2374/4905] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:16 2022] POST /compute/v2.1/servers => generated 1197 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 24 09:14:16.837405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:16.838954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:16.861758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:16.866932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:16.867755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:16.870313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:16.873907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:16.876147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:16.965192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abee5b1d-e1fa-4dea-8015-55163e5440cb tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-857099981", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abee5b1d-e1fa-4dea-8015-55163e5440cb tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 1265 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-857099981", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cbeac627-52f1-42f1-88ba-a954cfcc5da3"}]}} Oct 24 09:14:16.983739 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-857099981', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cbeac627-52f1-42f1-88ba-a954cfcc5da3'}]}}} Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.986114 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:14:16.987281 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:14:16.992367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 09:14:16.992367 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:16.992367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abee5b1d-e1fa-4dea-8015-55163e5440cb tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:16.992367 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abee5b1d-e1fa-4dea-8015-55163e5440cb tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.029751 Oct 24 09:14:16.992367 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2375/4906] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Oct 24 09:14:16 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 24 09:14:17.020881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d1658bc-459a-4f29-b739-7ec929237d8f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:17.021816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d1658bc-459a-4f29-b739-7ec929237d8f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: ab2f28f6-4857-4a86-9565-582f64578105] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:17.039697 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-0d1658bc-459a-4f29-b739-7ec929237d8f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] HTTP exception thrown: Instance ab2f28f6-4857-4a86-9565-582f64578105 could not be found. Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d1658bc-459a-4f29-b739-7ec929237d8f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ab2f28f6-4857-4a86-9565-582f64578105/metadata/test2 HTTP/1.1 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ab2f28f6-4857-4a86-9565-582f64578105 could not be found. Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'ab2f28f6-4857-4a86-9565-582f64578105', 'id': 'test2'} Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2f28f6-4857-4a86-9565-582f64578105 could not be found. Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2f28f6-4857-4a86-9565-582f64578105 could not be found. Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:17.048995 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:17.060736 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:17.060736 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:17.060736 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2f28f6-4857-4a86-9565-582f64578105 could not be found. Oct 24 09:14:17.060736 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:17.064533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d1658bc-459a-4f29-b739-7ec929237d8f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 404 to user: Instance ab2f28f6-4857-4a86-9565-582f64578105 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:17.069398 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d1658bc-459a-4f29-b739-7ec929237d8f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/ab2f28f6-4857-4a86-9565-582f64578105/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.062883 Oct 24 09:14:17.070568 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2376/4907] 10.222.0.25 () {58 vars in 1281 bytes} [Mon Oct 24 09:14:16 2022] GET /compute/v2.1/servers/ab2f28f6-4857-4a86-9565-582f64578105/metadata/test2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:17.106478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:17.108639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:17.126774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.128639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.131708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.132582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.134811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.135380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.248428 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:14:17.377086 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1d1e1df-bccf-4116-b573-d2ee00b66b0f tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 204 len: 0 microversion: 2.1 time: 0.280771 Oct 24 09:14:17.378658 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2377/4908] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:14:17 2022] DELETE /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:14:17.390259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:17.391502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:17.399984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.401014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.401899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.402965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.403798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.404818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.449994 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:17.461570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c738c65-5460-4ec9-aa2c-dc9f1b3b4c5a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1523 microversion: 2.1 time: 0.629621 Oct 24 09:14:17.479718 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2532/4909] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:16 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1523 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:17.611823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:17.612789 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:17.623122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.623933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.625424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.629119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.629865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.632331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.753041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:17.763832 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ffe61e05-848b-482f-9364-de9f5ca492c5 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1526 microversion: 2.1 time: 0.378978 Oct 24 09:14:17.764439 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2378/4910] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:17 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1526 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:17.776867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:17.777592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:17.791578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.792075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.792521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.793235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.798901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.799415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.877481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:17.877994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:17.881934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:17.882561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lazy-loading 'fault' on Instance uuid 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:14:17.999706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:18.009063 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2af21cc-10d2-493d-9329-7340c45511cd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 200 len: 1331 microversion: 2.1 time: 0.242537 Oct 24 09:14:18.034631 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2379/4911] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:17 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 1331 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:18.445696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:18.455474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c461507c-9077-4947-9664-1fb9d9d3a64f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.848032 Oct 24 09:14:18.456071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2533/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:17 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:18.489402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:18.489986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:18.504036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:18.504666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:18.505852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:18.506574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:18.507031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:18.521663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:18.789143 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:18.790274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:18.826193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:18.834799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:18.839470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:18.840382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:18.841223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:18.841706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:18.920376 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:18.937462 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4f90578f-6530-4e72-ad52-fc118fc6c53c tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1503 microversion: 2.1 time: 0.454180 Oct 24 09:14:18.941732 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2380/4913] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:18 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:18.971248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bea7dc5-c2d9-4a4a-9015-f536e39f76f5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'create', calling method: .version_select at 0x7f8daa0f1dc0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1052361162", "description": "tempest-description-2077819889"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:19.586301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bea7dc5-c2d9-4a4a-9015-f536e39f76f5 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.622197 Oct 24 09:14:19.587946 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2381/4914] 10.222.0.25 () {60 vars in 1180 bytes} [Mon Oct 24 09:14:18 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:19.600403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:19.601403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:19.612038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:19.615071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:19.615829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:19.618745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:19.621275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:19.621963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:19.670915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 HTTP/1.1 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3dfabd2e-75fe-4a89-aec7-6fd8ea26db90'} Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:19.676470 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:19.682722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60a2056e-1c18-4f42-878f-6b71bede2158 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 404 len: 111 microversion: 2.1 time: 0.090924 Oct 24 09:14:19.685170 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2382/4915] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:19 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:19.692054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:19.696598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:19.715420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:19.716762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:19.718783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:19.719831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:19.720461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:19.721054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:20.006299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:20.016090 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d8cb5e4-5548-478a-8769-ce37b0aa18f2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.329736 Oct 24 09:14:20.016687 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2383/4916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:19 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:20.023188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1052361162"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:20.024870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:20.031675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:20.033025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:20.033743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:20.036707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:20.038672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:20.039540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:20.270364 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Adding security group 64e1c9dd-e011-4687-a365-5e5551467c9d to port e2387824-9024-49c7-a289-815d5a38676e Oct 24 09:14:20.341178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:20.353179 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55c52f22-f09d-4985-b0e2-6649a1b9097b tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1526 microversion: 2.1 time: 1.567830 Oct 24 09:14:20.354116 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2534/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:18 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1526 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:20.362360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12570586-cae9-41f0-a8f4-b8a81e25ca20 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '.version_select at 0x7f8daf28a4c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:20.404343 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12570586-cae9-41f0-a8f4-b8a81e25ca20 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-658762735" status: 202 len: 0 microversion: 2.1 time: 0.045808 Oct 24 09:14:20.405518 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2535/4918] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:14:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-658762735 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:14:20.767733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-220b45cd-6efa-447b-bf86-ccf8b428be76 req-100490ee-3d91-43ea-bac0-806b8e17fefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1484921f-2743-4293-8612-41bed0f98326", "tag": "3d46ea9a-e148-4594-96ff-ddfb2f8110aa"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:20.791976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-220b45cd-6efa-447b-bf86-ccf8b428be76 req-100490ee-3d91-43ea-bac0-806b8e17fefd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:20.792473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-220b45cd-6efa-447b-bf86-ccf8b428be76 req-100490ee-3d91-43ea-bac0-806b8e17fefd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:20.792912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-220b45cd-6efa-447b-bf86-ccf8b428be76 req-100490ee-3d91-43ea-bac0-806b8e17fefd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:20.831403 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-220b45cd-6efa-447b-bf86-ccf8b428be76 req-100490ee-3d91-43ea-bac0-806b8e17fefd service nova] Creating event network-changed:3d46ea9a-e148-4594-96ff-ddfb2f8110aa for instance 1484921f-2743-4293-8612-41bed0f98326 on n-h1-master-1 Oct 24 09:14:20.848348 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-220b45cd-6efa-447b-bf86-ccf8b428be76 req-100490ee-3d91-43ea-bac0-806b8e17fefd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082455 Oct 24 09:14:20.849471 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2536/4919] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:14:21.047416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:21.048630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:21.065833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:21.066641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:21.067451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:21.069727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:21.074159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:21.075006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:21.946346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:21.972733 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cbf016a6-5841-463d-81e5-abab3bd78e2c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.929320 Oct 24 09:14:21.980144 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2537/4920] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:21 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:22.005876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:22.013280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:22.029048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:22.034140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:22.037242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:22.042510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:22.045749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:22.047075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:22.195431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:22.208094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:22.208840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:22.209636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lazy-loading 'fault' on Instance uuid dc2b6d56-bf9c-4300-a63a-22b7634d1251 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:14:22.313701 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13516ce1-5cc2-431c-8267-a9873c9506c7 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action" status: 202 len: 0 microversion: 2.1 time: 2.295327 Oct 24 09:14:22.316447 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2384/4921] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:14:20 2022] POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action => generated 0 bytes in 2299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:14:22.324523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1052361162"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:22.325810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:22.355143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:22.357219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:22.357886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:22.360816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:22.361901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:22.364008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:22.399076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfd0f5d7dcd444a9414c69b41044a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154609c5bdf3461aaab4bd699351fb12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:22.413623 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a972ed07-2b30-403e-9737-185c485bfeb0 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 200 len: 1314 microversion: 2.1 time: 0.419964 Oct 24 09:14:22.414493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2538/4922] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:21 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:22.421279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-65c5bd5a-bb65-4e14-bf1f-f6549d639675 req-e666b426-9ccc-44de-b85b-20cca12fdd62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:22.458389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-65c5bd5a-bb65-4e14-bf1f-f6549d639675 req-e666b426-9ccc-44de-b85b-20cca12fdd62 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:22.476195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-65c5bd5a-bb65-4e14-bf1f-f6549d639675 req-e666b426-9ccc-44de-b85b-20cca12fdd62 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:22.477806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-65c5bd5a-bb65-4e14-bf1f-f6549d639675 req-e666b426-9ccc-44de-b85b-20cca12fdd62 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:22.500710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-65c5bd5a-bb65-4e14-bf1f-f6549d639675 req-e666b426-9ccc-44de-b85b-20cca12fdd62 service nova] Creating event network-changed:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:14:22.509091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-65c5bd5a-bb65-4e14-bf1f-f6549d639675 req-e666b426-9ccc-44de-b85b-20cca12fdd62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092367 Oct 24 09:14:22.509739 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2539/4923] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:22.967385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-95b552c9-4c4d-496b-81cb-dd15ee92cb40 req-0dbda5d2-e6db-46e0-8e4a-954ab00c2211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2b6d56-bf9c-4300-a63a-22b7634d1251", "name": "network-vif-deleted", "tag": "3aabc950-9435-422f-80dc-5721c35c7f22"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:22.995421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-95b552c9-4c4d-496b-81cb-dd15ee92cb40 req-0dbda5d2-e6db-46e0-8e4a-954ab00c2211 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:23.002368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-95b552c9-4c4d-496b-81cb-dd15ee92cb40 req-0dbda5d2-e6db-46e0-8e4a-954ab00c2211 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:23.003048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-95b552c9-4c4d-496b-81cb-dd15ee92cb40 req-0dbda5d2-e6db-46e0-8e4a-954ab00c2211 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:23.046639 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-95b552c9-4c4d-496b-81cb-dd15ee92cb40 req-0dbda5d2-e6db-46e0-8e4a-954ab00c2211 service nova] Creating event network-vif-deleted:3aabc950-9435-422f-80dc-5721c35c7f22 for instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 on n-h1-master-1 Oct 24 09:14:23.056305 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-95b552c9-4c4d-496b-81cb-dd15ee92cb40 req-0dbda5d2-e6db-46e0-8e4a-954ab00c2211 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093141 Oct 24 09:14:23.058147 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2540/4924] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:23.064402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:23.065518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:23.073125 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Removing security group 64e1c9dd-e011-4687-a365-5e5551467c9d from port e2387824-9024-49c7-a289-815d5a38676e Oct 24 09:14:23.074198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:23.074900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:23.075528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:23.076402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:23.077079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:23.078353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:23.678846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:23.688186 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91b5d8f3-c058-42c3-b84e-7aa6fe7266ba tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.628194 Oct 24 09:14:23.688971 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2541/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:23 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:23.710609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:23.711444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] [instance: dc2b6d56-bf9c-4300-a63a-22b7634d1251] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:23.717825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:23.718661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:23.719283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:23.720430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:23.721072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:23.721734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:23.737387 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] HTTP exception thrown: Instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 could not be found. Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Request method failure captured: Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 HTTP/1.1 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVldDa0sko2RYD15ZdnAlMbq824ybYXmzcmsAzXfbCqZiO-e7ZgjmIAFOt8nYzPmp87SkxI7jN9CwFuF2ppORb-XtqUvgBqdfz5OE62HBkvIcw6fCW4EYs8VJAaHcQOkSbcCPpS9iCPO9qhIUoRmsXvDbqx47KrKcKn7u4-k_ENT2f9Y Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/154609c5bdf3461aaab4bd699351fb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/154609c5bdf3461aaab4bd699351fb12"}]}] Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 154609c5bdf3461aaab4bd699351fb12 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2024375283 Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8cfd0f5d7dcd444a9414c69b41044a0a Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2024375283-project Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: exception: Instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 could not be found. Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'dc2b6d56-bf9c-4300-a63a-22b7634d1251'} Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 could not be found. Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 could not be found. Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:23.740389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 could not be found. Oct 24 09:14:23.744695 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:23.746108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] Returning 404 to user: Instance dc2b6d56-bf9c-4300-a63a-22b7634d1251 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:23.747130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8d9427d-6c18-4187-94a5-81404a1d8478 tempest-ServerMetadataNegativeTestJSON-2024375283 tempest-ServerMetadataNegativeTestJSON-2024375283-project] 10.222.0.25 "GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251" status: 404 len: 111 microversion: 2.1 time: 0.044204 Oct 24 09:14:23.747872 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2542/4926] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:23 2022] GET /compute/v2.1/servers/dc2b6d56-bf9c-4300-a63a-22b7634d1251 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:23.757691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a55866f8-36e2-4847-bdbf-aefc45d1042a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: .version_select at 0x7f8daa3e6ca0>, body: {"keypair": {"name": "tempest-keypair-1595233653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA62v7o0rHlJVlbLZtsZV+EDiQIpnpxri/jXdfBAHL7t8eaXkBT50NgFT9UXU68AISqDIkqOx2hRnHj0dYnj7jaYLmxsd4kV5oOV5ppiqMVqkesFx45LptSpVtmWwUXGg=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:23.776421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-a55866f8-36e2-4847-bdbf-aefc45d1042a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:14:23.783344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-a55866f8-36e2-4847-bdbf-aefc45d1042a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:14:23.813002 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a55866f8-36e2-4847-bdbf-aefc45d1042a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059949 Oct 24 09:14:23.814307 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2543/4927] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:14:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:24.715285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:24.715928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:24.733179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:24.733707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:24.734149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:24.734872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:24.735329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:24.735756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:24.747017 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:25.343067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-946baa60-b302-4f36-ae0a-ce329c7e728a tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action" status: 202 len: 0 microversion: 2.1 time: 3.022238 Oct 24 09:14:25.345372 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2385/4928] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:14:22 2022] POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action => generated 0 bytes in 3025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:14:25.363521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71e235ab-e995-4a52-a0ad-9d0304ae6cde tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'create', calling method: .version_select at 0x7f8daa5644c0>, body: {"pool": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:25.417324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:25.432108 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-18bdd9a4-8cd7-4231-b16b-2cc331b6c82f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.720939 Oct 24 09:14:25.432919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2544/4929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:24 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:25.444582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e57b9eaa-9046-4443-aa93-bde002a1f728 req-db60a757-79a0-4ab3-bb85-f207609efeca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:25.480864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e57b9eaa-9046-4443-aa93-bde002a1f728 req-db60a757-79a0-4ab3-bb85-f207609efeca service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:25.482854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e57b9eaa-9046-4443-aa93-bde002a1f728 req-db60a757-79a0-4ab3-bb85-f207609efeca service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:25.485533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e57b9eaa-9046-4443-aa93-bde002a1f728 req-db60a757-79a0-4ab3-bb85-f207609efeca service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:25.507650 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e57b9eaa-9046-4443-aa93-bde002a1f728 req-db60a757-79a0-4ab3-bb85-f207609efeca service nova] Creating event network-changed:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:14:25.515352 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e57b9eaa-9046-4443-aa93-bde002a1f728 req-db60a757-79a0-4ab3-bb85-f207609efeca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079177 Oct 24 09:14:25.516737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2545/4930] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:26.461267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:26.462327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:26.476337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:26.480372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:26.481012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:26.481798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:26.482329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:26.482956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:26.868791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:26.879261 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8720145-8ded-4a07-97e7-10bfa9db5560 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.422844 Oct 24 09:14:26.880169 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2546/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:26 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:27.903960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:27.904648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:27.918880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:27.919374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:27.919815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:27.920537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:27.920993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:27.923094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:28.387394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:28.398171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f824e53c-167c-41f4-9b92-87f3cf28c14a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.499843 Oct 24 09:14:28.401340 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2547/4932] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:27 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:28.416382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-90280a78-5f89-4718-afde-49e26ae50ca0 req-95bf48fe-55ed-41b8-8a03-1899e052460a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-plugged", "status": "completed", "tag": "7830950a-8d90-481e-92a9-37a31d84da64"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:28.443064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-90280a78-5f89-4718-afde-49e26ae50ca0 req-95bf48fe-55ed-41b8-8a03-1899e052460a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:28.445993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-90280a78-5f89-4718-afde-49e26ae50ca0 req-95bf48fe-55ed-41b8-8a03-1899e052460a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:28.448802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-90280a78-5f89-4718-afde-49e26ae50ca0 req-95bf48fe-55ed-41b8-8a03-1899e052460a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:28.473519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-90280a78-5f89-4718-afde-49e26ae50ca0 req-95bf48fe-55ed-41b8-8a03-1899e052460a service nova] Creating event network-vif-plugged:7830950a-8d90-481e-92a9-37a31d84da64 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:28.486955 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-90280a78-5f89-4718-afde-49e26ae50ca0 req-95bf48fe-55ed-41b8-8a03-1899e052460a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086206 Oct 24 09:14:28.490765 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2548/4933] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:29.323014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-324373139", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "a2cf5b7d-7a12-4b83-8e1d-3a7960f68ee8"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:29.420184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] validate_networks() for [('a2cf5b7d-7a12-4b83-8e1d-3a7960f68ee8', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:14:29.845955 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71e235ab-e995-4a52-a0ad-9d0304ae6cde tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.487416 Oct 24 09:14:29.846568 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2386/4934] 10.222.0.25 () {60 vars in 1170 bytes} [Mon Oct 24 09:14:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:29.852628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1763383714", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcfcdb25-90f0-4d8a-8f56-0850a24cf320"}], "security_groups": [{"name": "tempest-securitygroup--1128959516"}], "key_name": "tempest-keypair-1595233653", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:30.107557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] validate_networks() for [('bcfcdb25-90f0-4d8a-8f56-0850a24cf320', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:14:30.717163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:14:30.717641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:14:30.718116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:14:30.718747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:14:30.719424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:14:30.733404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:30.734145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:30.734765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:30.735754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:30.736404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:30.737125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:30.759037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:14:30.766670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:14:30.781934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:14:30.785014 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:14:30.851000 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78eb6aed-f2df-4fc4-bb94-389f7a612da4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.002827 Oct 24 09:14:30.858754 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2387/4935] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:14:30.864887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:30.865805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:30.872573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:30.873348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:30.873952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:30.874847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:30.875693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:30.876288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.157361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:31.167440 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a04be611-d556-4297-b3d8-1bd711fafd3e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.306814 Oct 24 09:14:31.168575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2388/4936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:30 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:31.174388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.192"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:31.182013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:31.204619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.209495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.210144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.211217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.211829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.214182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.223635 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:31.260925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "refresh_cache-1e564297-0244-4225-98df-604a17f8c518" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 09:14:31.261082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquired lock "refresh_cache-1e564297-0244-4225-98df-604a17f8c518" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 09:14:31.498150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:14:31.498799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:14:31.499938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:14:31.500709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:14:31.501221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:14:31.549158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.549725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.551367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.555818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.556521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.558777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.629094 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Getting quotas for project d7deb9c74f124ab5947e4fba6320d70f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:14:31.647434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Getting quotas for user b1dd46553649476ca54adf47ecf1a009 and project d7deb9c74f124ab5947e4fba6320d70f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:14:31.667556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:14:31.670183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:14:31.812619 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a13800f-2049-482f-8c93-0172a27d3900 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.083964 Oct 24 09:14:31.822459 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2549/4937] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:14:31.835672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-plugged", "status": "completed", "tag": "3584e91b-3d34-480f-b361-a551e84771a2"}, {"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-plugged", "status": "completed", "tag": "dee07267-85af-44d8-8f4f-b744c74a44a8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:31.847747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.848838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.849780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.867067 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] Creating event network-vif-plugged:3584e91b-3d34-480f-b361-a551e84771a2 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:31.867067 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] Creating event network-vif-plugged:dee07267-85af-44d8-8f4f-b744c74a44a8 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:31.876707 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-dc93c721-2008-4376-9523-9903eafc3ce3 req-5e28088a-7794-4742-896f-714ed8dca612 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052700 Oct 24 09:14:31.880401 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2550/4938] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:31.894288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:31.895215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:31.909038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.909797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.910856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:31.912416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:31.913089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:31.913758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:32.181640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:32.193680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8119da64-7623-4b09-976b-c790aeb3bea5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1238 microversion: 2.1 time: 0.304847 Oct 24 09:14:32.209660 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2551/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:31 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1238 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:32.225261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08e39be5-f7f0-4963-8592-0845a119c391 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:32.226253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08e39be5-f7f0-4963-8592-0845a119c391 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:32.414136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08e39be5-f7f0-4963-8592-0845a119c391 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:32.423631 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08e39be5-f7f0-4963-8592-0845a119c391 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1227 microversion: 2.1 time: 0.211754 Oct 24 09:14:32.424445 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2552/4940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:32 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1227 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:32.435474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:32.446706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:32.465230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:32.467944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:32.472680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:32.476628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:32.478504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:32.480881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:33.226039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:33.254151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a504a6e-cb26-40de-bc09-94cb2012fe8a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1354 microversion: 2.1 time: 0.812415 Oct 24 09:14:33.254790 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2553/4941] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:32 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1354 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:33.271483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:33.279724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:33.318855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:33.319364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:33.330873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:33.332298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:33.332799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:33.333244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:33.513965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:33.524900 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7fe7b1a-dea2-4e97-ac3f-5b34d652fde4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1300 microversion: 2.1 time: 0.262361 Oct 24 09:14:33.525526 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2554/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:33 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:33.533729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:33.537914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:33.552566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:33.554598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:33.556192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:33.556936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:33.558885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:33.559360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:33.860242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:33.879488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c6cb728-c5e1-4a53-abce-207de45c7a23 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1231 microversion: 2.1 time: 0.344988 Oct 24 09:14:33.880840 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2555/4943] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:33 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1231 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:34.278110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:34.283832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:34.330137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:34.333320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:34.337624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:34.338384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:34.345345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:34.350068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:34.887074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:34.905696 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dbfb3efe-e66f-478a-9c97-e1128746e6c9 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1803 microversion: 2.1 time: 0.627706 Oct 24 09:14:34.906809 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2556/4944] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:34 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1803 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:34.917119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:34.921019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:34.946715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:34.949036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:34.950566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:34.954944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:34.955579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:34.957480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.137134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:35.150604 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06d251be-a833-4950-8ec8-78b1fbfb85b2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1300 microversion: 2.1 time: 0.241724 Oct 24 09:14:35.151374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2557/4945] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:34 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1300 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:35.162007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:35.162936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:35.188860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.193489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.195024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.196143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.196731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.197176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.466808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:35.488292 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a5b86026-0fa4-4336-a38a-52c8fc212f34 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1287 microversion: 2.1 time: 0.330106 Oct 24 09:14:35.488996 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2558/4946] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:35 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1287 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:35.502570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:35.503107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:35.519725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.520253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.522721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.523405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.523887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.524324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.587478 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2672ca2-671e-468b-83db-7e2a75b92878 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154/ips" status: 200 len: 217 microversion: 2.1 time: 0.097236 Oct 24 09:14:35.588812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2559/4947] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:14:35 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154/ips => generated 217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:35.617273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:35.622350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:35.636538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.637245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.637884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.638764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.640848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.642555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.723371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:14:35.908017 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7922d079-126a-415c-88b7-24a1bdf2698f tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 204 len: 0 microversion: 2.1 time: 0.299562 Oct 24 09:14:35.912232 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2560/4948] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:14:35 2022] DELETE /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:14:35.918418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:35.920145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:35.933521 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:35.935630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.938680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.939637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:35.941090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:35.941602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:35.941992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:36.271878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 09:14:36.347945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:36.362328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23a4f7b5-a574-41e3-a494-2bb88b09a7de tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1809 microversion: 2.1 time: 0.448179 Oct 24 09:14:36.363598 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2561/4949] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:35 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1809 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:36.368825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:36.373221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:36.387623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:36.388432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:36.389054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:36.389970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:36.396871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:36.397598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:36.707131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:36.721163 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9e8bf11-87a7-4045-b423-5d9face73fa5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 0.352717 Oct 24 09:14:36.724652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2562/4950] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:36 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:36.735806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-055052c6-5774-42b9-a295-d7ab26b65b05 req-6c3eb6bb-a6a1-4172-b4b1-66678f449956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:36.764345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-055052c6-5774-42b9-a295-d7ab26b65b05 req-6c3eb6bb-a6a1-4172-b4b1-66678f449956 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:36.765252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-055052c6-5774-42b9-a295-d7ab26b65b05 req-6c3eb6bb-a6a1-4172-b4b1-66678f449956 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:36.769986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-055052c6-5774-42b9-a295-d7ab26b65b05 req-6c3eb6bb-a6a1-4172-b4b1-66678f449956 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:36.779799 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:36.805286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-055052c6-5774-42b9-a295-d7ab26b65b05 req-6c3eb6bb-a6a1-4172-b4b1-66678f449956 service nova] Creating event network-changed:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:14:36.816118 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-055052c6-5774-42b9-a295-d7ab26b65b05 req-6c3eb6bb-a6a1-4172-b4b1-66678f449956 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089090 Oct 24 09:14:36.821070 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2563/4951] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:36.833677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:36.837235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:36.867301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:36.868041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:36.869644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:36.872860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:36.874167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:36.877289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:37.100842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:37.111417 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44f8b138-9ba8-45cd-a796-c7681684fae2 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1285 microversion: 2.1 time: 0.288949 Oct 24 09:14:37.114408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2564/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:36 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:37.394568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:37.395520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:37.404722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:37.405503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:37.406218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:37.407639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:37.408413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:37.409575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:38.817943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:38.826162 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-69184fc7-23f2-4c99-9f54-6e8d34d9b9d5 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1809 microversion: 2.1 time: 1.438682 Oct 24 09:14:38.838477 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2565/4953] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:37 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1809 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:38.857606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-bf8deb8c-1eb6-4b75-b070-95ac421cdd90 req-4664a75b-9bcb-4176-b140-b0964315a604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9435d5-d687-47fa-a450-b70a41159ef7", "tag": "dd06afd7-6b45-4719-afe1-0d38536b02b0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:38.878994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bf8deb8c-1eb6-4b75-b070-95ac421cdd90 req-4664a75b-9bcb-4176-b140-b0964315a604 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:38.879489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bf8deb8c-1eb6-4b75-b070-95ac421cdd90 req-4664a75b-9bcb-4176-b140-b0964315a604 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:38.879924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bf8deb8c-1eb6-4b75-b070-95ac421cdd90 req-4664a75b-9bcb-4176-b140-b0964315a604 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:38.905471 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-bf8deb8c-1eb6-4b75-b070-95ac421cdd90 req-4664a75b-9bcb-4176-b140-b0964315a604 service nova] Creating event network-changed:dd06afd7-6b45-4719-afe1-0d38536b02b0 for instance 9c9435d5-d687-47fa-a450-b70a41159ef7 on n-h2-master-1 Oct 24 09:14:38.915065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-bf8deb8c-1eb6-4b75-b070-95ac421cdd90 req-4664a75b-9bcb-4176-b140-b0964315a604 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075310 Oct 24 09:14:38.915995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2566/4954] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:38.921273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:38.922005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:38.939741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:38.940815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:38.953526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:38.954441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:38.955126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:38.955733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:39.458554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:39.470133 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a4edaa1-f28c-4879-8bd9-a9ea338839d3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 0.552907 Oct 24 09:14:39.479730 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2567/4955] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:38 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:39.495521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:39.496395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:39.506289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:39.506905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:39.507984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:39.509087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:39.510461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:39.511520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:39.790362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:39.800564 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93c2382b-6b08-447d-9772-bf17e2b22431 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 0.318855 Oct 24 09:14:39.802704 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2568/4956] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:39 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:39.869553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:39.870252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:39.878264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:39.879093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:39.891853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:39.893510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:39.894767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:39.895469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:40.170010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Updating instance_info_cache with network_info: [{"id": "e2387824-9024-49c7-a289-815d5a38676e", "address": "fa:16:3e:d3:34:a2", "network": {"id": "69e5eae1-6162-4ad6-b272-9cffcd4d20cb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-855563746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5a7f312d12224117b8c8a1f167d901b8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape2387824-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 09:14:40.193474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Releasing lock "refresh_cache-1e564297-0244-4225-98df-604a17f8c518" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 09:14:40.193645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:40.197915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb23e771-3a2f-4c6f-bfd9-a680938598f4 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action" status: 202 len: 0 microversion: 2.1 time: 9.026848 Oct 24 09:14:40.199290 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2389/4957] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:14:31 2022] POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action => generated 0 bytes in 9030 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 09:14:40.206729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-865034cb-2d1b-49a8-ad93-764e8b193435 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1809 microversion: 2.1 time: 0.341128 Oct 24 09:14:40.214280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.192"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:40.229662 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2569/4958] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:39 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1809 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:40.496811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:40.497773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:40.515737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:40.518252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:40.519938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:40.521544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:40.523232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:40.523839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:40.626021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:40.634512 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:40.636826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:40.637878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:40.638547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:40.642514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:40.644982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:40.646798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:40.746999 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:40.775867 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:40.983132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:40.995593 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-858976ae-765c-4684-840f-f63137e6075c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 0.504072 Oct 24 09:14:40.996472 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2570/4959] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:40 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:41.001583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:41.013017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:41.020140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:41.022844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:41.023499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:41.024399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:41.025836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:41.028033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:41.550522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "refresh_cache-1e564297-0244-4225-98df-604a17f8c518" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 09:14:41.551569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquired lock "refresh_cache-1e564297-0244-4225-98df-604a17f8c518" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 09:14:41.590583 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:41.691052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:41.704501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-045c511c-a93a-4205-8f31-869efc49b4c5 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 0.706250 Oct 24 09:14:41.722553 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2571/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:40 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:41.729817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a9b62f62-9e5d-4c51-a250-0b7abf768813 req-c399e924-9eb8-49f9-95df-14dfe768e598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-deleted", "tag": "3584e91b-3d34-480f-b361-a551e84771a2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:41.741664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a9b62f62-9e5d-4c51-a250-0b7abf768813 req-c399e924-9eb8-49f9-95df-14dfe768e598 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:41.742729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a9b62f62-9e5d-4c51-a250-0b7abf768813 req-c399e924-9eb8-49f9-95df-14dfe768e598 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:41.743412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a9b62f62-9e5d-4c51-a250-0b7abf768813 req-c399e924-9eb8-49f9-95df-14dfe768e598 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:41.757408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a9b62f62-9e5d-4c51-a250-0b7abf768813 req-c399e924-9eb8-49f9-95df-14dfe768e598 service nova] Creating event network-vif-deleted:3584e91b-3d34-480f-b361-a551e84771a2 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:41.765699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a9b62f62-9e5d-4c51-a250-0b7abf768813 req-c399e924-9eb8-49f9-95df-14dfe768e598 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040769 Oct 24 09:14:41.766675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2572/4961] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:41.773172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-72016e7f-3889-40fa-a20d-fd6c5d3810f2 req-f0aaf9e5-58e3-468f-84c7-9946dbf73676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-unplugged", "status": "completed", "tag": "dee07267-85af-44d8-8f4f-b744c74a44a8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:41.784883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-72016e7f-3889-40fa-a20d-fd6c5d3810f2 req-f0aaf9e5-58e3-468f-84c7-9946dbf73676 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:41.785681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-72016e7f-3889-40fa-a20d-fd6c5d3810f2 req-f0aaf9e5-58e3-468f-84c7-9946dbf73676 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:41.786281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-72016e7f-3889-40fa-a20d-fd6c5d3810f2 req-f0aaf9e5-58e3-468f-84c7-9946dbf73676 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:41.802884 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-72016e7f-3889-40fa-a20d-fd6c5d3810f2 req-f0aaf9e5-58e3-468f-84c7-9946dbf73676 service nova] Creating event network-vif-unplugged:dee07267-85af-44d8-8f4f-b744c74a44a8 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:41.810956 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-72016e7f-3889-40fa-a20d-fd6c5d3810f2 req-f0aaf9e5-58e3-468f-84c7-9946dbf73676 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041731 Oct 24 09:14:41.812702 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2573/4962] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:41.820840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:41.821974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:41.832494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:41.833349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:41.834740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:41.835669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:41.836379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:41.837618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:42.404969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:42.417448 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19646575-2a8e-4491-bedc-c491180d5c20 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1673 microversion: 2.1 time: 0.600621 Oct 24 09:14:42.418422 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2574/4963] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:41 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1673 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:42.427163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:42.437800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:42.447252 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:42.450062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:42.450820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:42.451559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:42.452718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:42.453225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:42.453960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:42.906632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:42.920822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-030bc16a-6bcd-4521-8d40-5a2b4846bff7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 0.501254 Oct 24 09:14:42.921454 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2575/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:42 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:42.926100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:42.926720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:42.950527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:42.951668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:42.953739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:42.956115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:42.956908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:42.959024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:43.490419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:43.503990 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-29022c2d-918b-43e0-921a-e11d162f5e31 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 0.581431 Oct 24 09:14:43.522421 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2576/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:42 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:43.527675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:43.528528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:43.536617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:43.537367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:43.537996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:43.538877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:43.539502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:43.540152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:43.931600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:43.947399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dbb86af3-6121-46b0-b7d1-fc4ea2ced49c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1652 microversion: 2.1 time: 0.420348 Oct 24 09:14:43.949057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2577/4966] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:43 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1652 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:43.961601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-958730fa-9e63-4332-9fa8-3b38f5f28063 req-2b03e68e-81ec-42a3-b614-338be1b3ef1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-unplugged", "status": "completed", "tag": "7830950a-8d90-481e-92a9-37a31d84da64"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:43.991282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-958730fa-9e63-4332-9fa8-3b38f5f28063 req-2b03e68e-81ec-42a3-b614-338be1b3ef1c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:43.992445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-958730fa-9e63-4332-9fa8-3b38f5f28063 req-2b03e68e-81ec-42a3-b614-338be1b3ef1c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:43.994585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-958730fa-9e63-4332-9fa8-3b38f5f28063 req-2b03e68e-81ec-42a3-b614-338be1b3ef1c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.022436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-958730fa-9e63-4332-9fa8-3b38f5f28063 req-2b03e68e-81ec-42a3-b614-338be1b3ef1c service nova] Creating event network-vif-unplugged:7830950a-8d90-481e-92a9-37a31d84da64 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:44.036286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-958730fa-9e63-4332-9fa8-3b38f5f28063 req-2b03e68e-81ec-42a3-b614-338be1b3ef1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085837 Oct 24 09:14:44.040059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2578/4967] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:44.053105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:44.056424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:44.068389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.069244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.070033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.071109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.071543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.072151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.301424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:44.315884 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-982cdedd-9978-4c26-9e59-2035f61b9e22 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 0.273782 Oct 24 09:14:44.316979 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2579/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:44 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:44.322391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4adb0f4-7c0c-4b62-bcf7-d11e7b084572", "tag": "7b1a9aec-697a-469c-824e-a9c2a92d42ee"}, {"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-deleted", "tag": "7830950a-8d90-481e-92a9-37a31d84da64"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:44.368702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.369204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.369675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.419982 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] Creating event network-changed:7b1a9aec-697a-469c-824e-a9c2a92d42ee for instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 on n-h1-master-1 Oct 24 09:14:44.420429 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] Creating event network-vif-deleted:7830950a-8d90-481e-92a9-37a31d84da64 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:44.438465 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a01403c4-1298-4d24-bb5a-67ee844a3dc6 req-e6621b00-0db2-4190-b86e-b185555bfaa5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.118566 Oct 24 09:14:44.442523 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2580/4969] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:44.531926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:44.532824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:44.553060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.554091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.554776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.558041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.559119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.560324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.931302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:44.939996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd143079-b601-45a7-a365-550dee41b0d8 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 0.414146 Oct 24 09:14:44.941669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Building network info cache for instance {{(pid=126919) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 09:14:44.948265 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2581/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:44 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:44.959312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:44.961110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:44.977557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.985962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.986969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:44.991226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:44.992269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:44.992959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:45.075584 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca9722c8-f305-4bde-8132-5e756b1edd82 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/ips" status: 200 len: 144 microversion: 2.1 time: 0.125852 Oct 24 09:14:45.076754 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2582/4971] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:14:44 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/ips => generated 144 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:45.087992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:45.091166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:45.118527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:45.119161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:45.119698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:45.120494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:45.121028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:45.121610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:45.260164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:45.275607 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ab00f9b-2023-4340-af77-47c7d388dc4c tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 200 len: 1610 microversion: 2.1 time: 0.196378 Oct 24 09:14:45.276234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2583/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:45 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 1610 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:45.340952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:45.341746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:45.354341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:45.354856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:45.357842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:45.361544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:45.363101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:45.364409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:45.403979 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:45.954517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:45.969256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9116534d-f5f1-40af-a26c-4a3ffc7a2162 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 0.628243 Oct 24 09:14:45.970855 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2584/4973] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:45 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:45.982734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:45.983373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:46.009840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:46.010360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:46.014041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:46.018055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:46.018625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:46.019081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:46.845280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Updating instance_info_cache with network_info: [{"id": "e2387824-9024-49c7-a289-815d5a38676e", "address": "fa:16:3e:d3:34:a2", "network": {"id": "69e5eae1-6162-4ad6-b272-9cffcd4d20cb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-855563746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5a7f312d12224117b8c8a1f167d901b8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape2387824-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126919) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 09:14:46.876287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Releasing lock "refresh_cache-1e564297-0244-4225-98df-604a17f8c518" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 09:14:46.881328 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1088876a-c68c-483d-986b-0a761a1b8720 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action" status: 202 len: 0 microversion: 2.1 time: 6.673372 Oct 24 09:14:46.886045 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2390/4974] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:14:40 2022] POST /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518/action => generated 0 bytes in 6683 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 09:14:46.909328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-95952401-122c-4aa7-8562-cf8e487344c1 req-98998b2c-4b57-4589-8ace-026f9b34757f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9435d5-d687-47fa-a450-b70a41159ef7", "name": "network-vif-plugged", "status": "completed", "tag": "dd06afd7-6b45-4719-afe1-0d38536b02b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:46.948353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-95952401-122c-4aa7-8562-cf8e487344c1 req-98998b2c-4b57-4589-8ace-026f9b34757f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:46.948831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-95952401-122c-4aa7-8562-cf8e487344c1 req-98998b2c-4b57-4589-8ace-026f9b34757f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:46.959482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-95952401-122c-4aa7-8562-cf8e487344c1 req-98998b2c-4b57-4589-8ace-026f9b34757f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:47.019735 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-95952401-122c-4aa7-8562-cf8e487344c1 req-98998b2c-4b57-4589-8ace-026f9b34757f service nova] Creating event network-vif-plugged:dd06afd7-6b45-4719-afe1-0d38536b02b0 for instance 9c9435d5-d687-47fa-a450-b70a41159ef7 on n-h2-master-1 Oct 24 09:14:47.064481 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-95952401-122c-4aa7-8562-cf8e487344c1 req-98998b2c-4b57-4589-8ace-026f9b34757f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176238 Oct 24 09:14:47.073617 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2391/4975] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:47.103245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:47.108936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:47.142528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:47.143041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:47.156649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:47.157469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:47.157988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:47.164458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:47.228639 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] HTTP exception thrown: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Request method failure captured: Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 HTTP/1.1 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc7Jjc4JNMt85j4ZCMbiiLOUR_OKLVWHN6N18BpPC0gMS5eMp0EDyvysfutKR4W4kLxERNOk3bswiXjAP3EcGb5u9G3hR6mSFfqz4r5oZ1qbTBlkjBIzJpb4fN4m27pN_QyqSgvCFzLW-C-Mwcu8ScqHDge3-yxYrvhFRWyVHiKQ-I Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a4329719ac6b4fc0894b1f642a068376"}]}] Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestMultiNic-1652357517 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d9ac971da2614beab2e4598795ed9583 Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f6487fb3-d473-477d-8a0b-ac61b0ecb154'} Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:47.249167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Returning 404 to user: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3ea6725-2059-47e3-b30b-8e96ed79fdfc tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 404 len: 111 microversion: 2.1 time: 0.174541 Oct 24 09:14:47.254264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2392/4976] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:47 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:47.271160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:47.273256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6487fb3-d473-477d-8a0b-ac61b0ecb154", "name": "network-vif-deleted", "tag": "dee07267-85af-44d8-8f4f-b744c74a44a8"}, {"name": "network-changed", "server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:47.279932 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7dc0268-8742-4579-9aa9-56f51f1868bb tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 1.308185 Oct 24 09:14:47.288866 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2585/4977] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:45 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:47.316306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7dad54c-1b17-423d-ac70-7f2923058fc1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '.version_select at 0x7f8daa3e6700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:47.323989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:47.325954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:47.326596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:47.374753 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] Creating event network-vif-deleted:dee07267-85af-44d8-8f4f-b744c74a44a8 for instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 on n-h1-master-1 Oct 24 09:14:47.376464 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] Creating event network-changed:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:14:47.395115 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d432c6f9-b940-4b33-a007-4917b3f2d5e9 req-1100f520-6ec1-43c4-9a16-5099c5ffd44f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.142622 Oct 24 09:14:47.395757 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2393/4978] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:47.413128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:47.415115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:47.450884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:47.451379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:47.451828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:47.452551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:47.453018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:47.456567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:48.541113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:48.550359 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31f43e88-76b8-4373-883f-c02405d3b014 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1368 microversion: 2.1 time: 1.150929 Oct 24 09:14:48.554682 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2394/4979] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:47 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1368 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:48.581468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:48.582360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:48.598695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:48.599499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:48.600843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:48.602120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:48.603810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:48.604928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:50.081326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:50.108511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41132719-23f4-4948-8b39-b04f286be02b tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 1.542180 Oct 24 09:14:50.109282 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2395/4980] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:48 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:50.124422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:50.126642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:50.155025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:50.155627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:50.156147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:50.160624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:50.161257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:50.161852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:50.707626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:50.720276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7dad54c-1b17-423d-ac70-7f2923058fc1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/c2988d52-c5be-4baa-8f3f-26f2a4074d3f" status: 202 len: 0 microversion: 2.1 time: 3.428001 Oct 24 09:14:50.722179 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2586/4981] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:14:47 2022] DELETE /compute/v2.1/os-floating-ips/c2988d52-c5be-4baa-8f3f-26f2a4074d3f => generated 0 bytes in 3430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:14:50.725819 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41d44680-8228-482c-9cd8-0904f549b17d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1559 microversion: 2.1 time: 0.613466 Oct 24 09:14:50.726406 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2396/4982] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:50 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1559 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:50.728174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3e60552-dc22-4acf-9c11-1591b533c20e"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:50.734549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:50.738722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94d24c71-03fd-44af-8337-6ae5f2cf7a1d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '.version_select at 0x7f8daa3bb0d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:50.748366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:50.749115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:50.749822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:50.751737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:50.767334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:50.767919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.112132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94d24c71-03fd-44af-8337-6ae5f2cf7a1d tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/64e1c9dd-e011-4687-a365-5e5551467c9d" status: 202 len: 0 microversion: 2.1 time: 0.382993 Oct 24 09:14:51.113107 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2397/4983] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Oct 24 09:14:50 2022] DELETE /compute/v2.1/os-security-groups/64e1c9dd-e011-4687-a365-5e5551467c9d => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:14:51.118591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:51.119253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:51.137083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.137620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.138071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.138885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.139329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.149646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.393165 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d31b7a23-8680-4d75-997e-d6e2669319d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669512 Oct 24 09:14:51.398637 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2587/4984] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:14:50 2022] POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:51.411227 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-91bcdc93-da0f-4a3a-8ef4-d73727fd4491 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296803 Oct 24 09:14:51.412663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2398/4985] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:14:51 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-interface => generated 285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:51.417630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:51.420493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:51.425641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:51.428384 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:51.441004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.445969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.446649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.447217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.447401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.448162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.448749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.449278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.452005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.452852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.453427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.455343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.561680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:14:51.709115 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be4ec6d3-f20f-4973-9736-37d62b91e3a9 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 204 len: 0 microversion: 2.1 time: 0.307809 Oct 24 09:14:51.710438 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2588/4986] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:14:51 2022] DELETE /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:14:51.719340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:51.725761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:51.736112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.739814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.740578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:51.741604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:51.745952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:51.746721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:52.438081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:52.459134 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29a9ff47-1afa-43d5-bc73-3d0420a1e9fe tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 1.043453 Oct 24 09:14:52.461728 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2399/4987] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:51 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:52.476309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-126f6507-fc0a-4d6e-9bbf-7bf42eef2ac0 req-8278613d-301a-4536-a294-a310cc67ed02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4adb0f4-7c0c-4b62-bcf7-d11e7b084572", "name": "network-vif-plugged", "status": "completed", "tag": "7b1a9aec-697a-469c-824e-a9c2a92d42ee"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:52.508929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-126f6507-fc0a-4d6e-9bbf-7bf42eef2ac0 req-8278613d-301a-4536-a294-a310cc67ed02 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:52.510895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-126f6507-fc0a-4d6e-9bbf-7bf42eef2ac0 req-8278613d-301a-4536-a294-a310cc67ed02 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:52.511519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-126f6507-fc0a-4d6e-9bbf-7bf42eef2ac0 req-8278613d-301a-4536-a294-a310cc67ed02 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:52.532105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-126f6507-fc0a-4d6e-9bbf-7bf42eef2ac0 req-8278613d-301a-4536-a294-a310cc67ed02 service nova] Creating event network-vif-plugged:7b1a9aec-697a-469c-824e-a9c2a92d42ee for instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 on n-h1-master-1 Oct 24 09:14:52.544987 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-126f6507-fc0a-4d6e-9bbf-7bf42eef2ac0 req-8278613d-301a-4536-a294-a310cc67ed02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081599 Oct 24 09:14:52.547731 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2400/4988] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:52.661196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:52.676594 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e7e5cbd-2ca2-4b2f-9b87-ac46e4205870 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1509 microversion: 2.1 time: 0.961713 Oct 24 09:14:52.681630 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2589/4989] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:51 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1509 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:53.484858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:53.485678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:53.509436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:53.510720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:53.511448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:53.513920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:53.515243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:53.516643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:53.707269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:53.708309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:53.730602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:53.731118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:53.740270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:53.740843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:53.749853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:53.750359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:54.443392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:54.458469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-efb12f47-b003-4a94-9502-1a3a811e8189 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1327 microversion: 2.1 time: 0.979290 Oct 24 09:14:54.483129 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2401/4990] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:53 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1327 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:54.775696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:54.787386 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11f6acc4-aa81-4b07-9a6d-b23a2503bde1 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1509 microversion: 2.1 time: 1.086563 Oct 24 09:14:54.789645 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2590/4991] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:53 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1509 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:55.489377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:55.490016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:55.504965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:55.506067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:55.506513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:55.507260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:55.509974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:55.510409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:55.813497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:55.814206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:55.857587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:55.860360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:55.861069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:55.864555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:55.865122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:55.869113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:56.384096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:56.394256 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed5c82b2-e84c-40f4-a2d0-e216775c0b71 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1527 microversion: 2.1 time: 0.912963 Oct 24 09:14:56.399413 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2402/4992] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:55 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1527 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:56.406161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4eca7024-cd4b-4778-bf35-c69181b64684 req-3d81fbfc-179c-4eeb-83f8-f472e25c5bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9435d5-d687-47fa-a450-b70a41159ef7", "tag": "dd06afd7-6b45-4719-afe1-0d38536b02b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:56.433100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4eca7024-cd4b-4778-bf35-c69181b64684 req-3d81fbfc-179c-4eeb-83f8-f472e25c5bf6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:56.434051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4eca7024-cd4b-4778-bf35-c69181b64684 req-3d81fbfc-179c-4eeb-83f8-f472e25c5bf6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:56.435974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4eca7024-cd4b-4778-bf35-c69181b64684 req-3d81fbfc-179c-4eeb-83f8-f472e25c5bf6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:56.455552 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4eca7024-cd4b-4778-bf35-c69181b64684 req-3d81fbfc-179c-4eeb-83f8-f472e25c5bf6 service nova] Creating event network-changed:dd06afd7-6b45-4719-afe1-0d38536b02b0 for instance 9c9435d5-d687-47fa-a450-b70a41159ef7 on n-h2-master-1 Oct 24 09:14:56.468053 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4eca7024-cd4b-4778-bf35-c69181b64684 req-3d81fbfc-179c-4eeb-83f8-f472e25c5bf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063179 Oct 24 09:14:56.471651 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2403/4993] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:56.495236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:56.503676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:56.530760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:56.531273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:56.531723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:56.535870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:56.538301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:56.540087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:56.725663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79772a24d13244809f7dad6e8d29bd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7f312d12224117b8c8a1f167d901b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:56.764456 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-213bbcb6-816f-4add-93ef-906095fb5053 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 200 len: 1509 microversion: 2.1 time: 0.956168 Oct 24 09:14:56.769716 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2591/4994] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:55 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 1509 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:14:57.089235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-692781437", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:57.175189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:14:57.279507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:57.288605 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1129a84-58e5-4d75-8ccc-70acc982e196 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1527 microversion: 2.1 time: 0.808839 Oct 24 09:14:57.305951 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2404/4995] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:56 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1527 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:57.645220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:57.646489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:57.660338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:57.663184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:57.665519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:57.666455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:57.668855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:57.677822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:57.703396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] HTTP exception thrown: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Request method failure captured: Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 HTTP/1.1 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVld0EqI7gmyddlAJll5ft9jXZtqYn81IPuMpLu98wyQq-10WWPAPWJ3g3mGRArONzOfEjYKjDat_2V0gVn9h7nuG0cTuF1xMpfHjNEiU8WItBefh8cRmW31N7cY0Tvh99ZNzCRcmYe-0pCYEpx2RqEBToAEF4xX948-IrheIfa9wO-Y Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 06ffb746b2354d3689043de0992af392 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-259404998 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06ffb746b2354d3689043de0992af392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06ffb746b2354d3689043de0992af392"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06ffb746b2354d3689043de0992af392"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06ffb746b2354d3689043de0992af392"}]}] Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-259404998 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 06ffb746b2354d3689043de0992af392 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-259404998 Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestMultiTenantJSON-259404998-project Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c1cd5b3a0d6c4133894caea52ddc488e Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-259404998-project Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e4adb0f4-7c0c-4b62-bcf7-d11e7b084572'} Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:57.707083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:57.711539 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:57.717552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Returning 404 to user: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:57.720174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f225f93-6e23-48af-981a-74bc0a0a7e73 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 404 len: 111 microversion: 2.1 time: 0.403416 Oct 24 09:14:57.723551 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2405/4996] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:14:57 2022] DELETE /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 111 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:14:57.782673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:57.787552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:57.847219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:57.853834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:57.859788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:57.866811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:57.867439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:57.867897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.547509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:14:58.548418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:14:58.548916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:14:58.549433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:14:58.549863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:14:58.568767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.569549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.570185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.574067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.574823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.575445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.627043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:14:58.640741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:14:58.679920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:14:58.682511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:14:58.719192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:58.736327 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5044f4b6-6812-4890-a361-1262b7bd2ba3 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1527 microversion: 2.1 time: 0.995112 Oct 24 09:14:58.759636 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2406/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:57 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1527 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:58.791964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:58.794085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] [instance: 1e564297-0244-4225-98df-604a17f8c518] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:58.809731 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-644debbc-dbeb-4232-8307-50e5c924b489 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.038302 Oct 24 09:14:58.821015 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2592/4998] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:14:58.826457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d4ecb6e2-3f04-4cda-bdfa-255a7e6c92a0 req-f8538297-6cf2-4a81-b055-0a1e705f9e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e564297-0244-4225-98df-604a17f8c518", "name": "network-vif-deleted", "tag": "e2387824-9024-49c7-a289-815d5a38676e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:58.838690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.839365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.839931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.840816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.845833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d4ecb6e2-3f04-4cda-bdfa-255a7e6c92a0 req-f8538297-6cf2-4a81-b055-0a1e705f9e27 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.854816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.855469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.855949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d4ecb6e2-3f04-4cda-bdfa-255a7e6c92a0 req-f8538297-6cf2-4a81-b055-0a1e705f9e27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.856565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d4ecb6e2-3f04-4cda-bdfa-255a7e6c92a0 req-f8538297-6cf2-4a81-b055-0a1e705f9e27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.869062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d4ecb6e2-3f04-4cda-bdfa-255a7e6c92a0 req-f8538297-6cf2-4a81-b055-0a1e705f9e27 service nova] Creating event network-vif-deleted:e2387824-9024-49c7-a289-815d5a38676e for instance 1e564297-0244-4225-98df-604a17f8c518 on n-h2-master-1 Oct 24 09:14:58.891283 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d4ecb6e2-3f04-4cda-bdfa-255a7e6c92a0 req-f8538297-6cf2-4a81-b055-0a1e705f9e27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068580 Oct 24 09:14:58.891813 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2593/4999] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:14:58.896979 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] HTTP exception thrown: Instance 1e564297-0244-4225-98df-604a17f8c518 could not be found. Oct 24 09:14:58.897590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Action: 'update', calling method: >, body: {"server": {"name": "e4adb0f4-7c0c-4b62-bcf7-d11e7b084572_new"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:14:58.900099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Request method failure captured: Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 HTTP/1.1 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlcrMf8d0-_VEIR9c6k8R8lAH-64isLBHjVSiKWvJ1t9nKwaXneVZbhvxiS2x5vEl3FIGvpQbWSDxjM2HW3K4Jsd3LU3te6luiaBKpA9YPEVZ74KrmboG7UvwYPztSnYcvGnsYH1s3PFCR4CfwqSEc-BNmoPkNLxw83vWbjBtmEASwA Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5a7f312d12224117b8c8a1f167d901b8 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-845916216 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a7f312d12224117b8c8a1f167d901b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5a7f312d12224117b8c8a1f167d901b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5a7f312d12224117b8c8a1f167d901b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5a7f312d12224117b8c8a1f167d901b8"}]}] Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-845916216 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5a7f312d12224117b8c8a1f167d901b8 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-845916216 Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerRescueTestJSONUnderV235-845916216-project Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 79772a24d13244809f7dad6e8d29bd7f Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-845916216-project Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1e564297-0244-4225-98df-604a17f8c518 could not be found. Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1e564297-0244-4225-98df-604a17f8c518'} Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e564297-0244-4225-98df-604a17f8c518 could not be found. Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e564297-0244-4225-98df-604a17f8c518 could not be found. Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.906317 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e564297-0244-4225-98df-604a17f8c518 could not be found. Oct 24 09:14:58.911209 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.911736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.911736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.911736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.911736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.912154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.912766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.915729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] Returning 404 to user: Instance 1e564297-0244-4225-98df-604a17f8c518 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:58.918781 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db57df0d-6ad2-4577-96fb-c559ecc7a819 tempest-ServerRescueTestJSONUnderV235-845916216 tempest-ServerRescueTestJSONUnderV235-845916216-project] 10.222.0.25 "GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518" status: 404 len: 111 microversion: 2.1 time: 0.154751 Oct 24 09:14:58.925509 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2407/5000] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:58 2022] GET /compute/v2.1/servers/1e564297-0244-4225-98df-604a17f8c518 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:58.929108 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] HTTP exception thrown: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Request method failure captured: Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: request: PUT /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 HTTP/1.1 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 64 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVld0EqI7gmyddlAJll5ft9jXZtqYn81IPuMpLu98wyQq-10WWPAPWJ3g3mGRArONzOfEjYKjDat_2V0gVn9h7nuG0cTuF1xMpfHjNEiU8WItBefh8cRmW31N7cY0Tvh99ZNzCRcmYe-0pCYEpx2RqEBToAEF4xX948-IrheIfa9wO-Y Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 06ffb746b2354d3689043de0992af392 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-259404998 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06ffb746b2354d3689043de0992af392"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06ffb746b2354d3689043de0992af392"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06ffb746b2354d3689043de0992af392"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06ffb746b2354d3689043de0992af392"}]}] Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-259404998 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 06ffb746b2354d3689043de0992af392 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-259404998 Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestMultiTenantJSON-259404998-project Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c1cd5b3a0d6c4133894caea52ddc488e Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-259404998-project Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "e4adb0f4-7c0c-4b62-bcf7-d11e7b084572_new"}} Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: exception: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e4adb0f4-7c0c-4b62-bcf7-d11e7b084572', 'body': {'server': {'name': 'e4adb0f4-7c0c-4b62-bcf7-d11e7b084572_new'}}} Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:14:58.931128 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:14:58.936016 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:14:58.938152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] Returning 404 to user: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:14:58.939207 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed8cd446-cbbc-4397-b4e5-fbb26ee8f0e5 tempest-ServersNegativeTestMultiTenantJSON-259404998 tempest-ServersNegativeTestMultiTenantJSON-259404998-project] 10.222.0.25 "PUT /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 404 len: 111 microversion: 2.1 time: 0.046298 Oct 24 09:14:58.940349 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2594/5001] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:14:58 2022] PUT /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:14:58.942593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5433bd8a-1ff2-4017-8236-ba42b8aa63d0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:58.949758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5433bd8a-1ff2-4017-8236-ba42b8aa63d0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:58.953759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:58.955849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:58.968741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.969967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.970602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:58.973174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:58.979679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:58.980468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:59.046643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:14:59.132655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5433bd8a-1ff2-4017-8236-ba42b8aa63d0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:59.144094 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5433bd8a-1ff2-4017-8236-ba42b8aa63d0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1192 microversion: 2.1 time: 0.214555 Oct 24 09:14:59.144962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2408/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:58 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1192 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:14:59.211108 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37b55f4b-1bdd-487c-8f35-b7be893b9753 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 204 len: 0 microversion: 2.1 time: 0.264081 Oct 24 09:14:59.211900 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2595/5003] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:14:58 2022] DELETE /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:14:59.220193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:14:59.221477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:14:59.239128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:59.239992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:59.240954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:59.242351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:14:59.243113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:14:59.243803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:14:59.832107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:14:59.858921 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afea5924-e3ea-4659-b593-c2e86ff338f0 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1533 microversion: 2.1 time: 0.642499 Oct 24 09:14:59.881548 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2409/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:14:59 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1533 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:00.169822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:00.171375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:00.181932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:00.198331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:00.199091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:00.202039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:00.202805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:00.205900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:00.479935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:00.490316 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-203e97fe-7257-4a2a-904a-ad8129dbe789 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1188 microversion: 2.1 time: 0.325587 Oct 24 09:15:00.494674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2596/5005] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:00 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:00.911039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:00.911691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:00.938612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:00.939024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:00.939473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:00.940941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:00.944757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:00.952614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:01.523503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:01.524124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:01.540696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:01.544048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:01.544541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:01.549781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:01.550285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:01.550726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:01.921416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:01.926372 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:01.944666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-401f55ff-b01a-45d7-9d74-92a35ef67ab7 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1533 microversion: 2.1 time: 1.037889 Oct 24 09:15:01.964827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2410/5006] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:00 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1533 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:02.106627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f34750c0-7051-4ece-91c7-4b007fb3237a req-a793565c-be9f-4ad7-b3a3-38b393ddccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4adb0f4-7c0c-4b62-bcf7-d11e7b084572", "name": "network-vif-deleted", "tag": "7b1a9aec-697a-469c-824e-a9c2a92d42ee"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:02.146405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f34750c0-7051-4ece-91c7-4b007fb3237a req-a793565c-be9f-4ad7-b3a3-38b393ddccc9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:02.149281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f34750c0-7051-4ece-91c7-4b007fb3237a req-a793565c-be9f-4ad7-b3a3-38b393ddccc9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:02.151048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f34750c0-7051-4ece-91c7-4b007fb3237a req-a793565c-be9f-4ad7-b3a3-38b393ddccc9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:02.208336 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f34750c0-7051-4ece-91c7-4b007fb3237a req-a793565c-be9f-4ad7-b3a3-38b393ddccc9 service nova] Creating event network-vif-deleted:7b1a9aec-697a-469c-824e-a9c2a92d42ee for instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 on n-h1-master-1 Oct 24 09:15:02.226550 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f34750c0-7051-4ece-91c7-4b007fb3237a req-a793565c-be9f-4ad7-b3a3-38b393ddccc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123923 Oct 24 09:15:02.239730 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2411/5007] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:15:02.519984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:02.536805 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2cb740c8-3ac4-4313-81c5-6a190edf72d5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1250 microversion: 2.1 time: 1.017629 Oct 24 09:15:02.540812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2597/5008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:01 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1250 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:02.974506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:02.975916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:03.003741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:03.005879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:03.008611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:03.013075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:03.015861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:03.017331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:03.145597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:03.146494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:03.147232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:03.147967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lazy-loading 'fault' on Instance uuid e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:15:03.246978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dd46553649476ca54adf47ecf1a009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7deb9c74f124ab5947e4fba6320d70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:03.257721 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8d0cf71-5eaf-4164-98d4-98c77ff5a74f tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 200 len: 1317 microversion: 2.1 time: 0.288873 Oct 24 09:15:03.258736 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2412/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:02 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:03.567797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:03.568389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:03.577008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:03.577526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:03.581391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:03.583730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:03.584455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:03.585116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:03.754157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:03.762489 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-242d41de-7d3a-4596-afb1-d917f3c08b7e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1250 microversion: 2.1 time: 0.198484 Oct 24 09:15:03.763441 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2598/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:03 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1250 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:04.153986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-984257022", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "1a830f61-6293-4e82-8ec7-01a057c6b8c0"}, {"uuid": "ac64d467-aabf-4fe4-ae7f-cc726f75b584"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:04.258072 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] validate_networks() for [('1a830f61-6293-4e82-8ec7-01a057c6b8c0', None, None, None, None, None), ('ac64d467-aabf-4fe4-ae7f-cc726f75b584', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:15:04.283679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:04.284304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] [instance: e4adb0f4-7c0c-4b62-bcf7-d11e7b084572] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:04.288676 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:04.292986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:04.293815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:04.294458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:04.295343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:04.295808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:04.296240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:04.331710 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:04.333208 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] HTTP exception thrown: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Request method failure captured: Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 HTTP/1.1 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVldjeheiec3YebFPXoYdqkqQAqTj7I26K271TalaYivq13xjX7Yz7UwLUCoT0TwPNSsbIj-FJapU9kMWbooiF1uAN77VQx0QUU2VmhmDBCGc4HEoPjEr9KRkgtTESEQuhBiIBCFCcMN9CctvOkPNYpjCWu0YfRa5vJ1VUV7XUVeyqwA Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d7deb9c74f124ab5947e4fba6320d70f Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1999855318 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7deb9c74f124ab5947e4fba6320d70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7deb9c74f124ab5947e4fba6320d70f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7deb9c74f124ab5947e4fba6320d70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7deb9c74f124ab5947e4fba6320d70f"}]}] Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1999855318 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d7deb9c74f124ab5947e4fba6320d70f Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1999855318 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1999855318-project Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1dd46553649476ca54adf47ecf1a009 Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1999855318-project Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: exception: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e4adb0f4-7c0c-4b62-bcf7-d11e7b084572'} Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:15:04.338420 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] Returning 404 to user: Instance e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3847c11-7269-4357-9083-80787ca3dea1 tempest-ServersNegativeTestMultiTenantJSON-1999855318 tempest-ServersNegativeTestMultiTenantJSON-1999855318-project] 10.222.0.25 "GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572" status: 404 len: 111 microversion: 2.1 time: 0.058661 Oct 24 09:15:04.348427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2599/5011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:04 2022] GET /compute/v2.1/servers/e4adb0f4-7c0c-4b62-bcf7-d11e7b084572 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:15:04.794112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:04.795336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:04.836022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:04.840446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:04.840949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:04.841727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:04.842207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:04.842638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:05.269193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:05.285580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de3cc360-8f8c-4daf-b8f4-6077f5b4fec2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.495752 Oct 24 09:15:05.303051 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2600/5012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:04 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:06.315362 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:06.316752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:06.329532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:06.331194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:06.335429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:06.336502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:06.337163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:06.338436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:06.972587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:07.002024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff3522bb-7636-4db6-ac91-801746b3a0dc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.691708 Oct 24 09:15:07.010892 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2601/5013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:06 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:07.019624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3bf85e6b-efc4-4646-a792-e0ce1b636ab4 req-38c88b34-a6e3-4e57-8a38-45eeda2829a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ae9c91-8fe1-4e38-baa0-0cf0aee14441", "tag": "bb186eb9-89c2-411b-9e42-8e09ee660503"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:07.045790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bf85e6b-efc4-4646-a792-e0ce1b636ab4 req-38c88b34-a6e3-4e57-8a38-45eeda2829a1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:07.051592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bf85e6b-efc4-4646-a792-e0ce1b636ab4 req-38c88b34-a6e3-4e57-8a38-45eeda2829a1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:07.052371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3bf85e6b-efc4-4646-a792-e0ce1b636ab4 req-38c88b34-a6e3-4e57-8a38-45eeda2829a1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:07.077919 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3bf85e6b-efc4-4646-a792-e0ce1b636ab4 req-38c88b34-a6e3-4e57-8a38-45eeda2829a1 service nova] Creating event network-changed:bb186eb9-89c2-411b-9e42-8e09ee660503 for instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 on n-h2-master-1 Oct 24 09:15:07.083703 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3bf85e6b-efc4-4646-a792-e0ce1b636ab4 req-38c88b34-a6e3-4e57-8a38-45eeda2829a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071028 Oct 24 09:15:07.084829 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2602/5014] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:07.670814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:07.671456 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:07.671920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:07.672694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:07.675096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:07.687610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:07.688449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:07.689186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:07.690636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:07.691993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:07.693048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:07.721446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Getting quotas for project a4329719ac6b4fc0894b1f642a068376. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:07.727922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Getting quotas for user d9ac971da2614beab2e4598795ed9583 and project a4329719ac6b4fc0894b1f642a068376. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:07.742747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:07.745332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:07.826352 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-727b96bd-2af9-434b-b73a-d8080de4b31d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.677366 Oct 24 09:15:07.827028 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2413/5015] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:15:07.841778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37b86c0f-9020-4ce7-b29d-e52f4fcb306e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:07.842307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37b86c0f-9020-4ce7-b29d-e52f4fcb306e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:07.957936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37b86c0f-9020-4ce7-b29d-e52f4fcb306e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:07.976858 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37b86c0f-9020-4ce7-b29d-e52f4fcb306e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1212 microversion: 2.1 time: 0.141566 Oct 24 09:15:07.979275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2603/5016] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:07 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1212 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:08.031942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:08.032564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:08.045028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:08.045739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:08.046277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:08.046892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:08.047351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:08.049860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:08.842638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:08.870975 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30a916d5-4dfc-45ec-bcc7-3ba3277a2575 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.842845 Oct 24 09:15:08.877830 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2414/5017] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:08 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:09.008622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:09.010027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:09.014661 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:09.037374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:09.038981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:09.040509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:09.042688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:09.043422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:09.046769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:09.258558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:09.271166 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-345e56fc-ebbb-4e24-948d-dd891519714b tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1208 microversion: 2.1 time: 0.271982 Oct 24 09:15:09.274133 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2604/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:08 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1208 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:09.903300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:09.904702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:09.917888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:09.918585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:09.924793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:09.925855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:09.926508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:09.927105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:10.308677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:10.312525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:10.332523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:10.339229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:10.340169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:10.341172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:10.341987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:10.342507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:10.485807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:10.503284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a26d5b93-e6ae-46ed-b179-138d360a84be tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1270 microversion: 2.1 time: 0.208612 Oct 24 09:15:10.508048 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2605/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:10 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:10.519899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30cc7781-4906-4b13-bced-1c0e9b2ab871 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:10.540004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30cc7781-4906-4b13-bced-1c0e9b2ab871 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:10.540509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30cc7781-4906-4b13-bced-1c0e9b2ab871 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:10.540954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30cc7781-4906-4b13-bced-1c0e9b2ab871 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:10.604125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30cc7781-4906-4b13-bced-1c0e9b2ab871 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:15:10.699082 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30cc7781-4906-4b13-bced-1c0e9b2ab871 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action" status: 202 len: 0 microversion: 2.1 time: 0.188061 Oct 24 09:15:10.720513 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2606/5020] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:15:10 2022] POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:15:10.742255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:10.742988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:10.751074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:10.751790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:10.752499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:10.753460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:10.754114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:10.755476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:10.818102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:10.852370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b2d8fe3-6274-4861-b4f8-033e8f26a76c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.952827 Oct 24 09:15:10.856822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2415/5021] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:09 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:11.251197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:11.266877 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f54343e0-3258-4275-bee6-13c024ed2cd3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.539831 Oct 24 09:15:11.269186 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2607/5022] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:10 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:11.532045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:11.534004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:11.558168 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:11.573376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:11.575823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:11.579588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:11.582602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:11.583735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:11.585963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:11.771891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:11.786111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cfb45cb4-ffd6-485a-9a91-5ef0d6ce1100 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1270 microversion: 2.1 time: 0.259157 Oct 24 09:15:11.803358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2416/5023] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:11 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1270 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:11.886103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:11.887287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:11.898030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:11.905578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:11.906250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:11.914285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:11.915033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:11.915645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:12.294312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:12.295192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:12.298758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:12.309791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:12.311442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:12.311609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-646b965b-f5eb-487a-abb8-5c5cb324efed tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.429808 Oct 24 09:15:12.312409 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2608/5024] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:11 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:12.315797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:12.317157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:12.319168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:12.320260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:12.814153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:12.814979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:12.825344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:12.829596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:12.830372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:12.831314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:12.831995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:12.832603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:12.959908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:12.970236 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c22a938-fd1f-406a-9ae4-d718e207935a tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1270 microversion: 2.1 time: 0.160942 Oct 24 09:15:12.971675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2609/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:12 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:13.340656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:13.341398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:13.353686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:13.354197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:13.354645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:13.355377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:13.355843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:13.360017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:13.571250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:13.600810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-caf67a7d-7a23-4515-b714-9e37b2b513a3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 1.310588 Oct 24 09:15:13.612299 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2417/5026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:12 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:13.725863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:13.747173 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e623ca8-a50a-43b3-888c-61f33b25a8f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.411368 Oct 24 09:15:13.747857 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2610/5027] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:13 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:13.997514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:13.998399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:14.006487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:14.007421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:14.008034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:14.008912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:14.009635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:14.010231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:14.316580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:14.326356 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16d72288-6f43-4f4b-99ef-e9155bb9bc92 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1312 microversion: 2.1 time: 0.332752 Oct 24 09:15:14.334130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2611/5028] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:13 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:14.421341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-131546804", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:14.543206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:14.543863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:14.551959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:14.552992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:14.553708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:14.577622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:14.578218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:14.578593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:14.579294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:14.579698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:14.582576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:14.612852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Getting quotas for project 91a35426751247d7a80934483412ba31. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:14.621052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Getting quotas for user 8b20c6dc0656476e8635c0f2807ce469 and project 91a35426751247d7a80934483412ba31. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:14.640111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:14.640657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:14.640785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:14.644203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:14.652461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:14.654643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:14.655204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:14.656474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:14.657620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:14.660750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:14.732410 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7d0a68f-04bd-4533-91ef-302d05dab100 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.780500 Oct 24 09:15:14.732972 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2418/5029] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:15:14.746277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e3b2e60-c1aa-4251-9db0-fc02157a69e8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:14.751773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e3b2e60-c1aa-4251-9db0-fc02157a69e8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:14.922353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e3b2e60-c1aa-4251-9db0-fc02157a69e8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:14.931908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e3b2e60-c1aa-4251-9db0-fc02157a69e8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:14.940837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e3b2e60-c1aa-4251-9db0-fc02157a69e8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:14.943160 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e3b2e60-c1aa-4251-9db0-fc02157a69e8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 200 len: 1277 microversion: 2.47 time: 0.202140 Oct 24 09:15:14.946858 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2419/5030] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:14 2022] GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:14.968846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:14.973579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:14.999183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.002257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.002817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.008703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.009272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.010103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.154861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:15.164383 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-565ea278-ff21-4c1a-9afe-15c62e7b89ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.530025 Oct 24 09:15:15.166739 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2612/5031] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:14 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:15.196199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1587174484", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:15.364824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:15.365519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:15.365955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:15.366592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:15.367292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:15.388887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.392102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.394868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.397096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.399023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.399671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.446249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Getting quotas for project 91a35426751247d7a80934483412ba31. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:15.459456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Getting quotas for user 8b20c6dc0656476e8635c0f2807ce469 and project 91a35426751247d7a80934483412ba31. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:15.484329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:15.498442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:15.518996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:15.527772 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1d129d4-41c8-427c-83c6-8a2695c64962 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.579648 Oct 24 09:15:15.542419 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2420/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:14 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:15.552579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7933296e-457e-4c82-a1ad-92cea2e8e4e9 req-6eb8b7ea-dab2-4401-b951-698de4137207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ae9c91-8fe1-4e38-baa0-0cf0aee14441", "name": "network-vif-plugged", "status": "completed", "tag": "bb186eb9-89c2-411b-9e42-8e09ee660503"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:15.560515 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07bbbbf4-dade-439a-beb2-b38677777081 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.392513 Oct 24 09:15:15.561782 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2613/5033] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:15:15.568692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:15.569629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:15.576632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.577364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.578027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.579675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.580789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.581881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.583598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7933296e-457e-4c82-a1ad-92cea2e8e4e9 req-6eb8b7ea-dab2-4401-b951-698de4137207 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:15.585401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7933296e-457e-4c82-a1ad-92cea2e8e4e9 req-6eb8b7ea-dab2-4401-b951-698de4137207 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:15.623063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7933296e-457e-4c82-a1ad-92cea2e8e4e9 req-6eb8b7ea-dab2-4401-b951-698de4137207 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:15.665088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7933296e-457e-4c82-a1ad-92cea2e8e4e9 req-6eb8b7ea-dab2-4401-b951-698de4137207 service nova] Creating event network-vif-plugged:bb186eb9-89c2-411b-9e42-8e09ee660503 for instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 on n-h2-master-1 Oct 24 09:15:15.688566 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7933296e-457e-4c82-a1ad-92cea2e8e4e9 req-6eb8b7ea-dab2-4401-b951-698de4137207 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142131 Oct 24 09:15:15.689311 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2421/5034] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:15.714059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df84d21f-1716-4493-b24a-d6e9ab79a116 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:15.722592 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df84d21f-1716-4493-b24a-d6e9ab79a116 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:15.809666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df84d21f-1716-4493-b24a-d6e9ab79a116 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "PUT /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 992 microversion: 2.47 time: 0.111598 Oct 24 09:15:15.822819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2422/5035] 10.222.0.25 () {62 vars in 1297 bytes} [Mon Oct 24 09:15:15 2022] PUT /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 992 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:15:15.834752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-261cc58e-756f-4256-8f53-a78128538161 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:15.836170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-261cc58e-756f-4256-8f53-a78128538161 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:15.904957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:15.914467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5154999-20e1-4260-93a6-e78220bedb36 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1312 microversion: 2.1 time: 0.350818 Oct 24 09:15:15.932786 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2614/5036] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:15 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:15.983537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-261cc58e-756f-4256-8f53-a78128538161 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:16.002963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-261cc58e-756f-4256-8f53-a78128538161 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:16.005398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-261cc58e-756f-4256-8f53-a78128538161 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:16.007985 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-261cc58e-756f-4256-8f53-a78128538161 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1278 microversion: 2.47 time: 0.178616 Oct 24 09:15:16.031939 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2423/5037] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:15 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:16.193810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:16.195013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:16.207335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:16.208071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:16.208682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:16.210643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:16.211313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:16.213043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:16.556004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:16.560444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:16.574813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:16.575576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:16.577123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:16.581114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:16.587987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:16.589036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:16.729695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:16.756658 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1749d2f-689d-44e2-9a6d-2d7f8081b136 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.564803 Oct 24 09:15:16.774264 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2615/5038] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:16 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:16.953866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:16.954353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:17.001178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:17.001178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:17.003098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:17.004025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:17.006050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:17.007249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:17.374986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:17.387553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1a42e4d-d3cf-4038-a3fc-e308494854b4 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.448875 Oct 24 09:15:17.388772 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2616/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:16 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:17.394972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:17.395675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:17.408662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:17.409441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:17.410057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:17.410992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:17.412218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:17.413096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:17.499242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:17.511445 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e8fdf4c3-7633-4386-968d-4bf8a7731e12 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1292 microversion: 2.1 time: 0.959152 Oct 24 09:15:17.525335 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2424/5040] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:16 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1292 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:17.525703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:17.527289 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:17.534777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:17.536289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:17.537522 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99bff78e-9bb5-4556-ae46-6e08c6aace12 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1330 microversion: 2.47 time: 0.147484 Oct 24 09:15:17.541462 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2617/5041] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:17 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1330 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:17.786551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:17.787284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:17.800954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:17.803614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:17.804247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:17.806444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:17.807468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:17.810849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.095603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:18.109511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-adc9d815-e108-41c7-a888-0ce33208a950 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.327276 Oct 24 09:15:18.112543 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2425/5042] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:17 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:18.184879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b13b99f4-828d-4851-b5ae-1b462696aa01 req-500ba789-ed0e-4d9e-a7fb-766ecc288dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "tag": "ecdc301a-8185-46e5-9a99-8d229ce8eae5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:18.206262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b13b99f4-828d-4851-b5ae-1b462696aa01 req-500ba789-ed0e-4d9e-a7fb-766ecc288dbe service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.206761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b13b99f4-828d-4851-b5ae-1b462696aa01 req-500ba789-ed0e-4d9e-a7fb-766ecc288dbe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.207197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b13b99f4-828d-4851-b5ae-1b462696aa01 req-500ba789-ed0e-4d9e-a7fb-766ecc288dbe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.250294 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b13b99f4-828d-4851-b5ae-1b462696aa01 req-500ba789-ed0e-4d9e-a7fb-766ecc288dbe service nova] Creating event network-changed:ecdc301a-8185-46e5-9a99-8d229ce8eae5 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:18.257030 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b13b99f4-828d-4851-b5ae-1b462696aa01 req-500ba789-ed0e-4d9e-a7fb-766ecc288dbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077133 Oct 24 09:15:18.258577 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2618/5043] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:18.418127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:18.418764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:18.433617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.434121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.434556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.435272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.435717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.436139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.537256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:18.538624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:18.550304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.552560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.553217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.554303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.554769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.555203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.697554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:18.713225 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c97e43e1-9ce1-473b-85de-5b1b53612829 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.298204 Oct 24 09:15:18.715447 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2426/5044] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:18 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:18.728339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:18.729136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:18.746405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.746909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.747347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:18.748327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:18.748787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:18.749448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:19.015220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:19.026877 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9161d6b-ae97-4808-b8d5-6c4572c88e76 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1473 microversion: 2.1 time: 0.494611 Oct 24 09:15:19.029742 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2619/5045] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:18 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:19.139294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:19.140374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:19.149665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:19.150545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:19.151215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:19.153212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:19.154471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:19.155188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:19.157339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:19.169499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:19.176922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:19.178173 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-150cb674-fb2b-4dbd-9484-35e74edcd48f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1338 microversion: 2.47 time: 0.461281 Oct 24 09:15:19.193552 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2427/5046] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:18 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1338 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:19.227377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1790739511", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:19.328085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:15:19.446910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:19.459712 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb18ca37-63f8-4bd4-b30f-a703613669df tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.325464 Oct 24 09:15:19.460297 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2620/5047] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:19 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:19.745234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:19.745929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:19.753097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:19.754087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:19.754551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:19.755262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:19.755981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:19.756412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.084259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:20.120676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df25fa0c-5193-4966-a41e-b9563e44101d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.382366 Oct 24 09:15:20.124014 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2621/5048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:19 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:20.223208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:20.225421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:20.237656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:20.240873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:20.241668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.256435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:20.261989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:20.262870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.573129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:20.585402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:20.587816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:20.590948 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6bd7ff80-9f74-4beb-be5d-d7b165263e08 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1336 microversion: 2.47 time: 0.372115 Oct 24 09:15:20.592410 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2622/5049] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:20 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1336 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:20.611834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:20.612795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:20.621138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:20.622287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:20.622964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.624107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:20.624959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:20.625885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.852136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:20.853139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:20.853852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:20.854436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:20.855105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:20.868585 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=19 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:20.871741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:20.872700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:20.873230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.874207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:20.874846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:20.875760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:20.903891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:20.910859 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:20.925434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:20.929223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: a48f5fca-44c2-4ebd-85df-b9eaa0572524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:20.984672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:20.998647 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55d64c18-14f0-47ab-a7b3-88688199992d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.402028 Oct 24 09:15:21.002153 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2623/5050] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:20 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:21.014238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8bc284d1-1c41-4323-8277-de195f5035a1 req-4c215f93-de5e-48e0-afc3-29bfe0874836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "tag": "89cb9735-2f74-4cb9-a1da-8e4955f4e8d3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:21.047752 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-235323df-1c31-4341-a2fe-b857e17f62ea tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822392 Oct 24 09:15:21.050205 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2428/5051] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:15:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:15:21.058561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8bc284d1-1c41-4323-8277-de195f5035a1 req-4c215f93-de5e-48e0-afc3-29bfe0874836 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:21.059274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8bc284d1-1c41-4323-8277-de195f5035a1 req-4c215f93-de5e-48e0-afc3-29bfe0874836 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:21.059869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8bc284d1-1c41-4323-8277-de195f5035a1 req-4c215f93-de5e-48e0-afc3-29bfe0874836 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:21.076151 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5a452802-8da0-4a7c-90f7-0e4a5108ee88 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:21.077897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5a452802-8da0-4a7c-90f7-0e4a5108ee88 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: a48f5fca-44c2-4ebd-85df-b9eaa0572524] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:21.086343 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8bc284d1-1c41-4323-8277-de195f5035a1 req-4c215f93-de5e-48e0-afc3-29bfe0874836 service nova] Creating event network-changed:89cb9735-2f74-4cb9-a1da-8e4955f4e8d3 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:21.101138 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8bc284d1-1c41-4323-8277-de195f5035a1 req-4c215f93-de5e-48e0-afc3-29bfe0874836 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092287 Oct 24 09:15:21.101746 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2624/5052] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:21.121947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5a452802-8da0-4a7c-90f7-0e4a5108ee88 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: a48f5fca-44c2-4ebd-85df-b9eaa0572524] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:15:21.147635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:21.148640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:21.159375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:21.160409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:21.161029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:21.162161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:21.162790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:21.163379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:21.502226 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5a452802-8da0-4a7c-90f7-0e4a5108ee88 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524" status: 204 len: 0 microversion: 2.1 time: 0.437842 Oct 24 09:15:21.506259 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2429/5053] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:15:21 2022] DELETE /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:15:21.511379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4fe132f3-6918-4a6a-9509-5595480a0ead tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:21.512008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4fe132f3-6918-4a6a-9509-5595480a0ead tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: a48f5fca-44c2-4ebd-85df-b9eaa0572524] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:21.569637 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-4fe132f3-6918-4a6a-9509-5595480a0ead tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4fe132f3-6918-4a6a-9509-5595480a0ead tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 HTTP/1.1 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a48f5fca-44c2-4ebd-85df-b9eaa0572524'} Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:21.583423 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4fe132f3-6918-4a6a-9509-5595480a0ead tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4fe132f3-6918-4a6a-9509-5595480a0ead tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524" status: 404 len: 111 microversion: 2.1 time: 0.077577 Oct 24 09:15:21.588708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2430/5054] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:21 2022] GET /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:15:21.624872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:21.626502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:21.648132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:21.650756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:21.651695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:21.653639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:21.655407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:21.657286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:21.874678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:21.885041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1349b856-0e79-46d1-aa15-23f6076ad6fe tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.741753 Oct 24 09:15:21.885679 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2625/5055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:21 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:21.904675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-539012716", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:21.970707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:21.978893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:15:21.992915 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:22.000627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:22.005417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3635d22-5b9f-4ab2-ac09-3a8f19f89e5f tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1357 microversion: 2.47 time: 0.387185 Oct 24 09:15:22.009407 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2431/5056] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:21 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1357 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:22.034686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:22.035908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:22.051625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.052450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.053096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.058730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.059422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.061163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.545867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:22.563114 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c01dbddf-a860-4816-b182-7667696578f1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.539383 Oct 24 09:15:22.564884 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2432/5057] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:22 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:22.569965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:22.584303 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:22.591626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.593488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.594154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.595073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.595745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.596361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.646784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:22.647332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:22.647713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:22.648127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:22.648542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:22.655109 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=15 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:22.671217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.671825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.672370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.673242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.673858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.674363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.714167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:22.723356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:22.740151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:22.742957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:22.770601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:22.771306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:22.773171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:22.773846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:22.774780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:22.804733 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5a6bc2f-91d7-4409-80c7-92ab49e517c9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917150 Oct 24 09:15:22.812592 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2626/5058] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:15:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:15:22.818595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a78a646a-e7c4-4fa0-8f14-df3fe35c5169 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:22.819553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a78a646a-e7c4-4fa0-8f14-df3fe35c5169 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:22.894862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a78a646a-e7c4-4fa0-8f14-df3fe35c5169 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:22.907193 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a78a646a-e7c4-4fa0-8f14-df3fe35c5169 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1220 microversion: 2.1 time: 0.091410 Oct 24 09:15:22.922089 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2627/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:22 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:22.929405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:22.930591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:22.942288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.943489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.944169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.945104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.945811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.946459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.956546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:22.970881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.971462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.973616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:22.974441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:22.974918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:22.975356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:23.020825 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:23.038704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b11d687d-c7a6-4515-80ef-6906bd0b1cf1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "POST /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e/action" status: 202 len: 1079 microversion: 2.47 time: 0.471198 Oct 24 09:15:23.041873 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2433/5060] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:15:22 2022] POST /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e/action => generated 1079 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 09:15:23.063336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:23.063960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:23.079268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:23.081888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:23.082528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:23.083846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:23.085157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:23.087354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:23.194265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:23.205971 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dc76cfc-9b98-464b-8062-14f5f46976e8 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.280592 Oct 24 09:15:23.207111 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2628/5061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:22 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:23.291036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:23.304188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:23.306583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:23.308352 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-293646f6-11db-4a30-8dc7-6b2ccfec3894 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.250964 Oct 24 09:15:23.321433 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2434/5062] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:23 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:23.599670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:23.601474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:23.608916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:23.609730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:23.610388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:23.613059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:23.613735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:23.614338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:23.852630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:23.865065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e1e33ef-92e7-4868-8237-4d2adc628c97 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.280173 Oct 24 09:15:23.865695 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2629/5063] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:23 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:23.941939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:23.944615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:23.959252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:23.959702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:23.960140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:23.960843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:23.961758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:23.982860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:24.112490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:24.127192 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbaffc3b-2d05-4f81-b42d-45a519d8b6bf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1272 microversion: 2.1 time: 0.199351 Oct 24 09:15:24.127781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2435/5064] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:23 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:24.229596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:24.230215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:24.243667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:24.244075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:24.244514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:24.245210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:24.245881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:24.246306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:24.344536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:24.353809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:24.356907 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:24.360669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:24.364337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:24.381001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:24.382065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:24.382823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:24.383494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:24.567039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:24.580576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-011cd0b4-34df-43ab-aadc-7061c6c53eb2 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.354811 Oct 24 09:15:24.581494 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2630/5065] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:24 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:24.684788 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:24.721658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:24.723421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:24.724742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0b73951-5b65-41aa-adb0-51da4ec7e23c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.389782 Oct 24 09:15:24.725351 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2436/5066] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:24 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:24.894639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:24.895266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:24.908699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:24.909211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:24.911928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:24.924152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:24.924152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:24.924152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.153927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:25.155422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:25.165365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:25.169768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:25.170497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.175635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:25.176439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:25.178816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.187630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:25.200303 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1639e001-56e0-473c-8653-5042d276281a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.313269 Oct 24 09:15:25.213976 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2631/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:24 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:25.369731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:25.383069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85d6d599-dd87-4fbd-a63b-605c0eade6b5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1278 microversion: 2.1 time: 0.234721 Oct 24 09:15:25.397393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2437/5068] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:25 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:25.605818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:25.606706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:25.618936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:25.619802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:25.620408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.621429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:25.624933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:25.625695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.752826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:25.753158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:25.770172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:25.770785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:25.774127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.775016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:25.777230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:25.779113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:25.864781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:25.887544 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c0840f2-23a5-446a-8529-d810b30aeaa3 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.285117 Oct 24 09:15:25.888613 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2632/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:25 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:25.933510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:25.943782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:25.949498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:25.950737 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-836fe5f2-fa7a-4a2b-8810-4c91e249708e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.202755 Oct 24 09:15:25.951323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2438/5070] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:25 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:26.233417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:26.234049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:26.238194 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:26.258117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.259713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.260602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.261619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.262309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.262956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.410768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:26.411733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:26.443595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.444112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.451436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.452228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.452683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.459025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.698418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:26.713682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a54c9b78-1135-4bd2-980c-732fa33f4960 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.491303 Oct 24 09:15:26.714782 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2633/5071] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:26 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:26.752119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:26.775281 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-183d8409-f2a1-4c95-a032-faeef72016be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1278 microversion: 2.1 time: 0.368989 Oct 24 09:15:26.776558 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2439/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:26 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1278 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:26.919597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:26.920402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:26.931017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.931645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.932378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.933104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.933595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.934022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.977857 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:26.978559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:26.987315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.988138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:26.990910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:26.991931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:26.998187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:27.000159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:27.219762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:27.234255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:27.236695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:27.239955 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53beaf1a-2120-4a1f-bef5-c2b146dddbda tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.265996 Oct 24 09:15:27.241108 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2440/5073] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:26 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:27.354573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:27.365969 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1c611f9-12c4-4fa1-8b5b-2d5ab96ecb17 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.451182 Oct 24 09:15:27.367698 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2634/5074] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:26 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:27.742140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:27.742815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:27.752203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:27.753013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:27.755315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:27.759135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:27.759877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:27.760486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:27.803710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:27.804379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:27.821438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:27.822007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:27.822453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:27.823237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:27.834695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:27.836702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.122699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:28.134632 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9d7953f-9e6d-4a15-bfa8-2ef2eb1e693c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.336242 Oct 24 09:15:28.140215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:28.163152 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2635/5075] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:27 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:28.164319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8fc45cb6-c35c-48ff-bdf9-d9d8cea85ef5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.424898 Oct 24 09:15:28.166444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2441/5076] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:27 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:28.192505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:28.193870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:28.205747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.207374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.208235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.209517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.210559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.211478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.270510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:28.271140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:28.281702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.282257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.282675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.299021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.299529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.300113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.310674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44e0e23b-afa0-4fd5-8f71-cefffe16facf tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/ips" status: 200 len: 151 microversion: 2.1 time: 0.121743 Oct 24 09:15:28.311348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2636/5077] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:15:28 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/ips => generated 151 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:28.390351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:28.391022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:28.442492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.443103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.444648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.446793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.447758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.451540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.780822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:28.797559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:28.802864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:28.815741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d2990c4-a960-4733-9a05-e761d12435fd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.546919 Oct 24 09:15:28.817908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2442/5078] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:28 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:28.850400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f58b2a20-3c34-4bd1-a766-93a3bd2a9a3c req-22ac5cae-352a-41e5-b8d0-10fcdcf32c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d956643-af77-4b1c-8b7d-24605673a6f0", "tag": "e13a5cf1-b84e-4406-bbc8-dbc43a86c335"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:28.872319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f58b2a20-3c34-4bd1-a766-93a3bd2a9a3c req-22ac5cae-352a-41e5-b8d0-10fcdcf32c38 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:28.872802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f58b2a20-3c34-4bd1-a766-93a3bd2a9a3c req-22ac5cae-352a-41e5-b8d0-10fcdcf32c38 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:28.873234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f58b2a20-3c34-4bd1-a766-93a3bd2a9a3c req-22ac5cae-352a-41e5-b8d0-10fcdcf32c38 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:28.903761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:28.906366 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:28.922606 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ccd17b5b-a166-421f-b629-4d1f1a4bcf37 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.535930 Oct 24 09:15:28.936190 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f58b2a20-3c34-4bd1-a766-93a3bd2a9a3c req-22ac5cae-352a-41e5-b8d0-10fcdcf32c38 service nova] Creating event network-changed:e13a5cf1-b84e-4406-bbc8-dbc43a86c335 for instance 4d956643-af77-4b1c-8b7d-24605673a6f0 on n-h2-master-1 Oct 24 09:15:28.937673 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2637/5079] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:28 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:28.962554 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f58b2a20-3c34-4bd1-a766-93a3bd2a9a3c req-22ac5cae-352a-41e5-b8d0-10fcdcf32c38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112770 Oct 24 09:15:28.963202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2443/5080] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:15:29.168326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:29.169637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:29.179767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.180265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.180703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.192061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.192574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.193027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.197899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:29.199016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:29.209854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.210579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.211477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.212451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.213110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.213951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.528933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:29.540104 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a952bb07-32a2-47b3-9773-14b003ed4c4f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.380249 Oct 24 09:15:29.540900 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2638/5081] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:29 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:29.655364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:29.667913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0b6f686-058c-4773-8227-5fd7951c7dd7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.475911 Oct 24 09:15:29.682182 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2444/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:29 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:29.849546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:29.850709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:29.866612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.867510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.868485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.869698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.870586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.871139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.955470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:29.956889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:29.968415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.969925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.976564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:29.980380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.986553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:29.989212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:29.989780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:29.991394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:29.996192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:30.005538 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ab5c65b-29f4-498a-8830-1a0474f6c3c1 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.161130 Oct 24 09:15:30.006754 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2639/5083] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:29 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:30.261194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:30.267158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8727d481-e755-4b0a-81f8-416a7b83a65b tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Calling method '.version_select at 0x7f8daa2b1ca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:30.274353 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ec9b10e-bb72-4ef3-b273-91729340d5f7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.324224 Oct 24 09:15:30.276102 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2445/5084] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:29 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:30.527009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-da2e1eb0-72b6-4de5-aae1-d69603b9e663 req-0497c284-ac29-46cb-94d3-20fd98abccb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "name": "network-vif-plugged", "status": "completed", "tag": "89cb9735-2f74-4cb9-a1da-8e4955f4e8d3"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:30.546042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-da2e1eb0-72b6-4de5-aae1-d69603b9e663 req-0497c284-ac29-46cb-94d3-20fd98abccb3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:30.547767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-da2e1eb0-72b6-4de5-aae1-d69603b9e663 req-0497c284-ac29-46cb-94d3-20fd98abccb3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:30.549756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-da2e1eb0-72b6-4de5-aae1-d69603b9e663 req-0497c284-ac29-46cb-94d3-20fd98abccb3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:30.567228 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-da2e1eb0-72b6-4de5-aae1-d69603b9e663 req-0497c284-ac29-46cb-94d3-20fd98abccb3 service nova] Creating event network-vif-plugged:89cb9735-2f74-4cb9-a1da-8e4955f4e8d3 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:30.573205 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-da2e1eb0-72b6-4de5-aae1-d69603b9e663 req-0497c284-ac29-46cb-94d3-20fd98abccb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051055 Oct 24 09:15:30.574584 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2446/5085] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:30.580469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:30.582006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:30.588948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:30.589720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:30.590484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:30.591362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:30.592002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:30.592744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:30.638844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8727d481-e755-4b0a-81f8-416a7b83a65b tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.609069 Oct 24 09:15:30.640145 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2640/5086] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:15:30 2022] GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd/defaults => generated 371 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:30.661580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f45125d-e470-4aac-91e3-86cecb063e98 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Calling method '.version_select at 0x7f8daaef1a60>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:30.853545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:30.870445 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec2ecc5e-a8ba-4466-95a6-b57d9d49932a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.294450 Oct 24 09:15:30.875124 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2447/5087] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:30 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:30.880587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:30.881637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:30.899515 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:30.911144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:30.912007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:30.913887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:30.917277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:30.922063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:30.924670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:30.964905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f45125d-e470-4aac-91e3-86cecb063e98 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd" status: 200 len: 371 microversion: 2.1 time: 0.315313 Oct 24 09:15:30.965494 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2641/5088] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:15:30 2022] GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd => generated 371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:30.982346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34cd4f93-e442-466a-a9c7-e2d08ef721da tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Calling method '.version_select at 0x7f8daa371820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:31.059518 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34cd4f93-e442-466a-a9c7-e2d08ef721da tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.082793 Oct 24 09:15:31.060389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2642/5089] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:15:30 2022] GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd/defaults => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:31.074082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:31.075006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:31.090149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.090630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.091096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.096727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.098286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.098955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.194139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:31.200295 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=7 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:31.207396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:31.210221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:31.212218 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16224377-bd87-415a-8bfa-d07037d8181e tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.150593 Oct 24 09:15:31.226153 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2643/5090] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:31 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:31.238924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60646235-e3a4-4f07-8574-6e42c5ba1eff tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Calling method '.version_select at 0x7f8daa4f05e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:31.256893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:31.268427 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d5918ed-7f82-415c-80a4-ebcc7892257e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.392220 Oct 24 09:15:31.274472 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2448/5091] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:30 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:31.280283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec3cf86d-c92e-4018-9e24-8c5215915a59"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:31.286606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:31.307405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.308008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.308327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.309036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.309521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.309949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.318307 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60646235-e3a4-4f07-8574-6e42c5ba1eff tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd" status: 200 len: 371 microversion: 2.1 time: 0.090631 Oct 24 09:15:31.319456 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2644/5092] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:15:31 2022] GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:31.327767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:31.330489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:31.338254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.339064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.339740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.340800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.341528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.342421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.511103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:31.526720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-232ed04e-b4cf-4c5c-971e-bc479e12a2ed tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.205541 Oct 24 09:15:31.527642 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2645/5093] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:31 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:31.532902 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-236c5d5f-8858-438c-89c8-9294ade91763 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Calling method '.version_select at 0x7f8daadaa790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:31.622467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-236c5d5f-8858-438c-89c8-9294ade91763 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd?user_id=40113756c05741519abdecafeca161e2" status: 200 len: 371 microversion: 2.1 time: 0.093482 Oct 24 09:15:31.623392 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2646/5094] 10.222.0.25 () {58 vars in 1323 bytes} [Mon Oct 24 09:15:31 2022] GET /compute/v2.1/os-quota-sets/20e50dc64ab24fa68a122b10e4cb6acd?user_id=40113756c05741519abdecafeca161e2 => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:31.809020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-acaa4785-351e-4dd9-995b-182169b66927 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532717 Oct 24 09:15:31.825648 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2449/5095] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:15:31 2022] POST /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:31.900510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:31.901675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:31.917554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.918425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.918872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:31.919908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:31.920372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:31.920816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.156064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:32.168236 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08cb6870-ff1a-4b2b-8cf2-b99c03b7017f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.272862 Oct 24 09:15:32.169820 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2647/5096] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:31 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:32.249392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:32.252106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:32.264302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.265984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.267662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.268749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.270022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.270693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.294369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:32.294997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:32.302049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.302549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.302997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.303705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.325920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.326347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.336588 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:32.460193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:32.479036 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:32.482638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:32.484898 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dd0aac2f-e807-4524-9fb8-09ea5189cca5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.244397 Oct 24 09:15:32.488714 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2450/5097] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:32 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:32.552669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:32.553815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:32.566815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.570078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.570820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.572159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.572853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.574557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.648846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:32.662281 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fba2844f-9d0c-408e-9a10-bc745b9763a7 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.371655 Oct 24 09:15:32.665059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2648/5098] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:32 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:32.669886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-41412d70-bddc-4c99-90a2-00b5d8e2ad2b req-5cb60874-8476-4f8f-895f-11f91401c915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "name": "network-vif-plugged", "status": "completed", "tag": "ecdc301a-8185-46e5-9a99-8d229ce8eae5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:32.695316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-41412d70-bddc-4c99-90a2-00b5d8e2ad2b req-5cb60874-8476-4f8f-895f-11f91401c915 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:32.710095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-41412d70-bddc-4c99-90a2-00b5d8e2ad2b req-5cb60874-8476-4f8f-895f-11f91401c915 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:32.711042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-41412d70-bddc-4c99-90a2-00b5d8e2ad2b req-5cb60874-8476-4f8f-895f-11f91401c915 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:32.719002 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:32.740227 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-41412d70-bddc-4c99-90a2-00b5d8e2ad2b req-5cb60874-8476-4f8f-895f-11f91401c915 service nova] Creating event network-vif-plugged:ecdc301a-8185-46e5-9a99-8d229ce8eae5 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:32.752770 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-41412d70-bddc-4c99-90a2-00b5d8e2ad2b req-5cb60874-8476-4f8f-895f-11f91401c915 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084321 Oct 24 09:15:32.755542 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2649/5099] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:33.007152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:33.033622 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-007db824-6558-4b62-99e5-44cbabe661d7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.483486 Oct 24 09:15:33.040976 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2451/5100] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:32 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:33.192300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:33.193005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:33.201339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:33.201831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:33.202283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:33.202972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:33.203451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:33.203879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:33.477403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:33.486576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a0d9190-7a89-49fe-957e-ae02758fc686 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.298510 Oct 24 09:15:33.502478 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2650/5101] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:33 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:33.517480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:33.518320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:33.531045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:33.533675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:33.537528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:33.538627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:33.539273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:33.539909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:33.645522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:33.662622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:33.664066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:33.665813 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ccf67ab6-3c48-432b-bc80-cb73f78ed47b tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.153424 Oct 24 09:15:33.666529 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2452/5102] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:33 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:33.692646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:33.693644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:33.703782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:33.705794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:33.707144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:33.710199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:33.710884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:33.712588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:33.980379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:33.989362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40a9df47-c63e-42c1-b226-d26ab2fea482 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.302567 Oct 24 09:15:33.990874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2651/5103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:33 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:34.069037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:34.069684 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:34.078933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:34.079460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:34.079993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:34.080590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:34.081076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:34.081565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:34.422803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:34.435697 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e9359d5-8738-4366-a6b9-1bc56c7ec295 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1333 microversion: 2.1 time: 0.370539 Oct 24 09:15:34.438449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2453/5104] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:34 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1333 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:34.524824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:34.532617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:34.560551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:34.562325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:34.563461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:34.566036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:34.567337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:34.568505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:34.710480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:34.714916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:34.762845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:34.765895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:34.771755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:34.775088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:34.780423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:34.783487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:34.938130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:34.948053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:34.956154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:34.957916 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a2559b3-f606-4fbe-9857-c7a7af3a4d4c tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.264690 Oct 24 09:15:34.958449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2454/5105] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:34 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:35.015604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:35.016671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:35.027196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:35.030945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:35.031654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:35.035449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:35.036231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:35.038137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:35.075935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:35.089599 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92a1c265-f08e-45c4-8694-146ffcdb6012 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.577827 Oct 24 09:15:35.090411 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2652/5106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:34 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:35.449632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c257e5be-1eb3-4b5f-8477-d2358872fb9f req-0c5e24f8-eec0-4b4a-992b-1f005cda4874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d956643-af77-4b1c-8b7d-24605673a6f0", "name": "network-vif-plugged", "status": "completed", "tag": "e13a5cf1-b84e-4406-bbc8-dbc43a86c335"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:35.467282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:35.473491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c257e5be-1eb3-4b5f-8477-d2358872fb9f req-0c5e24f8-eec0-4b4a-992b-1f005cda4874 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:35.474247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c257e5be-1eb3-4b5f-8477-d2358872fb9f req-0c5e24f8-eec0-4b4a-992b-1f005cda4874 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:35.474863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c257e5be-1eb3-4b5f-8477-d2358872fb9f req-0c5e24f8-eec0-4b4a-992b-1f005cda4874 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:35.481413 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25ee10b9-e942-4f9d-9f6e-40880b832557 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1720 microversion: 2.1 time: 0.466780 Oct 24 09:15:35.481878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2455/5107] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:35 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1720 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:35.494193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:35.494848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:35.509130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:35.509637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:35.510260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:35.511160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:35.511779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:35.512366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:35.531040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c257e5be-1eb3-4b5f-8477-d2358872fb9f req-0c5e24f8-eec0-4b4a-992b-1f005cda4874 service nova] Creating event network-vif-plugged:e13a5cf1-b84e-4406-bbc8-dbc43a86c335 for instance 4d956643-af77-4b1c-8b7d-24605673a6f0 on n-h2-master-1 Oct 24 09:15:35.551804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c257e5be-1eb3-4b5f-8477-d2358872fb9f req-0c5e24f8-eec0-4b4a-992b-1f005cda4874 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104651 Oct 24 09:15:35.553473 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2653/5108] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:35.990127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:35.990759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:36.004619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.005470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.006985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.008051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.013332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.014016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.051361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:36.068290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0545c338-2974-4959-8953-9b5cd7ad3312 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1667 microversion: 2.1 time: 0.582862 Oct 24 09:15:36.069706 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2456/5109] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:35 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1667 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:36.096714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:36.097352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:36.115994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.119013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.122951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.125580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.126939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.127996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.196194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3581a5e5-7973-44ea-a849-27b62a940760 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501/ips" status: 200 len: 178 microversion: 2.1 time: 0.103634 Oct 24 09:15:36.202738 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2457/5110] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:15:36 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501/ips => generated 178 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:15:36.206194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:36.215623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:36.217914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:36.218848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:36.226393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:36.228136 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a5caf85a-d0ee-4941-a93f-a723e7d02ba6 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.244372 Oct 24 09:15:36.229453 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2654/5111] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:35 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:36.237917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.237917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.237917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.237917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.237917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.237917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.263872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:36.265239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:36.281175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.284285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.285456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.286445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.290515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.291230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.351926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:15:36.615418 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4be1fbe2-cf4a-4fa1-a837-77077b4ede5e tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 204 len: 0 microversion: 2.1 time: 0.374776 Oct 24 09:15:36.622460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2655/5112] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:15:36 2022] DELETE /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:15:36.635751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:36.637796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:36.654858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.655970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.658115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.659098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.659767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.662623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.903786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:36.933331 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5a030570-77c1-439b-b09f-be6271ea2ac2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1697 microversion: 2.1 time: 0.308598 Oct 24 09:15:36.935771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2656/5113] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:36 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1697 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:36.941804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:36.943540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:36.956814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.957229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.957696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.965456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:36.968285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:36.968986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:36.970440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:36.984029 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fba7c0ca-1a91-4351-b1a8-ef114ccdf964 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1320 microversion: 2.1 time: 0.778415 Oct 24 09:15:36.984668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2458/5114] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:36 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1320 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:37.008896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2221d13b-0c00-4aec-917e-ae45efe220f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:37.025802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2221d13b-0c00-4aec-917e-ae45efe220f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:37.026277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2221d13b-0c00-4aec-917e-ae45efe220f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:37.027739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2221d13b-0c00-4aec-917e-ae45efe220f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:37.117426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2221d13b-0c00-4aec-917e-ae45efe220f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Going to try to start instance {{(pid=126919) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 09:15:37.227380 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2221d13b-0c00-4aec-917e-ae45efe220f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action" status: 202 len: 0 microversion: 2.1 time: 0.229259 Oct 24 09:15:37.231660 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2459/5115] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:15:36 2022] POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:15:37.244316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:37.248502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:37.264533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:37.266035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:37.267255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:37.271166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:37.272294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:37.272945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:37.368546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:37.393201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-351fd6b3-c9fd-4d41-861a-5fcf1ff193ea tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1673 microversion: 2.1 time: 0.447663 Oct 24 09:15:37.394164 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2657/5116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:36 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:37.399867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:37.403432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:37.437399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:37.446313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:37.446802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:37.448802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:37.449285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:37.449745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:37.606503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:37.621563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:37.628343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:37.633619 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c2f3ea7-70ec-49ea-a0f1-fd8476d316e3 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.236206 Oct 24 09:15:37.635605 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2658/5117] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:37 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:38.012640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:38.018076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:38.031613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.033012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.034432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.039142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.041026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.041743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.068106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:38.078820 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:38.079014 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42d46d11-02e6-4f28-bc57-071167cb6abe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1706 microversion: 2.1 time: 0.844779 Oct 24 09:15:38.084544 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2460/5118] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:37 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1706 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:38.402565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:38.419710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-291b7854-7762-448f-a45f-7e199ec1f6c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1500 microversion: 2.1 time: 0.408760 Oct 24 09:15:38.419995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:38.421145 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2659/5119] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:38 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1500 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:38.421958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:38.435613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.439102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.439851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.441092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.443642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.452601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:38.453226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:38.453856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.465621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.466066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.466722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.467641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.468269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.468900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.763145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:38.775990 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3f06011-a0fe-4079-b53f-46ddd2c0a757 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1500 microversion: 2.1 time: 0.332954 Oct 24 09:15:38.776561 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2660/5120] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:38 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1500 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:38.800003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:38.823897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:38.844257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.845992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.846445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:38.849105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:38.849622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:38.850067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.018991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:39.031239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:39.033603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:39.035010 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d467380d-2ed1-4b58-93df-e5ef78e0c357 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.255317 Oct 24 09:15:39.036063 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2661/5121] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:38 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:39.071786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:39.073505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:39.086185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:39.087065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:39.088339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.089740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:39.090434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:39.091330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.125766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:15:39.275679 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7739780a-d352-4784-9952-8309ebfd5dff tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 204 len: 0 microversion: 2.1 time: 0.237735 Oct 24 09:15:39.277041 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2662/5122] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:15:39 2022] DELETE /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:15:39.289030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:39.290197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:39.301858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:39.302742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:39.303412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.304570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:39.305262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:39.305963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.613158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:39.627495 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d62ac28e-d838-42cf-9004-3512535d8f96 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1706 microversion: 2.1 time: 0.348730 Oct 24 09:15:39.631512 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2663/5123] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:39 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1706 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:39.646405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:39.648067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:39.678552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:39.681396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:39.699416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.703171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:39.703901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:39.704603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:39.725894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:39.739918 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d465191-61d4-416f-914b-1e2dc33ed478 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1673 microversion: 2.1 time: 1.323508 Oct 24 09:15:39.752385 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2461/5124] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:38 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1673 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:40.048830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:40.061383 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d55016dc-4dbf-47fd-a8be-e3d5c43b9836 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1506 microversion: 2.1 time: 0.426715 Oct 24 09:15:40.076636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:40.077583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:40.080571 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2664/5125] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:39 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:40.087193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.088116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.088733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:40.091090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.091839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.095554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:40.302365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:40.318766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:40.322884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:40.326294 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08e65ca7-1979-439a-b4be-45b369d5ac06 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.260753 Oct 24 09:15:40.327180 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2462/5126] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:40 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:40.560057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f8a1a4d0-9a1e-4c0a-a515-46ae38204805 req-2b125678-8981-40f6-ba41-03f4f6138664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "name": "network-vif-deleted", "tag": "89cb9735-2f74-4cb9-a1da-8e4955f4e8d3"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:40.597536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f8a1a4d0-9a1e-4c0a-a515-46ae38204805 req-2b125678-8981-40f6-ba41-03f4f6138664 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.598311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f8a1a4d0-9a1e-4c0a-a515-46ae38204805 req-2b125678-8981-40f6-ba41-03f4f6138664 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.598853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f8a1a4d0-9a1e-4c0a-a515-46ae38204805 req-2b125678-8981-40f6-ba41-03f4f6138664 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:40.613652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f8a1a4d0-9a1e-4c0a-a515-46ae38204805 req-2b125678-8981-40f6-ba41-03f4f6138664 service nova] Creating event network-vif-deleted:89cb9735-2f74-4cb9-a1da-8e4955f4e8d3 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:40.621579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f8a1a4d0-9a1e-4c0a-a515-46ae38204805 req-2b125678-8981-40f6-ba41-03f4f6138664 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066038 Oct 24 09:15:40.622594 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2665/5127] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:40.661992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:40.664898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:40.685639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.687210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.691692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:40.694321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.698231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.698889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:40.770602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:40.770602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:40.784147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.787186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.788950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:40.791091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:40.791760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:40.795454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:41.166779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:41.174773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e08b9d74-7138-4523-9965-9fbdd4c76c5d tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1494 microversion: 2.1 time: 0.410752 Oct 24 09:15:41.175371 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2666/5128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:40 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1494 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:41.180898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:41.181751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:41.188420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:41.189693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:41.190301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:41.191200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:41.191827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:41.192440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:41.373969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:41.385199 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb5afed1-8532-41a8-8c34-501fb3f97835 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1506 microversion: 2.1 time: 0.208444 Oct 24 09:15:41.386583 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2667/5129] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:41 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:41.413100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:41.414339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:41.421119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:41.422039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:41.422643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:41.424450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:41.425271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:41.425901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:41.519231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:41.541127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:41.545115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:41.550225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08956cbd-b5b1-4bf2-ae4a-35406a4195bd tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.140767 Oct 24 09:15:41.567211 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2668/5130] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:41 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:41.757344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ecb1773f-ef15-4a9e-ae48-5ec29ae9b129 req-28b49adf-e350-4d93-8b57-1ea49307dfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "name": "network-vif-unplugged", "status": "completed", "tag": "ecdc301a-8185-46e5-9a99-8d229ce8eae5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:41.767994 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=15 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:41.778040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ecb1773f-ef15-4a9e-ae48-5ec29ae9b129 req-28b49adf-e350-4d93-8b57-1ea49307dfe7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:41.778530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ecb1773f-ef15-4a9e-ae48-5ec29ae9b129 req-28b49adf-e350-4d93-8b57-1ea49307dfe7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:41.778971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ecb1773f-ef15-4a9e-ae48-5ec29ae9b129 req-28b49adf-e350-4d93-8b57-1ea49307dfe7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:41.800062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ecb1773f-ef15-4a9e-ae48-5ec29ae9b129 req-28b49adf-e350-4d93-8b57-1ea49307dfe7 service nova] Creating event network-vif-unplugged:ecdc301a-8185-46e5-9a99-8d229ce8eae5 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:41.809767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:41.815362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ecb1773f-ef15-4a9e-ae48-5ec29ae9b129 req-28b49adf-e350-4d93-8b57-1ea49307dfe7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060177 Oct 24 09:15:41.817904 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2669/5131] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:15:41.821605 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b97a49e-8942-4a11-94a6-2d6ecde964cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1706 microversion: 2.1 time: 1.167840 Oct 24 09:15:41.825340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2463/5132] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:40 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1706 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:42.200780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:42.202066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:42.212190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.213488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.214339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.216163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.216926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.217629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.337890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:42.351697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5dbcbfbc-c610-4ec8-9756-b6695b4557e7 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1452 microversion: 2.1 time: 0.155278 Oct 24 09:15:42.361401 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2670/5133] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:42 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:42.412660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:42.413850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:42.434405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.435303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.435966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.438112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.439739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.440358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.586068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:42.586747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:42.595177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.605983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.606559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.616233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.616957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.617829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.637451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:42.647532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-901894de-7353-4cb7-93d7-9587863bef4d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1464 microversion: 2.1 time: 0.240391 Oct 24 09:15:42.663264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2464/5134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:42 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:42.715498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cb005d08-c89b-41ea-ae9c-7ba18b17da9b req-884f489d-1825-4736-ad73-08af93b72aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70b8f82-f297-4eb7-9657-7e9637055501", "name": "network-vif-deleted", "tag": "ecdc301a-8185-46e5-9a99-8d229ce8eae5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:42.727874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:42.745702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:42.747992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:42.750255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c4fc7ce-2816-457f-ad3a-6b8dbbfbfeb0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.169372 Oct 24 09:15:42.752852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2671/5135] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:42 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:42.765729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb005d08-c89b-41ea-ae9c-7ba18b17da9b req-884f489d-1825-4736-ad73-08af93b72aeb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.765729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb005d08-c89b-41ea-ae9c-7ba18b17da9b req-884f489d-1825-4736-ad73-08af93b72aeb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.766175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb005d08-c89b-41ea-ae9c-7ba18b17da9b req-884f489d-1825-4736-ad73-08af93b72aeb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.827276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cb005d08-c89b-41ea-ae9c-7ba18b17da9b req-884f489d-1825-4736-ad73-08af93b72aeb service nova] Creating event network-vif-deleted:ecdc301a-8185-46e5-9a99-8d229ce8eae5 for instance b70b8f82-f297-4eb7-9657-7e9637055501 on n-h1-master-1 Oct 24 09:15:42.843910 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cb005d08-c89b-41ea-ae9c-7ba18b17da9b req-884f489d-1825-4736-ad73-08af93b72aeb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130288 Oct 24 09:15:42.847442 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2465/5136] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:42.849911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:42.850547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:42.885221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.890492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.890970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:42.892302 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:42.892778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:42.893213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.384160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:43.384856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:43.425320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.426594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.430146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.432248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.432967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.434803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.540059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.540552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.540995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.541485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lazy-loading 'fault' on Instance uuid b70b8f82-f297-4eb7-9657-7e9637055501 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:15:43.558574 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:43.560885 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:43.581959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3461af33-cea2-4f6c-b4ed-9fc5481d4dbe tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1710 microversion: 2.1 time: 0.734824 Oct 24 09:15:43.601395 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2672/5137] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:42 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1710 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:43.676493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:43.677108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:43.688061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ac971da2614beab2e4598795ed9583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4329719ac6b4fc0894b1f642a068376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:43.693630 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:43.696898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.697506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.697951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.700768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-817be872-35a2-4552-ad91-33e93a715619 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 200 len: 1302 microversion: 2.1 time: 0.326395 Oct 24 09:15:43.704746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.707560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.710294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.714626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2466/5138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:43 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 1302 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:43.787523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:43.788480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:43.812207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.812866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.813643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.814431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.814925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.815354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.825499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:43.826345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:43.826769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:43.827298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lazy-loading 'fault' on Instance uuid 4d956643-af77-4b1c-8b7d-24605673a6f0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:15:43.934225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:43.945455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:43.946910 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74c477d3-7d67-4b5b-8fca-9c10d1aeacb2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 200 len: 1310 microversion: 2.1 time: 0.274655 Oct 24 09:15:43.948058 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2673/5139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:43 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 1310 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:43.962969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:43.964867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:43.972005 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fbb911f-292a-4c8d-a658-ae40e00a12ec tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.192392 Oct 24 09:15:43.972597 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2467/5140] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:43 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:44.733486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:44.734726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:44.747334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:44.749193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:44.750080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:44.751848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:44.752486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:44.753103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:44.774006 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] HTTP exception thrown: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Request method failure captured: Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 HTTP/1.1 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlc7Jjc4JNMt85j4ZCMbiiLOUR_OKLVWHN6N18BpPC0gMS5eMp0EDyvysfutKR4W4kLxERNOk3bswiXjAP3EcGb5u9G3hR6mSFfqz4r5oZ1qbTBlkjBIzJpb4fN4m27pN_QyqSgvCFzLW-C-Mwcu8ScqHDge3-yxYrvhFRWyVHiKQ-I Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a4329719ac6b4fc0894b1f642a068376"}]}] Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d9ac971da2614beab2e4598795ed9583 Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b70b8f82-f297-4eb7-9657-7e9637055501'} Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:44.776346 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:44.783018 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:44.785164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Returning 404 to user: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:44.787433 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0942836a-2a9e-444a-9720-8bfced932444 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 404 len: 111 microversion: 2.1 time: 0.059963 Oct 24 09:15:44.788317 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2674/5141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:44 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:15:44.892390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-41ce2c3d-f376-4bb0-9ba0-94d665509bb3 req-894b3674-2a57-4c35-9dea-5bed8dcdaf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d956643-af77-4b1c-8b7d-24605673a6f0", "name": "network-vif-deleted", "tag": "e13a5cf1-b84e-4406-bbc8-dbc43a86c335"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:44.912044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-41ce2c3d-f376-4bb0-9ba0-94d665509bb3 req-894b3674-2a57-4c35-9dea-5bed8dcdaf76 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:44.914486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-41ce2c3d-f376-4bb0-9ba0-94d665509bb3 req-894b3674-2a57-4c35-9dea-5bed8dcdaf76 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:44.915259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-41ce2c3d-f376-4bb0-9ba0-94d665509bb3 req-894b3674-2a57-4c35-9dea-5bed8dcdaf76 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:44.934970 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-41ce2c3d-f376-4bb0-9ba0-94d665509bb3 req-894b3674-2a57-4c35-9dea-5bed8dcdaf76 service nova] Creating event network-vif-deleted:e13a5cf1-b84e-4406-bbc8-dbc43a86c335 for instance 4d956643-af77-4b1c-8b7d-24605673a6f0 on n-h2-master-1 Oct 24 09:15:44.944220 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-41ce2c3d-f376-4bb0-9ba0-94d665509bb3 req-894b3674-2a57-4c35-9dea-5bed8dcdaf76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054616 Oct 24 09:15:44.945805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2468/5142] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:44.978153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:44.979121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:44.990974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:44.993537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:44.994162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:45.005380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:45.007812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:45.010262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:45.010714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:45.013875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:45.034194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:45.035780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:45.037846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:45.040647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:45.041169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:45.041562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:45.059520 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 HTTP/1.1 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4d956643-af77-4b1c-8b7d-24605673a6f0'} Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:45.068642 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:15:45.074217 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:15:45.075446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:45.082037 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f5fcdd9-f4a0-4105-8253-c8d4f6666aa6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 404 len: 111 microversion: 2.1 time: 0.109714 Oct 24 09:15:45.082990 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2675/5143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:44 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:15:45.099037 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2f2562b-ca87-4ec3-a758-c1d5183161b1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: .version_select at 0x7f8daa2b1310>, body: {"keypair": {"name": "tempest-key-799306643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3F2Tg0iX3yGE9QTTToI0V7bHYD9oaM/XTwL+DXO59Uwf+MwANFGSX1GmOMNLtZ+EicVlNA+v2LcKHIAvOebfTE+Wyx03dpUXKy9PDdbVk8foIipnLRkUEmXlfecd/NQw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:45.118588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-a2f2562b-ca87-4ec3-a758-c1d5183161b1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:45.126444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-a2f2562b-ca87-4ec3-a758-c1d5183161b1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:45.163615 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2f2562b-ca87-4ec3-a758-c1d5183161b1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.069126 Oct 24 09:15:45.166532 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2676/5144] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:15:45 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:15:45.179365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b90efa0e-b498-404b-85bc-b38a305f505b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '.version_select at 0x7f8da9d8c160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:45.185949 n-d-master-1 devstack@n-api.service[126920]: WARNING oslo_db.sqlalchemy.utils [None req-b90efa0e-b498-404b-85bc-b38a305f505b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 09:15:45.187486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:45.196877 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b90efa0e-b498-404b-85bc-b38a305f505b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.023764 Oct 24 09:15:45.197832 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2677/5145] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:15:45 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:45.210814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:45.212357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:45.214666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e8071c3-e306-4975-903b-cb9e6f1c0f00 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.217756 Oct 24 09:15:45.216044 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2469/5146] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:44 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:15:45.414198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-4973841", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-key-799306643", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:45.496088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:15:46.247141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:46.247766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:46.261532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:46.262266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:46.262900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:46.263956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:46.264237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:46.268114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:46.497648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:46.515587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:46.520908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:46.531280 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e19d05da-680e-4d5b-b82b-40cf7d317604 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.284200 Oct 24 09:15:46.554840 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2470/5147] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:46 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:46.895784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec3cf86d-c92e-4018-9e24-8c5215915a59"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:46.903948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:46.934823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:46.935324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:46.935765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:46.936476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:46.944956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:46.945545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:47.201852 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Invalid volume: volume ec3cf86d-c92e-4018-9e24-8c5215915a59 is already attached to instances: 9c9435d5-d687-47fa-a450-b70a41159ef7 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments HTTP/1.1 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 74 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "ec3cf86d-c92e-4018-9e24-8c5215915a59"}} Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid volume: volume ec3cf86d-c92e-4018-9e24-8c5215915a59 is already attached to instances: 9c9435d5-d687-47fa-a450-b70a41159ef7 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '9c9435d5-d687-47fa-a450-b70a41159ef7', 'body': {'volumeAttachment': {'volumeId': 'ec3cf86d-c92e-4018-9e24-8c5215915a59'}}} Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ec3cf86d-c92e-4018-9e24-8c5215915a59 is already attached to instances: 9c9435d5-d687-47fa-a450-b70a41159ef7 Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:15:47.203594 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ec3cf86d-c92e-4018-9e24-8c5215915a59 is already attached to instances: 9c9435d5-d687-47fa-a450-b70a41159ef7 Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ec3cf86d-c92e-4018-9e24-8c5215915a59 is already attached to instances: 9c9435d5-d687-47fa-a450-b70a41159ef7 Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 400 to user: Invalid volume: volume ec3cf86d-c92e-4018-9e24-8c5215915a59 is already attached to instances: 9c9435d5-d687-47fa-a450-b70a41159ef7 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ad7f2ad-2724-4e67-98bc-653de73de563 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.314434 Oct 24 09:15:47.209828 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2471/5148] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:15:46 2022] POST /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 174 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:15:47.448468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d0f3d18-42a4-43eb-8f96-44d5b90cdd34 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'create', calling method: .version_select at 0x7f8da9bb1700>, body: {"keypair": {"name": "tempest-keypair-705603548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7k2u1CVFVjdXoP8vtfoZmGWe5nZADcgrlh6CItGZ4b1w9vcqE2SdPBEk6lrEtJo02jlXNVvuns2CUGmOOg89nsrZ3ZPuhzrN8wnlC9SlAnX+y0w2YL8HCvPNcT7Ky1/g=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:47.489142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3d0f3d18-42a4-43eb-8f96-44d5b90cdd34 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:47.502472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3d0f3d18-42a4-43eb-8f96-44d5b90cdd34 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for user b2755c3ea93440999d287890d328ecd6 and project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:47.581685 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d0f3d18-42a4-43eb-8f96-44d5b90cdd34 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.371136 Oct 24 09:15:47.582294 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2472/5149] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 09:15:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 372 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 09:15:47.587976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:47.588672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:47.605520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:47.606528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:47.607335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:47.607698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:47.608154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:47.608589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:47.809185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:47.810014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:47.810521 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:47.810978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:47.811395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:47.841652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:47.846797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:47.851193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:47.854059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:47.858123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:47.872638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lazy-loading 'services' on Instance uuid 9c9435d5-d687-47fa-a450-b70a41159ef7 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:15:47.876637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:47.933056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:47.959504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:47.996426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:47.998930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:48.076116 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4acdfc2-b388-4640-823e-8020aaa79614 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments/ec3cf86d-c92e-4018-9e24-8c5215915a59" status: 202 len: 0 microversion: 2.1 time: 0.491968 Oct 24 09:15:48.077768 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2473/5150] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:15:47 2022] DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments/ec3cf86d-c92e-4018-9e24-8c5215915a59 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:15:48.092148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:48.093541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:48.115533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:48.117327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:48.120686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:48.122819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:48.126903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:48.130316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:48.203215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b253369-3716-4c5c-a441-86ae319dfb72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.794050 Oct 24 09:15:48.209154 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2678/5151] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:15:48.221937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:48.227714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:48.244056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:48.248438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:48.249051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:48.249969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:48.250575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:48.251647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:48.312343 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:48.325792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:48.339505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0429d9e2-1cb3-481f-9033-a0958a65631b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127973 Oct 24 09:15:48.342791 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2679/5152] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:48 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:48.345414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:48.348021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:48.350025 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a0f81ba-fad4-47f3-b4f1-3087f7683372 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.269806 Oct 24 09:15:48.352667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa925189-844c-43ec-a128-b150a6075171 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:48.353363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa925189-844c-43ec-a128-b150a6075171 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:48.358225 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2474/5153] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:48 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:48.505219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa925189-844c-43ec-a128-b150a6075171 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:48.521869 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa925189-844c-43ec-a128-b150a6075171 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1225 microversion: 2.1 time: 0.175190 Oct 24 09:15:48.522457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2680/5154] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:48 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:49.357731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:49.361078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:49.383080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:49.384441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:49.405392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:49.406121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:49.410952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:49.416901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:49.417745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:49.418934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:49.421819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:49.422433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:49.425629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:49.428245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:49.436515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:49.437108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:49.549382 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-546b6248-c2dc-446c-aa62-d908825f3a86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191828 Oct 24 09:15:49.557655 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2475/5155] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:49 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:49.567273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:49.567894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:49.587749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:49.591015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:49.594031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:49.596472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:49.600017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:49.602142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:49.721098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:49.742893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:49.746585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:49.752236 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5049d7d4-89a0-45bb-a787-806a94dbb8ff tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.379109 Oct 24 09:15:49.778852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2681/5156] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:49 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:49.829836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:49.839787 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b3a9ea1-7a92-4b5b-89e9-bad86f7f6d41 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1277 microversion: 2.1 time: 0.280749 Oct 24 09:15:49.842574 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2476/5157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:49 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:50.562775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:50.565702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:50.582614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:50.603335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:50.606021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:50.607092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:50.607802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:50.609615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:50.687926 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e690e31a-1dc0-4d27-a635-9851ecaad607 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129605 Oct 24 09:15:50.689490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2682/5158] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:50 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:50.787834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:50.789012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:50.810793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:50.810793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:50.814467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:50.817667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:50.818348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:50.822060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:50.870940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:50.872192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:50.892365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:50.895623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:50.899147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:50.900448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:50.902238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:50.904679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.047856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:51.055775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:51.065390 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:51.066975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:51.067570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a74ae632-316b-4621-bd61-2de370a5ba72 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1283 microversion: 2.1 time: 0.202326 Oct 24 09:15:51.068210 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b633c729-cb39-4252-8fae-ffc6579721f2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 0.285307 Oct 24 09:15:51.069612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2683/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:50 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:51.083525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2477/5160] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:50 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:51.090938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:51.091187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:51.096470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1235341182", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a59e1058-3a7b-4dd3-b40e-da035da5b278"}], "security_groups": [{"name": "tempest-securitygroup--1247609363"}], "key_name": "tempest-keypair-705603548", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:51.114957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.115480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.118045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.119013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.120358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.122416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.171107 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] HTTP exception thrown: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Request method failure captured: Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 HTTP/1.1 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc7Jjc4JNMt85j4ZCMbiiLOUR_OKLVWHN6N18BpPC0gMS5eMp0EDyvysfutKR4W4kLxERNOk3bswiXjAP3EcGb5u9G3hR6mSFfqz4r5oZ1qbTBlkjBIzJpb4fN4m27pN_QyqSgvCFzLW-C-Mwcu8ScqHDge3-yxYrvhFRWyVHiKQ-I Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a4329719ac6b4fc0894b1f642a068376"}]}] Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d9ac971da2614beab2e4598795ed9583 Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b70b8f82-f297-4eb7-9657-7e9637055501'} Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:51.179474 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.186167 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.191869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Returning 404 to user: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:51.193758 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38d96fb2-5ed2-4fda-a1b2-a169a88d6785 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 404 len: 111 microversion: 2.1 time: 0.106843 Oct 24 09:15:51.196534 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2478/5161] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:15:51 2022] DELETE /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:15:51.206738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:51.207568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: b70b8f82-f297-4eb7-9657-7e9637055501] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:51.221976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.223103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.224318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.228016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.229450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.230124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.260807 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] HTTP exception thrown: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Request method failure captured: Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 HTTP/1.1 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc7Jjc4JNMt85j4ZCMbiiLOUR_OKLVWHN6N18BpPC0gMS5eMp0EDyvysfutKR4W4kLxERNOk3bswiXjAP3EcGb5u9G3hR6mSFfqz4r5oZ1qbTBlkjBIzJpb4fN4m27pN_QyqSgvCFzLW-C-Mwcu8ScqHDge3-yxYrvhFRWyVHiKQ-I Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a4329719ac6b4fc0894b1f642a068376"}]}] Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d9ac971da2614beab2e4598795ed9583 Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b70b8f82-f297-4eb7-9657-7e9637055501'} Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.263075 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. Oct 24 09:15:51.269237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.283289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Returning 404 to user: Instance b70b8f82-f297-4eb7-9657-7e9637055501 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:51.284526 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28b06abd-7f92-45a6-82b6-77a4ee8f3506 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501" status: 404 len: 111 microversion: 2.1 time: 0.083550 Oct 24 09:15:51.287443 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2479/5162] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:51 2022] GET /compute/v2.1/servers/b70b8f82-f297-4eb7-9657-7e9637055501 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:15:51.300355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:51.301809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:51.309130 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:51.314545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.315357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.316423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.317553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.318258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.318961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.369621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] validate_networks() for [('a59e1058-3a7b-4dd3-b40e-da035da5b278', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:15:51.382881 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] HTTP exception thrown: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Request method failure captured: Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 HTTP/1.1 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc7Jjc4JNMt85j4ZCMbiiLOUR_OKLVWHN6N18BpPC0gMS5eMp0EDyvysfutKR4W4kLxERNOk3bswiXjAP3EcGb5u9G3hR6mSFfqz4r5oZ1qbTBlkjBIzJpb4fN4m27pN_QyqSgvCFzLW-C-Mwcu8ScqHDge3-yxYrvhFRWyVHiKQ-I Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a4329719ac6b4fc0894b1f642a068376"}]}] Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d9ac971da2614beab2e4598795ed9583 Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f6487fb3-d473-477d-8a0b-ac61b0ecb154'} Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:51.385518 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.391390 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.394463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Returning 404 to user: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:51.396092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa80dba7-7888-4cec-9451-91bf2cd4c5c1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 404 len: 111 microversion: 2.1 time: 0.105020 Oct 24 09:15:51.396971 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2480/5163] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:15:51 2022] DELETE /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:15:51.407371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:51.410068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] [instance: f6487fb3-d473-477d-8a0b-ac61b0ecb154] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:51.424321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.426846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.429867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.430910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.431602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.435841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.455783 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] HTTP exception thrown: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Request method failure captured: Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 HTTP/1.1 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc7Jjc4JNMt85j4ZCMbiiLOUR_OKLVWHN6N18BpPC0gMS5eMp0EDyvysfutKR4W4kLxERNOk3bswiXjAP3EcGb5u9G3hR6mSFfqz4r5oZ1qbTBlkjBIzJpb4fN4m27pN_QyqSgvCFzLW-C-Mwcu8ScqHDge3-yxYrvhFRWyVHiKQ-I Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a4329719ac6b4fc0894b1f642a068376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a4329719ac6b4fc0894b1f642a068376"}]}] Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a4329719ac6b4fc0894b1f642a068376 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestMultiNic-1652357517 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d9ac971da2614beab2e4598795ed9583 Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestMultiNic-1652357517-project Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: exception: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'f6487fb3-d473-477d-8a0b-ac61b0ecb154'} Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:15:51.457797 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:15:51.463156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] Returning 404 to user: Instance f6487fb3-d473-477d-8a0b-ac61b0ecb154 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:15:51.464732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58282d8e-c819-4865-a9bc-0fe1506ecbc1 tempest-ServersTestMultiNic-1652357517 tempest-ServersTestMultiNic-1652357517-project] 10.222.0.25 "GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154" status: 404 len: 111 microversion: 2.1 time: 0.060586 Oct 24 09:15:51.468539 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2481/5164] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:51 2022] GET /compute/v2.1/servers/f6487fb3-d473-477d-8a0b-ac61b0ecb154 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:15:51.701105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:51.703926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:51.726072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.729447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.730052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.736599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:51.738589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:51.739328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:51.847831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-66d85e7b-8ec8-4422-b9d2-98181e8ba6f7 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151106 Oct 24 09:15:51.856476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2482/5165] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:51 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:52.097574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:52.099539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:52.115506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:52.117928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:52.121978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:52.123314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:52.127060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:52.130999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:52.697082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:15:52.697697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:15:52.698025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:15:52.698439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:15:52.698859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:15:52.728842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:52.747409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:52.747924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:52.748768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:52.749254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:52.749728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:52.843917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:15:52.859794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for user b2755c3ea93440999d287890d328ecd6 and project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:15:52.893375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:15:52.901996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:15:52.997212 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42b543a6-58b8-4d96-b78b-adc67783c62b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.924042 Oct 24 09:15:53.007310 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2684/5166] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:15:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:15:53.012652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:53.013584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:53.020668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:53.021595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:53.022318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:53.023305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:53.024045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:53.024724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:53.744447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:53.758400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-288bc616-bd84-4617-a482-8913f5dc9260 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1325 microversion: 2.1 time: 1.666093 Oct 24 09:15:53.759507 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2483/5167] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:52 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1325 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:15:53.764873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:53.768296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:53.776151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:53.777264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:53.777919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:53.778900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:53.779524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:53.780222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:53.887848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92733223-a218-4d6e-b87c-f0bf9093adbe tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126932 Oct 24 09:15:53.894468 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2484/5168] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:53 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:53.902597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d39ada73-1dbd-422f-aa2f-51a5ac6ae824 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:53.903595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d39ada73-1dbd-422f-aa2f-51a5ac6ae824 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:54.049340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d39ada73-1dbd-422f-aa2f-51a5ac6ae824 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:54.057813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d39ada73-1dbd-422f-aa2f-51a5ac6ae824 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:54.069977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d39ada73-1dbd-422f-aa2f-51a5ac6ae824 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:54.071453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d39ada73-1dbd-422f-aa2f-51a5ac6ae824 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1281 microversion: 2.20 time: 0.175622 Oct 24 09:15:54.072631 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2485/5169] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:53 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:54.126831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:54.146412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:54.152943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:54.154475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a39bbe1e-a2ff-4d0d-ad72-8f306c96a705 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1366 microversion: 2.47 time: 1.145639 Oct 24 09:15:54.156577 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2685/5170] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:53 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1366 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:54.273525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-983f6b64-d1e3-4563-8260-57ba1c1480eb req-741c6765-c632-43f8-98c9-7a5ddbd95986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d324057-f10a-4db2-950f-dd0f965374b6", "tag": "d96a4381-c7c6-4f7e-bd0c-596e54fe5a76"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:15:54.289987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-983f6b64-d1e3-4563-8260-57ba1c1480eb req-741c6765-c632-43f8-98c9-7a5ddbd95986 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:54.293063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-983f6b64-d1e3-4563-8260-57ba1c1480eb req-741c6765-c632-43f8-98c9-7a5ddbd95986 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:54.293663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-983f6b64-d1e3-4563-8260-57ba1c1480eb req-741c6765-c632-43f8-98c9-7a5ddbd95986 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:54.317550 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-983f6b64-d1e3-4563-8260-57ba1c1480eb req-741c6765-c632-43f8-98c9-7a5ddbd95986 service nova] Creating event network-changed:d96a4381-c7c6-4f7e-bd0c-596e54fe5a76 for instance 9d324057-f10a-4db2-950f-dd0f965374b6 on n-h2-master-1 Oct 24 09:15:54.328586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-983f6b64-d1e3-4563-8260-57ba1c1480eb req-741c6765-c632-43f8-98c9-7a5ddbd95986 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058572 Oct 24 09:15:54.335942 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2486/5171] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:54.785066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:54.786714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:54.801011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:54.801831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:54.803300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:54.804310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:54.804997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:54.805644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:54.907182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:54.909770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:54.936466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:54.937003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:54.937491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:54.941995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:54.942426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:54.942871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:55.057157 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a607149-e3f1-4bfc-badd-c1d30c2243ad tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155062 Oct 24 09:15:55.057787 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2487/5172] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:54 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:55.104681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:55.105753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:55.127149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:55.129996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:55.132002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:55.134212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:55.135183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:55.136965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:55.194120 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:55.347516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:55.361988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:55.370648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:55.373151 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29dd967b-7a53-40db-8817-341d23fa8856 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1285 microversion: 2.20 time: 0.274813 Oct 24 09:15:55.374118 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2488/5173] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:55 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1285 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:55.385842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:55.387802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:55.399599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:55.400508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:55.401168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:55.402142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:55.402822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:55.403487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:55.540251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:55.553363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:55.554941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:55.556799 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9211ec8-8de5-415f-8419-ba16bc7f5953 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1384 microversion: 2.47 time: 0.181415 Oct 24 09:15:55.562286 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2489/5174] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:55 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1384 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:56.054374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.072337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:56.075221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:56.083101 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43dd19a7-d4de-44ef-85c5-2f2e0337e07e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1325 microversion: 2.1 time: 1.300615 Oct 24 09:15:56.083917 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2686/5175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:54 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1325 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:56.087040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:56.087870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:56.088468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:56.089641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:56.090290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:56.090894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:56.130433 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb37e833-ae6b-4964-a301-537d3da68985 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063314 Oct 24 09:15:56.132936 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2490/5176] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:56 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:15:56.402394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:56.403364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:56.411477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:56.412884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:56.413701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:56.414719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:56.415422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:56.416088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:56.562892 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.575868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.577472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.578644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4724f4bf-a26a-4bef-b4e2-8d245eaa1769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1333 microversion: 2.20 time: 0.180166 Oct 24 09:15:56.595677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:56.596864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:56.603656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2687/5177] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:56 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1333 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:56.607796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:56.608284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:56.613748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:56.617249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:56.617815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:56.618302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:56.913309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.936460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.942167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:56.957847 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cb2e9a6-076b-4b54-bda2-94f550ce79ac tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1372 microversion: 2.47 time: 0.358294 Oct 24 09:15:56.959265 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2491/5178] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:56 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:57.110683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:57.111358 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:57.124934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:57.126005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:57.126439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:57.127165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:57.127628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:57.128054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:57.615791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:57.627030 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1caa1753-b616-4f38-a210-72a081584002 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1325 microversion: 2.1 time: 0.520625 Oct 24 09:15:57.627501 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2688/5179] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:57 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1325 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:57.647074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:57.647706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:57.658840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:57.662922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:57.668847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:57.670532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:57.672061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:57.675903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:57.725077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:57.728899 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:57.761965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:57.769267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:57.769834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:57.771161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:57.772735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:57.775675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:57.883687 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2370b43-1a05-4583-9c11-5d5bdccba10a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.743250 Oct 24 09:15:57.884591 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2492/5180] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:57 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 197 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:15:57.905264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:57.930049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:57.934564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:57.943077 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f241758d-5042-4fa8-8a87-910a7072959f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1333 microversion: 2.20 time: 0.306643 Oct 24 09:15:57.960199 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2689/5181] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:57 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1333 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:57.985674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:57.986288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:58.009891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:58.010313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:58.011047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:58.011942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:58.012726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:58.013366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:58.270676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:58.293790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:58.298898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:58.303078 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55a65de1-bc69-4293-851f-2621780474ee tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1372 microversion: 2.47 time: 0.320445 Oct 24 09:15:58.305068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2493/5182] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:57 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:58.655168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:58.655736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:58.667252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:58.681185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:58.682849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:58.686778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:58.688990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:58.689587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:58.905744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:58.909715 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:58.933193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:58.933870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:58.934438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:58.935886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:58.936618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:58.937400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:58.974616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:58.985228 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-093e0ad0-88d6-4a2d-93ec-b5696efbfb10 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1325 microversion: 2.1 time: 0.334214 Oct 24 09:15:58.989234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2690/5183] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:58 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:15:58.999280 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b15ba59-224d-4872-bb22-a711b5dba05a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106321 Oct 24 09:15:59.005030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2494/5184] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:15:58 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:15:59.017145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:59.019099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:59.037379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.039351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.040895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.042172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.044114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.044642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.144336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:59.144935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:59.156370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.163083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.164135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.165836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.167867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.168560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.247077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:15:59.292609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.310509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.317141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.327497 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3947e71b-f596-479a-b815-739ece2f7aa4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1339 microversion: 2.20 time: 0.327633 Oct 24 09:15:59.334753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2691/5185] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:58 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1339 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:59.352132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:59.352753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:59.377330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.378344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.379567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.382236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.383237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.384518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.432116 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e315e4e-2d6a-465f-87be-00f9824ddbe2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 204 len: 0 microversion: 2.1 time: 0.293330 Oct 24 09:15:59.436346 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2495/5186] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:15:59 2022] DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:15:59.445502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:59.446323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:15:59.461944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.465506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.466277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.467507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.469199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.488394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.652032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.665418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.669855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.690537 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76dcbb61-a8e3-4b2b-bba0-a9704ca83e34 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1357 microversion: 2.47 time: 0.337218 Oct 24 09:15:59.695381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2692/5187] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:15:59 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:15:59.724502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:15:59.735633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:15:59.739476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Searching by: {'deleted': False, 'project_id': '91a35426751247d7a80934483412ba31'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:15:59.754418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.758798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.759443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:15:59.760860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:15:59.762786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:15:59.765696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:00.098746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:16:00.264511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:00.274873 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73e062b5-5b30-41f8-bb89-376b5357e8e6 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1684 microversion: 2.1 time: 0.835731 Oct 24 09:16:00.275765 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2496/5188] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:15:59 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1684 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:00.284020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:00.284956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:00.285186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:00.294125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:00.295796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:00.296701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:00.297773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:00.299199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:00.300102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:00.304729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:00.305439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:00.306021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:00.351294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:00.353423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:00.798854 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1be91561-c8a5-4370-bd60-9753b5be16c8 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.078234 Oct 24 09:16:00.799686 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2693/5189] 10.222.0.25 () {60 vars in 1187 bytes} [Mon Oct 24 09:15:59 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:00.805435 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:00.806249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:00.828264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:00.831049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:00.832153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:00.833105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:00.833772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:00.834377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:00.970974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:00.984098 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8ca617af-c0d6-4328-b640-25f46c01713f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1325 microversion: 2.1 time: 0.706738 Oct 24 09:16:00.995478 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2497/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:00 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1325 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:01.003638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:01.008231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:01.036910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.039598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.040128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.040574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.041321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.041769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.042200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.054248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.056580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.065630 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9f8c383-8369-431b-a0a6-570fe6c79b73 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 0.264029 Oct 24 09:16:01.082456 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2694/5191] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:00 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:01.122708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:16:01.284579 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fdbce60c-9c24-4b76-ace9-79695fc35261 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 204 len: 0 microversion: 2.47 time: 0.287243 Oct 24 09:16:01.285674 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2498/5192] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:16:00 2022] DELETE /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:16:01.295083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:01.296570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:01.305267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:01.306175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:01.310497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.311014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.311464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.312188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.317772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.318315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.318997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.323721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.324451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.325379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.326003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.326753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.448430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.457975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.459507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.460762 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a63d4fd2-47ba-4496-b4d4-98a9ec7172a5 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1363 microversion: 2.47 time: 0.171343 Oct 24 09:16:01.461424 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2695/5193] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:01 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:01.466297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-519fc758-3549-4ac2-978a-cd28694368dd req-ad84a73f-efdd-4c96-b221-1bd5e1474044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d324057-f10a-4db2-950f-dd0f965374b6", "name": "network-vif-plugged", "status": "completed", "tag": "d96a4381-c7c6-4f7e-bd0c-596e54fe5a76"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:01.476353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-519fc758-3549-4ac2-978a-cd28694368dd req-ad84a73f-efdd-4c96-b221-1bd5e1474044 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:01.477112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-519fc758-3549-4ac2-978a-cd28694368dd req-ad84a73f-efdd-4c96-b221-1bd5e1474044 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:01.477774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-519fc758-3549-4ac2-978a-cd28694368dd req-ad84a73f-efdd-4c96-b221-1bd5e1474044 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:01.489906 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-519fc758-3549-4ac2-978a-cd28694368dd req-ad84a73f-efdd-4c96-b221-1bd5e1474044 service nova] Creating event network-vif-plugged:d96a4381-c7c6-4f7e-bd0c-596e54fe5a76 for instance 9d324057-f10a-4db2-950f-dd0f965374b6 on n-h2-master-1 Oct 24 09:16:01.495169 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-519fc758-3549-4ac2-978a-cd28694368dd req-ad84a73f-efdd-4c96-b221-1bd5e1474044 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 Oct 24 09:16:01.495889 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2696/5194] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:01.968123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:01.999589 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24c87940-175e-4c99-8fab-bb2330195081 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1684 microversion: 2.1 time: 0.695481 Oct 24 09:16:02.000497 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2499/5195] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:01 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1684 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:02.022507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:02.025067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:02.054355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:02.057147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:02.057801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:02.058728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:02.059856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:02.060496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:02.095424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:02.102840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:02.113701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:02.114651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:02.115257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:02.122043 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:02.122676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:02.123348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:02.124438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:02.335046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:02.346365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fdecf8f2-4da2-40d0-8ba5-3e9e0bf4e6e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1325 microversion: 2.1 time: 0.342139 Oct 24 09:16:02.349474 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2697/5196] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:02 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:02.490432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:02.491277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:02.504444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:02.504444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:02.504444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:02.504894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:02.506997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:02.508704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:02.720446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:02.738149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:02.745542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:02.756201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8db580d7-3102-49b3-9c83-2e1d266cd53d tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1363 microversion: 2.47 time: 0.269397 Oct 24 09:16:02.756814 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2698/5197] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:02 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:03.021413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.029503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:03.030815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:03.033504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.035543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.037477 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-985d833e-d71f-4ae2-8f21-7f72c9a8521b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 0.947748 Oct 24 09:16:03.038676 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2500/5198] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:02 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:03.048919 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:03.051827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.053019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.053751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.054741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.055498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.062650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.251134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-af87dd86-1177-4f0c-ac66-7b8deeebcefa req-9007065e-22b4-4b7e-bb1b-b467a37aca39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:03.251434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.262337 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bb1acd7e-9d06-4ee7-84c3-96695ff57ae5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1684 microversion: 2.1 time: 0.238246 Oct 24 09:16:03.263352 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2699/5199] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:03 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1684 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:03.278285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af87dd86-1177-4f0c-ac66-7b8deeebcefa req-9007065e-22b4-4b7e-bb1b-b467a37aca39 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.278285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af87dd86-1177-4f0c-ac66-7b8deeebcefa req-9007065e-22b4-4b7e-bb1b-b467a37aca39 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.278285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af87dd86-1177-4f0c-ac66-7b8deeebcefa req-9007065e-22b4-4b7e-bb1b-b467a37aca39 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.293618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-af87dd86-1177-4f0c-ac66-7b8deeebcefa req-9007065e-22b4-4b7e-bb1b-b467a37aca39 service nova] Creating event network-changed:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h1-master-1 Oct 24 09:16:03.300432 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-af87dd86-1177-4f0c-ac66-7b8deeebcefa req-9007065e-22b4-4b7e-bb1b-b467a37aca39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053040 Oct 24 09:16:03.307708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2501/5200] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:03.372264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:03.372875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:03.384686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.385448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.385640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.386544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.387205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.387795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.546514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.561756 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19e3a9d6-c592-4bbb-a677-6365cdc89c5d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1506 microversion: 2.1 time: 0.193360 Oct 24 09:16:03.584848 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2700/5201] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:03 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:03.590997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:03.591785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:03.600144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.600718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.601222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.602045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.602570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.603236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.644089 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:03.786545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:03.787566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:03.798112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.798915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.799545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.800494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.801682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.802299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.876254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:03.876707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:03.877150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:03.877628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lazy-loading 'fault' on Instance uuid d9db2a7c-beee-41a3-841b-e38a60c96f8e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:03.981517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.996305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.998234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:03.999464 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4ab17a63-cb96-4074-9b9b-0d2d158ffe94 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 200 len: 1368 microversion: 2.47 time: 0.219423 Oct 24 09:16:04.001743 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2701/5202] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:03 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:04.056414 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:04.067682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:04.068338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:04.078185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.078731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.079145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.082912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.084392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.085929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.106621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:04.127274 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db0b738d-0089-49d5-95e0-9350009c748b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1506 microversion: 2.1 time: 0.540647 Oct 24 09:16:04.128148 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2502/5203] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:03 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:04.159812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:04.160516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:04.179114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.179906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.180511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.181444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.182063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.182641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.226169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:16:04.393728 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35377c69-0776-4c52-9348-1797da3c736b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 204 len: 0 microversion: 2.1 time: 0.237816 Oct 24 09:16:04.394573 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2503/5204] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:16:04 2022] DELETE /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:16:04.400641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:04.401820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:04.415178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.426107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.426818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.427767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.428414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.429008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.537632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:04.551181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:04.553716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:04.557325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-36571fc6-2308-4349-96c5-8983b0c9419b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 0.494455 Oct 24 09:16:04.558554 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2702/5205] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:04 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:04.570557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:04.571560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:04.585066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.587367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.589546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.591691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:04.592770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:04.594832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:04.647465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:04.655379 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d12354a8-f615-4553-abfe-52f9787d9fb2 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1616 microversion: 2.1 time: 0.259346 Oct 24 09:16:04.663972 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2504/5206] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:04 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1616 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:04.841263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:04.851629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1481d598-dbe7-40da-af05-a114a34fc96d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1512 microversion: 2.1 time: 0.291053 Oct 24 09:16:04.852774 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2703/5207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:04 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:05.029691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:05.030855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: d9db2a7c-beee-41a3-841b-e38a60c96f8e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:05.047252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.050490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.050897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.051638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.052101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.052530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.091549 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] HTTP exception thrown: Instance d9db2a7c-beee-41a3-841b-e38a60c96f8e could not be found. Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Request method failure captured: Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e HTTP/1.1 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleh2lsiQIlYhz70vBaX8HT-i4nnzJXyOPbwTTSnscaBl62eU4BCL3oqGvnmb-gRlCANXkVXmG-OPtzw5F9eRP4boQUwo2oglOvWl9pA0uLs-9-cUJBNf5TFtZN30KUQrj0jX5XHxv0UONIvKtxV_JACvrGwmg2uV99mK6ZmNeWaMOQ Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.47 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 91a35426751247d7a80934483412ba31 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerShowV247Test-1884530203 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91a35426751247d7a80934483412ba31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91a35426751247d7a80934483412ba31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91a35426751247d7a80934483412ba31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91a35426751247d7a80934483412ba31"}]}] Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerShowV247Test-1884530203 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 91a35426751247d7a80934483412ba31 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerShowV247Test-1884530203 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerShowV247Test-1884530203-project Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8b20c6dc0656476e8635c0f2807ce469 Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerShowV247Test-1884530203-project Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: exception: Instance d9db2a7c-beee-41a3-841b-e38a60c96f8e could not be found. Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'd9db2a7c-beee-41a3-841b-e38a60c96f8e'} Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9db2a7c-beee-41a3-841b-e38a60c96f8e could not be found. Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9db2a7c-beee-41a3-841b-e38a60c96f8e could not be found. Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:05.099898 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9db2a7c-beee-41a3-841b-e38a60c96f8e could not be found. Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Returning 404 to user: Instance d9db2a7c-beee-41a3-841b-e38a60c96f8e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2712c573-0769-411b-ad95-a229d8a32eed tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e" status: 404 len: 111 microversion: 2.47 time: 0.077429 Oct 24 09:16:05.108844 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2505/5208] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:05 2022] GET /compute/v2.1/servers/d9db2a7c-beee-41a3-841b-e38a60c96f8e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:16:05.111949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:05.112459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:05.121704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.122208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.122676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.123393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.123856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.124288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.187529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:16:05.340346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ed6f2a4e-1c05-4060-aabf-384a42844ef3 req-183c52e3-4bed-454e-9d00-8b8d14b4fd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9435d5-d687-47fa-a450-b70a41159ef7", "name": "network-vif-deleted", "tag": "dd06afd7-6b45-4719-afe1-0d38536b02b0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:05.361629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e94caf0e-eaa8-4264-a18d-5ac14622cbd0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 204 len: 0 microversion: 2.47 time: 0.254884 Oct 24 09:16:05.362860 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2704/5209] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:16:05 2022] DELETE /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:16:05.368933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ed6f2a4e-1c05-4060-aabf-384a42844ef3 req-183c52e3-4bed-454e-9d00-8b8d14b4fd71 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.370574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ed6f2a4e-1c05-4060-aabf-384a42844ef3 req-183c52e3-4bed-454e-9d00-8b8d14b4fd71 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.371021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ed6f2a4e-1c05-4060-aabf-384a42844ef3 req-183c52e3-4bed-454e-9d00-8b8d14b4fd71 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.374740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:05.380106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:05.391987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.392901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.394156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.397875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.398657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.399336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.416034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ed6f2a4e-1c05-4060-aabf-384a42844ef3 req-183c52e3-4bed-454e-9d00-8b8d14b4fd71 service nova] Creating event network-vif-deleted:dd06afd7-6b45-4719-afe1-0d38536b02b0 for instance 9c9435d5-d687-47fa-a450-b70a41159ef7 on n-h2-master-1 Oct 24 09:16:05.427522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ed6f2a4e-1c05-4060-aabf-384a42844ef3 req-183c52e3-4bed-454e-9d00-8b8d14b4fd71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090594 Oct 24 09:16:05.430150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2506/5210] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:05.555297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:05.567183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:05.568866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:05.570281 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7ffb692-3b3e-4089-aa50-c130bc3e43dc tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 200 len: 1362 microversion: 2.47 time: 0.203111 Oct 24 09:16:05.571356 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2705/5211] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:05 2022] GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:05.598153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:05.599105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:05.609346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.613227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.613975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.615353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.617725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.618364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.684490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:05.685147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:05.698043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.704352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.707967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.710339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.716487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.718183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.852569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:05.853334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:05.853987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:05.854620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lazy-loading 'fault' on Instance uuid 9c9435d5-d687-47fa-a450-b70a41159ef7 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:05.963237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:05.977495 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1944c7d-9942-47b5-ad30-35cb117ad3a1 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 200 len: 1332 microversion: 2.1 time: 0.296052 Oct 24 09:16:05.978982 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2706/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:05 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 1332 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:05.992509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:05.994366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:06.013595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:06.014098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:06.014536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:06.027938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:06.029043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:06.029527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:06.308831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:06.335374 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8de125a-faf6-4210-afe7-691de3f3f934 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1512 microversion: 2.1 time: 0.354968 Oct 24 09:16:06.336175 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2707/5213] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:05 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:06.603636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:06.606093 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:06.610510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:06.620619 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:06.626407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:06.629603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:06.631357 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e6b7914-98a1-42cd-9528-8c7e16242128 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 1.037964 Oct 24 09:16:06.639985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:06.640619 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2507/5214] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:05 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:06.645796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:06.652616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:06.657092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:06.662209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.007876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:07.008506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:07.027137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:07.027450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:07.028289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.031462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:07.033703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:07.034191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:07.035926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.040567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:07.043388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:07.048046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e25ad819-06ac-4d84-8a01-467f7e0ab256 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 200 len: 1362 microversion: 2.47 time: 0.452436 Oct 24 09:16:07.050747 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2708/5215] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:06 2022] GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:07.064307 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 HTTP/1.1 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9c9435d5-d687-47fa-a450-b70a41159ef7'} Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:07.070215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:07.076608 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6315d365-ca7a-4f30-ae8d-dbddf8493214 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 404 len: 111 microversion: 2.1 time: 0.068084 Oct 24 09:16:07.078517 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2508/5216] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:07 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:16:07.090099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec8b6d5b-a9b6-4c4c-ada4-b61441718c4c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '.version_select at 0x7f8da9d8c430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:07.181902 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec8b6d5b-a9b6-4c4c-ada4-b61441718c4c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595233653" status: 202 len: 0 microversion: 2.1 time: 0.104237 Oct 24 09:16:07.182866 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2709/5217] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:16:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595233653 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:16:07.363224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:07.363846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:07.380678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:07.382014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:07.386661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.387985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:07.388691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:07.389378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.664295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:07.664919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:07.677034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:07.677570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:07.678015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.678741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:07.679203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:07.679637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:07.840004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:07.849585 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6fa91d4-290d-42a4-930b-8759276d942a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1512 microversion: 2.1 time: 0.490415 Oct 24 09:16:07.850174 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2509/5218] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:07 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:08.079797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:08.080654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:08.091087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:08.094935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:08.095988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:08.100905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:08.101627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:08.102264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:08.122827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:08.133244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:08.138203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:08.147101 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1720788-5eb4-4f87-834f-770fc0f5ab57 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 0.481504 Oct 24 09:16:08.165430 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2710/5219] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:07 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:08.406132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:08.444017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:08.449681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:08.468640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9eb99be9-5d9c-44eb-9eea-5f045acb17d2 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 200 len: 1362 microversion: 2.47 time: 0.387831 Oct 24 09:16:08.493809 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2510/5220] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:08 2022] GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:08.689942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf7bd8f4-af19-471e-859d-aa7d77e91170 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: .version_select at 0x7f8da9d885e0>, body: {"keypair": {"name": "tempest-keypair-1527247174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyn3r8u4FKtNFvcXv20V2uqXEHWZs5qiDfbXlb84PU7Up7r2iuXOAA9o/YRmF3HcxcaatyfKpfw0t8R9yS1FpN0ccTRaJCCbXgmcGTKD+iCprmpgxclBXMA/264Voig6Q=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:08.762458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e0c9221a-5351-4eb7-9799-e3ca835a1214 req-7094566d-eb0c-4cf7-8e32-78d32f1609b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d324057-f10a-4db2-950f-dd0f965374b6", "name": "network-vif-deleted", "tag": "d96a4381-c7c6-4f7e-bd0c-596e54fe5a76"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:08.768420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cf7bd8f4-af19-471e-859d-aa7d77e91170 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:16:08.792630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e0c9221a-5351-4eb7-9799-e3ca835a1214 req-7094566d-eb0c-4cf7-8e32-78d32f1609b8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:08.793121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e0c9221a-5351-4eb7-9799-e3ca835a1214 req-7094566d-eb0c-4cf7-8e32-78d32f1609b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:08.793586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e0c9221a-5351-4eb7-9799-e3ca835a1214 req-7094566d-eb0c-4cf7-8e32-78d32f1609b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:08.794148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cf7bd8f4-af19-471e-859d-aa7d77e91170 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:16:08.845723 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e0c9221a-5351-4eb7-9799-e3ca835a1214 req-7094566d-eb0c-4cf7-8e32-78d32f1609b8 service nova] Creating event network-vif-deleted:d96a4381-c7c6-4f7e-bd0c-596e54fe5a76 for instance 9d324057-f10a-4db2-950f-dd0f965374b6 on n-h2-master-1 Oct 24 09:16:08.859587 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e0c9221a-5351-4eb7-9799-e3ca835a1214 req-7094566d-eb0c-4cf7-8e32-78d32f1609b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100531 Oct 24 09:16:08.863247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2511/5221] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:08.886420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:08.887149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:08.889730 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf7bd8f4-af19-471e-859d-aa7d77e91170 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207407 Oct 24 09:16:08.893318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2711/5222] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:16:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:08.916122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:08.916852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:08.917522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:08.921813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:08.922583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:08.924139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.054580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:09.059210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:09.060712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.062144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lazy-loading 'fault' on Instance uuid 9d324057-f10a-4db2-950f-dd0f965374b6 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:09.178368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:09.178997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:09.193421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:09.196965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:09.199636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.200484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:09.200973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:09.206170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.435020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:09.451869 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db10ed64-1704-4b35-adde-888978f2ee3e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 200 len: 1315 microversion: 2.1 time: 0.577635 Oct 24 09:16:09.493487 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2512/5223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:08 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:09.504809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:09.506121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:09.530062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:09.530694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:09.531316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.532428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:09.533260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:09.534010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.675364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:09.678594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:09.679169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:09.679638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lazy-loading 'fault' on Instance uuid 4772367c-be00-41c1-ad92-49c6ed022325 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:09.903620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:09.918530 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:09.924266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:09.929079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b20c6dc0656476e8635c0f2807ce469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a35426751247d7a80934483412ba31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:09.938962 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3d1cddc-4539-46b2-af2d-8a7a8ded32a0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 200 len: 1367 microversion: 2.47 time: 0.434198 Oct 24 09:16:09.945273 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2513/5224] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:09 2022] GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:10.192118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:10.204706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:10.208105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:10.211498 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b19f1c7-0dc4-4597-af23-9ca14b377e06 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 1.037394 Oct 24 09:16:10.215667 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2712/5225] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:09 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:10.487966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:10.488598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:10.536331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:10.536821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:10.545080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:10.545910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:10.546398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:10.546839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:10.614796 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:16:10.616452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-dd624f2e-ee19-4ea1-8493-73d179dbcbfd req-34373a73-7a3b-4932-8c78-395e220d787b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "name": "network-vif-plugged", "status": "completed", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 HTTP/1.1 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '9d324057-f10a-4db2-950f-dd0f965374b6'} Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:10.626546 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a94f4da0-af75-4bc6-af28-254ee51ee493 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 404 len: 111 microversion: 2.1 time: 0.147433 Oct 24 09:16:10.632837 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2514/5226] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:10 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:16:10.636834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a90afb2a-6964-473c-b224-4496cc5704e6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '.version_select at 0x7f8da9a4f4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:10.639033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd624f2e-ee19-4ea1-8493-73d179dbcbfd req-34373a73-7a3b-4932-8c78-395e220d787b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:10.641866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd624f2e-ee19-4ea1-8493-73d179dbcbfd req-34373a73-7a3b-4932-8c78-395e220d787b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:10.651774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd624f2e-ee19-4ea1-8493-73d179dbcbfd req-34373a73-7a3b-4932-8c78-395e220d787b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:10.664469 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-dd624f2e-ee19-4ea1-8493-73d179dbcbfd req-34373a73-7a3b-4932-8c78-395e220d787b service nova] Creating event network-vif-plugged:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h1-master-1 Oct 24 09:16:10.680630 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-dd624f2e-ee19-4ea1-8493-73d179dbcbfd req-34373a73-7a3b-4932-8c78-395e220d787b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068322 Oct 24 09:16:10.681881 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a90afb2a-6964-473c-b224-4496cc5704e6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-799306643" status: 202 len: 0 microversion: 2.1 time: 0.048278 Oct 24 09:16:10.682460 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2515/5227] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-799306643 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:16:10.682882 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2713/5228] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:16:10.904446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1957506348", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:10.976755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:10.978522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] [instance: 4772367c-be00-41c1-ad92-49c6ed022325] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:10.988853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:16:10.990527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:10.991025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:10.991476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:10.992190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:10.992634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:10.993063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:11.023831 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] HTTP exception thrown: Instance 4772367c-be00-41c1-ad92-49c6ed022325 could not be found. Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Request method failure captured: Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 HTTP/1.1 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleh2lsiQIlYhz70vBaX8HT-i4nnzJXyOPbwTTSnscaBl62eU4BCL3oqGvnmb-gRlCANXkVXmG-OPtzw5F9eRP4boQUwo2oglOvWl9pA0uLs-9-cUJBNf5TFtZN30KUQrj0jX5XHxv0UONIvKtxV_JACvrGwmg2uV99mK6ZmNeWaMOQ Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.47 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 91a35426751247d7a80934483412ba31 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerShowV247Test-1884530203 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91a35426751247d7a80934483412ba31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91a35426751247d7a80934483412ba31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91a35426751247d7a80934483412ba31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91a35426751247d7a80934483412ba31"}]}] Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerShowV247Test-1884530203 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 91a35426751247d7a80934483412ba31 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerShowV247Test-1884530203 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerShowV247Test-1884530203-project Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8b20c6dc0656476e8635c0f2807ce469 Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerShowV247Test-1884530203-project Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4772367c-be00-41c1-ad92-49c6ed022325 could not be found. Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4772367c-be00-41c1-ad92-49c6ed022325'} Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4772367c-be00-41c1-ad92-49c6ed022325 could not be found. Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4772367c-be00-41c1-ad92-49c6ed022325 could not be found. Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:11.036067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4772367c-be00-41c1-ad92-49c6ed022325 could not be found. Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] Returning 404 to user: Instance 4772367c-be00-41c1-ad92-49c6ed022325 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0bc20252-b853-4b26-a4d4-95e716b32bf0 tempest-ServerShowV247Test-1884530203 tempest-ServerShowV247Test-1884530203-project] 10.222.0.25 "GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325" status: 404 len: 111 microversion: 2.47 time: 0.066395 Oct 24 09:16:11.041592 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2714/5229] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:10 2022] GET /compute/v2.1/servers/4772367c-be00-41c1-ad92-49c6ed022325 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:16:11.242419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:11.243240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:11.252694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:11.254588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:11.258021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:11.258806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:11.260782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:11.261245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:11.266387 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:11.671014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:11.690048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:11.708863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:11.713958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03572187-fa2d-4454-a189-819a688aaa04 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1407 microversion: 2.20 time: 0.472646 Oct 24 09:16:11.717703 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2715/5230] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:11 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:16:12.408736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1889657411", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcfcdb25-90f0-4d8a-8f56-0850a24cf320"}], "security_groups": [{"name": "tempest-securitygroup--1769390020"}], "key_name": "tempest-keypair-1527247174", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:12.589214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] validate_networks() for [('bcfcdb25-90f0-4d8a-8f56-0850a24cf320', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:16:13.079267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:16:13.080773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:16:13.081505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:16:13.082245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:16:13.082956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:16:13.088928 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:13.110513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:13.111811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:13.112539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:13.114357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:13.117635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:13.119388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:13.184533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:16:13.191227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:16:13.208275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:16:13.210908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:16:13.275453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13fd85dc-e84f-48b6-8b50-5a6a679874fd tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374367 Oct 24 09:16:13.288280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:16:13.288975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:16:13.289683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:16:13.290403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:16:13.290996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:16:13.297790 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2516/5231] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:16:13.306491 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=25 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:13.311812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:13.312414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:13.313756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:13.315207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:13.316006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:13.318146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:13.320820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:13.322485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:13.337058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:13.360676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:13.362096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:13.365234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:13.367280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:13.370824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:13.428062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:16:13.449040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Getting quotas for user a170d67efe094c4e8b9267e33e4e476d and project e4098b77de8d4b07853cf61416c0b870. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:16:13.496508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:16:13.505374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:16:13.628460 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ad25fcd-0955-40f1-b33f-481d455e90e8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.225103 Oct 24 09:16:13.633364 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2716/5232] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:16:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:16:13.645422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6756327f-a714-4ea2-96be-529de44d4b91 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:13.647414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6756327f-a714-4ea2-96be-529de44d4b91 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:13.922245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:13.956352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:13.957181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:13.962470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c612a79-a459-4f57-95f6-f09e894d97dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1599 microversion: 2.20 time: 0.663067 Oct 24 09:16:13.963082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2517/5233] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:13 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1599 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:13.984658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8745841-9ecb-4ab8-a7f6-6ff4927c3fa3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:13.985553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8745841-9ecb-4ab8-a7f6-6ff4927c3fa3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:14.096553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6756327f-a714-4ea2-96be-529de44d4b91 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:14.114596 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6756327f-a714-4ea2-96be-529de44d4b91 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1209 microversion: 2.1 time: 0.470604 Oct 24 09:16:14.128056 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2717/5234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:13 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1209 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:14.128056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:14.128056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:14.128480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c8745841-9ecb-4ab8-a7f6-6ff4927c3fa3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:14.141986 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8745841-9ecb-4ab8-a7f6-6ff4927c3fa3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1242 microversion: 2.1 time: 0.174850 Oct 24 09:16:14.156853 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2518/5235] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:13 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:14.159798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:14.160307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:14.160756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:14.169729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:14.170225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:14.170687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:14.488794 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3fd2e6b-14a7-45f8-8845-db40f214306d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.371781 Oct 24 09:16:14.516604 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2718/5236] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 09:16:14 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-interface => generated 284 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:16:15.145792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:15.146400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:15.168164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:15.168650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:15.182866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:15.183078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:15.185801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:15.186252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:15.187002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:15.187155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:15.187980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:15.188132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:15.191197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:15.191714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:15.192833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:15.194423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:15.406549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:15.426974 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f5ceb00-52b7-43ba-9d29-22b181550104 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1205 microversion: 2.1 time: 0.281418 Oct 24 09:16:15.440562 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2519/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:15 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1205 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:15.516020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:15.539012 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00279164-b6eb-46c2-afb5-b65598f9ac86 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1294 microversion: 2.1 time: 0.374243 Oct 24 09:16:15.546049 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2719/5238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:15 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1294 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:16.419030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:16.419548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:16.433335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:16.433831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:16.434262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:16.442386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:16.442905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:16.443343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:16.467005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:16.470540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:16.489171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:16.493773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:16.494653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:16.495843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:16.496426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:16.497054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:16.629994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lazy-loading 'services' on Instance uuid 1484921f-2743-4293-8612-41bed0f98326 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:16.702806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:16.727908 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf4629b2-a76f-4d9f-bed8-0c5bd8df1ca6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1261 microversion: 2.1 time: 0.272402 Oct 24 09:16:16.730895 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2720/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:16 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:16.744906 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:16.764194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:16.793105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:16.796493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:16.802969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:16.807707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:16.809700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:16.815838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:16.859012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-50e0f4bc-cffc-4305-9792-bc8b32b668f2 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-volume_attachments/a3e60552-dc22-4acf-9c11-1591b533c20e" status: 202 len: 0 microversion: 2.1 time: 0.444148 Oct 24 09:16:16.864441 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2520/5240] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:16:16 2022] DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-volume_attachments/a3e60552-dc22-4acf-9c11-1591b533c20e => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:16:17.405212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:17.417271 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-45c3d349-907c-4d10-9c07-b9be30d0eb9d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1300 microversion: 2.1 time: 0.685030 Oct 24 09:16:17.417907 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2721/5241] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:16 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1300 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:17.764066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:17.766189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:17.788535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:17.789640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:17.790101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:17.792463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:17.793071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-096bdb1c-0d7c-4973-8324-4691c8faa5c8 tempest-ExtensionsTest-788167661 tempest-ExtensionsTest-788167661-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:17.794719 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-096bdb1c-0d7c-4973-8324-4691c8faa5c8 tempest-ExtensionsTest-788167661 tempest-ExtensionsTest-788167661-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.230860 Oct 24 09:16:17.795467 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2521/5242] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Oct 24 09:16:17 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:17.796937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:17.797603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:17.804343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a169497b-93d5-411f-88d4-eae0f047879b tempest-ExtensionsTest-788167661 tempest-ExtensionsTest-788167661-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:17.819901 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a169497b-93d5-411f-88d4-eae0f047879b tempest-ExtensionsTest-788167661 tempest-ExtensionsTest-788167661-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.018906 Oct 24 09:16:17.820799 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2522/5243] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:16:17 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:16:18.274538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:18.286146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6aead7cd-9d24-47d9-b1f7-1fb04299a654 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1267 microversion: 2.1 time: 0.535159 Oct 24 09:16:18.293012 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2722/5244] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:17 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1267 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:18.440341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:18.441323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:18.451742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:18.452240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:18.452697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:18.453975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:18.454444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:18.454877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:19.315848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:19.317381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:19.330869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:19.331733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:19.332555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:19.334295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:19.335429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:19.336603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:19.772372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:19.780479 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2ab1360d-6092-44ea-b198-8a2a4724cba0 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 1.344176 Oct 24 09:16:19.781109 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2523/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:18 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:19.794585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-31d0476b-ae06-40e2-8f94-25d5e76ffa1a req-b677c090-196e-454b-aba4-b1bf382c5e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:19.847608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-31d0476b-ae06-40e2-8f94-25d5e76ffa1a req-b677c090-196e-454b-aba4-b1bf382c5e83 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:19.848555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-31d0476b-ae06-40e2-8f94-25d5e76ffa1a req-b677c090-196e-454b-aba4-b1bf382c5e83 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:19.850017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-31d0476b-ae06-40e2-8f94-25d5e76ffa1a req-b677c090-196e-454b-aba4-b1bf382c5e83 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:19.866877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:19.876669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da3e81e6-acb9-48e2-8bd3-0717b8dc9e1c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.567084 Oct 24 09:16:19.877269 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2723/5246] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:19 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:19.882315 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:19.889109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-31d0476b-ae06-40e2-8f94-25d5e76ffa1a req-b677c090-196e-454b-aba4-b1bf382c5e83 service nova] Creating event network-changed:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h1-master-1 Oct 24 09:16:19.909109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-31d0476b-ae06-40e2-8f94-25d5e76ffa1a req-b677c090-196e-454b-aba4-b1bf382c5e83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115263 Oct 24 09:16:19.912705 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2524/5247] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:20.807540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:20.808152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:20.821830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:20.833675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:20.836907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:20.837929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:20.838579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:20.842579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:20.906371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:20.907175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:20.933155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:20.933617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:20.943074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:20.943839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:20.948639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:20.949131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:21.523815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:21.533923 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44932dc4-23bb-4162-837b-e9b45414af5a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.633457 Oct 24 09:16:21.538264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2525/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:20 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:21.762921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-800fe177-96bd-4a25-8d60-95afcfb8dc21 req-72ce408d-63a0-4304-850e-7737ffc006d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6a3115-d9cf-4c81-8939-f85460b33d46", "tag": "f6685c4a-5fdc-4435-b950-03f6aa536f1c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:21.787920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-800fe177-96bd-4a25-8d60-95afcfb8dc21 req-72ce408d-63a0-4304-850e-7737ffc006d9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:21.788689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-800fe177-96bd-4a25-8d60-95afcfb8dc21 req-72ce408d-63a0-4304-850e-7737ffc006d9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:21.789845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-800fe177-96bd-4a25-8d60-95afcfb8dc21 req-72ce408d-63a0-4304-850e-7737ffc006d9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:21.818242 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-800fe177-96bd-4a25-8d60-95afcfb8dc21 req-72ce408d-63a0-4304-850e-7737ffc006d9 service nova] Creating event network-changed:f6685c4a-5fdc-4435-b950-03f6aa536f1c for instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 on n-h2-master-1 Oct 24 09:16:21.829711 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-800fe177-96bd-4a25-8d60-95afcfb8dc21 req-72ce408d-63a0-4304-850e-7737ffc006d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070331 Oct 24 09:16:21.832688 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2526/5249] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:16:22.262702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:22.276951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-17d71c65-6e90-4fd8-9a84-dfa1be18cacb tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 1.472928 Oct 24 09:16:22.279946 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2724/5250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:20 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:22.568175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:22.568882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:22.580735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:22.581213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:22.581669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:22.582369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:22.587158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:22.587898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:22.997198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:23.025939 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad81fea4-f73e-4af0-8544-fb7485d6fc53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.462885 Oct 24 09:16:23.030164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2527/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:22 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:23.058083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f82ee212-9b79-4578-bafd-a2db0f4d1093 req-1fcb31c4-3d4e-49a8-a3cf-897b58e98a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a2ed7b-d75a-4cd6-a320-88267be827d7", "tag": "6bf46737-44cb-4a46-879e-60dc67b179a9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:23.101263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f82ee212-9b79-4578-bafd-a2db0f4d1093 req-1fcb31c4-3d4e-49a8-a3cf-897b58e98a74 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:23.102085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f82ee212-9b79-4578-bafd-a2db0f4d1093 req-1fcb31c4-3d4e-49a8-a3cf-897b58e98a74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:23.103812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f82ee212-9b79-4578-bafd-a2db0f4d1093 req-1fcb31c4-3d4e-49a8-a3cf-897b58e98a74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:23.137847 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f82ee212-9b79-4578-bafd-a2db0f4d1093 req-1fcb31c4-3d4e-49a8-a3cf-897b58e98a74 service nova] Creating event network-changed:6bf46737-44cb-4a46-879e-60dc67b179a9 for instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 on n-h2-master-1 Oct 24 09:16:23.146051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f82ee212-9b79-4578-bafd-a2db0f4d1093 req-1fcb31c4-3d4e-49a8-a3cf-897b58e98a74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091281 Oct 24 09:16:23.148220 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2725/5252] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:23.302713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:23.303831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:23.310543 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:23.312863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:23.313680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:23.314351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:23.315310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:23.315994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:23.316663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:23.846584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:23.860035 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f8097006-4b3a-4d34-9b53-86ab12787b11 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 0.560128 Oct 24 09:16:23.860644 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2528/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:23 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:24.064225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:24.067405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:24.080931 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:24.088639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:24.090409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:24.094320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:24.098232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:24.098930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:24.099453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:24.106174 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:24.639823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:24.652695 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b36be62e-2a95-48c2-8536-2073213f369f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.602515 Oct 24 09:16:24.670340 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2726/5254] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:24 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:24.821337 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:24.886062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:24.886688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:24.897431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:24.897931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:24.898374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:24.899081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:24.906598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:24.907065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:25.330478 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8eaa464e-6bd7-4309-9f22-64ea0caaf6fc tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Action: 'create', calling method: .version_select at 0x7f8da9a05c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-858641210", "metadata": {"Type": "work"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8eaa464e-6bd7-4309-9f22-64ea0caaf6fc tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Request method failure captured: Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 121 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfoA8TUXXqmNNDNaivRZ8PuX69tPU3sn-rGlJjqos4Nep2ukzn6Roh2GxpIfXEugm_FM1OxaxsL4f-3iJtbAURiGqzYmYIXJrld_WWnTciPzulwADZVtqYUiR-IdklYONbJkOZAGlJmZXkaaOsABmcWnEm4GFgiDdi2IPT_durIbp8 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5a5ed8f05734a0abc4272c34dd291b6"}]}] Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 30e8e31bef1a435c97f69cce0c6d3893 Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-858641210", "metadata": {"Type": "work"}}} Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-858641210', 'metadata': {'Type': 'work'}}}} Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '#$%' Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:16:25.335489 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 09:16:25.341987 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.347900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8eaa464e-6bd7-4309-9f22-64ea0caaf6fc tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:25.349969 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8eaa464e-6bd7-4309-9f22-64ea0caaf6fc tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.534027 Oct 24 09:16:25.351191 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2529/5255] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:16:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 537 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:16:25.367460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbf630ae-2d5e-4738-b4c4-570405e28c66 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Action: 'create', calling method: .version_select at 0x7f8da9d42dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-736801477", "metadata": {"Type": "work"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbf630ae-2d5e-4738-b4c4-570405e28c66 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Request method failure captured: Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 119 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfoA8TUXXqmNNDNaivRZ8PuX69tPU3sn-rGlJjqos4Nep2ukzn6Roh2GxpIfXEugm_FM1OxaxsL4f-3iJtbAURiGqzYmYIXJrld_WWnTciPzulwADZVtqYUiR-IdklYONbJkOZAGlJmZXkaaOsABmcWnEm4GFgiDdi2IPT_durIbp8 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5a5ed8f05734a0abc4272c34dd291b6"}]}] Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 30e8e31bef1a435c97f69cce0c6d3893 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-736801477", "metadata": {"Type": "work"}}} Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-736801477', 'metadata': {'Type': 'work'}}}} Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '0' Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:16:25.382440 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbf630ae-2d5e-4738-b4c4-570405e28c66 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bbf630ae-2d5e-4738-b4c4-570405e28c66 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027905 Oct 24 09:16:25.388097 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2530/5256] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:16:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:16:25.407996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54573c80-d1de-4ec6-9d24-abea77040599 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Action: 'create', calling method: .version_select at 0x7f8da9a5b550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-231406294", "metadata": {"Type": "work"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54573c80-d1de-4ec6-9d24-abea77040599 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Request method failure captured: Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 118 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfoA8TUXXqmNNDNaivRZ8PuX69tPU3sn-rGlJjqos4Nep2ukzn6Roh2GxpIfXEugm_FM1OxaxsL4f-3iJtbAURiGqzYmYIXJrld_WWnTciPzulwADZVtqYUiR-IdklYONbJkOZAGlJmZXkaaOsABmcWnEm4GFgiDdi2IPT_durIbp8 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5a5ed8f05734a0abc4272c34dd291b6"}]}] Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 30e8e31bef1a435c97f69cce0c6d3893 Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-231406294", "metadata": {"Type": "work"}}} Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-231406294', 'metadata': {'Type': 'work'}}}} Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '' Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:16:25.413136 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.419622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54573c80-d1de-4ec6-9d24-abea77040599 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:25.420668 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-54573c80-d1de-4ec6-9d24-abea77040599 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025038 Oct 24 09:16:25.421888 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2531/5257] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:16:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:16:25.436188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f4fa3d7-006f-4214-b97c-67f1f9144da6 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Calling method '.version_select at 0x7f8da99b4c10>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:25.468591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:25.476973 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70c370be-a173-4215-b17d-073d185dc58b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 0.594820 Oct 24 09:16:25.483753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2727/5258] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:24 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:25.509845 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5f4fa3d7-006f-4214-b97c-67f1f9144da6 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] HTTP exception thrown: Volume tempest-invalid-1123475583 could not be found. Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f4fa3d7-006f-4214-b97c-67f1f9144da6 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Request method failure captured: Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1123475583 HTTP/1.1 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfoA8TUXXqmNNDNaivRZ8PuX69tPU3sn-rGlJjqos4Nep2ukzn6Roh2GxpIfXEugm_FM1OxaxsL4f-3iJtbAURiGqzYmYIXJrld_WWnTciPzulwADZVtqYUiR-IdklYONbJkOZAGlJmZXkaaOsABmcWnEm4GFgiDdi2IPT_durIbp8 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5a5ed8f05734a0abc4272c34dd291b6"}]}] Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 30e8e31bef1a435c97f69cce0c6d3893 Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: exception: Volume tempest-invalid-1123475583 could not be found. Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'tempest-invalid-1123475583'} Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1123475583 could not be found. (HTTP 404) (Request-ID: req-40691ede-23af-45ac-8880-f903e552575e) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:16:25.517733 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1123475583 could not be found. Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1123475583 could not be found. Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1123475583 could not be found. Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f4fa3d7-006f-4214-b97c-67f1f9144da6 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Returning 404 to user: Volume tempest-invalid-1123475583 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5f4fa3d7-006f-4214-b97c-67f1f9144da6 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1123475583" status: 404 len: 99 microversion: 2.1 time: 0.090659 Oct 24 09:16:25.523133 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2532/5259] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:16:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1123475583 => generated 99 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 09:16:25.530138 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5226786a-98eb-4469-a239-8dc3e1f4c3c8 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003913 Oct 24 09:16:25.534986 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2728/5260] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Oct 24 09:16:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 09:16:25.543519 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-21289c85-4e2f-43e5-88b8-907ccd94835f tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007541 Oct 24 09:16:25.548345 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2533/5261] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:16:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 09:16:25.559628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d91479f-2550-4e6f-ba0e-be45c36798db tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Calling method '.version_select at 0x7f8da9c32820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:25.607815 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9d91479f-2550-4e6f-ba0e-be45c36798db tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] HTTP exception thrown: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d91479f-2550-4e6f-ba0e-be45c36798db tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Request method failure captured: Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-volumes/31f93f98-13d3-49b5-a709-fd370fe08092 HTTP/1.1 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlfoA8TUXXqmNNDNaivRZ8PuX69tPU3sn-rGlJjqos4Nep2ukzn6Roh2GxpIfXEugm_FM1OxaxsL4f-3iJtbAURiGqzYmYIXJrld_WWnTciPzulwADZVtqYUiR-IdklYONbJkOZAGlJmZXkaaOsABmcWnEm4GFgiDdi2IPT_durIbp8 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5a5ed8f05734a0abc4272c34dd291b6"}]}] Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 30e8e31bef1a435c97f69cce0c6d3893 Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: exception: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '31f93f98-13d3-49b5-a709-fd370fe08092'} Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. (HTTP 404) (Request-ID: req-302c5604-228f-4baa-a04f-7a4c624f69ad) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:16:25.609964 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d91479f-2550-4e6f-ba0e-be45c36798db tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Returning 404 to user: Volume 31f93f98-13d3-49b5-a709-fd370fe08092 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:25.615924 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d91479f-2550-4e6f-ba0e-be45c36798db tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/31f93f98-13d3-49b5-a709-fd370fe08092" status: 404 len: 109 microversion: 2.1 time: 0.055881 Oct 24 09:16:25.625917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e63d334-6cc0-4338-9712-2c7e68497746 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Calling method '.version_select at 0x7f8da9a42700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:25.626088 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2729/5262] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:16:25 2022] DELETE /compute/v2.1/os-volumes/31f93f98-13d3-49b5-a709-fd370fe08092 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:16:25.674238 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1e63d334-6cc0-4338-9712-2c7e68497746 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] HTTP exception thrown: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. Oct 24 09:16:25.682655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:25.683278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e63d334-6cc0-4338-9712-2c7e68497746 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Request method failure captured: Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-volumes/dd1a39f4-493b-432f-a16a-3ec6bcb2d793 HTTP/1.1 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfoA8TUXXqmNNDNaivRZ8PuX69tPU3sn-rGlJjqos4Nep2ukzn6Roh2GxpIfXEugm_FM1OxaxsL4f-3iJtbAURiGqzYmYIXJrld_WWnTciPzulwADZVtqYUiR-IdklYONbJkOZAGlJmZXkaaOsABmcWnEm4GFgiDdi2IPT_durIbp8 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5a5ed8f05734a0abc4272c34dd291b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5a5ed8f05734a0abc4272c34dd291b6"}]}] Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d5a5ed8f05734a0abc4272c34dd291b6 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-1805430294 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 30e8e31bef1a435c97f69cce0c6d3893 Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-1805430294-project Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: exception: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'dd1a39f4-493b-432f-a16a-3ec6bcb2d793'} Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. (HTTP 404) (Request-ID: req-114ed13d-548f-40b2-afd4-bf4edde6d73d) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:16:25.686089 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e63d334-6cc0-4338-9712-2c7e68497746 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] Returning 404 to user: Volume dd1a39f4-493b-432f-a16a-3ec6bcb2d793 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:25.692544 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e63d334-6cc0-4338-9712-2c7e68497746 tempest-VolumesNegativeTest-1805430294 tempest-VolumesNegativeTest-1805430294-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/dd1a39f4-493b-432f-a16a-3ec6bcb2d793" status: 404 len: 109 microversion: 2.1 time: 0.070962 Oct 24 09:16:25.699259 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2534/5263] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:16:25 2022] GET /compute/v2.1/os-volumes/dd1a39f4-493b-432f-a16a-3ec6bcb2d793 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:16:25.722524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:25.723067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:25.723517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:25.724314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:25.724777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:25.725214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:26.030002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:26.040558 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bdde5891-3c31-43a6-bb92-472394225484 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.362350 Oct 24 09:16:26.042478 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2730/5264] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:25 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:26.516606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:26.518043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:26.527694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:26.544069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:26.544789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:26.545804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:26.548132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:26.550138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:27.069779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:27.071222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:27.076674 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:27.084252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:27.085174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:27.086973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:27.089678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:27.091307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:27.092092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:27.396566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:27.408203 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a86e8e11-f541-42ea-9e04-d1acd44675f4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.342547 Oct 24 09:16:27.409478 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2731/5265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:27 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:27.462465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:27.471240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b1844d5-3a9f-491a-b2ba-442846ace065 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 0.964535 Oct 24 09:16:27.482434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2535/5266] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:26 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:27.843683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a84d3d3d-0744-49de-970b-672b030c3bc9 req-9df02bd4-35b2-40d3-9c8b-566a88d018ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6a3115-d9cf-4c81-8939-f85460b33d46", "name": "network-vif-plugged", "status": "completed", "tag": "f6685c4a-5fdc-4435-b950-03f6aa536f1c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:27.860210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a84d3d3d-0744-49de-970b-672b030c3bc9 req-9df02bd4-35b2-40d3-9c8b-566a88d018ea service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:27.860716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a84d3d3d-0744-49de-970b-672b030c3bc9 req-9df02bd4-35b2-40d3-9c8b-566a88d018ea service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:27.861163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a84d3d3d-0744-49de-970b-672b030c3bc9 req-9df02bd4-35b2-40d3-9c8b-566a88d018ea service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:27.878781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a84d3d3d-0744-49de-970b-672b030c3bc9 req-9df02bd4-35b2-40d3-9c8b-566a88d018ea service nova] Creating event network-vif-plugged:f6685c4a-5fdc-4435-b950-03f6aa536f1c for instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 on n-h2-master-1 Oct 24 09:16:27.885574 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a84d3d3d-0744-49de-970b-672b030c3bc9 req-9df02bd4-35b2-40d3-9c8b-566a88d018ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046123 Oct 24 09:16:27.886380 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2732/5267] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:27.951334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d0736cb-cb1d-4ab4-a07b-9e815193ee3a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:27.964398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0736cb-cb1d-4ab4-a07b-9e815193ee3a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:27.974691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0736cb-cb1d-4ab4-a07b-9e815193ee3a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:27.975507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d0736cb-cb1d-4ab4-a07b-9e815193ee3a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.054423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d0736cb-cb1d-4ab4-a07b-9e815193ee3a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Going to try to stop instance {{(pid=126919) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:16:28.186867 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d0736cb-cb1d-4ab4-a07b-9e815193ee3a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action" status: 202 len: 0 microversion: 2.1 time: 0.239836 Oct 24 09:16:28.192243 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2536/5268] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:16:27 2022] POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:16:28.202291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:28.203922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:28.214061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:28.214557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:28.214994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.215709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:28.216588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:28.217183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.435948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:28.439157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:28.439945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:28.446078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6bc1a2cd-ec8f-4b24-aada-c6702edddd06 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.249233 Oct 24 09:16:28.447416 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2733/5269] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:28 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:28.455483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:28.455957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:28.456396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.457102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:28.457585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:28.458009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.507153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:28.508049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:28.516069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:28.516827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:28.517527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.518460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:28.519448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:28.520082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:28.657837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:28.668752 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-644ca630-f462-434b-be12-cf2ccf99feae tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.236849 Oct 24 09:16:28.669789 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2537/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:28 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:28.742617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:28.770945 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b3f4aa5-9b1f-470f-a6bb-faecd8fadb75 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 0.269885 Oct 24 09:16:28.771357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2734/5271] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:28 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:29.471968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:29.473242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:29.490578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:29.491007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:29.491452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:29.492694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:29.492694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:29.493023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:29.707232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:29.707927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:29.727677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:29.729966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:29.731670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:29.733571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:29.736448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:29.738499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:29.773552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:29.788230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa0d13be-bc99-4029-9248-e0075c55791b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.319068 Oct 24 09:16:29.789260 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2538/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:29 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:29.832000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:29.832618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:29.855916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:29.857678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:29.858137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:29.860984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:29.862434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:29.863079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:30.213583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:30.237361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fe93632-94dd-4992-b5cc-7e8b84f840d4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1368 microversion: 2.1 time: 0.420716 Oct 24 09:16:30.240836 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2539/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:29 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:30.345118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:30.364782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba6704e0-65eb-4fb3-a6a2-0541660cee08 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.664777 Oct 24 09:16:30.366959 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2735/5274] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:29 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:30.819588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:30.820922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:30.831472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:30.831902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:30.837320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:30.838167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:30.838620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:30.839044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.162784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:31.173597 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2505814d-f95f-40b4-a3e9-441c232cbec6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.358383 Oct 24 09:16:31.175081 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2540/5275] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:30 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:31.266366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:31.266999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:31.281653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:31.286478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:31.287130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.288018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:31.288471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:31.288986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.401665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:31.403076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:31.412364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:31.426246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:31.427166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.428102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:31.431873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:31.436522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.636769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:31.650015 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76f55016-d112-431a-bcba-11d247c64f70 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1559 microversion: 2.1 time: 0.389069 Oct 24 09:16:31.662721 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2736/5276] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:31 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1559 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:31.690426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:31.691431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:31.703696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:31.718497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:31.725027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.727520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:31.728236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:31.730470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:31.738893 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:31.849230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:31.862545 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c1d093c-188f-4d16-9a83-b4d1c9bce0e0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.468560 Oct 24 09:16:31.863148 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2541/5277] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:31 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:31.947626 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6812c531-bff0-4f3d-89ca-d4b6e0ff86a8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262121 Oct 24 09:16:31.948170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2737/5278] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:16:31 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-interface => generated 285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:16:32.206423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:32.207392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:32.214926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:32.215428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:32.215866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:32.216579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:32.217017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:32.217479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:32.560664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:32.581074 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0278033b-f3ad-4fb5-855c-468fe394d7b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.386112 Oct 24 09:16:32.591555 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2542/5279] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:32 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:32.887617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:32.889348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:32.900006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:32.902605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:32.919654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:32.921924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:32.926455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:32.928920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:33.623595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:33.624301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:33.633393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:33.634584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:33.636536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:33.637682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:33.638249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:33.638923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:33.924662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:33.934252 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea5935c6-8fbf-4fca-bf70-de0835199962 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.317197 Oct 24 09:16:33.934252 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2543/5280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:33 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:33.946329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:33.956819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-221e57db-70ed-4457-8338-21b7457e25c7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 1.073706 Oct 24 09:16:33.977059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2738/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:32 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:34.232895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-43d31e45-b797-4378-8089-bd80a601ac68 req-58d20ddb-da6d-4b76-971d-5316a7bb1e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a2ed7b-d75a-4cd6-a320-88267be827d7", "name": "network-vif-plugged", "status": "completed", "tag": "6bf46737-44cb-4a46-879e-60dc67b179a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:34.253116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-43d31e45-b797-4378-8089-bd80a601ac68 req-58d20ddb-da6d-4b76-971d-5316a7bb1e89 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:34.257660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-43d31e45-b797-4378-8089-bd80a601ac68 req-58d20ddb-da6d-4b76-971d-5316a7bb1e89 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:34.259592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-43d31e45-b797-4378-8089-bd80a601ac68 req-58d20ddb-da6d-4b76-971d-5316a7bb1e89 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:34.301827 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-43d31e45-b797-4378-8089-bd80a601ac68 req-58d20ddb-da6d-4b76-971d-5316a7bb1e89 service nova] Creating event network-vif-plugged:6bf46737-44cb-4a46-879e-60dc67b179a9 for instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 on n-h2-master-1 Oct 24 09:16:34.314235 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-43d31e45-b797-4378-8089-bd80a601ac68 req-58d20ddb-da6d-4b76-971d-5316a7bb1e89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085886 Oct 24 09:16:34.332210 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2544/5282] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:34.959753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:34.961675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:34.975018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:34.977709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:34.978790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:34.982513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:34.983009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:34.983450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:34.984930 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:34.986640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:35.004063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:35.004839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:35.007076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:35.008150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:35.011335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:35.012033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:35.258852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:35.270580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-300a33bd-ed61-45d8-ac94-f21d8dd6f16f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.315046 Oct 24 09:16:35.274299 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2739/5283] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:34 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:35.402418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:35.422841 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c666855-e6d7-4c7d-9246-d8699f6b7998 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1309 microversion: 2.1 time: 0.445830 Oct 24 09:16:35.424775 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2545/5284] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:34 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:35.754516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b51bbc6c-3b94-4ede-8785-bae82153f42e req-ce8612c6-0298-4032-b25f-f44558a93f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6a3115-d9cf-4c81-8939-f85460b33d46", "tag": "f6685c4a-5fdc-4435-b950-03f6aa536f1c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:35.786670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b51bbc6c-3b94-4ede-8785-bae82153f42e req-ce8612c6-0298-4032-b25f-f44558a93f08 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:35.787075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b51bbc6c-3b94-4ede-8785-bae82153f42e req-ce8612c6-0298-4032-b25f-f44558a93f08 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:35.787512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b51bbc6c-3b94-4ede-8785-bae82153f42e req-ce8612c6-0298-4032-b25f-f44558a93f08 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:35.832145 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b51bbc6c-3b94-4ede-8785-bae82153f42e req-ce8612c6-0298-4032-b25f-f44558a93f08 service nova] Creating event network-changed:f6685c4a-5fdc-4435-b950-03f6aa536f1c for instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 on n-h2-master-1 Oct 24 09:16:35.854170 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b51bbc6c-3b94-4ede-8785-bae82153f42e req-ce8612c6-0298-4032-b25f-f44558a93f08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.578172 Oct 24 09:16:35.854794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2740/5285] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:36.299821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:36.301053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:36.326919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:36.338143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:36.338918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:36.339855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:36.340489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:36.342303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:36.454948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:36.456474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:36.473887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:36.474744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:36.476772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:36.478034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:36.480036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:36.480995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:36.798660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:36.808063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58ebc72e-71ad-48ce-8265-b93d20c880e1 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1489 microversion: 2.1 time: 0.359627 Oct 24 09:16:36.808652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2741/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:36 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1489 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:36.925484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:36.940393 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-75918e96-9d1a-41ae-8b1a-b892006c156f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.644555 Oct 24 09:16:36.942851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2546/5287] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:36 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:37.134402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1957506348", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:37.250045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:16:37.967951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:37.969143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:37.991050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:37.991558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:37.992010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:37.992747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:37.998331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:37.998792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:38.167659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:16:38.169263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:16:38.170230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:16:38.172047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:16:38.172690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:16:38.188863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:38.202501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:38.204813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:38.206995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:38.211487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:38.212862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:38.238070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:16:38.244698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:16:38.270514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:16:38.273531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:16:38.341165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:38.344420 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:38.369051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2608db96-1895-459d-9abc-4df5f0ca40c3 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1674 microversion: 2.1 time: 0.402084 Oct 24 09:16:38.370877 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2547/5288] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:37 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1674 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:38.392312 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4ea2f9e-8417-4bd4-9f53-af8d8fe07e8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261889 Oct 24 09:16:38.393502 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2742/5289] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:16:38.427775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-188d31c0-f0be-4815-8c60-2fb06bc3a78d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:38.428521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-188d31c0-f0be-4815-8c60-2fb06bc3a78d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:38.596641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-188d31c0-f0be-4815-8c60-2fb06bc3a78d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:38.604422 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-188d31c0-f0be-4815-8c60-2fb06bc3a78d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1209 microversion: 2.1 time: 0.185737 Oct 24 09:16:38.605023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2548/5290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:38 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1209 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:39.397109 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:39.404742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:39.425795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.430374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.431151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:39.434191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.434879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.435643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:39.644272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:39.644894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:39.675181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.675969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.677866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:39.683703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.684163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.684620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:39.711886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:39.722268 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65f03ba1-cb2a-4c17-a594-1e1ec835c114 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1651 microversion: 2.1 time: 0.330948 Oct 24 09:16:39.723222 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2743/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:39 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1651 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:39.749845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fee574d8-4685-4ab5-b107-8bd4086e041d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:39.757622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fee574d8-4685-4ab5-b107-8bd4086e041d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.758507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fee574d8-4685-4ab5-b107-8bd4086e041d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.759201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fee574d8-4685-4ab5-b107-8bd4086e041d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:39.799673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fee574d8-4685-4ab5-b107-8bd4086e041d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Going to try to start instance {{(pid=126920) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 09:16:39.849951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:39.862346 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37b43048-52f7-47ee-8179-6b0f0a67720e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1205 microversion: 2.1 time: 0.226042 Oct 24 09:16:39.865884 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2549/5292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:39 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1205 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:39.883729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fee574d8-4685-4ab5-b107-8bd4086e041d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action" status: 202 len: 0 microversion: 2.1 time: 0.137851 Oct 24 09:16:39.884796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2744/5293] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:16:39 2022] POST /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:16:39.894055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:39.895048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:39.908355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.910342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.913254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:39.914487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:39.917254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:39.917733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:40.241344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:40.249919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2dcf7d3-9207-4a52-beec-1e441000a342 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1660 microversion: 2.1 time: 0.360503 Oct 24 09:16:40.252474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2550/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:39 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1660 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:40.895080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:40.897204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:40.912198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:40.912714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:40.913166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:40.914949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:40.918348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:40.919092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:41.076624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:41.091117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4881e34e-2ee4-4d42-9559-c9d346cf4c11 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1267 microversion: 2.1 time: 0.204735 Oct 24 09:16:41.095218 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2745/5295] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:40 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:41.277205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:41.278077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:41.295997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:41.299079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:41.300560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:41.301549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:41.303618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:41.304075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:42.083422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:42.092639 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82518db0-1d82-4aff-8371-05133ec65e28 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1660 microversion: 2.1 time: 0.820654 Oct 24 09:16:42.101468 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2551/5296] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:41 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1660 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:42.127198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:42.127636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:42.134882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:42.135380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:42.136023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:42.136911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:42.137845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:42.138639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:42.343657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:42.355675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0060e4b-039c-4992-bc11-df9403c43682 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1267 microversion: 2.1 time: 0.235301 Oct 24 09:16:42.360354 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2746/5297] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:42 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:43.123517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:43.124475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:43.155417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:43.156838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:43.157321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:43.158178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:43.166081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:43.166656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:43.382793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:43.384382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:43.397591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:43.398393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:43.400066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:43.402968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:43.403615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:43.404711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:43.708489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:43.730229 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7324ac2-003c-4fc7-a3bd-7b7de6231b53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.351543 Oct 24 09:16:43.732319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2747/5298] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:43 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:16:43.943114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:43.951877 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-180e82b7-8410-4f5c-8f3d-156715d090e8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1664 microversion: 2.1 time: 0.833831 Oct 24 09:16:43.954157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2552/5299] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:43 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1664 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:44.756862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:44.757566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:44.761037 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:44.769545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:44.769864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:44.771264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:44.779385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:44.780985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:44.781903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:44.937147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-418fdbaa-9f7d-4c6e-a1ff-bd29faa7d541 req-56828005-b147-49ab-af4f-c11adb185710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b9a31e-88ef-4b67-9316-5bdb38d5af82", "tag": "86c38689-11ca-46e7-885d-8b4f02ebd6df"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:44.952073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-418fdbaa-9f7d-4c6e-a1ff-bd29faa7d541 req-56828005-b147-49ab-af4f-c11adb185710 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:44.953587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-418fdbaa-9f7d-4c6e-a1ff-bd29faa7d541 req-56828005-b147-49ab-af4f-c11adb185710 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:44.954501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-418fdbaa-9f7d-4c6e-a1ff-bd29faa7d541 req-56828005-b147-49ab-af4f-c11adb185710 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:44.970275 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-418fdbaa-9f7d-4c6e-a1ff-bd29faa7d541 req-56828005-b147-49ab-af4f-c11adb185710 service nova] Creating event network-changed:86c38689-11ca-46e7-885d-8b4f02ebd6df for instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 on n-h1-master-1 Oct 24 09:16:44.988439 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-418fdbaa-9f7d-4c6e-a1ff-bd29faa7d541 req-56828005-b147-49ab-af4f-c11adb185710 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412447 Oct 24 09:16:44.990160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2748/5300] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:45.145893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:45.158190 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e05fa1fa-8c17-40ee-b21b-76970944daa7 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.406488 Oct 24 09:16:45.159696 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2553/5301] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:44 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:46.183086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:46.184137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:46.199334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:46.201482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:46.204484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:46.207366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:46.208360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:46.210624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:46.444021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:46.458487 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f917781b-d461-4982-aadd-32743d9319be tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.280154 Oct 24 09:16:46.479120 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2749/5302] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:46 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:47.500411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:47.501030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:47.512642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:47.513442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:47.514090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:47.515709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:47.516354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:47.517092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:47.802416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:47.811262 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e8054a0-247e-46f2-a0e8-33a1637f1ebb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.328752 Oct 24 09:16:47.815082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2554/5303] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:47 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:48.834540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:48.835321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:48.844878 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:48.847469 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:48.850237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:48.851217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:48.852405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:48.853340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:48.853977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:48.854672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:49.068743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:49.079279 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b980cb1-d9aa-43bc-a5a7-455ef36ef353 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.248588 Oct 24 09:16:49.079870 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2750/5304] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:48 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:50.104607 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:50.105245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:50.111781 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:50.120579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:50.121080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:50.122009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:50.122758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:50.122758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:50.124803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:50.366045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c4bcb841-eb79-4cbf-b04f-42d99337c000 req-b65bb273-84de-4ed2-9cd8-345c01004ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b9a31e-88ef-4b67-9316-5bdb38d5af82", "name": "network-vif-plugged", "status": "completed", "tag": "86c38689-11ca-46e7-885d-8b4f02ebd6df"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:50.393191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4bcb841-eb79-4cbf-b04f-42d99337c000 req-b65bb273-84de-4ed2-9cd8-345c01004ccf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:50.395396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4bcb841-eb79-4cbf-b04f-42d99337c000 req-b65bb273-84de-4ed2-9cd8-345c01004ccf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:50.398452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4bcb841-eb79-4cbf-b04f-42d99337c000 req-b65bb273-84de-4ed2-9cd8-345c01004ccf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:50.430690 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c4bcb841-eb79-4cbf-b04f-42d99337c000 req-b65bb273-84de-4ed2-9cd8-345c01004ccf service nova] Creating event network-vif-plugged:86c38689-11ca-46e7-885d-8b4f02ebd6df for instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 on n-h1-master-1 Oct 24 09:16:50.445641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c4bcb841-eb79-4cbf-b04f-42d99337c000 req-b65bb273-84de-4ed2-9cd8-345c01004ccf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083363 Oct 24 09:16:50.448153 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2751/5305] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:16:50.471712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:50.479780 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a0d2f86-22a0-4846-be1a-9829d3d9bb39 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.380415 Oct 24 09:16:50.480362 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2555/5306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:50 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:51.018003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:51.018651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:51.039522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:51.042030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:51.042893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:51.046895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:51.047848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:51.048518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:51.115157 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3730ece5-e630-483b-9650-7b2a9b069820 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/ips" status: 200 len: 152 microversion: 2.20 time: 0.102199 Oct 24 09:16:51.117958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2752/5307] 10.222.0.25 () {60 vars in 1289 bytes} [Mon Oct 24 09:16:51 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/ips => generated 152 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:16:51.506828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:51.508206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:51.527617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:51.529521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:51.530081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:51.531104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:51.531766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:51.532482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:51.823336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:51.832954 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ae487339-25aa-4ebb-9198-ec5404c9857f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1309 microversion: 2.1 time: 0.331948 Oct 24 09:16:51.838991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2556/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:51 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:52.862597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:52.864597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:52.904694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:52.904694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:52.904694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:52.904694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:52.904694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:52.904694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.150833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:53.160235 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c465ac0a-dc25-4383-b37e-e13336b86725 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1490 microversion: 2.1 time: 0.303924 Oct 24 09:16:53.170182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2753/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:52 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1490 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:53.183667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:53.184286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:53.192284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.192780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.193219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.193960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.194421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.194852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.439054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:53.450059 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a00f20ce-72f7-4028-a036-5427e250ef23 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1489 microversion: 2.1 time: 0.270390 Oct 24 09:16:53.451510 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2557/5310] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:53 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1489 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:53.476857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:53.477708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:53.485071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.485953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.486475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.487294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.488148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.488825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.728424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:53.739010 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-310f77db-9065-4535-82e3-083d00f59cd8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1490 microversion: 2.1 time: 0.268742 Oct 24 09:16:53.740061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2754/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:53 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1490 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:53.762065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:53.762577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:53.768869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.769386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.769829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.770531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.771177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.771788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.805854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:16:53.932123 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-874bb91a-e10f-456b-99b3-44d029e2f25f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 204 len: 0 microversion: 2.1 time: 0.173394 Oct 24 09:16:53.933035 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2558/5312] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:16:53 2022] DELETE /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:16:53.943298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:53.943981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:53.961075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.963204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.963668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:53.964427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:53.964898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:53.965394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:54.180266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:54.191349 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5b858a6-ab19-47dc-bb60-ae61cc41c8ab tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1496 microversion: 2.1 time: 0.252452 Oct 24 09:16:54.191933 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2755/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:53 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1496 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:54.443249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:54.443977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:54.450923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:54.451524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:54.452141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:54.453065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:54.453471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:54.454152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:54.480144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lazy-loading 'flavor' on Instance uuid ad46abbe-9593-4b3f-bb44-93e777c29fdf {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:54.820733 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f58e7c6-f3e0-4925-926f-22fd06bab402 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/action" status: 202 len: 0 microversion: 2.20 time: 0.381674 Oct 24 09:16:54.821397 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2559/5314] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:16:54 2022] POST /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:16:54.831281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:54.831911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:54.842846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:54.844251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:54.844919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:54.845702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:54.846166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:54.846603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:54.892926 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:55.093254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:55.103721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:55.105392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:55.106691 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5a9f71c1-1009-4c6d-bb81-c2a66187769e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.280054 Oct 24 09:16:55.107743 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2756/5315] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:54 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:55.216161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:55.216868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:55.231863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:55.232612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:55.234756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:55.236592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:55.237569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:55.239590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:55.462300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:55.471834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb7395fa-ea4f-4679-a1bb-4ae60c3eff2f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1496 microversion: 2.1 time: 0.259772 Oct 24 09:16:55.472730 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2560/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:55 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1496 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:56.137062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:56.137802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:56.170379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:56.171235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:56.172668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:56.175118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:56.176422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:56.178347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:56.239685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-09e9f9dc-7054-46f2-82b6-9dfdb6bbe88b req-e8cef7a0-aff0-4b59-900e-d852871b1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b9a31e-88ef-4b67-9316-5bdb38d5af82", "name": "network-vif-deleted", "tag": "86c38689-11ca-46e7-885d-8b4f02ebd6df"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:16:56.257752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-09e9f9dc-7054-46f2-82b6-9dfdb6bbe88b req-e8cef7a0-aff0-4b59-900e-d852871b1bc1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:56.259708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-09e9f9dc-7054-46f2-82b6-9dfdb6bbe88b req-e8cef7a0-aff0-4b59-900e-d852871b1bc1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:56.260275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-09e9f9dc-7054-46f2-82b6-9dfdb6bbe88b req-e8cef7a0-aff0-4b59-900e-d852871b1bc1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:56.294439 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-09e9f9dc-7054-46f2-82b6-9dfdb6bbe88b req-e8cef7a0-aff0-4b59-900e-d852871b1bc1 service nova] Creating event network-vif-deleted:86c38689-11ca-46e7-885d-8b4f02ebd6df for instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 on n-h1-master-1 Oct 24 09:16:56.304835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-09e9f9dc-7054-46f2-82b6-9dfdb6bbe88b req-e8cef7a0-aff0-4b59-900e-d852871b1bc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070209 Oct 24 09:16:56.312017 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2561/5317] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:16:56.503994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:56.507248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:56.517383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:56.518397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:56.519308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:56.519590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:56.520646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:56.521413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:56.522218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:56.568172 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:56.585119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:56.585725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:56.586349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:56.586988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lazy-loading 'fault' on Instance uuid 47b9a31e-88ef-4b67-9316-5bdb38d5af82 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:16:56.590857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:56.598562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:56.600107 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc10bb67-c1e3-437e-b15e-562e94341ea8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.467352 Oct 24 09:16:56.620453 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2757/5318] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:56 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:56.675871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:56.685312 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb3c8107-c583-49f9-a1bb-e457269fda25 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 200 len: 1299 microversion: 2.1 time: 0.192514 Oct 24 09:16:56.703055 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2562/5319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:56 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:57.637626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:57.638990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:57.643442 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:57.649601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:57.650295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:57.650920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:57.651788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:57.652472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:57.653100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:57.719283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:57.720709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:57.729162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:57.730061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:57.730750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:57.733730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:57.734519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:57.735045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:57.755790 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 HTTP/1.1 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '47b9a31e-88ef-4b67-9316-5bdb38d5af82'} Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:16:57.760451 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:16:57.765450 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:16:57.767435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:16:57.768551 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-722afbc3-847f-40e6-b433-3a8ffaa4e019 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 404 len: 111 microversion: 2.1 time: 0.053982 Oct 24 09:16:57.770064 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2563/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:57 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:16:57.778189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:57.779024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:57.786574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:57.788021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:57.788981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:57.790963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:57.791727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:57.793778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:57.832644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:16:57.932092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:57.945667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:57.949864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:57.959022 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f3a8e27-b227-478c-8a99-26b3ec16dc99 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.325843 Oct 24 09:16:57.960865 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2758/5321] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:57 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:58.015759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-238806f4-5681-4afa-88f0-d696434d439a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 204 len: 0 microversion: 2.1 time: 0.238441 Oct 24 09:16:58.016430 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2564/5322] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:16:57 2022] DELETE /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:16:58.027364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:58.028297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:58.039927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:58.040591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:58.041516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:58.046572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:58.047391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:58.048058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:58.388752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:58.397474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ea09114-4e6f-4d18-9c4f-d8fcad7d1f64 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1495 microversion: 2.1 time: 0.375451 Oct 24 09:16:58.422767 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2759/5323] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:58 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1495 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:16:59.012697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:59.014221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:59.034497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:59.035327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:59.037497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:59.041154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:59.041952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:59.046564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:59.381481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:59.402964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:59.404516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:59.421870 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f285d3ca-959d-4517-a739-fca2b1a81c69 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.430515 Oct 24 09:16:59.423056 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2565/5324] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:16:58 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:16:59.438815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:16:59.440682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:16:59.450198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:59.451072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:59.451538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:59.452265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:16:59.463426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:16:59.464383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:16:59.727155 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:16:59.736766 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df6fca43-473e-4148-805b-310347d6ef16 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1495 microversion: 2.1 time: 0.310548 Oct 24 09:16:59.750573 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2760/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:16:59 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1495 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:00.431943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8cf5a790-d740-4596-b925-eb379acf11c6 req-6554fed2-10a2-49b9-aa66-9f508395a8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a2ed7b-d75a-4cd6-a320-88267be827d7", "name": "network-vif-deleted", "tag": "6bf46737-44cb-4a46-879e-60dc67b179a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:00.448555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:00.449202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:00.457179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:00.457707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:00.458147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:00.471863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:00.472880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:00.475510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8cf5a790-d740-4596-b925-eb379acf11c6 req-6554fed2-10a2-49b9-aa66-9f508395a8e7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:00.476206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:00.480798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8cf5a790-d740-4596-b925-eb379acf11c6 req-6554fed2-10a2-49b9-aa66-9f508395a8e7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:00.481818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8cf5a790-d740-4596-b925-eb379acf11c6 req-6554fed2-10a2-49b9-aa66-9f508395a8e7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:00.512648 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8cf5a790-d740-4596-b925-eb379acf11c6 req-6554fed2-10a2-49b9-aa66-9f508395a8e7 service nova] Creating event network-vif-deleted:6bf46737-44cb-4a46-879e-60dc67b179a9 for instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 on n-h2-master-1 Oct 24 09:17:00.534117 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8cf5a790-d740-4596-b925-eb379acf11c6 req-6554fed2-10a2-49b9-aa66-9f508395a8e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105892 Oct 24 09:17:00.540930 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2566/5326] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:00.762272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:00.762976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:00.774514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:00.775009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:00.781636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:00.782456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:00.782932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:00.783370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:00.828591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:00.862231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:00.862231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:00.862231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:00.862231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lazy-loading 'fault' on Instance uuid 30a2ed7b-d75a-4cd6-a320-88267be827d7 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:17:00.862741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:00.863958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:00.872468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-26ef85c7-19b6-40af-afda-eec0a3bbd99d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.426535 Oct 24 09:17:00.873091 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2761/5327] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:00 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:00.910260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:00.924501 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44831cbd-6964-4bee-aa52-2e508b11692c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 200 len: 1299 microversion: 2.1 time: 0.166329 Oct 24 09:17:00.925214 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2567/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:00 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:01.899792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:01.901813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:01.910037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:01.910981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:01.911593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:01.912513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:01.913207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:01.913956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:01.950030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:01.951312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:01.964824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:01.966556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:01.969187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:01.970242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:01.970896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:01.973655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:01.992615 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 HTTP/1.1 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '30a2ed7b-d75a-4cd6-a320-88267be827d7'} Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:01.995205 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:17:02.000765 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:17:02.002820 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:17:02.003877 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-315529c0-5e64-4226-be0d-7a545a455870 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 404 len: 111 microversion: 2.1 time: 0.059201 Oct 24 09:17:02.004945 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2568/5329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:01 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:02.219885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:02.236978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:02.245471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:02.246708 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b44d2007-f895-4b5c-a740-40e52a370ffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.351000 Oct 24 09:17:02.249916 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2762/5330] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:01 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:02.354988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1042488796", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:02.464309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:17:03.099549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:17:03.100348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:17:03.100973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:17:03.101506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:17:03.102062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:17:03.115733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:03.121255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:03.122072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:03.123102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:03.124327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:03.125106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:03.162743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:17:03.171475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:17:03.198599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:17:03.199144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:17:03.267273 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf7a0be7-acff-4274-94c9-3145de370fd3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915942 Oct 24 09:17:03.268625 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2569/5331] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:17:03.279753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:03.280417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:03.280653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d59e5fd-fdf8-4d0a-8ac2-65481cb9ee78 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:03.281503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d59e5fd-fdf8-4d0a-8ac2-65481cb9ee78 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:03.295319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:03.296370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:03.297417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:03.297702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:03.298199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:03.298630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:03.382966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d59e5fd-fdf8-4d0a-8ac2-65481cb9ee78 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:03.404326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d59e5fd-fdf8-4d0a-8ac2-65481cb9ee78 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1209 microversion: 2.1 time: 0.128777 Oct 24 09:17:03.404964 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2570/5332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:03 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1209 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:03.524227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:03.537484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:03.542576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:03.543971 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-254d2c4a-f59f-4aa4-95a0-67432a2dd35b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.269616 Oct 24 09:17:03.545021 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2763/5333] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:03 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:04.427643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:04.429203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:04.445376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:04.445885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:04.446322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:04.448971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:04.449492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:04.452360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:04.551178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:04.559115 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5534cca-b176-4522-9787-f2ec4c2efd9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1261 microversion: 2.1 time: 0.136102 Oct 24 09:17:04.559689 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2571/5334] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:04 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:04.576463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:04.577901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:04.587091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:04.588403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:04.588854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:04.589715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:04.590310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:04.590796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:04.751374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:04.775692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:04.777247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:04.786156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8210adae-5a95-4b2a-9419-8d25f7c91df0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.212741 Oct 24 09:17:04.788934 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2764/5335] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:04 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:05.597227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:05.597966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:05.610661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:05.613248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:05.614075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:05.614853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:05.616086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:05.616759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:05.809085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:05.819952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:05.820576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:05.821969 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-293d4e2d-bce7-45fd-8b8b-1e2e7c801b55 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1267 microversion: 2.1 time: 0.238237 Oct 24 09:17:05.822663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2572/5336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:05 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:05.854696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:05.860602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:05.863571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:05.867814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:05.871633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:05.873500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:06.335750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:06.350749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:06.356540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:06.358620 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7c8d289-86eb-4ade-97aa-18431184d4c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1745 microversion: 2.20 time: 0.543624 Oct 24 09:17:06.359953 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2765/5337] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:05 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1745 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:06.853040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:06.854278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:06.866923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:06.869897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:06.870626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:06.873097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:06.874018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:06.876793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:07.130315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:07.143168 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62e47dc0-44c2-4253-a885-c8c25f334d92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1267 microversion: 2.1 time: 0.294023 Oct 24 09:17:07.145468 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2573/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:06 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:07.392060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:07.393421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:07.404140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:07.412105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:07.412932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:07.413993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:07.414905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:07.415592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:07.732005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:07.750556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:07.754670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:07.761550 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f12e906-eb2b-4b4b-ab24-1f3a2014d8e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1745 microversion: 2.20 time: 0.373213 Oct 24 09:17:07.765229 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2766/5339] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:07 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1745 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:08.168227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:08.180482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:08.206565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:08.207060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:08.210256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:08.211147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:08.212850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:08.213621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:08.567670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:08.576143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5f3ccd1-7ef1-4d84-af62-60cfb95d1350 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.413160 Oct 24 09:17:08.576814 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2574/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:08 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:08.796431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:08.798217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:08.812156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:08.813883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:08.817928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:08.822875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:08.823616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:08.825884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:09.242299 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:09.255334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:09.257524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:09.275350 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f86bcdd2-cfca-4818-a0b7-b52873a139a2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1745 microversion: 2.20 time: 0.484290 Oct 24 09:17:09.280103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2767/5341] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:08 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1745 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:09.379394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f4e8e581-447a-4595-9fe3-8e32de6631af req-d89b07fd-7383-4ceb-b4d5-5cfeca1b00d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687cf129-e7e4-4f2d-a302-38a93ae49aed", "tag": "f38b6412-caa7-469b-aaee-a5de8d060973"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:09.439659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4e8e581-447a-4595-9fe3-8e32de6631af req-d89b07fd-7383-4ceb-b4d5-5cfeca1b00d9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:09.444144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4e8e581-447a-4595-9fe3-8e32de6631af req-d89b07fd-7383-4ceb-b4d5-5cfeca1b00d9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:09.445844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f4e8e581-447a-4595-9fe3-8e32de6631af req-d89b07fd-7383-4ceb-b4d5-5cfeca1b00d9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:09.494794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f4e8e581-447a-4595-9fe3-8e32de6631af req-d89b07fd-7383-4ceb-b4d5-5cfeca1b00d9 service nova] Creating event network-changed:f38b6412-caa7-469b-aaee-a5de8d060973 for instance 687cf129-e7e4-4f2d-a302-38a93ae49aed on n-h1-master-1 Oct 24 09:17:09.510961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f4e8e581-447a-4595-9fe3-8e32de6631af req-d89b07fd-7383-4ceb-b4d5-5cfeca1b00d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136958 Oct 24 09:17:09.520151 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2575/5342] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:09.601498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:09.602111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:09.616546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:09.618300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:09.622384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:09.623313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:09.623983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:09.626113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:10.008230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:10.008890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:10.023741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:10.025576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:10.026841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:10.028479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:10.030216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:10.030793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:10.094823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:10.115277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4382f74b-4d1e-483b-802c-3af24f20ae26 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.518224 Oct 24 09:17:10.119160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2768/5343] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:09 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:10.141594 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-526a4583-beae-4396-b65d-c2e06d27494e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/ips" status: 200 len: 151 microversion: 2.1 time: 0.139445 Oct 24 09:17:10.153919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2576/5344] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:17:10 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/ips => generated 151 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:10.322981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:10.323839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:10.343682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:10.365414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:10.366512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:10.371862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:10.374257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:10.374862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:10.790813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:10.807441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:10.816366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:10.822202 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4429f5b8-c0d6-4939-b305-e5597dd3e0c2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.502326 Oct 24 09:17:10.825895 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2769/5345] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:10 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:11.057287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fe329cff-8b23-4f1b-a711-479e236c8b86 req-4a71dbd0-7720-4095-aaed-2d5310c50f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "name": "network-vif-plugged", "status": "completed", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:11.123631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fe329cff-8b23-4f1b-a711-479e236c8b86 req-4a71dbd0-7720-4095-aaed-2d5310c50f54 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:11.126496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fe329cff-8b23-4f1b-a711-479e236c8b86 req-4a71dbd0-7720-4095-aaed-2d5310c50f54 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:11.126968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fe329cff-8b23-4f1b-a711-479e236c8b86 req-4a71dbd0-7720-4095-aaed-2d5310c50f54 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:11.156030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:11.156650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:11.161645 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fe329cff-8b23-4f1b-a711-479e236c8b86 req-4a71dbd0-7720-4095-aaed-2d5310c50f54 service nova] Creating event network-vif-plugged:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h1-master-1 Oct 24 09:17:11.168536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:11.169030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:11.169494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:11.182332 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fe329cff-8b23-4f1b-a711-479e236c8b86 req-4a71dbd0-7720-4095-aaed-2d5310c50f54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.599662 Oct 24 09:17:11.183323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2577/5346] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:17:11.187812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:11.188541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:11.188999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:11.568021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:11.578971 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9499c07e-238c-4f40-ac6d-6ed1b45a7ccc tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.438492 Oct 24 09:17:11.580274 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2770/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:11 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:11.860191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:11.865863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:11.879140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:11.883765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:11.886834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:11.887713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:11.888316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:11.893553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:12.604725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:12.605949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:12.615961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:12.619012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:12.619626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:12.620493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:12.624176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:12.624827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:12.814973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:12.831664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:12.836803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:12.838419 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c2f344ae-d9ce-4ae3-837f-75d4112b10e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.984179 Oct 24 09:17:12.842627 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2578/5348] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:11 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:13.129186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:13.139558 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30652ac1-5383-46de-b7c4-e2f8ee0c1f92 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.538736 Oct 24 09:17:13.155891 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2771/5349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:12 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:13.242370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c921870-cbda-4217-b04a-fc2498db008e"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:13.245062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:13.256886 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:13.277185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:13.280721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:13.285015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:13.288816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:13.289504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:13.292942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:13.409161 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:13.877922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:13.879130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:13.894560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:13.906164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:13.907152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:13.910579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:13.914724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:13.916736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:14.007627 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47c4379e-37cd-41db-a522-1f758969d130 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "POST /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761519 Oct 24 09:17:14.027715 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2579/5350] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:17:13 2022] POST /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:17:14.167308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:14.168288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:14.189281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:14.191154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:14.191902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:14.195328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:14.195953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:14.196561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:14.583004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:14.585757 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:14.596354 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-079a6d42-66d7-41ef-b74a-a7920f305064 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.434743 Oct 24 09:17:14.599255 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2580/5351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:14 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:14.650004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:14.653970 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:14.666207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:14.668020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:14.669486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-023d7986-a8c2-4dd6-98dc-955044e3c6b0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.796214 Oct 24 09:17:14.671454 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2772/5352] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:13 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:15.628559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:15.629928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:15.643270 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:15.644993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:15.648074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:15.650392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:15.654431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:15.656426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:15.657017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:15.702683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:15.703881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:15.730156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:15.731638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:15.736130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:15.740545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:15.743987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:15.748025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:16.441607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:16.462503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:16.469012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:16.475894 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e934b88-5e99-4c97-9ed0-c809aac758c7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.778294 Oct 24 09:17:16.492143 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2773/5353] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:15 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:16.581095 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:16.593574 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12ec2f33-4dbc-48fc-88b6-7ef77a9c72c8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.969670 Oct 24 09:17:16.594427 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2581/5354] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:15 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:17.532680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:17.533197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:17.553281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:17.556899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:17.557508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:17.562182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:17.565037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:17.567930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:17.616199 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:17.616821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:17.634720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:17.635213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:17.635654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:17.636363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:17.650972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:17.654323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:18.271342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:18.281540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:18.283002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:18.284201 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03d5b440-24af-4d95-9ee7-c926eb8c856b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.772757 Oct 24 09:17:18.284780 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2774/5355] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:17 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:19.297880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:19.300791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:19.323626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:19.324160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:19.324630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:19.329267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:19.333179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:19.336396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:19.489663 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f89938e0-3d2b-406a-b268-76585827c6cc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196577 Oct 24 09:17:19.490262 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2775/5356] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:19 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:17:19.537269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:19.538656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:19.574998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:19.579035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:19.587347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:19.588738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:19.593067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:19.599545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:19.966183 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:19.981028 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa4eb535-80f2-4b4f-a81f-65a612cc7103 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 2.368700 Oct 24 09:17:20.000918 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2582/5357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:17 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:20.021058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:20.022564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:20.057715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:20.062868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:20.064569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:20.072985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:20.073611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:20.073982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:20.205343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:17:20.312512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:20.327706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:20.333001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:20.343024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-479fd326-2b3a-4282-9b78-fe2870fba8e2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.829479 Oct 24 09:17:20.346198 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2776/5358] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:19 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:20.481601 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df4fcef1-7b47-40a6-9ada-7a37031529ff tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 204 len: 0 microversion: 2.1 time: 0.476560 Oct 24 09:17:20.484840 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2583/5359] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:17:20 2022] DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:17:20.494168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:20.495158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:20.510770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:20.514742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:20.517064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:20.518998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:20.519978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:20.522333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:20.895126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:20.905482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2485bf35-a0ce-4b40-a97b-abf22fff9d24 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1670 microversion: 2.1 time: 0.416569 Oct 24 09:17:20.909093 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2777/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:20 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:21.024568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:21.026254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:21.040981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:21.049991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:21.052926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:21.060287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:21.068855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:21.071803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:21.375139 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:21.376077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:21.403690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:21.407933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:21.411803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:21.412753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:21.417858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:21.421486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:22.004840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:22.025842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:22.029165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:22.031485 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-839f2633-1ab1-4b39-af54-d83da2268d70 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.661442 Oct 24 09:17:22.033656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2778/5361] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:21 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:22.051774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:22.052616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:22.063870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:22.064613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:22.065062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:22.069685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:22.070202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:22.072448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:22.674325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:22.682399 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6f28860-ace8-48a8-9ea2-b1811b101387 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 1.666266 Oct 24 09:17:22.686181 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2584/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:21 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:22.781326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb722ba0-0d63-471e-a3d5-3a75788d03ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Action: 'create', calling method: .version_select at 0x7f8da99718b0>, body: {"keypair": {"name": "tempest-keypair-1138506613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOxmRD+8XkKiueIbRChj4Aq5EMEmBlsg6iiwj3eZn2yEDlN6BozjJxg7p4wBS/clGcOGLlV+VpGFPVPwPT2F8iSZoo6Z6xWx6v6W8i/vFsSeJjlOthVyt1EbhN6+KxJpw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:22.842773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-fb722ba0-0d63-471e-a3d5-3a75788d03ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Getting quotas for project 49837016a43847f0b145aa177b5bc08d. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:17:22.860583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-fb722ba0-0d63-471e-a3d5-3a75788d03ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Getting quotas for user e1fd438c83414de8b742cfc444739fd8 and project 49837016a43847f0b145aa177b5bc08d. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:17:22.958130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb722ba0-0d63-471e-a3d5-3a75788d03ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.180504 Oct 24 09:17:22.963151 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2585/5363] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 09:17:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 09:17:22.982882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7ec0c49d-1ccb-4cfb-be3f-808339ac73d1 req-b50b5c81-ffa3-4f1d-8284-fcd3ff852aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687cf129-e7e4-4f2d-a302-38a93ae49aed", "name": "network-vif-plugged", "status": "completed", "tag": "f38b6412-caa7-469b-aaee-a5de8d060973"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:23.012975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7ec0c49d-1ccb-4cfb-be3f-808339ac73d1 req-b50b5c81-ffa3-4f1d-8284-fcd3ff852aec service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:23.019041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7ec0c49d-1ccb-4cfb-be3f-808339ac73d1 req-b50b5c81-ffa3-4f1d-8284-fcd3ff852aec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:23.021686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7ec0c49d-1ccb-4cfb-be3f-808339ac73d1 req-b50b5c81-ffa3-4f1d-8284-fcd3ff852aec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:23.066089 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7ec0c49d-1ccb-4cfb-be3f-808339ac73d1 req-b50b5c81-ffa3-4f1d-8284-fcd3ff852aec service nova] Creating event network-vif-plugged:f38b6412-caa7-469b-aaee-a5de8d060973 for instance 687cf129-e7e4-4f2d-a302-38a93ae49aed on n-h1-master-1 Oct 24 09:17:23.081323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7ec0c49d-1ccb-4cfb-be3f-808339ac73d1 req-b50b5c81-ffa3-4f1d-8284-fcd3ff852aec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106280 Oct 24 09:17:23.082629 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2586/5364] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:17:23.088255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:23.094062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:23.106511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:23.107177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:23.108791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:23.128241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:23.130076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:23.134403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:23.519070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:23.532920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56373225-92c3-4288-b2e3-851994592d2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1670 microversion: 2.1 time: 1.497547 Oct 24 09:17:23.536366 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2779/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:22 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1670 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:23.662317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:23.679864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:23.682255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:23.689075 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6346ab3-6421-471d-918d-e36e1392c424 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.604963 Oct 24 09:17:23.689888 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2587/5366] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:23 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:23.713153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:23.714064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:23.721066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:23.726743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:23.727543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:23.728534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:23.730681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:23.735205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:24.057188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:24.068827 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-236405d8-86c0-4aa9-b43e-4faa52605d15 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1309 microversion: 2.1 time: 0.362633 Oct 24 09:17:24.072841 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2780/5367] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:23 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:24.564058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:24.565114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:24.584628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:24.589695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:24.590709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:24.592157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:24.594993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:24.597899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:24.740594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:24.743035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:24.774761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:24.780937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:24.782629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:24.787763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:24.788565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:24.789828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:25.319572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:25.329090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:25.330508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:25.331737 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d9d6937-040a-4063-bf19-95c3b5e0f1dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.615680 Oct 24 09:17:25.341756 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2781/5368] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:24 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:25.350005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:25.353179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:25.354151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:25.368909 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e60b027-01f2-4d41-ad19-38bf8f29def0 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1670 microversion: 2.1 time: 0.809392 Oct 24 09:17:25.372856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:25.374142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:25.374359 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2588/5369] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:24 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1670 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:25.374623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:25.375361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:25.375846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:25.376268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:25.881942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:25.894672 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb14796d-27ef-4095-a31c-b1a851c002bb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1490 microversion: 2.1 time: 0.551079 Oct 24 09:17:25.895271 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2782/5370] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:25 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1490 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:25.923972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:25.928535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:25.957643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:25.959407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:25.962825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:25.965643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:25.967889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:25.968913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:26.210193 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11de59de-b4d8-42a7-924a-512d28d3f9cf tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "PUT /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1085 microversion: 2.1 time: 0.292212 Oct 24 09:17:26.224549 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2589/5371] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:17:25 2022] PUT /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1085 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:26.232330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:26.233184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:26.255481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:26.260493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:26.267274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:26.272125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:26.278720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:26.281015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:26.364378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:26.365673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:26.372692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:26.388230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:26.390675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:26.392669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:26.408489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:26.411415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:26.923277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:26.937522 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1a33c03-1a0a-4427-b5a7-b9a79aee23a6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1511 microversion: 2.1 time: 0.704311 Oct 24 09:17:26.955813 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2783/5372] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:26 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1511 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:26.976483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:26.991814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:27.007149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.023292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.025887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.026892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.031000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.032033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.208451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.209041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.209593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.210021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lazy-loading 'fault' on Instance uuid 1484921f-2743-4293-8612-41bed0f98326 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:17:27.244672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:27.275298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:27.277849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:27.284481 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3aaf9111-ee8b-41ba-9581-ddd2c339cefa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.924782 Oct 24 09:17:27.285325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2590/5373] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:26 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:27.290609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1f5ed0f1-fdda-4281-9201-1a99ef20f48e req-8ee39557-8daa-4c17-80ea-f35ce5123b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1484921f-2743-4293-8612-41bed0f98326", "name": "network-vif-deleted", "tag": "3d46ea9a-e148-4594-96ff-ddfb2f8110aa"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:27.345423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:27.359151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f5ed0f1-fdda-4281-9201-1a99ef20f48e req-8ee39557-8daa-4c17-80ea-f35ce5123b81 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.361607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f5ed0f1-fdda-4281-9201-1a99ef20f48e req-8ee39557-8daa-4c17-80ea-f35ce5123b81 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.363960 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a8ce0d4-d429-4110-88c8-014118a1f850 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 200 len: 1327 microversion: 2.1 time: 0.402932 Oct 24 09:17:27.364613 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2784/5374] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:26 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 1327 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:27.365609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f5ed0f1-fdda-4281-9201-1a99ef20f48e req-8ee39557-8daa-4c17-80ea-f35ce5123b81 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.383012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:27.386593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:27.411224 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1f5ed0f1-fdda-4281-9201-1a99ef20f48e req-8ee39557-8daa-4c17-80ea-f35ce5123b81 service nova] Creating event network-vif-deleted:3d46ea9a-e148-4594-96ff-ddfb2f8110aa for instance 1484921f-2743-4293-8612-41bed0f98326 on n-h1-master-1 Oct 24 09:17:27.416727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.419571 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1f5ed0f1-fdda-4281-9201-1a99ef20f48e req-8ee39557-8daa-4c17-80ea-f35ce5123b81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132206 Oct 24 09:17:27.422661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2591/5375] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:27.423738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.424215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.424962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.425471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.425903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.430257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1372716207", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "15622bf1-7b5f-4b17-bebd-aae2c700d1f9"}, {"port": "1a3f9d28-fb12-486b-a872-8a508788143b", "tag": "port-1"}, {"port": "8ac03a61-fba1-4bce-ac1e-56e52791a4d2", "tag": "port-2"}, {"uuid": "04abd293-36b5-4ee7-986b-ad231b46c660", "tag": "net-1"}, {"uuid": "04abd293-36b5-4ee7-986b-ad231b46c660"}, {"uuid": "86992dbd-82ba-4852-867a-dc7594f5191f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "86992dbd-82ba-4852-867a-dc7594f5191f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "061af1e0-4820-4ced-b6c7-66e6566b31df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4f0c6a8b-f40e-438d-a618-a59807bf60a5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9263d245-716d-41c9-b3f2-92d19da930a2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2111223421"}], "key_name": "tempest-keypair-1138506613", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:27.812198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] validate_networks() for [('15622bf1-7b5f-4b17-bebd-aae2c700d1f9', None, None, None, None, None), (None, None, '1a3f9d28-fb12-486b-a872-8a508788143b', None, None, None), (None, None, '8ac03a61-fba1-4bce-ac1e-56e52791a4d2', None, None, None), ('04abd293-36b5-4ee7-986b-ad231b46c660', None, None, None, None, None), ('04abd293-36b5-4ee7-986b-ad231b46c660', None, None, None, None, None), ('86992dbd-82ba-4852-867a-dc7594f5191f', '10.2.2.100', None, None, None, None), ('86992dbd-82ba-4852-867a-dc7594f5191f', '10.2.2.200', None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:17:27.836453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:27.861513 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89784a77-e410-4f5c-85cf-c7d695e4a965 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1511 microversion: 2.1 time: 0.488173 Oct 24 09:17:27.862319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2785/5376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:27 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:27.893759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:27.897997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:27.913904 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=58 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:27.931123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.934055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.936083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:27.942220 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:27.949096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:27.950034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:28.068935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:17:28.419494 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59de0aa3-fddb-41e2-a2c4-640edd4f454e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 204 len: 0 microversion: 2.1 time: 0.533113 Oct 24 09:17:28.423269 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2786/5377] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:17:27 2022] DELETE /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:17:28.437285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:28.438124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:28.450045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:28.451670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:28.452494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:28.453519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:28.454169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:28.454769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:28.537035 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:28.818790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:28.845224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:28.846752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:28.847984 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40b813db-76b7-4d73-b43e-604bb84e6f1d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.426140 Oct 24 09:17:28.848586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2787/5378] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:28 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:28.857052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:28.861348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:28.875011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:28.875521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:28.875970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:28.876685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:28.883444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:28.884121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:28.923200 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] HTTP exception thrown: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Request method failure captured: Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 HTTP/1.1 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlc9db1q0thT52l3TZk3ZLADEO6QnYP5Qbaxda1FpEtywh7X49FBf8LVm5IQ1LphL7X2q2MOh_EdVOYAT34kmGEEw583XwC5xxdZ_88TDeiJbXftu2OJdB0cj_GpqJXAfNvpf8_c1JCZdRRx1IeUzQOfUj04wtJCcfJG3-o3Cvo4jHI Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee7511c75374ba599216666ba191e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee7511c75374ba599216666ba191e9e"}]}] Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: de6929c304ff4260b9e7c4d469b71a0d Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1484921f-2743-4293-8612-41bed0f98326'} Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:28.938645 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:17:28.943141 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:28.946602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Returning 404 to user: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:17:28.950139 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff9ed263-b078-47e6-b302-fb1f6edc52d8 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 404 len: 111 microversion: 2.1 time: 0.100622 Oct 24 09:17:28.957018 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2788/5379] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:28 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:28.973796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:28.975623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:28.987504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:28.989523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:28.992855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:28.994068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:28.994785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:28.996982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:29.609736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:29.619717 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b3caaf0-123f-4074-9ff8-d7aa6b734f3d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1517 microversion: 2.1 time: 0.661251 Oct 24 09:17:29.635042 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2789/5380] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:28 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1517 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:29.647286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d33cc83c-f154-4136-86ba-a4853b4daa3d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '.version_select at 0x7f8daa368820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:29.705775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d33cc83c-f154-4136-86ba-a4853b4daa3d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767674656" status: 202 len: 0 microversion: 2.1 time: 0.069101 Oct 24 09:17:29.708004 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2790/5381] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767674656 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:17:29.879276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:29.879915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:29.932092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:29.932613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:29.933071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:29.937077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:29.937606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:29.938063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:30.611647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:30.623709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:30.628360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:30.631413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fabbb388-ba70-4d0a-9f73-f378a3bd962a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.758410 Oct 24 09:17:30.634378 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2791/5382] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:29 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:30.650248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:30.651814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:30.665620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:30.666402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:30.667009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:30.668931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:30.670996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:30.671620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:31.522303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:31.544186 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e44304ac-df2f-4479-b1e8-3b6cfc0d29ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1517 microversion: 2.1 time: 0.899799 Oct 24 09:17:31.547975 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2792/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:30 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1517 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:31.665404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:31.666833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:31.686020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:31.709512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:31.709990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:31.710766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:31.711240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:31.711675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:32.292269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:32.308628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:32.312149 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:32.313741 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b12c0300-cde3-40ec-a527-7603894f813a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.654124 Oct 24 09:17:32.315131 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2793/5384] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:31 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:32.335400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac9c9d78-a201-499c-b05d-c849876c5846 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: .version_select at 0x7f8da9c24700>, body: {"keypair": {"name": "tempest-keypair-802609745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLdYwllCr332nV5b6GCK5jKnVKw0YirFrmHqQWU+VISZ3sKdABjK5gMsmCD1wRs3BGcxMBTDVjcmZUIJmqBw1nTIWvITwjAFsGbh0XbjK/aTKcbd1ZbhF00HXwLW3eqrw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:32.382019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ac9c9d78-a201-499c-b05d-c849876c5846 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for project 7ee7511c75374ba599216666ba191e9e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:17:32.395397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ac9c9d78-a201-499c-b05d-c849876c5846 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for user de6929c304ff4260b9e7c4d469b71a0d and project 7ee7511c75374ba599216666ba191e9e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:17:32.495387 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac9c9d78-a201-499c-b05d-c849876c5846 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178725 Oct 24 09:17:32.505193 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2794/5385] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:17:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:32.512528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-4865767e-276d-4459-86f7-c07654d98d8d req-c684889d-8851-47e6-a422-22d4891d5b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687cf129-e7e4-4f2d-a302-38a93ae49aed", "name": "network-vif-deleted", "tag": "f38b6412-caa7-469b-aaee-a5de8d060973"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:32.543161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4865767e-276d-4459-86f7-c07654d98d8d req-c684889d-8851-47e6-a422-22d4891d5b97 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:32.546652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4865767e-276d-4459-86f7-c07654d98d8d req-c684889d-8851-47e6-a422-22d4891d5b97 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:32.548594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-4865767e-276d-4459-86f7-c07654d98d8d req-c684889d-8851-47e6-a422-22d4891d5b97 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:32.589160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-4865767e-276d-4459-86f7-c07654d98d8d req-c684889d-8851-47e6-a422-22d4891d5b97 service nova] Creating event network-vif-deleted:f38b6412-caa7-469b-aaee-a5de8d060973 for instance 687cf129-e7e4-4f2d-a302-38a93ae49aed on n-h1-master-1 Oct 24 09:17:32.606149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-4865767e-276d-4459-86f7-c07654d98d8d req-c684889d-8851-47e6-a422-22d4891d5b97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089666 Oct 24 09:17:32.608854 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2795/5386] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:32.639749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:32.648990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:32.674398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:32.675037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:32.676570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:32.678314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:32.679030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:32.681892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:32.805252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:32.811967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:32.813657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:32.814298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lazy-loading 'fault' on Instance uuid 687cf129-e7e4-4f2d-a302-38a93ae49aed {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:17:32.889691 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:32.919728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:32.950402 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc6b3cf9-7631-4bd4-bd9b-5e2afe1bd73f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 200 len: 1320 microversion: 2.1 time: 0.339962 Oct 24 09:17:32.970782 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2796/5387] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:32 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:33.350779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:33.352585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:33.366162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:33.367422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:33.368241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:33.371739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:33.372475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:33.373988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:33.741971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:33.759584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:33.763798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:33.767255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c820b59-faa0-4167-b44e-4b0b974620ba tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.430905 Oct 24 09:17:33.768826 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2797/5388] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:33 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:33.983327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:33.984189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:34.002116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:34.002653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:34.003274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:34.004167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:34.007437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:34.008054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:34.055965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed HTTP/1.1 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '687cf129-e7e4-4f2d-a302-38a93ae49aed'} Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:34.058612 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:17:34.062813 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:34.070042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:17:34.071209 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02930b7d-40e8-4502-abaf-db641e6df1a2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 404 len: 111 microversion: 2.1 time: 0.093270 Oct 24 09:17:34.072507 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2798/5389] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:33 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:34.320314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1459051103", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "98b5946b-205b-42ef-bbdb-69ebb27be3f3"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:34.672450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:17:34.673270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:17:34.673417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:17:34.673761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:17:34.674173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:17:34.692095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:34.692592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:34.693037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:34.704485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] validate_networks() for [('98b5946b-205b-42ef-bbdb-69ebb27be3f3', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:17:34.710248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:34.710776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:34.711268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:34.745595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Getting quotas for project 49837016a43847f0b145aa177b5bc08d. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:17:34.751939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Getting quotas for user e1fd438c83414de8b742cfc444739fd8 and project 49837016a43847f0b145aa177b5bc08d. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:17:35.135712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:17:35.139318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='061af1e0-4820-4ced-b6c7-66e6566b31df',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4f0c6a8b-f40e-438d-a618-a59807bf60a5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9263d245-716d-41c9-b3f2-92d19da930a2',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:17:35.830073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:17:35.831064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:17:35.831689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:17:35.832265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:17:35.832824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:17:35.850903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:35.851334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:35.851786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:35.852596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:35.853057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:35.853518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:35.927734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:17:35.941348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Getting quotas for user b1ae9fcca02548dfa6e29d2787288e49 and project 2ef8299318ec4b59a75e26867a009a2f. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:17:35.981140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:17:35.985889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:17:36.042977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cd82576-670a-4e7b-813e-4a4dd6492aeb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.618395 Oct 24 09:17:36.046243 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2592/5390] 10.222.0.25 () {62 vars in 1189 bytes} [Mon Oct 24 09:17:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 8623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:17:36.062045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:36.068001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:36.082708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:36.084429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:36.085035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:36.086063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:36.086711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:36.087534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:36.124435 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-658790df-7485-4e8f-b948-fb7a631086d9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807745 Oct 24 09:17:36.129633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2799/5391] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:17:36.154418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c858a672-c941-485f-85a4-d9f437357e87 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:36.158496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c858a672-c941-485f-85a4-d9f437357e87 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:36.339938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c858a672-c941-485f-85a4-d9f437357e87 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:36.353066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c858a672-c941-485f-85a4-d9f437357e87 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:36.354837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c858a672-c941-485f-85a4-d9f437357e87 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:36.363524 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c858a672-c941-485f-85a4-d9f437357e87 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1286 microversion: 2.32 time: 0.226664 Oct 24 09:17:36.364496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2800/5392] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:36 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1286 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:36.370621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac0f814e-9e5d-48a0-bc63-d24290537c37 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:36.371526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac0f814e-9e5d-48a0-bc63-d24290537c37 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:36.538520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac0f814e-9e5d-48a0-bc63-d24290537c37 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:36.557176 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac0f814e-9e5d-48a0-bc63-d24290537c37 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1209 microversion: 2.1 time: 0.189344 Oct 24 09:17:36.562972 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2801/5393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:36 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:36.626780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:36.627284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:36.644826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:36.648979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:36.654064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:36.654896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:36.658197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:36.658549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:36.844769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lazy-loading 'services' on Instance uuid 0c6a3115-d9cf-4c81-8939-f85460b33d46 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:17:36.989145 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dcb3a8ce-b345-4678-aefc-5e74c7baa0fa tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments/9c921870-cbda-4217-b04a-fc2498db008e" status: 202 len: 0 microversion: 2.1 time: 0.366925 Oct 24 09:17:36.993272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2802/5394] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:17:36 2022] DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments/9c921870-cbda-4217-b04a-fc2498db008e => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:17:37.019361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:37.074084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:37.119909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:37.121819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:37.123523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:37.193559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:37.193559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:37.193559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:37.228334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f17e4a42-e9e5-49a7-b353-21bfa1b74bf8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233624 Oct 24 09:17:37.235081 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2803/5395] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:36 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:37.264533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.284384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.285867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.287338 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-050a6c8f-3cff-4864-867b-90d687be2575 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 1.237274 Oct 24 09:17:37.301848 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2593/5396] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:36 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:37.402914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0ac1422-3e62-4ffb-9098-75dd5ba7d5ab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:37.403723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d0ac1422-3e62-4ffb-9098-75dd5ba7d5ab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:37.520623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d0ac1422-3e62-4ffb-9098-75dd5ba7d5ab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.549995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d0ac1422-3e62-4ffb-9098-75dd5ba7d5ab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.552028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d0ac1422-3e62-4ffb-9098-75dd5ba7d5ab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.559468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0ac1422-3e62-4ffb-9098-75dd5ba7d5ab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1286 microversion: 2.32 time: 0.160812 Oct 24 09:17:37.578699 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2804/5397] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:37 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:37.589237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:37.592867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:37.609860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:37.618084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:37.618807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:37.619757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:37.623655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:37.624480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:37.850342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:37.862256 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eede14e8-1e0b-4b3f-b829-b5a45757f70c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1205 microversion: 2.1 time: 0.276632 Oct 24 09:17:37.873209 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2594/5398] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:37 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1205 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:37.933031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-389048918", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8307514-b798-47d6-a1cc-4ea023d1539d"}], "security_groups": [{"name": "tempest-securitygroup--1872236511"}], "key_name": "tempest-keypair-802609745", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:38.241694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:38.244180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:38.268102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:38.268746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:38.269017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:38.281517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:38.282750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:38.289182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:38.402199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] validate_networks() for [('e8307514-b798-47d6-a1cc-4ea023d1539d', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:17:39.615161 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:17:39.616715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:17:39.617858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:17:39.619433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:17:39.625742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:17:39.663906 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e96ba2dc-9b36-4c28-a3b3-a9fa5df97f2b tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.426127 Oct 24 09:17:39.664521 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2595/5399] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:38 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:39.675080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:39.675809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:39.677550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:39.678175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:39.678529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:39.682483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:39.683325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:39.693665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:39.718146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:39.718879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:39.719507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:39.721420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:39.726833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:39.730453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:39.774099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for project 7ee7511c75374ba599216666ba191e9e. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:17:39.786969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Getting quotas for user de6929c304ff4260b9e7c4d469b71a0d and project 7ee7511c75374ba599216666ba191e9e. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:17:39.811491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:17:39.816268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:17:39.894658 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a9a012b-a192-47e0-8e46-e681d6017a2b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.968492 Oct 24 09:17:39.895859 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2805/5400] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:17:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:17:39.901088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:39.902201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:39.909215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:39.910025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:39.910695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:39.911976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:39.914860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:39.915842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:40.161209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:40.173576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:40.175882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:40.178357 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65acff8f-0700-4286-94a0-807f48d4a075 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1584 microversion: 2.32 time: 0.280330 Oct 24 09:17:40.189432 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2806/5401] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:39 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1584 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:40.192532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:40.201351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:40.214347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:40.216058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:40.218291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:40.220458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:40.222070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:40.223071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:40.407592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:40.423179 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e56f86df-6127-4269-9adf-ebf26dc9d396 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1267 microversion: 2.1 time: 0.241491 Oct 24 09:17:40.433850 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2807/5402] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:40 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:40.440904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37898fa8-03d0-439c-9476-2fa10c6c4e52 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:40.441561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37898fa8-03d0-439c-9476-2fa10c6c4e52 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:40.502645 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:40.645777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37898fa8-03d0-439c-9476-2fa10c6c4e52 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:40.663315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37898fa8-03d0-439c-9476-2fa10c6c4e52 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1236 microversion: 2.1 time: 0.228312 Oct 24 09:17:40.685550 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2808/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:40 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1236 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:40.704213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:40.706645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:40.717654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:40.718161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:40.718604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:40.719323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:40.719786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:40.720218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:40.830324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a356f59-131d-4c11-94ea-f73d53d57d93 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139287 Oct 24 09:17:40.831522 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2809/5404] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:40 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:41.223532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:41.225680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:41.269712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.270857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.272888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.276063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.277859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.279223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.441621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.456451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.463416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.464797 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42bb2d58-4f7b-4261-8bed-86a4d98d0696 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1594 microversion: 2.32 time: 0.252805 Oct 24 09:17:41.469857 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2810/5405] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:41 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1594 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:41.480677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:41.483649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:41.498884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.502990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.504432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.505499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.509211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.509886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.616855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.651133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.673133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.681666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbfa3843-fba7-488b-8f56-510f7ffdbedf tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 2.010904 Oct 24 09:17:41.682330 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2596/5406] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:39 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:41.712990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:41.720458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:41.761055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.766963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.771067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.779322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.779939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.784411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.839854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:41.857899 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c630b289-5406-4f1a-ab1b-47a2b58b935c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.385946 Oct 24 09:17:41.862770 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2811/5407] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:41 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:41.883052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:41.893736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:41.918818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.921925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.922501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.929590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:41.932582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:41.933325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:41.993418 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:42.042740 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aaa949f9-8033-4df6-b5cc-b88d69d8e87c tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175823 Oct 24 09:17:42.048907 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2812/5408] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:41 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:42.182405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:42.192415 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9b9fffe-0d71-4901-840f-96790185e4ed tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1232 microversion: 2.1 time: 0.499560 Oct 24 09:17:42.205393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2597/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:41 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1232 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:42.497068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:42.497879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:42.518271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:42.519375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:42.519840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:42.522259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:42.522622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:42.523059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:42.714410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:42.718077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:42.730488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:42.739905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:42.741601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:42.743194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:42.745179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:42.745696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:42.764711 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:42.804467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:42.816064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:42.835274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:42.839488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ded44b3-a6dc-48b1-92bb-0e7b7367c42e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1594 microversion: 2.32 time: 0.347077 Oct 24 09:17:42.857520 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2813/5410] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:42 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1594 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:42.899193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:42.900072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:42.908773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:42.912437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:42.913277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:42.915575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:42.918313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:42.919159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:43.204685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:43.214144 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bd9f7a2-6d5c-4e15-ac96-907899958898 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.328612 Oct 24 09:17:43.214924 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2814/5411] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:42 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:43.221562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:43.224426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:43.231502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:43.232307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:43.232966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:43.233909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:43.234671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:43.235307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:43.270217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a4659af-bf44-4846-adcd-e84c8c7a1a07 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053912 Oct 24 09:17:43.270899 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2815/5412] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:43 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:43.276047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:43.276834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:43.284232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:43.284882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:43.285511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:43.286437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:43.287040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:43.287610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:43.363118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:43.375872 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8530121-7c35-436b-9aef-4abce8a00aa5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1294 microversion: 2.1 time: 0.103423 Oct 24 09:17:43.376648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2816/5413] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:43 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:43.485957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:43.496200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:43.498641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:43.501723 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8312c2c7-4313-4c35-9c22-9ad4a5a86216 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1740 microversion: 2.20 time: 0.790875 Oct 24 09:17:43.518281 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2598/5414] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:42 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1740 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:43.889318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:43.890590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:43.901916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:43.905235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:43.906103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:43.907057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:43.908618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:43.911281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.046973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.058641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.060363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.061897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-455f955c-68b7-41f3-964e-0b47d2237d9a tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1594 microversion: 2.32 time: 0.177960 Oct 24 09:17:44.062958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2817/5415] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:43 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:44.241703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:44.243016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:44.253603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.254135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.256674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.258195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.259840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.266638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.282645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:44.285651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:44.298497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.299112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.305349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.306495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.307224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.307955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.364779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dab53418-15ec-4bca-b172-8fca7bcd59b3 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085997 Oct 24 09:17:44.371339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2818/5416] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:44 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:17:44.407040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:44.412914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:44.430933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.431453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.437153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.438033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.438448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.440056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.557565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.567361 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c0704620-20a0-4fdc-b81c-6c0ee350c5b9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1294 microversion: 2.1 time: 0.167945 Oct 24 09:17:44.597848 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2819/5417] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:44 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1294 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:44.603445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:44.604453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:44.611543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.612996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.614168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.615254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:44.615926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:44.616569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:44.737722 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:44.759967 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:44.791766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.802567 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dcba35d3-4337-442c-8579-2f33aecf2afb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.564657 Oct 24 09:17:44.821762 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2599/5418] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:44 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:44.919504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.933397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.938852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:44.940833 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de9837ec-f923-498a-8831-d7f92b6cc0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1722 microversion: 2.20 time: 0.341225 Oct 24 09:17:44.955037 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2820/5419] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:44 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:45.067687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0bddde8b-054b-43ad-8bb3-f39af6533e36 req-35d73b20-1a76-4301-b2a7-57612ce7e5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "498439cf-dddd-4c7a-aba9-7b1f5dc112e9", "tag": "84df550e-5205-4306-9d97-1bbf14738b80"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:45.080448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0bddde8b-054b-43ad-8bb3-f39af6533e36 req-35d73b20-1a76-4301-b2a7-57612ce7e5e5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.081049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0bddde8b-054b-43ad-8bb3-f39af6533e36 req-35d73b20-1a76-4301-b2a7-57612ce7e5e5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.081785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0bddde8b-054b-43ad-8bb3-f39af6533e36 req-35d73b20-1a76-4301-b2a7-57612ce7e5e5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.089281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:45.090372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:45.101343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.101832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.102280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.112605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.114208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.114823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.129418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0bddde8b-054b-43ad-8bb3-f39af6533e36 req-35d73b20-1a76-4301-b2a7-57612ce7e5e5 service nova] Creating event network-changed:84df550e-5205-4306-9d97-1bbf14738b80 for instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 on n-h1-master-1 Oct 24 09:17:45.141277 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0bddde8b-054b-43ad-8bb3-f39af6533e36 req-35d73b20-1a76-4301-b2a7-57612ce7e5e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073116 Oct 24 09:17:45.142813 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2600/5420] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:45.345404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:45.356592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:45.361202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:45.363508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-258b8f6e-8318-4914-84ca-9a546a105afa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1662 microversion: 2.32 time: 0.279261 Oct 24 09:17:45.367840 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2821/5421] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:45 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1662 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:45.388559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:45.392893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:45.410965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.413608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.418492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.419954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.420576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.421179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.503194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fd58618-8597-46f1-8bc2-f4e0e652dfdc tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120136 Oct 24 09:17:45.503804 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2601/5422] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:45 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:45.595455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:45.596657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:45.607551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.607981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.608419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.609119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.609608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.610032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.788293 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:45.798041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ac96d4f-13f0-4b4c-acd6-24c0bb7d93c1 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.207094 Oct 24 09:17:45.814213 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2822/5423] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:45 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:45.831745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:45.832572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:45.837079 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:45.852683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.853517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.855546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.856554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.857858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.858511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.970885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:45.972280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:45.979329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.980138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.980794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:45.982285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:45.983577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:45.984223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.080457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.089759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f9acf96-631a-4e04-a79f-a3e13e4c9bf0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.263694 Oct 24 09:17:46.090331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2602/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:45 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:46.173900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.183852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.186111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.187393 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b7ff5f2-d4f8-4528-a46f-ea5d6d652dec tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1722 microversion: 2.20 time: 0.221328 Oct 24 09:17:46.188414 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2823/5425] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:45 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:46.398217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:46.398836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:46.408473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:46.408921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:46.409392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.410103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:46.410572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:46.422217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.518652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:46.521989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:46.529796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:46.530535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:46.530978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.531913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:46.532626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:46.533212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.625720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-177f9586-1118-44cb-a345-495def9a5f8e tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113673 Oct 24 09:17:46.627060 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2824/5426] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:46 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:46.823908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:46.824998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:46.838578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:46.839458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:46.840606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.842802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:46.845384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:46.846288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:46.927003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.946865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.948964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:46.950511 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7bcfb2ad-fac7-4db2-a6a5-e37aceb7c03b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1662 microversion: 2.32 time: 0.556647 Oct 24 09:17:46.951283 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2603/5427] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:46 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1662 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:47.112591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:47.113209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:47.123947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.125708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.127135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.128223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.129962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.132903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.673408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:47.682780 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43903a21-8a08-4022-8735-d4f4246fc643 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.864179 Oct 24 09:17:47.705098 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2825/5428] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:46 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:47.713257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:47.715397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:47.725510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.726789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.727323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.728379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.729068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.729624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.729921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:47.747522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac451c7d-6ec5-4481-9c83-d4bee33e8d44 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.638545 Oct 24 09:17:47.757600 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2604/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:47 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:47.769059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3167587c-df5c-4af6-b3ca-03a875bcbd51 req-5538d2f5-5c87-4595-90cc-5b44ef39a8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb71e8c-110f-4129-b6cb-05d7422a5083", "tag": "41e1b855-88ab-4cd5-8e94-eacac4a681ea"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:47.792032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3167587c-df5c-4af6-b3ca-03a875bcbd51 req-5538d2f5-5c87-4595-90cc-5b44ef39a8a3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.795624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3167587c-df5c-4af6-b3ca-03a875bcbd51 req-5538d2f5-5c87-4595-90cc-5b44ef39a8a3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.796308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3167587c-df5c-4af6-b3ca-03a875bcbd51 req-5538d2f5-5c87-4595-90cc-5b44ef39a8a3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.835802 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3167587c-df5c-4af6-b3ca-03a875bcbd51 req-5538d2f5-5c87-4595-90cc-5b44ef39a8a3 service nova] Creating event network-changed:41e1b855-88ab-4cd5-8e94-eacac4a681ea for instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 on n-h2-master-1 Oct 24 09:17:47.844743 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3167587c-df5c-4af6-b3ca-03a875bcbd51 req-5538d2f5-5c87-4595-90cc-5b44ef39a8a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092063 Oct 24 09:17:47.845672 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2605/5430] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:47.853640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:47.856001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:47.873637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.874125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.878499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.884739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.885413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.886092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.953682 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c7a8ba4-2000-4c75-b3e6-4ef846ddfb6d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106721 Oct 24 09:17:47.956039 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2606/5431] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:17:47 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:17:47.979858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:47.980567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:47.989439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.992050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.993550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:47.994368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:47.996523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:47.996643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:47.997109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.021666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:48.023966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:48.025187 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e8fa977-d487-4ed4-8056-b6a210b1c397 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1665 microversion: 2.20 time: 0.318723 Oct 24 09:17:48.025808 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2826/5432] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:47 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1665 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:48.055122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99e5343b-e900-4cf3-a3e8-17c37ced0971"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:48.057923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:48.064772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.065540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.066143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.066852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.067313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.067744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.349423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:48.378587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:48.382550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:48.383784 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84132789-875a-4bb8-877c-3f1b6f7cb672 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1662 microversion: 2.32 time: 0.408211 Oct 24 09:17:48.384356 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2607/5433] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:47 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1662 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:48.403483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:48.405262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:48.425711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.426389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.426849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.427593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.428604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.428983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.481164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:17:48.623255 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3554d375-195b-403a-bb64-58be44c67653 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 204 len: 0 microversion: 2.1 time: 0.232282 Oct 24 09:17:48.627086 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2608/5434] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:17:48 2022] DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:17:48.642786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:48.645041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:48.662715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.666561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.667267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.671322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.673244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.675455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.714696 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:48.943181 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d08d4e01-404e-4926-8419-70c23f28d5d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.893472 Oct 24 09:17:48.947501 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2827/5435] 10.222.0.25 () {62 vars in 1364 bytes} [Mon Oct 24 09:17:48 2022] POST /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 188 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:17:48.955405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:48.957174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:48.965595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.966587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.968799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:48.969898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:48.971192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:48.972065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.195786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:49.210132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bbe3fef-6c3a-4d48-a2a8-ca04442fa29c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.260333 Oct 24 09:17:49.221969 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2828/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:48 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:49.233850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:49.237374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:49.248843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.251376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.251979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.252975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.255654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.256520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.486099 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:49.495870 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90b939da-9bcb-4fac-81d1-be02f2e0562b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.272464 Oct 24 09:17:49.496604 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2829/5437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:49 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:49.509417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e6e45f78-2e1e-4f24-8fb7-dbce99f6d796 req-ca774dc1-2187-4074-88e7-2a67969c980a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "name": "network-vif-unplugged", "status": "completed", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:49.548586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e6e45f78-2e1e-4f24-8fb7-dbce99f6d796 req-ca774dc1-2187-4074-88e7-2a67969c980a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.549109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e6e45f78-2e1e-4f24-8fb7-dbce99f6d796 req-ca774dc1-2187-4074-88e7-2a67969c980a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.551062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e6e45f78-2e1e-4f24-8fb7-dbce99f6d796 req-ca774dc1-2187-4074-88e7-2a67969c980a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.592431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_external_events [req-e6e45f78-2e1e-4f24-8fb7-dbce99f6d796 req-ca774dc1-2187-4074-88e7-2a67969c980a service nova] Unable to find a host for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf. Dropping event network-vif-unplugged {{(pid=126920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 09:17:49.595051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e6e45f78-2e1e-4f24-8fb7-dbce99f6d796 req-ca774dc1-2187-4074-88e7-2a67969c980a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.092921 Oct 24 09:17:49.599886 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2830/5438] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 09:17:49.607808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:49.608417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:49.646690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.650611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.651226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.652172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.654286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.655489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.706992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:49.720249 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bbb4a6a4-909d-4702-b73e-7f27cd84c077 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1684 microversion: 2.1 time: 1.088537 Oct 24 09:17:49.738921 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:49.739878 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2609/5439] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:48 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1684 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:49.757710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:49.758559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:49.772423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.773025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.774424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.777354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.779431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.779956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.792623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126920) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 09:17:49.941956 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-827c7d24-5b90-4001-a136-8672daf0b89e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/action" status: 202 len: 0 microversion: 2.20 time: 0.340685 Oct 24 09:17:49.942611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2831/5440] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:17:49 2022] POST /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:17:49.951660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:49.952290 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:49.960458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.961410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.962025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:49.962887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:49.963697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:49.964526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.165908 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.179578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.180378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.185813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.187067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e0a8c4f-9c72-4f49-9358-4e26b76deed3 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1709 microversion: 2.32 time: 0.445871 Oct 24 09:17:50.203008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2610/5441] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:49 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1709 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:50.204794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.206276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.207843 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-906d3972-a97f-4aa6-9601-57b1bfa5427d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1751 microversion: 2.20 time: 0.259984 Oct 24 09:17:50.225918 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2832/5442] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:49 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1751 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:50.238828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:50.239767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:50.251244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:50.252292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:50.252980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.253921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:50.255275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:50.256567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.527331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.534776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:50.535425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:50.539264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23087b79-08f5-4c8c-95be-1b755e3a14ce tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.306297 Oct 24 09:17:50.540390 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2611/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:50 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:50.548448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:50.548936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:50.549395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.559115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:50.561811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:50.562475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.650817 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=24 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:50.755462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:50.756937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:50.766914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:50.767644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:50.771482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.772614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:50.773257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:50.776095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:50.855842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:50.874406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-39b11f51-83fd-417a-afe0-d3746b59eeeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.345867 Oct 24 09:17:50.875549 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2833/5444] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:50 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:51.157965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:51.176113 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2802da8f-1a50-4b07-a3d7-2d3da52cf179 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1684 microversion: 2.1 time: 0.422173 Oct 24 09:17:51.191733 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2612/5445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:50 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1684 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:51.213882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:51.214697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:51.224818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:51.235227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:51.236113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:51.237228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:51.238048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:51.239591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:51.243044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:51.245457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:51.258866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:51.259611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:51.261728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:51.263730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:51.269875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:51.271079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:51.690414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:51.700441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:51.701915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:51.717861 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e09b63da-7e9d-45a2-8804-3e2a71ac4392 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1756 microversion: 2.32 time: 0.508165 Oct 24 09:17:51.718484 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2834/5446] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:51 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1756 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:51.735073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:51.735619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:51.760173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:51.760680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:51.761123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:51.761866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:51.762323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:51.770837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:51.976565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:51.995609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:51.999141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:52.002081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5ff6868-b694-45be-9105-3a863dd0126c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1751 microversion: 2.20 time: 0.767823 Oct 24 09:17:52.026143 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2613/5447] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:51 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1751 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:52.041094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:52.043420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:52.064505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:52.065595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:52.067840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:52.068925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:52.069960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:52.070877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:52.103497 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:52.392988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:52.408160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c87b7e29-e867-4783-b29d-4f2dd4fc2f6c tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.686349 Oct 24 09:17:52.418069 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2835/5448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:51 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:52.423498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:52.426278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:52.444637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:52.451583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:52.452322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:52.453740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:52.454428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:52.455071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:52.703002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:52.714019 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b900ab0b-cfe3-4363-8f1c-4232efb82a57 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.683758 Oct 24 09:17:52.716081 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2614/5449] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:52 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:52.751533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:52.752611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:52.764836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:52.769424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:52.772144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:52.773241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:52.773995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:52.777900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:53.005778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:53.015192 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7cce5c7-3181-43a4-a903-2a31132e12ac tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1684 microversion: 2.1 time: 0.595668 Oct 24 09:17:53.017167 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2836/5450] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:52 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1684 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:53.039907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:53.040524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:53.048151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:53.048608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:53.049203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:53.051186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:53.051799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:53.052928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:53.471861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:53.489877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:53.503864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:53.510354 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d55ed9e-2213-4619-a0d3-47edc48b6308 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1756 microversion: 2.32 time: 0.763238 Oct 24 09:17:53.511338 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2615/5451] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:52 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1756 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:53.534028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:53.539309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:53.565193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:53.577988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:53.578903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:53.579891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:53.584420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:53.586527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.104178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:54.161380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:54.171090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:54.173385 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-142d2c47-7b12-4ea6-8372-f1f8828ddf30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 1.141359 Oct 24 09:17:54.177989 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2837/5452] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:53 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:54.210073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:54.212628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:54.226967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.227465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.227902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.232406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.232963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.236585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.257804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:54.276447 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3383e3ce-13fa-488f-9cdf-2afee30c1220 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.759553 Oct 24 09:17:54.281433 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2616/5453] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:53 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:54.297114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:54.302554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:54.326839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.335001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.336335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.341441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.342177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.349858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.482950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.484713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.485800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.487940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lazy-loading 'fault' on Instance uuid 0c6a3115-d9cf-4c81-8939-f85460b33d46 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:17:54.645452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a170d67efe094c4e8b9267e33e4e476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4098b77de8d4b07853cf61416c0b870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:54.660686 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e9c432b-7735-4561-b95e-0cd40d52175a tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 200 len: 1332 microversion: 2.1 time: 0.375756 Oct 24 09:17:54.661566 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2617/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:54 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 1332 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:54.674989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3a517272-2310-404b-8bf7-92a014036935 req-0d875b0e-7fde-4507-b8a2-c1626e941ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6a3115-d9cf-4c81-8939-f85460b33d46", "name": "network-vif-deleted", "tag": "f6685c4a-5fdc-4435-b950-03f6aa536f1c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:54.696357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3a517272-2310-404b-8bf7-92a014036935 req-0d875b0e-7fde-4507-b8a2-c1626e941ee2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.698823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3a517272-2310-404b-8bf7-92a014036935 req-0d875b0e-7fde-4507-b8a2-c1626e941ee2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.699461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3a517272-2310-404b-8bf7-92a014036935 req-0d875b0e-7fde-4507-b8a2-c1626e941ee2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.714219 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3a517272-2310-404b-8bf7-92a014036935 req-0d875b0e-7fde-4507-b8a2-c1626e941ee2 service nova] Creating event network-vif-deleted:f6685c4a-5fdc-4435-b950-03f6aa536f1c for instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 on n-h2-master-1 Oct 24 09:17:54.720744 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3a517272-2310-404b-8bf7-92a014036935 req-0d875b0e-7fde-4507-b8a2-c1626e941ee2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057844 Oct 24 09:17:54.722077 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2618/5455] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:54.726773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:54.737528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:54.738512 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd2ec352-a2f5-4003-8097-125a0d349d2a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.557496 Oct 24 09:17:54.740957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:54.753321 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2838/5456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:54 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:54.779132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.780360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.782034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:54.782986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:54.784663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:54.787729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.132950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.155843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.160522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.168737 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1f779fe-ec2a-4286-9106-897d88399336 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1803 microversion: 2.32 time: 0.441902 Oct 24 09:17:55.206364 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2619/5457] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:54 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1803 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:55.208420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:55.210261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:55.239694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.242053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.263271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.270343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.271199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.272054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.284755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8b6edc2d-7ed3-4d1d-86cf-299770a8eed9 req-d4c6c52c-0d0e-473c-83f1-1028a8f9cfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498439cf-dddd-4c7a-aba9-7b1f5dc112e9", "name": "network-vif-plugged", "status": "completed", "tag": "84df550e-5205-4306-9d97-1bbf14738b80"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:55.318250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8b6edc2d-7ed3-4d1d-86cf-299770a8eed9 req-d4c6c52c-0d0e-473c-83f1-1028a8f9cfae service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.319154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8b6edc2d-7ed3-4d1d-86cf-299770a8eed9 req-d4c6c52c-0d0e-473c-83f1-1028a8f9cfae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.319823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8b6edc2d-7ed3-4d1d-86cf-299770a8eed9 req-d4c6c52c-0d0e-473c-83f1-1028a8f9cfae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.351524 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8b6edc2d-7ed3-4d1d-86cf-299770a8eed9 req-d4c6c52c-0d0e-473c-83f1-1028a8f9cfae service nova] Creating event network-vif-plugged:84df550e-5205-4306-9d97-1bbf14738b80 for instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 on n-h1-master-1 Oct 24 09:17:55.364871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8b6edc2d-7ed3-4d1d-86cf-299770a8eed9 req-d4c6c52c-0d0e-473c-83f1-1028a8f9cfae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082048 Oct 24 09:17:55.366810 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2620/5458] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:55.382623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:55.383831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:55.398209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.413008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.414614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.417844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.418733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.421613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.683749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.706697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.716835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.725095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d4e3cce-121c-42de-bc59-3b5d2f24e9a9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.522114 Oct 24 09:17:55.727462 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2839/5459] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:55 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:55.744005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:55.745663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:55.776142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.777996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.782427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.788349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.789099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.789894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.825104 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 HTTP/1.1 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0c6a3115-d9cf-4c81-8939-f85460b33d46'} Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:17:55.829451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:17:55.832959 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:17:55.834877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:17:55.838518 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e4b3e1fe-fad0-4320-ab05-37d86a6801c5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 404 len: 111 microversion: 2.1 time: 0.108277 Oct 24 09:17:55.842931 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2840/5460] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:55 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:55.849972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:55.854128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:55.870459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.871005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.871450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.872724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:55.878614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:55.879280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:55.932694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:55.946242 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a35cf1f-f5cf-4372-a4f2-c102940d459b tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.574816 Oct 24 09:17:55.948193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2621/5461] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:55 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:55.955150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25a7fe4c-97a8-48df-af3b-484e0117bed8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '.version_select at 0x7f8da99710d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:56.002716 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25a7fe4c-97a8-48df-af3b-484e0117bed8 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527247174" status: 202 len: 0 microversion: 2.1 time: 0.052723 Oct 24 09:17:56.003731 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2622/5462] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527247174 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:17:56.164422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:56.183293 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-294f3360-8114-4bf1-bb97-b0383525cd18 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1309 microversion: 2.1 time: 0.337816 Oct 24 09:17:56.185881 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2841/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:55 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:56.203501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:56.204401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:56.216320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:56.218759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:56.220035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:56.222436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:56.223207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:56.223681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:56.755528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:56.756413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:56.772843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:56.774737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:56.776508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:56.778941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:56.780159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:56.781169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.106322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.131642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.140555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.143325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec2a85db-1041-4bee-b64d-07d43594c85b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.391574 Oct 24 09:17:57.160644 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2842/5464] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:56 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:57.173475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:57.174118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:57.182084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.182084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.182551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.183273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.183741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.184173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.245571 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:57.453127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.463833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.465262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.478751 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86d3add3-85eb-4941-92ef-dda0a8119ad1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1850 microversion: 2.32 time: 1.280567 Oct 24 09:17:57.479360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2623/5465] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:56 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1850 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:57.487763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:57.489554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:57.497965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.498628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.499842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.500789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.501434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.503084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.696432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.707397 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c038f31-3adb-4188-a2c5-69e51336fae6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 0.545212 Oct 24 09:17:57.710774 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2843/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:57 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:57.726884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2b46a3a5-a6d5-4ea7-97d3-63cc8ef5c35c req-fafc1fc6-4e64-455c-8697-d0c586d7aff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb71e8c-110f-4129-b6cb-05d7422a5083", "name": "network-vif-plugged", "status": "completed", "tag": "41e1b855-88ab-4cd5-8e94-eacac4a681ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:57.746090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b46a3a5-a6d5-4ea7-97d3-63cc8ef5c35c req-fafc1fc6-4e64-455c-8697-d0c586d7aff1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.746592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b46a3a5-a6d5-4ea7-97d3-63cc8ef5c35c req-fafc1fc6-4e64-455c-8697-d0c586d7aff1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.747790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b46a3a5-a6d5-4ea7-97d3-63cc8ef5c35c req-fafc1fc6-4e64-455c-8697-d0c586d7aff1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.748761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:57.761187 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a582e7a9-19d2-44fd-bd3b-1e340d792f29 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1489 microversion: 2.1 time: 0.277941 Oct 24 09:17:57.764583 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2624/5467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:57 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1489 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:57.779006 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2b46a3a5-a6d5-4ea7-97d3-63cc8ef5c35c req-fafc1fc6-4e64-455c-8697-d0c586d7aff1 service nova] Creating event network-vif-plugged:41e1b855-88ab-4cd5-8e94-eacac4a681ea for instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 on n-h2-master-1 Oct 24 09:17:57.787213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-497496491"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:57.790064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:57.793554 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2b46a3a5-a6d5-4ea7-97d3-63cc8ef5c35c req-fafc1fc6-4e64-455c-8697-d0c586d7aff1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076514 Oct 24 09:17:57.796513 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2844/5468] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:57.797937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.799384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.799992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.800897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.801576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.802180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.905822 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9dcd12d5-cd63-45d2-8ddb-9e537ea76368 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "PUT /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1073 microversion: 2.1 time: 0.112961 Oct 24 09:17:57.906918 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2625/5469] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:17:57 2022] PUT /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1073 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:17:57.927054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:57.929782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:57.941534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.943005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.945280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:57.946421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:57.949460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:57.951326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.170974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:58.171830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:58.178867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.179664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.180314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.181227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.181916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.182591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.265729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:58.276042 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65ab66ab-eb80-4c2d-91aa-cf21045d9c58 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1499 microversion: 2.1 time: 0.354019 Oct 24 09:17:58.277336 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2845/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:57 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1499 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:58.299321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:58.300343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:58.308547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.309383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.310061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.310793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.311449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.311915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.461661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:58.474951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:58.478696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:58.481456 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f93f4cac-76eb-4b2e-9910-d1ddd1cfee15 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.313496 Oct 24 09:17:58.485781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2626/5471] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:58 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:17:58.516648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:58.517646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:58.525573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.526486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.527142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.528246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.529356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.534499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.602129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:58.616130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4ae20c6-a19f-4bd2-b576-f45a9291cf19 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1499 microversion: 2.1 time: 0.320545 Oct 24 09:17:58.617226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2846/5472] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:58 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1499 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:17:58.649983 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6f58f89-dcea-40b3-8c54-3de0ed78ebeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:58.658522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f58f89-dcea-40b3-8c54-3de0ed78ebeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.659153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f58f89-dcea-40b3-8c54-3de0ed78ebeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.659700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f58f89-dcea-40b3-8c54-3de0ed78ebeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.696332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6f58f89-dcea-40b3-8c54-3de0ed78ebeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:17:58.786607 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6f58f89-dcea-40b3-8c54-3de0ed78ebeb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "POST /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9/action" status: 202 len: 0 microversion: 2.1 time: 0.143699 Oct 24 09:17:58.789753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2847/5473] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:17:58 2022] POST /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:17:58.800063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:58.801860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:58.815205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.815930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.816381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:58.817474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:58.818066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:58.818554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:59.032755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:59.045033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:59.053686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:17:59.068443 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-577fe9b2-c248-41d2-9941-aca5bdabb5fb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1850 microversion: 2.32 time: 0.561519 Oct 24 09:17:59.070188 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2627/5474] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:17:58 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1850 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:17:59.081713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3e3c1c9c-687f-4a3b-9d96-5b6bac266b4d req-7c9435eb-e55b-4736-8be1-a4e4d4a167eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "f2654d0a-7398-4bc3-bf34-e5064dae3bef"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:17:59.104788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3e3c1c9c-687f-4a3b-9d96-5b6bac266b4d req-7c9435eb-e55b-4736-8be1-a4e4d4a167eb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:59.105645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3e3c1c9c-687f-4a3b-9d96-5b6bac266b4d req-7c9435eb-e55b-4736-8be1-a4e4d4a167eb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:59.106092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3e3c1c9c-687f-4a3b-9d96-5b6bac266b4d req-7c9435eb-e55b-4736-8be1-a4e4d4a167eb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:59.131468 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3e3c1c9c-687f-4a3b-9d96-5b6bac266b4d req-7c9435eb-e55b-4736-8be1-a4e4d4a167eb service nova] Creating event network-changed:f2654d0a-7398-4bc3-bf34-e5064dae3bef for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:17:59.154018 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3e3c1c9c-687f-4a3b-9d96-5b6bac266b4d req-7c9435eb-e55b-4736-8be1-a4e4d4a167eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068815 Oct 24 09:17:59.155041 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2628/5475] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:17:59.165220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:17:59.171746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:17:59.192352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:59.193108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:59.193797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:59.194683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:17:59.195297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:17:59.195912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:17:59.980980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.000371 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b485953-9efd-4b2e-94af-f3e34aa90933 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1362 microversion: 2.1 time: 1.204171 Oct 24 09:18:00.001280 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2848/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:58 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1362 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:00.009565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:00.015177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:00.033377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:00.035216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:00.036680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:00.037812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:00.038598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:00.039253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:00.111010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.120512 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83125bd8-f441-47e2-90ad-853dd939bdfb tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.962945 Oct 24 09:18:00.124794 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2629/5477] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:17:59 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:00.131776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:00.136626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:00.155128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:00.155797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:00.162838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:00.163760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:00.164406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:00.164986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:00.335045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.344758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.346241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.347438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-775cc446-90f7-4869-9b98-947d55613195 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.343274 Oct 24 09:18:00.377824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2849/5478] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:00 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:00.606895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.629637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.631744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:00.633081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-732386f3-fd2d-4cf2-890e-664fc009ce56 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1871 microversion: 2.32 time: 0.507034 Oct 24 09:18:00.633754 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2630/5479] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:00 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1871 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:01.028706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:01.029444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:01.045644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.046394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.047035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.049800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.051277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.052743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.156932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:01.157582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:01.167141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.167640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.168087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.169358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.169825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.170258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.448758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:01.462903 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29e69da0-330e-432a-b65f-303672968f59 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.306514 Oct 24 09:18:01.463768 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2631/5480] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:01 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:01.484291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6a53e3aa-5586-4bc7-9c53-42bc884e10da req-84057d14-8226-4d8b-9568-e69a944effc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "1a3f9d28-fb12-486b-a872-8a508788143b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:01.494056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6a53e3aa-5586-4bc7-9c53-42bc884e10da req-84057d14-8226-4d8b-9568-e69a944effc6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.494537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6a53e3aa-5586-4bc7-9c53-42bc884e10da req-84057d14-8226-4d8b-9568-e69a944effc6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.494965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6a53e3aa-5586-4bc7-9c53-42bc884e10da req-84057d14-8226-4d8b-9568-e69a944effc6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.507971 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6a53e3aa-5586-4bc7-9c53-42bc884e10da req-84057d14-8226-4d8b-9568-e69a944effc6 service nova] Creating event network-changed:1a3f9d28-fb12-486b-a872-8a508788143b for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:18:01.513620 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6a53e3aa-5586-4bc7-9c53-42bc884e10da req-84057d14-8226-4d8b-9568-e69a944effc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038336 Oct 24 09:18:01.514306 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2632/5481] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:01.519385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:01.520081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:01.526409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.526893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.527329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.528020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.528505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.528931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.604746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:01.614302 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a0f62bb-3c44-4436-bf3f-81b859ea96da tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1547 microversion: 2.1 time: 0.589436 Oct 24 09:18:01.616042 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2850/5482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:01 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1547 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:01.641183 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:01.641755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:01.659269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.659789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.660244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.660972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.672036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.672542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.807987 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee7af97b-f690-4656-b574-421c1ea87177 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168952 Oct 24 09:18:01.818925 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2851/5483] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:18:01 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:01.832836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:01.833877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:01.849961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.851997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.852676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.857667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:01.859375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:01.860177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:01.955715 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:01.958838 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:01.978583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:01.980764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:01.982613 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-572b894f-1f10-40a4-b6a0-c0fd5130f331 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.466717 Oct 24 09:18:01.983349 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2633/5484] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:01 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:02.267171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:02.280178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:02.286003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:02.290567 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f0836322-0fcd-4888-bc82-dc828afe7fb6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.470313 Oct 24 09:18:02.291320 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2852/5485] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:01 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:02.490551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:02.491336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:02.505414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:02.506444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:02.507040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:02.508191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:02.508791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:02.509384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:02.852402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:02.860962 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96dd26fc-5170-4237-a442-0f22741e8923 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.374609 Oct 24 09:18:02.876339 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2634/5486] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:02 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:03.015924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:03.016743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:03.029495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.030134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.030589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:03.031308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.031770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.032199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:03.324131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:03.324748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:03.339486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.339987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.340430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:03.342647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.343129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.346861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:03.472129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:03.488032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:03.492221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:03.493589 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d921372-1d1a-4f20-8059-82d8f1c67107 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.483115 Oct 24 09:18:03.496856 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2853/5487] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:03 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:03.589803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-eca0a65c-886b-4252-99e7-b1a2626f555a req-a95d6837-08cb-4885-a491-fe047dac0cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "8ac03a61-fba1-4bce-ac1e-56e52791a4d2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:03.602948 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:03.614637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eca0a65c-886b-4252-99e7-b1a2626f555a req-a95d6837-08cb-4885-a491-fe047dac0cae service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.616506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eca0a65c-886b-4252-99e7-b1a2626f555a req-a95d6837-08cb-4885-a491-fe047dac0cae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.618505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eca0a65c-886b-4252-99e7-b1a2626f555a req-a95d6837-08cb-4885-a491-fe047dac0cae service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:03.650659 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-eca0a65c-886b-4252-99e7-b1a2626f555a req-a95d6837-08cb-4885-a491-fe047dac0cae service nova] Creating event network-changed:8ac03a61-fba1-4bce-ac1e-56e52791a4d2 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:18:03.661903 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-eca0a65c-886b-4252-99e7-b1a2626f555a req-a95d6837-08cb-4885-a491-fe047dac0cae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077095 Oct 24 09:18:03.666318 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2854/5488] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:18:03.687837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:03.698212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:03.699661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:03.701478 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e21f5e5-d55a-443e-9235-e017470b64f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.381268 Oct 24 09:18:03.702059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2635/5489] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:03 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:03.886779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:03.888366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:03.906845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.908261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.911617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:03.913773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:03.914996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:03.916454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:04.057067 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0fb1dd12-e59f-456c-a500-07efbb61f911 req-939f311c-f474-4b9b-8227-3de79e0b14c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb71e8c-110f-4129-b6cb-05d7422a5083", "tag": "41e1b855-88ab-4cd5-8e94-eacac4a681ea"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:04.075492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0fb1dd12-e59f-456c-a500-07efbb61f911 req-939f311c-f474-4b9b-8227-3de79e0b14c5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:04.076849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0fb1dd12-e59f-456c-a500-07efbb61f911 req-939f311c-f474-4b9b-8227-3de79e0b14c5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:04.077463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0fb1dd12-e59f-456c-a500-07efbb61f911 req-939f311c-f474-4b9b-8227-3de79e0b14c5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:04.111866 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0fb1dd12-e59f-456c-a500-07efbb61f911 req-939f311c-f474-4b9b-8227-3de79e0b14c5 service nova] Creating event network-changed:41e1b855-88ab-4cd5-8e94-eacac4a681ea for instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 on n-h2-master-1 Oct 24 09:18:04.122757 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0fb1dd12-e59f-456c-a500-07efbb61f911 req-939f311c-f474-4b9b-8227-3de79e0b14c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068367 Oct 24 09:18:04.123338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:04.123701 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2636/5490] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:04.133174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2597ec07-913a-4ad0-ac37-5fef0484abc3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.250562 Oct 24 09:18:04.136881 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2855/5491] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:03 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:04.523984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:04.524917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:04.538610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:04.539281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:04.540908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:04.544067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:04.544817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:04.546071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:04.727551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:04.728866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:04.740984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:04.742123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:04.742594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:04.743313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:04.743781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:04.744211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:05.064650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.080483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.082279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.083902 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6328398-ae75-43fd-8d0e-4e82bdf52a92 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.564544 Oct 24 09:18:05.085985 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2637/5492] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:04 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:05.116813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.133909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.135280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.136479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e29abe30-72ea-449a-aba5-41ae46c7497b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.412845 Oct 24 09:18:05.159223 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2856/5493] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:04 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:05.171322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:05.171961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:05.185573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:05.186073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:05.186512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:05.187233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:05.187690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:05.188115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:05.608118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:05.621329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c166e7ed-d2c4-4d9c-9191-32625e0299a0 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.457086 Oct 24 09:18:05.633387 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2638/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:05 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:05.706752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cb68cd4c-38ac-4a85-83e9-4b2c4d4840f5 req-ad917838-c128-468c-8bc5-ad362dbd6f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "d9553579-010c-403c-9d62-6db9a95fe868"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:05.721144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cb68cd4c-38ac-4a85-83e9-4b2c4d4840f5 req-ad917838-c128-468c-8bc5-ad362dbd6f2f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:05.721789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cb68cd4c-38ac-4a85-83e9-4b2c4d4840f5 req-ad917838-c128-468c-8bc5-ad362dbd6f2f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:05.722224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cb68cd4c-38ac-4a85-83e9-4b2c4d4840f5 req-ad917838-c128-468c-8bc5-ad362dbd6f2f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:05.738507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cb68cd4c-38ac-4a85-83e9-4b2c4d4840f5 req-ad917838-c128-468c-8bc5-ad362dbd6f2f service nova] Creating event network-changed:d9553579-010c-403c-9d62-6db9a95fe868 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:18:05.745153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cb68cd4c-38ac-4a85-83e9-4b2c4d4840f5 req-ad917838-c128-468c-8bc5-ad362dbd6f2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042593 Oct 24 09:18:05.746269 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2857/5495] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:06.117102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:06.117741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:06.129964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:06.130758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:06.132509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:06.133567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:06.134137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:06.134658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:06.176380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:06.177084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:06.196836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:06.198623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:06.199008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:06.199731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:06.200479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:06.200929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:06.438178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.452360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.459724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.461450 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b10ff9ad-7eeb-467a-91bb-3711cab57324 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.290026 Oct 24 09:18:06.462597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2858/5496] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:06 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:06.521895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.535244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.542905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.557076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ae7225e-1325-40ce-8027-fcef432fc4e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.444851 Oct 24 09:18:06.561085 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2639/5497] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:06 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:06.644829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:06.646056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:06.652571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:06.653644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:06.654089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:06.654799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:06.655259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:06.656005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:06.884459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:06.902999 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-997ded7f-4428-4bff-af03-834eaef94d2e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.261810 Oct 24 09:18:06.904071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2859/5498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:06 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:07.487762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:07.488379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:07.496109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.497125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.497800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.498843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.499453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.500029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.585993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:07.586969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:07.594616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.595406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.596048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.596957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.597528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.598163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.791434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:07.811842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:07.815474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:07.818023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8c36171-d3a9-4817-996c-1b31201a4411 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.235271 Oct 24 09:18:07.820379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2860/5499] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:07 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:07.828211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5b2a474f-bb9c-48bc-8eee-5e0facbff60f req-f65b7536-8789-43fb-ab37-2bb29a6587ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "a059daee-94eb-4c0c-8cdc-1fec361e5564"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:07.842579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5b2a474f-bb9c-48bc-8eee-5e0facbff60f req-f65b7536-8789-43fb-ab37-2bb29a6587ef service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.843325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5b2a474f-bb9c-48bc-8eee-5e0facbff60f req-f65b7536-8789-43fb-ab37-2bb29a6587ef service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.844037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5b2a474f-bb9c-48bc-8eee-5e0facbff60f req-f65b7536-8789-43fb-ab37-2bb29a6587ef service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.856023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5b2a474f-bb9c-48bc-8eee-5e0facbff60f req-f65b7536-8789-43fb-ab37-2bb29a6587ef service nova] Creating event network-changed:a059daee-94eb-4c0c-8cdc-1fec361e5564 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:18:07.861758 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5b2a474f-bb9c-48bc-8eee-5e0facbff60f req-f65b7536-8789-43fb-ab37-2bb29a6587ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039169 Oct 24 09:18:07.862928 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2861/5500] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:07.927515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:07.929067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:07.941492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.942693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.943354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.944958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:07.945932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:07.947224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:07.953479 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:08.001013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:08.015389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:08.017244 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:08.019821 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dfa9590a-4e8e-423f-9683-f6549e15889e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.535933 Oct 24 09:18:08.021084 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2640/5501] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:07 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:08.204088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:08.213694 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1f8c5ac-cf92-4a86-9dad-d1f8ab4a9672 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.290259 Oct 24 09:18:08.229442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2862/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:07 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:08.850135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:08.851598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:08.860719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:08.861686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:08.862488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:08.863655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:08.864458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:08.865148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:09.048439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:09.050678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:09.060846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:09.061601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:09.062284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:09.063583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:09.064617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:09.065053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:09.116798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.128123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.129965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.132127 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a271d90d-7f9b-4195-8ecd-4e4546c9d222 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.286061 Oct 24 09:18:09.133687 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2641/5503] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:08 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:09.245432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:09.248118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:09.258755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:09.259367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:09.260148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:09.260986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:09.261585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:09.262119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:09.385531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.402981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.407856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.411426 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8fe1be48-60dd-4288-9ade-a5d88c689d8c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.364911 Oct 24 09:18:09.413163 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2863/5504] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:09 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:09.619527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:09.640776 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42c34222-ef77-44ea-8510-a7df9dd46c6b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.407531 Oct 24 09:18:09.645552 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2642/5505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:09 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:09.901878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "0dece821-1750-4813-947a-1f748a9717a6"}, {"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "d0a63b4a-baa5-4f88-b08b-25c1ebccec31"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:09.917053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:09.918715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:09.919434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:09.935567 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] Creating event network-changed:0dece821-1750-4813-947a-1f748a9717a6 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:18:09.936578 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] Creating event network-changed:d0a63b4a-baa5-4f88-b08b-25c1ebccec31 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:18:09.943789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-05422ce9-1975-4bc5-a9d8-1b48f2a34ebc req-f13f9e90-5a3a-4695-b7ef-e262b017da16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047653 Oct 24 09:18:09.946684 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2864/5506] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:10.167555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:10.169912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:10.192202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:10.198656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:10.199340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:10.200745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:10.201322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:10.202066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:10.443261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:10.443987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:10.457654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:10.458344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:10.458887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:10.459626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:10.460102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:10.462171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:10.566578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:10.577004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:10.579561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:10.590866 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c48fe221-d12e-48a1-b3fc-180b68a4b2fb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.427201 Oct 24 09:18:10.606941 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2643/5507] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:10 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:10.673745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:10.674538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:10.686334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:10.687139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:10.687766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:10.694568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:10.695306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:10.695961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:10.820689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:10.831327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:10.832968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:10.834371 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca2fc8f1-f50f-4569-8961-af4309348c83 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.396714 Oct 24 09:18:10.835418 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2865/5508] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:10 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:11.021152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:11.032769 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-50454181-5d24-4a76-8188-72d8ed1a039f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.364782 Oct 24 09:18:11.033393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2644/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:10 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:11.625030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:11.626242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:11.645000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:11.645527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:11.645972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:11.646684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:11.647140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:11.647563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:11.863352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:11.863963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:11.875772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:11.879371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:11.881268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:11.885629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:11.886307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:11.888865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:12.171385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.185155 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.195014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.196245 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3395ea8-e3ed-4dd6-823c-517a5f8268dd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1753 microversion: 2.20 time: 0.576119 Oct 24 09:18:12.196809 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2866/5510] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:11 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1753 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:12.207519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:12.208286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:12.217526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:12.222398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:12.227836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:12.228802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:12.230783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:12.231999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:12.549882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.570371 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.575452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.577661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac18cf6c-6d14-41f1-b399-6cbc80effdf1 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.718647 Oct 24 09:18:12.580787 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2645/5511] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:11 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:12.895877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:12.911278 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16609200-83f9-4757-85df-96e62dddbf07 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.712768 Oct 24 09:18:12.927743 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2867/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:12 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:13.028699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:13.029220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:13.042516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.043222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.045136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.046676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.050321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.051108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.091547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 HTTP/1.1 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '0c6a3115-d9cf-4c81-8939-f85460b33d46'} Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:13.097527 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.101833 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.105767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:13.108012 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ab6903f-9524-4504-b4da-9dbcfa9ae171 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 404 len: 111 microversion: 2.1 time: 0.084528 Oct 24 09:18:13.110296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2646/5513] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:13 2022] DELETE /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:13.120453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:13.121276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 0c6a3115-d9cf-4c81-8939-f85460b33d46] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:13.134789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.135312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.135764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.138951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.143083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.143536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.189239 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 HTTP/1.1 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0c6a3115-d9cf-4c81-8939-f85460b33d46'} Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:13.191977 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. Oct 24 09:18:13.197953 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:13.218304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 0c6a3115-d9cf-4c81-8939-f85460b33d46 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:13.221071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee528096-63e0-4c1f-a5ad-463324befdd5 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46" status: 404 len: 111 microversion: 2.1 time: 0.105399 Oct 24 09:18:13.224974 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2868/5514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:13 2022] GET /compute/v2.1/servers/0c6a3115-d9cf-4c81-8939-f85460b33d46 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:13.236236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:13.236865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:13.245514 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:13.254685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.255114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.255588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.256543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.257015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.257455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.612879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:13.613540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:13.629519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.630012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.634395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:13.639082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:13.647257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:13.647717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:14.545946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:14.577662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:14.579240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:14.580521 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e19aeba3-6ebd-4480-9017-e547e34d32e2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.971615 Oct 24 09:18:14.592898 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2869/5515] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:13 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:14.636598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:14.639044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:14.663263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:14.664010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:14.664457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:14.665465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:14.667475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:14.668337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:15.427499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:15.442293 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34930929-aa52-48da-b149-4c4ccae9cdd4 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.848178 Oct 24 09:18:15.442892 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2870/5516] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:14 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:15.522917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:15.560956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:15.562539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:15.567854 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-532ddfa6-4614-4925-a1d3-6cd25055d7ce tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 2.335391 Oct 24 09:18:15.569873 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2647/5517] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:13 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:15.611810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:15.612611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:15.624256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:15.624685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:15.625138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:15.625894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:15.626360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:15.626832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:16.435849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:16.470959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:16.473159 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:16.495271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:16.501260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:16.522972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:16.523592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:16.524236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:16.524695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:16.525128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:16.531961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:16.533494 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa02d530-c50e-409d-bd13-54a698032cfc tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.926393 Oct 24 09:18:16.544043 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2871/5518] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:15 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:16.613141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:16.616329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:16.631943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:16.632465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:16.632986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:16.635905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:16.636765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:16.641006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:17.638539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:17.656798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:17.660928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:17.662374 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-513b637a-85ed-4c19-b749-4eaa37b55ccc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 1.060467 Oct 24 09:18:17.665489 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2872/5519] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:16 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:17.665884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:17.677432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:17.678705 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:17.679939 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83f14199-6d8d-4df7-91a7-af85ce780e5c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 1.213180 Oct 24 09:18:17.693038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:17.694602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:17.695676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:17.697929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:17.699905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:17.700017 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2648/5520] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:16 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:17.702041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:18.413374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:18.429774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:18.433987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:18.435278 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a28165a-bdbb-4d4b-895e-30b5cbc43c3b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.768692 Oct 24 09:18:18.436220 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2873/5521] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:17 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:18.566166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3d0a9696-91a4-419e-8ce1-c77f0f3e3ecf req-6794713c-4ec6-4fb3-8363-f7f81b7d54f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:18.584570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d0a9696-91a4-419e-8ce1-c77f0f3e3ecf req-6794713c-4ec6-4fb3-8363-f7f81b7d54f3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:18.585148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d0a9696-91a4-419e-8ce1-c77f0f3e3ecf req-6794713c-4ec6-4fb3-8363-f7f81b7d54f3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:18.585629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d0a9696-91a4-419e-8ce1-c77f0f3e3ecf req-6794713c-4ec6-4fb3-8363-f7f81b7d54f3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:18.613154 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3d0a9696-91a4-419e-8ce1-c77f0f3e3ecf req-6794713c-4ec6-4fb3-8363-f7f81b7d54f3 service nova] Creating event network-changed:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h2-master-1 Oct 24 09:18:18.626512 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3d0a9696-91a4-419e-8ce1-c77f0f3e3ecf req-6794713c-4ec6-4fb3-8363-f7f81b7d54f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064031 Oct 24 09:18:18.627440 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2649/5522] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:18.696214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:18.696974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:18.709031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:18.709781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:18.723757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:18.724186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:18.724632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:18.725365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:18.735690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:18.736781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:18.740387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:18.740850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:18.741750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:18.742548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:18.743020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:18.743450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:19.039208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.055027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.057480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.059904 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7d13065-93ac-48ad-aa79-992953855994 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.367917 Oct 24 09:18:19.061353 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2874/5523] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:18 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:19.464298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:19.465217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:19.474853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:19.477758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:19.478560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:19.479719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:19.482549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:19.483188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:19.591906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.600164 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a41ab6d2-33eb-4090-9384-f831c3f38f4a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.896292 Oct 24 09:18:19.600675 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2650/5524] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:18 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:19.769936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.783198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.786874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:19.788775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9d18bb15-c136-4ec4-9356-43f6b586aeb5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.328475 Oct 24 09:18:19.791496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2875/5525] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:19 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:20.088267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:20.088697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:20.101593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:20.102342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:20.102796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:20.103510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:20.103963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:20.104389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:20.612832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:20.628333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:20.628519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:20.629501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:20.630115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:20.633874 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e1a0a50-7d87-4da0-a3f6-5b453b2683f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.549690 Oct 24 09:18:20.634465 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2651/5526] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:20 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:20.649474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:20.649474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:20.650254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:20.651241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:20.651922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:20.654141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:20.822432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:20.823047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:20.839377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:20.839860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:20.840842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:20.841591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:20.842049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:20.842534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:20.894301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:20.896261 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:20.908354 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cc963eb-2510-412e-9c7b-47bce500e7c3 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 0.281079 Oct 24 09:18:20.926869 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2876/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:20 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:21.671603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:21.672662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:21.688196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:21.690255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:21.693873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:21.695446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:21.696249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:21.698166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:21.726851 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:21.750843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:21.752722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:21.755020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24fa68e3-7424-43fb-9c6f-7e5fee9dc463 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.936304 Oct 24 09:18:21.766113 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2652/5528] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:20 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:21.942034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:21.944139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:21.965991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:21.970921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:21.971311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:21.975196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:21.979914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:21.980436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:22.030565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:22.044129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:22.049765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:22.054269 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f02c5d85-a046-4598-9d96-6fc6f2d09e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.387634 Oct 24 09:18:22.055491 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2877/5529] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:21 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:22.674356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:22.674890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:22.682383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:22.682879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:22.683321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:22.709680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:22.710283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:22.711214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:22.751780 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 HTTP/1.1 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9c9435d5-d687-47fa-a450-b70a41159ef7'} Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:22.767015 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.771905 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.773717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:22.775377 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dbf45955-b2ad-44fe-91f2-d664e2598cbd tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 404 len: 111 microversion: 2.1 time: 0.104821 Oct 24 09:18:22.776789 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2878/5530] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:22 2022] DELETE /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:18:22.789261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:22.790285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9c9435d5-d687-47fa-a450-b70a41159ef7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:22.807589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:22.808304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:22.809610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:22.810518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:22.811134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:22.811922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:22.838271 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 HTTP/1.1 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9c9435d5-d687-47fa-a450-b70a41159ef7'} Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:22.849054 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. Oct 24 09:18:22.853654 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:22.855028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 9c9435d5-d687-47fa-a450-b70a41159ef7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:22.857051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00d4d72f-53fa-46c3-986d-a736d130f56d tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7" status: 404 len: 111 microversion: 2.1 time: 0.075673 Oct 24 09:18:22.874597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2879/5531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:22 2022] GET /compute/v2.1/servers/9c9435d5-d687-47fa-a450-b70a41159ef7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:18:22.887693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:22.888760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:22.907385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:22.917972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:22.918781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:22.920319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:22.920981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:22.921787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.369285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:23.389985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:23.391495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:23.392746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3cb95008-0731-47d4-84d4-e029294d625c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.516804 Oct 24 09:18:23.405759 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2880/5532] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:22 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:23.426395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:23.427153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:23.444955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:23.445754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:23.446377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.447302 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:23.447918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:23.448553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.475994 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 HTTP/1.1 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9fc7944c-aa41-4bfa-9fdd-989138db06a2'} Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:23.478507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.483058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.484768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:23.492841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba3169cf-ac4a-44ec-993e-c53cb8f894a9 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 404 len: 111 microversion: 2.1 time: 0.080089 Oct 24 09:18:23.494073 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2881/5533] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:23 2022] DELETE /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:23.504111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:23.504965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:23.517773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:23.523076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:23.523895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.525740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:23.526439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:23.527112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.536952 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:23.902261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:23.920460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:23.922310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:23.924044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfb7b54b-6800-460a-9e96-e4207dcf1b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.428843 Oct 24 09:18:23.924843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2882/5534] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:23 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:23.929759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:23.936948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 9fc7944c-aa41-4bfa-9fdd-989138db06a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:23.955119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:23.955981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:23.956649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.957661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:23.958347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:23.958999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:23.992267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 HTTP/1.1 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9fc7944c-aa41-4bfa-9fdd-989138db06a2'} Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:23.997916 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. Oct 24 09:18:24.001699 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:24.003066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 9fc7944c-aa41-4bfa-9fdd-989138db06a2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:24.014590 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-784bb11e-8d76-4728-9ca4-589145c04ced tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2" status: 404 len: 111 microversion: 2.1 time: 0.088199 Oct 24 09:18:24.015761 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2883/5535] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:23 2022] GET /compute/v2.1/servers/9fc7944c-aa41-4bfa-9fdd-989138db06a2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:24.423209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:24.423958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:24.434293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:24.437591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:24.438477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:24.440747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:24.441660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:24.442787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:24.581570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:24.592131 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb0cdb52-3f39-4fb0-a592-737052c215f9 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1509 microversion: 2.1 time: 2.659044 Oct 24 09:18:24.594315 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2653/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:21 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1509 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:24.956335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:24.957196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:24.965260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:24.967577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:24.968104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:24.968553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:24.969310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:24.969782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:24.970213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:24.986486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:24.988927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:24.991339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ca06c70-1f1c-436e-80ee-048d176d180f tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.571637 Oct 24 09:18:24.992116 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2884/5537] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:24 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:25.624083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:25.624794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:25.635253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:25.635693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:25.644026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:25.666043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:25.668080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:25.670430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:25.740402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:25.759889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:25.761762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:25.765273 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dabe5971-444e-4ab4-8fbe-0e6191c5f913 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.812780 Oct 24 09:18:25.767262 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2654/5538] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:24 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:26.023052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:26.023644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:26.024144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:26.042715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.043765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.044313 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-374fa4f4-0353-4ccf-b8f2-265b8d07105f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1486 microversion: 2.1 time: 0.424926 Oct 24 09:18:26.046760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.054437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.055494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.056593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.063914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2885/5539] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:25 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1486 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:26.073535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-418916243"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:26.076557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:26.084665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.085452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.086196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.087446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.088823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.089550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.246550 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a75fd54-a5e5-49af-8c9d-5220a925de53 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "PUT /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1059 microversion: 2.1 time: 0.175919 Oct 24 09:18:26.260338 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2886/5540] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:18:26 2022] PUT /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1059 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:26.275899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:26.276790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:26.286056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.286967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.287564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.288537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.289317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.291186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.750997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:26.772179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:26.780866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:26.782691 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6247dd6e-067d-4764-a387-4db2fe1f3053 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1486 microversion: 2.1 time: 0.511066 Oct 24 09:18:26.784364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:26.793431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2887/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:26 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1486 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:26.802895 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c0e3e16-f856-4d2e-a80e-943b7685aaf7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.784286 Oct 24 09:18:26.805760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:26.806393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:26.807386 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2655/5542] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:26 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:26.819714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:26.826487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:26.831428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.831946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.832397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.833129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.833617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.834052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.855087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.857222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.857907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:26.858875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:26.865989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:26.867472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:27.334032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:27.352114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:27.354239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:27.356160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8125768-1512-43ae-a630-8c814db7c51e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.559057 Oct 24 09:18:27.359150 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2888/5543] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:26 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:27.581439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:27.594021 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ef53a4f-c95e-4257-95d3-7d76c1baef2c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1486 microversion: 2.1 time: 0.785255 Oct 24 09:18:27.603208 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2656/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:26 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1486 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:27.631173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:27.632148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:27.647779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:27.650820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:27.651504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:27.654843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:27.656175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:27.656913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:27.769004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:18:27.934299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:27.969884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:27.988978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:27.989929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:27.993934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:27.995495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:28.013329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:28.014750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:28.161691 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ad45929-c529-40ac-95d0-f6f8a9b1138c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 204 len: 0 microversion: 2.1 time: 0.533788 Oct 24 09:18:28.166817 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2889/5545] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:27 2022] DELETE /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:18:28.189271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:28.190296 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:28.204303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:28.205171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:28.209038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:28.210161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:28.210915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:28.211574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:28.681599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:28.691515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:28.692378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:28.695907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:28.698826 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d0796e9-644c-4ce8-babd-783f3db7e670 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 0.782760 Oct 24 09:18:28.715473 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3318fd1-f129-4e70-a821-0b4dbcac471b tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1492 microversion: 2.1 time: 0.528532 Oct 24 09:18:28.718666 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2657/5546] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:27 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:28.726118 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2890/5547] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:28 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1492 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:28.731109 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:28.736150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:28.750558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:28.751411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:28.752032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:28.755865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:28.756797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:28.757772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:29.264963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:29.287467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:29.289011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:29.290275 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73b16ce6-e59b-49c9-9fae-84fa934ab51c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.570274 Oct 24 09:18:29.317358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2658/5548] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:28 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:29.756237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:29.757122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:29.760086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:29.761469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:29.800792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:29.801993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:29.804953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:29.805704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:29.808056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:29.809158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:29.811396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:29.811833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:29.815179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:29.815894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:29.816983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:29.817701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:30.293381 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:30.307337 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f218c066-f634-420f-b9bf-be60943961ac tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1492 microversion: 2.1 time: 0.581036 Oct 24 09:18:30.307337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2891/5549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:29 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1492 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:30.334432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:30.335057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:30.354310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:30.354855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:30.355360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:30.364276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:30.366972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:30.370166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:30.732843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:30.756413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:30.758015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:30.772736 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50f0e387-11a0-4fc6-9434-03eab5651507 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.442444 Oct 24 09:18:30.791178 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2892/5550] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:30 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:31.340363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:31.341232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:31.363821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:31.370741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:31.383209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:31.385240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:31.396920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:31.407893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:31.436152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:31.595182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:31.599398 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:31.612283 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6d63a20-cd87-4a9b-a907-4d1cb470365e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1892 microversion: 2.32 time: 1.879107 Oct 24 09:18:31.621391 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2659/5551] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:29 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1892 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:31.642495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6c129f88-186a-4d86-825a-4c444805dfdb req-96360f35-366a-40c1-beaa-cf3e9145f39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498439cf-dddd-4c7a-aba9-7b1f5dc112e9", "name": "network-vif-deleted", "tag": "84df550e-5205-4306-9d97-1bbf14738b80"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:31.693139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6c129f88-186a-4d86-825a-4c444805dfdb req-96360f35-366a-40c1-beaa-cf3e9145f39e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:31.704446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6c129f88-186a-4d86-825a-4c444805dfdb req-96360f35-366a-40c1-beaa-cf3e9145f39e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:31.705272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6c129f88-186a-4d86-825a-4c444805dfdb req-96360f35-366a-40c1-beaa-cf3e9145f39e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:31.760963 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6c129f88-186a-4d86-825a-4c444805dfdb req-96360f35-366a-40c1-beaa-cf3e9145f39e service nova] Creating event network-vif-deleted:84df550e-5205-4306-9d97-1bbf14738b80 for instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 on n-h1-master-1 Oct 24 09:18:31.790912 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6c129f88-186a-4d86-825a-4c444805dfdb req-96360f35-366a-40c1-beaa-cf3e9145f39e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167855 Oct 24 09:18:31.791533 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2660/5552] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:31.838628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:31.847144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:31.883990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:31.884513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:31.884943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:31.885691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:31.886143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:31.887165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:32.474872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:32.492709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:32.495613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:32.499646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39105f82-497c-4c8d-85ce-79f82f321340 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.687319 Oct 24 09:18:32.529328 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2661/5553] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:31 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:32.653541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:32.654540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:32.672053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:32.672445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:32.673129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:32.677357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:32.680717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:32.681528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:32.942257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:32.957658 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a45f7cf2-9492-4fe2-9073-5bda8bb3a198 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 200 len: 1450 microversion: 2.1 time: 1.621387 Oct 24 09:18:32.977030 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2893/5554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:31 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 1450 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:18:33.238512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:33.257891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:33.271272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:33.273927 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1508d29c-b87b-4a38-a00c-0c1400373ffe tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.626542 Oct 24 09:18:33.295297 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2662/5555] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:32 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:33.542108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:33.543887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:33.573204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:33.584968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:33.589197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:33.660589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:33.665675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.072s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:33.677124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:33.988886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:33.990185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:34.025222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.042532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.046346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.052814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.054448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.060038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.137659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 HTTP/1.1 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '498439cf-dddd-4c7a-aba9-7b1f5dc112e9'} Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.145182 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.151347 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.159881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:34.161658 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b19098d-7889-421a-a79b-6ad821ed58d6 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 404 len: 111 microversion: 2.1 time: 0.177438 Oct 24 09:18:34.162919 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2663/5556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:33 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:34.243566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:34.250166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:34.287106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.292051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.292937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.300706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.304924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.306476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.367914 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 HTTP/1.1 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '498439cf-dddd-4c7a-aba9-7b1f5dc112e9'} Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:34.371597 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.375337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.377775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:34.378797 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a7c06dac-05af-4d0f-bd49-d50564627be2 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 404 len: 111 microversion: 2.1 time: 0.159911 Oct 24 09:18:34.382939 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2664/5557] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:34 2022] DELETE /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:34.405188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:34.406385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:34.437644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.448153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.448836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.450453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.451148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.456885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.586939 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:34.611337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:34.641163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:34.650954 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-023fd4e5-bb98-4b1c-99a5-675e64e32701 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 1.113339 Oct 24 09:18:34.676330 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2894/5558] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:33 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:34.691005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:34.695284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 498439cf-dddd-4c7a-aba9-7b1f5dc112e9] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:34.730691 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:34.752444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.752975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.764891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.765721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.767185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.767788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.850795 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 HTTP/1.1 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '498439cf-dddd-4c7a-aba9-7b1f5dc112e9'} Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.857921 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. Oct 24 09:18:34.863497 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.865104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 498439cf-dddd-4c7a-aba9-7b1f5dc112e9 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:34.866334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3832416e-98c2-423c-823b-69a51ddd493f tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9" status: 404 len: 111 microversion: 2.1 time: 0.186939 Oct 24 09:18:34.872683 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2895/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:34 2022] GET /compute/v2.1/servers/498439cf-dddd-4c7a-aba9-7b1f5dc112e9 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:34.885275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:34.889555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:34.903644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.906779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.907459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.908405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:34.909821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:34.910490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:34.951671 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed HTTP/1.1 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '687cf129-e7e4-4f2d-a302-38a93ae49aed'} Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:34.953745 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:34.957378 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:34.969620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:34.972729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-478baac7-d3d5-485f-b9ce-054500dbcc6c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 404 len: 111 microversion: 2.1 time: 0.096790 Oct 24 09:18:34.978343 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2896/5560] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:34 2022] DELETE /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:34.993680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.000510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 687cf129-e7e4-4f2d-a302-38a93ae49aed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.018614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.021805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.022493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.025479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.026210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.026661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.073799 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed HTTP/1.1 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '687cf129-e7e4-4f2d-a302-38a93ae49aed'} Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.076414 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. Oct 24 09:18:35.082276 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.084493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 687cf129-e7e4-4f2d-a302-38a93ae49aed could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.085919 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f405e7d-00a9-41bc-ab30-20972580de1d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed" status: 404 len: 111 microversion: 2.1 time: 0.105975 Oct 24 09:18:35.086873 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2897/5561] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:34 2022] GET /compute/v2.1/servers/687cf129-e7e4-4f2d-a302-38a93ae49aed => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.101792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.104421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.117141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.122766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.123363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.124747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.125445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.126730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.159839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 HTTP/1.1 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '47b9a31e-88ef-4b67-9316-5bdb38d5af82'} Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.162312 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.166393 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.168590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.169697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09435da7-3f81-4dee-9cf9-4f193b356c96 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 404 len: 111 microversion: 2.1 time: 0.076832 Oct 24 09:18:35.170807 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2898/5562] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:35 2022] DELETE /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:18:35.185958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.188550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 47b9a31e-88ef-4b67-9316-5bdb38d5af82] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.205526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.206458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.207166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.209628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.210316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.210992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.250838 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 HTTP/1.1 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '47b9a31e-88ef-4b67-9316-5bdb38d5af82'} Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.255350 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. Oct 24 09:18:35.260093 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.262767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 47b9a31e-88ef-4b67-9316-5bdb38d5af82 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.266546 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24deaf91-bd7a-4f67-bff0-891c9e711272 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82" status: 404 len: 111 microversion: 2.1 time: 0.090428 Oct 24 09:18:35.267750 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2899/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:35 2022] GET /compute/v2.1/servers/47b9a31e-88ef-4b67-9316-5bdb38d5af82 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.280277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.280996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.299321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.300203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.300866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.302358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.306693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.307512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.334860 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 HTTP/1.1 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '30a2ed7b-d75a-4cd6-a320-88267be827d7'} Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.337976 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.342822 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.348296 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.349441 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-54023555-4864-495e-8667-b2d5f64f2be8 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 404 len: 111 microversion: 2.1 time: 0.076984 Oct 24 09:18:35.350168 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2900/5564] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:35 2022] DELETE /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.363186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.365226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 30a2ed7b-d75a-4cd6-a320-88267be827d7] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.379698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.381959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.382587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.387035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.388557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.389500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.401637 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:35.436384 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 HTTP/1.1 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '30a2ed7b-d75a-4cd6-a320-88267be827d7'} Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.441318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.445021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 30a2ed7b-d75a-4cd6-a320-88267be827d7 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.446158 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-902470e5-f0a0-4386-a835-a3c0dc25d318 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7" status: 404 len: 111 microversion: 2.1 time: 0.087862 Oct 24 09:18:35.448472 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2901/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:35 2022] GET /compute/v2.1/servers/30a2ed7b-d75a-4cd6-a320-88267be827d7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.461687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.463985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.479958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.481971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.483517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.484445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.486237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.489390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.525921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 HTTP/1.1 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9d324057-f10a-4db2-950f-dd0f965374b6'} Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.530059 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.535906 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.538314 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b01b6ee4-35dd-4518-b234-9a7f6e6544ca tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 404 len: 111 microversion: 2.1 time: 0.082452 Oct 24 09:18:35.539496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2902/5566] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:35 2022] DELETE /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.552370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.553020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 9d324057-f10a-4db2-950f-dd0f965374b6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.582571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.584198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.586437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.587310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.587854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.591862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.625148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 HTTP/1.1 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9d324057-f10a-4db2-950f-dd0f965374b6'} Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.626924 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. Oct 24 09:18:35.633558 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.635740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 9d324057-f10a-4db2-950f-dd0f965374b6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.639088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44a2bdfa-3ee9-475c-a09b-4469e35d23ee tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6" status: 404 len: 111 microversion: 2.1 time: 0.095160 Oct 24 09:18:35.641126 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2903/5567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:35 2022] GET /compute/v2.1/servers/9d324057-f10a-4db2-950f-dd0f965374b6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.653730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.654654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.668161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.670671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.671432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.673480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.674320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.676716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.710718 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 HTTP/1.1 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4d956643-af77-4b1c-8b7d-24605673a6f0'} Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.717442 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.721011 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.724707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.727187 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52d49049-51ba-4821-8ee8-2d9e8655ae4e tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 404 len: 111 microversion: 2.1 time: 0.082300 Oct 24 09:18:35.729415 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2904/5568] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:35 2022] DELETE /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.743865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.744866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.755433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:35.763772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.764599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.765317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.767803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.769168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.770565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.779932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:35.784360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:35.797998 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6c70fcb-8c25-47bb-8f6e-2a8f361e6ad7 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 1.401373 Oct 24 09:18:35.807763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2665/5569] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:34 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:35.830105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.830869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 4d956643-af77-4b1c-8b7d-24605673a6f0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.847527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.848034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.848483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.850677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:35.851158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:35.851654 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:35.914081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 HTTP/1.1 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '4d956643-af77-4b1c-8b7d-24605673a6f0'} Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.915672 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 4d956643-af77-4b1c-8b7d-24605673a6f0 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.920034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a15a1f8-460e-4e87-b32d-5bdc8963a26a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0" status: 404 len: 111 microversion: 2.1 time: 0.113044 Oct 24 09:18:35.928392 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2666/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:35 2022] GET /compute/v2.1/servers/4d956643-af77-4b1c-8b7d-24605673a6f0 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:35.947778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c85a13f0-0acb-4173-aef5-a2753b473c0a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:35.950424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c85a13f0-0acb-4173-aef5-a2753b473c0a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: a48f5fca-44c2-4ebd-85df-b9eaa0572524] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:35.966864 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c85a13f0-0acb-4173-aef5-a2753b473c0a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c85a13f0-0acb-4173-aef5-a2753b473c0a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 HTTP/1.1 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a48f5fca-44c2-4ebd-85df-b9eaa0572524'} Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:35.972747 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:35.977443 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:35.980326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c85a13f0-0acb-4173-aef5-a2753b473c0a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:35.982829 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c85a13f0-0acb-4173-aef5-a2753b473c0a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524" status: 404 len: 111 microversion: 2.1 time: 0.050570 Oct 24 09:18:35.984779 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2667/5571] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:35 2022] DELETE /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:36.001805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42e488a4-4080-4d95-9b79-a81b10b4f53a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:36.006653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42e488a4-4080-4d95-9b79-a81b10b4f53a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: a48f5fca-44c2-4ebd-85df-b9eaa0572524] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:36.048152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-42e488a4-4080-4d95-9b79-a81b10b4f53a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42e488a4-4080-4d95-9b79-a81b10b4f53a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 HTTP/1.1 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a48f5fca-44c2-4ebd-85df-b9eaa0572524'} Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:36.058769 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:36.062371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:36.062371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:36.062371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:36.062371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. Oct 24 09:18:36.062371 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:18:36.065861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42e488a4-4080-4d95-9b79-a81b10b4f53a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance a48f5fca-44c2-4ebd-85df-b9eaa0572524 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:36.069156 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42e488a4-4080-4d95-9b79-a81b10b4f53a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524" status: 404 len: 111 microversion: 2.1 time: 0.081259 Oct 24 09:18:36.070292 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2668/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:35 2022] GET /compute/v2.1/servers/a48f5fca-44c2-4ebd-85df-b9eaa0572524 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:36.088219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:36.097025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:36.118907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:36.119478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:36.119955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:36.120687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:36.127328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:36.145673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:36.173060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:36.190681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:36.192029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:36.203474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd651f3a-dd1a-4562-8e6f-de18dc6c99da tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.469981 Oct 24 09:18:36.218027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:18:36.218604 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2905/5573] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:35 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:36.389459 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-236bb8fe-3ed2-4d22-ac36-4787161a0e9d tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 204 len: 0 microversion: 2.1 time: 0.313805 Oct 24 09:18:36.392607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2669/5574] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:36 2022] DELETE /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:18:36.402774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:36.404687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:36.411899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:36.412651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:36.418534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:36.421932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:36.422575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:36.423354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:36.692206 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:36.707199 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-788cd626-4d3e-4fc8-a7d4-058ea884ca8a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1479 microversion: 2.1 time: 0.310120 Oct 24 09:18:36.726403 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2906/5575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:36 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1479 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:36.832863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:36.833751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:36.845886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:36.846393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:36.846837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:36.850355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:36.851015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:36.853954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:37.238187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:37.239389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:37.249705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:37.250716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:37.251499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:37.253358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:37.256466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:37.257159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:37.336888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:37.354502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:37.359709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:37.361682 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-616c6f21-862a-46de-b46c-7dcc38493e2b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.533379 Oct 24 09:18:37.362824 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2670/5576] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:36 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:37.539375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:37.560007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:37.564663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:37.566680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6c113e0-da9d-4a0e-87a5-acde0b521bf5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.333847 Oct 24 09:18:37.571148 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2907/5577] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:37 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:37.733261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:37.734386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:37.757701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:37.759993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:37.762107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:37.771028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:37.771563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:37.772081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.093012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:38.102899 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-299365b2-bd08-4919-8ff4-9e44b4bc14de tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1479 microversion: 2.1 time: 0.374521 Oct 24 09:18:38.115053 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2671/5578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:37 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1479 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:38.169594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:38.170970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:38.178800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.179495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.180118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.180981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.181639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.182221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.203873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 HTTP/1.1 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '3dfabd2e-75fe-4a89-aec7-6fd8ea26db90'} Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:38.206184 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.211201 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.213167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:38.214398 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de742fbd-708c-4a8c-baf3-003d13070cae tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 404 len: 111 microversion: 2.1 time: 0.051440 Oct 24 09:18:38.215452 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2908/5579] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:18:38 2022] DELETE /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:38.226120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:38.227404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] [instance: 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:38.239498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.240268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.241054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.242051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.243025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.244039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.264715 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] HTTP exception thrown: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Request method failure captured: Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 HTTP/1.1 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlae5Y8BX9lZWk3R-p1Ie0VMtlwwXgrHzuGNqgnHSRzkohP5ZEvNHrtyTwEBn7U4meQx0D0F5MF9EZKoxuAtlDEtdUfsY0Fb8JwA3XS2dF1NyLwJGdqXVt0pQDQvRSUZlPVa5iVef7S5W2fhsw7giy4fMpglb7rZ4fQeFxq56JHe1m8 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4098b77de8d4b07853cf61416c0b870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4098b77de8d4b07853cf61416c0b870"}]}] Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: e4098b77de8d4b07853cf61416c0b870 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1918114870 Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a170d67efe094c4e8b9267e33e4e476d Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1918114870-project Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '3dfabd2e-75fe-4a89-aec7-6fd8ea26db90'} Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:38.266593 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. Oct 24 09:18:38.271070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:38.272894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] Returning 404 to user: Instance 3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:38.274154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-384cbee4-9d19-403c-a3e3-c3887b65e0b4 tempest-AttachVolumeNegativeTest-1918114870 tempest-AttachVolumeNegativeTest-1918114870-project] 10.222.0.25 "GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90" status: 404 len: 111 microversion: 2.1 time: 0.054878 Oct 24 09:18:38.275468 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2909/5580] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:38 2022] GET /compute/v2.1/servers/3dfabd2e-75fe-4a89-aec7-6fd8ea26db90 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:18:38.392112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:38.393607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:38.400849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.401823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.402536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.403464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.404406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.405067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.647938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:38.648437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:38.670252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.675300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.676224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.678562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.679208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.679824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.702402 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:38.748071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:38.766669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:38.768848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:38.772148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90984c71-c260-473d-8206-b43fd17c5d02 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.385350 Oct 24 09:18:38.773446 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2910/5581] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:38 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:38.774777 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa8ec307-aa72-4188-a29c-c1756b19d2e9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/ips" status: 200 len: 145 microversion: 2.1 time: 0.573235 Oct 24 09:18:38.782810 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2672/5582] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:18:38 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/ips => generated 145 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:18:38.790091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:38.790986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:38.799893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.800957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.800957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:38.801875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:38.804083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:38.805118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:39.063087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:39.073684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:39.076490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:39.091524 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-deca9e34-4a59-4b81-8ff0-2fc025b177af tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.293656 Oct 24 09:18:39.092450 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2911/5583] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:38 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:39.128234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:39.128807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:39.141796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:39.145890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:39.146351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:39.147110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:39.147575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:39.148008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:39.740278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:39.754274 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad208baa-029d-4f21-b290-3f6cb9760cc5 tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1479 microversion: 2.1 time: 0.630056 Oct 24 09:18:39.755201 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2673/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:39 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1479 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:39.803497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:39.804765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:39.828486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:39.828756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:39.829476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:39.833944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:39.834582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:39.835379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:40.119334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:40.123235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:40.135657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:40.147437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:40.149017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:40.150020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:40.152112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:40.152965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:40.188555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:40.206087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:40.208290 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:40.210019 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73deeb4f-dd8b-4063-8157-37dbd5173be4 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.411214 Oct 24 09:18:40.219608 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2912/5585] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:39 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:40.778793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:40.779764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:40.803424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:40.804261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:40.805415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:40.810726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:40.814669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:40.815969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:41.008281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:41.024180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:41.029815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:41.032513 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e814242e-4813-4501-89c2-7ad00ebef4e6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.916981 Oct 24 09:18:41.051456 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2674/5586] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:40 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:41.240401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:41.241762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:41.257686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:41.258798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:41.262974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:41.263943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:41.264790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:41.265431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:41.293756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ae9fcca02548dfa6e29d2787288e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef8299318ec4b59a75e26867a009a2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:41.303767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9090f160-1c1c-48cb-95fa-e7753ce8731c tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 200 len: 1479 microversion: 2.1 time: 0.530235 Oct 24 09:18:41.308034 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2913/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:40 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 1479 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:18:41.378522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-34f1896a-0301-4c23-b115-ebc35c046ef9 req-f439aef1-f3b2-4dde-9523-83d00a6a5409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ae9c91-8fe1-4e38-baa0-0cf0aee14441", "name": "network-vif-deleted", "tag": "bb186eb9-89c2-411b-9e42-8e09ee660503"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:41.403612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-34f1896a-0301-4c23-b115-ebc35c046ef9 req-f439aef1-f3b2-4dde-9523-83d00a6a5409 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:41.404105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-34f1896a-0301-4c23-b115-ebc35c046ef9 req-f439aef1-f3b2-4dde-9523-83d00a6a5409 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:41.404544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-34f1896a-0301-4c23-b115-ebc35c046ef9 req-f439aef1-f3b2-4dde-9523-83d00a6a5409 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:41.431257 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-34f1896a-0301-4c23-b115-ebc35c046ef9 req-f439aef1-f3b2-4dde-9523-83d00a6a5409 service nova] Creating event network-vif-deleted:bb186eb9-89c2-411b-9e42-8e09ee660503 for instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 on n-h2-master-1 Oct 24 09:18:41.440019 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-34f1896a-0301-4c23-b115-ebc35c046ef9 req-f439aef1-f3b2-4dde-9523-83d00a6a5409 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065588 Oct 24 09:18:41.444398 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2914/5588] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:18:41.678575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd1c5c1e-ea5c-4016-a04b-c677f152907b"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:41.681380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:41.692809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:41.693807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:41.694492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:41.695418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:41.698613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:41.701181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:42.005272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:42.025435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:42.027477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:42.030052 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3816be0-0dab-4f3a-a301-16b6e502d579 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.795075 Oct 24 09:18:42.031333 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2675/5589] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:41 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:42.075263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:42.076188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:42.099247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:42.101025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:42.104633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:42.107732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:42.108481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:42.119107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:42.404120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:42.415518 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-471172b8-eb0e-4f16-8633-16f117a7bcfc tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741863 Oct 24 09:18:42.419635 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2915/5590] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:18:41 2022] POST /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:18:42.427437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:42.428994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:42.432366 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5355b0f6-8b22-48b2-86c3-4ba2acc2ffd6 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.364088 Oct 24 09:18:42.435418 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2676/5591] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:42 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:42.458628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:42.472450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] [instance: 08ae9c91-8fe1-4e38-baa0-0cf0aee14441] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:42.490857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:42.492647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:42.493427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:42.495242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:42.496626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:42.499522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:42.540476 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] HTTP exception thrown: Instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 could not be found. Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Request method failure captured: Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 HTTP/1.1 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVleQ9cZLJp6O5Ziv2WkgCOl-SjsRM0pGv29Rnlm6E3xLsD00JG-NvxmHTyX34bDLhOH7aNL7MtYRy6gvC1h9NZLzcjcGKQtDIaUk6t8aofyqQpffAyJPqow7a9GNY0innnuU-SbOnOvCYHvAunWew1VmA6-xMRCvvuPs4EYdYyrhCIU Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ef8299318ec4b59a75e26867a009a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ef8299318ec4b59a75e26867a009a2f"}]}] Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersTestJSON-1594770929 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2ef8299318ec4b59a75e26867a009a2f Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersTestJSON-1594770929 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ae9fcca02548dfa6e29d2787288e49 Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersTestJSON-1594770929-project Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 could not be found. Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '08ae9c91-8fe1-4e38-baa0-0cf0aee14441'} Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 could not be found. Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 could not be found. Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:18:42.544119 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 could not be found. Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] Returning 404 to user: Instance 08ae9c91-8fe1-4e38-baa0-0cf0aee14441 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43470ed4-04f6-4409-bdca-880cbfea284a tempest-ServersTestJSON-1594770929 tempest-ServersTestJSON-1594770929-project] 10.222.0.25 "GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441" status: 404 len: 111 microversion: 2.1 time: 0.128131 Oct 24 09:18:42.570638 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2916/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:18:42 2022] GET /compute/v2.1/servers/08ae9c91-8fe1-4e38-baa0-0cf0aee14441 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:43.059772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:43.060885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:43.071259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:43.072089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:43.072970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:43.074626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:43.075386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:43.076050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:43.466464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:43.468092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:43.493622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:43.496182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:43.497564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:43.501718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:43.502833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:43.503471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:43.817262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:43.834890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:43.838666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:43.841496 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1bbe4bfe-5037-4575-ac2d-32d2765be6d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.788995 Oct 24 09:18:43.854825 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2677/5593] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:43 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:43.872113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:43.881694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:43.895120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:43.896596 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ecb0c9c-c3e7-4e78-b5b4-54d375d16e41 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.438619 Oct 24 09:18:43.897938 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2917/5594] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:43 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:44.873514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:44.874177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:44.890673 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:44.906832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:44.911889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:44.913567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:44.914877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:44.915408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:44.925818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:44.926447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:44.931088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:44.975062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:44.975575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:44.981619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:44.982689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:44.985416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:44.987894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:45.278935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:45.293338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:45.302259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:45.305112 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bab17854-294f-48ba-8d18-807e3aa04f8c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.383569 Oct 24 09:18:45.331373 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2918/5595] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:44 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:45.614879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:45.627266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:45.628653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:45.629864 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72b9d5c8-894a-4099-be3a-28f40a3bd37e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.764230 Oct 24 09:18:45.641727 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2678/5596] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:44 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:46.338047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:46.339197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:46.349120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:46.349670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:46.366073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:46.366859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:46.367353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:46.367794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:46.671229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:46.671854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:46.690930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:46.691872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:46.692323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:46.693159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:46.693544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:46.693955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:46.896631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:46.910548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:46.912128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:46.927998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9939984-8074-4d03-9635-500624697d98 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.579774 Oct 24 09:18:46.929025 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2919/5597] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:46 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:47.966083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:47.971859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:47.991731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:47.992531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:47.993129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:47.994723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:47.995338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:47.998580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:48.432728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:48.451878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:48.475384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:48.476893 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25dfae53-f109-442e-a924-7bf66c6205e0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 1.809852 Oct 24 09:18:48.477998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2679/5598] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:46 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:49.459476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-044022b4-ac5d-4d01-b903-57dbd0e6429d req-ecd94dbc-89d7-4b48-85ad-be2d18fd0ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "name": "network-vif-plugged", "status": "completed", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:49.487580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-044022b4-ac5d-4d01-b903-57dbd0e6429d req-ecd94dbc-89d7-4b48-85ad-be2d18fd0ce1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:49.489573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-044022b4-ac5d-4d01-b903-57dbd0e6429d req-ecd94dbc-89d7-4b48-85ad-be2d18fd0ce1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:49.490287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-044022b4-ac5d-4d01-b903-57dbd0e6429d req-ecd94dbc-89d7-4b48-85ad-be2d18fd0ce1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:49.520371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-044022b4-ac5d-4d01-b903-57dbd0e6429d req-ecd94dbc-89d7-4b48-85ad-be2d18fd0ce1 service nova] Creating event network-vif-plugged:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h2-master-1 Oct 24 09:18:49.533616 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-044022b4-ac5d-4d01-b903-57dbd0e6429d req-ecd94dbc-89d7-4b48-85ad-be2d18fd0ce1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078633 Oct 24 09:18:49.536805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2680/5599] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:18:49.544844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:49.550268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:49.568018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:49.570269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:49.572092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:49.573134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:49.574408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:49.575138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:49.758414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:49.771606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:49.773059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:49.774295 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a6be3a65-8a6c-4892-9522-1eb446ef376a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 1.818537 Oct 24 09:18:49.792081 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2920/5600] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:47 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:50.650734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:50.664169 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:50.678208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:50.686727 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1866238a-1e66-4438-ad62-586017155b10 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 1.148405 Oct 24 09:18:50.687635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2681/5601] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:49 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:50.821777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:50.822398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:50.841919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:50.842787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:50.843405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:50.844636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:50.845555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:50.846150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:51.725331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:51.725331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:51.728164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:51.737454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:51.740299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:51.741527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:51.744566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:51.745757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:51.754403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:51.762714 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:51.768749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:51.773980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:51.786925 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-108d87db-0f64-4b29-84b9-dfd1bdafab13 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 0.969152 Oct 24 09:18:51.788565 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2921/5602] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:50 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:52.817412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:52.818035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:52.835190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:52.841346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:52.848618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:52.849499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:52.849995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:52.850443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:53.354358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:53.371895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:53.373378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:53.374580 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d355cc5f-afd6-437e-95db-15ac9aee1f06 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 1.658442 Oct 24 09:18:53.402158 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2682/5603] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:51 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:53.919537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:53.941129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:53.947518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:53.952090 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2de3c3bc-013d-4cd5-850e-f74184cfecb7 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1809 microversion: 2.20 time: 1.138047 Oct 24 09:18:53.954083 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2922/5604] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:52 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1809 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:18:54.428540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:54.431282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:54.451592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:54.453262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:54.454853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:54.455803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:54.459357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:54.460827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:54.986955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:54.990908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:55.007006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:55.010016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:55.012669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:55.014443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:55.018184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:55.019380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:55.267051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:55.289991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:55.294220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:55.296146 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab0b41f6-913b-4339-8744-a29f8b8775f0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.872593 Oct 24 09:18:55.301594 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2683/5605] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:54 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:56.165116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:56.175196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:56.176673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:56.177937 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfa81008-3f53-4eaf-a4d9-ef0a90c06cc9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1796 microversion: 2.20 time: 1.198547 Oct 24 09:18:56.178515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2923/5606] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:54 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1796 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:56.336120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:56.337426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:56.358116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:56.365092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:56.365806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:56.366766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:56.375765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:56.376574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:57.050877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:57.068197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:57.073555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:57.077245 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c692a8a4-b1ef-497f-b786-a006b0869646 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.750568 Oct 24 09:18:57.078860 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2684/5607] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:56 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:58.107549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:58.109455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:58.124752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:58.126013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:58.126816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:58.130837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:58.132626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:58.135164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:58.545617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:58.564209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:58.569287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:18:58.581688 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43ef9479-0226-4d4f-a8c9-f86e5f3cfa78 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.478216 Oct 24 09:18:58.582759 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2924/5608] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:58 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:18:58.733029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9875d406-f71a-4313-8cbf-7dc827ffad78 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Action: 'create', calling method: .version_select at 0x7f8daa06aca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1742599018"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:18:59.344596 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9875d406-f71a-4313-8cbf-7dc827ffad78 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.946775 Oct 24 09:18:59.345892 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2685/5609] 10.222.0.25 () {60 vars in 1155 bytes} [Mon Oct 24 09:18:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 949 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 09:18:59.360186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbb1e64b-06da-4bb5-8a36-45266b781467 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa5c8f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:59.462048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9875d406-f71a-4313-8cbf-7dc827ffad78 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:59.463066 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9875d406-f71a-4313-8cbf-7dc827ffad78 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001455 Oct 24 09:18:59.463405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2686/5610] 10.222.0.25 () {56 vars in 886 bytes} [Mon Oct 24 09:18:59 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 24 09:18:59.492093 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dbb1e64b-06da-4bb5-8a36-45266b781467 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.136106 Oct 24 09:18:59.493083 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2925/5611] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:18:59 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:18:59.622419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:18:59.624008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:18:59.676304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:59.678934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:59.681355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:18:59.694917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:18:59.695552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:18:59.700453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:00.429441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:00.446187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:00.447993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:00.451243 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15040668-200c-4359-9195-567a7014c1a2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.840205 Oct 24 09:19:00.455485 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2687/5612] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:18:59 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:00.514417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93e0fe91-7c59-497c-8480-9f966852bbbc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa3e64c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:00.620680 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93e0fe91-7c59-497c-8480-9f966852bbbc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.116890 Oct 24 09:19:00.621322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2926/5613] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:00 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:01.395152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:01.418811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:01.446902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.449362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.451512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.452508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.453271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.454078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.483352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:01.483974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:01.492218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.492728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.493174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.498110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.498586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.499030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.501579 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-076f8c1e-3e28-4cde-a090-e26228f8d10a tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122781 Oct 24 09:19:01.502694 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2688/5614] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:19:01 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:01.518052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:01.520573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:01.538261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.539938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.542522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.546168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.549537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.550317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.643162 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d7f89b9-1c50-4edc-abf4-ea498bc599a5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/bd1c5c1e-ea5c-4016-a04b-c677f152907b" status: 200 len: 194 microversion: 2.1 time: 0.132960 Oct 24 09:19:01.645602 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2689/5615] 10.222.0.25 () {58 vars in 1413 bytes} [Mon Oct 24 09:19:01 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/bd1c5c1e-ea5c-4016-a04b-c677f152907b => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:19:01.655718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a4042b08-3412-4c2e-88ac-0cbbcb2a7672 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8dab0ebe50>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:01.802887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a4042b08-3412-4c2e-88ac-0cbbcb2a7672 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 346 microversion: 2.1 time: 0.153809 Oct 24 09:19:01.803670 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2690/5616] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:01 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:01.821801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cc01e548-4a6c-4dd2-a4b8-26c83c26bbcb req-5b9d5503-28c5-47a2-ad99-f96659257bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "8ac03a61-fba1-4bce-ac1e-56e52791a4d2"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:01.867344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc01e548-4a6c-4dd2-a4b8-26c83c26bbcb req-5b9d5503-28c5-47a2-ad99-f96659257bbd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:01.875597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc01e548-4a6c-4dd2-a4b8-26c83c26bbcb req-5b9d5503-28c5-47a2-ad99-f96659257bbd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:01.876655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc01e548-4a6c-4dd2-a4b8-26c83c26bbcb req-5b9d5503-28c5-47a2-ad99-f96659257bbd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:01.931403 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cc01e548-4a6c-4dd2-a4b8-26c83c26bbcb req-5b9d5503-28c5-47a2-ad99-f96659257bbd service nova] Creating event network-vif-plugged:8ac03a61-fba1-4bce-ac1e-56e52791a4d2 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:01.950682 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cc01e548-4a6c-4dd2-a4b8-26c83c26bbcb req-5b9d5503-28c5-47a2-ad99-f96659257bbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135173 Oct 24 09:19:01.951386 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2691/5617] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:01.967021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f01ea6d9-0778-46a4-9381-548ff8e4853d tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Action: 'create', calling method: .version_select at 0x7f8daf24da60>, body: {"snapshot": {"volume_id": "4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1024171930"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:02.199207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:02.212141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:02.222821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:02.226795 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73161f55-28ac-4c05-ada7-eeffee15e38d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.748544 Oct 24 09:19:02.232333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2927/5618] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:01 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:02.509426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f01ea6d9-0778-46a4-9381-548ff8e4853d tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.553545 Oct 24 09:19:02.510664 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2692/5619] 10.222.0.25 () {60 vars in 1162 bytes} [Mon Oct 24 09:19:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:02.522051 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ccf72ce-b4ef-4e6e-9228-eaec7d368132 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa5c8310>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:02.588354 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ccf72ce-b4ef-4e6e-9228-eaec7d368132 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.070364 Oct 24 09:19:02.589806 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2928/5620] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:02 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:02.602150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b13b497c-d580-4099-96b8-98eb91eebf57 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa06a790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:02.677657 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b13b497c-d580-4099-96b8-98eb91eebf57 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.079428 Oct 24 09:19:02.682663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2693/5621] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Oct 24 09:19:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:02.690450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-feaf62a4-796e-4374-9e6c-5976c030dd20 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa3b8ee0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:02.773153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-feaf62a4-796e-4374-9e6c-5976c030dd20 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.086627 Oct 24 09:19:02.773798 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2929/5622] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:02 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:03.262161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:03.262890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:03.281527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:03.282035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:03.282485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:03.283203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:03.283666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:03.297399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:03.787819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-862dcdc6-ea2c-45ca-92f1-9abcf89ee370 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa2d7550>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:03.841386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:03.860830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:03.862523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:03.863910 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cec51ad7-3867-4cbd-b097-054a925ffa19 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.605720 Oct 24 09:19:03.864932 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2694/5623] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:03 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:03.919683 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-862dcdc6-ea2c-45ca-92f1-9abcf89ee370 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.136515 Oct 24 09:19:03.925776 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2930/5624] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:03 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:04.147689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "d9553579-010c-403c-9d62-6db9a95fe868"}, {"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "1a3f9d28-fb12-486b-a872-8a508788143b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:04.169791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:04.176323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:04.177002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:04.226894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] Creating event network-vif-plugged:d9553579-010c-403c-9d62-6db9a95fe868 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:04.233742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] Creating event network-vif-plugged:1a3f9d28-fb12-486b-a872-8a508788143b for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:04.251773 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2560f984-0f73-4b6d-bf11-0ce7a8d2aa0a req-f04bed24-bca2-4a92-8df6-99ec5394db79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109158 Oct 24 09:19:04.258555 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2695/5625] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:19:04.791230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb919e62-a26f-499b-9a1d-6b59c5f5d998"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:04.800289 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:04.830868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:04.834985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:04.838782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:04.839840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:04.842300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:04.848250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:04.895932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:04.896849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:04.907531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:04.908025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:04.908462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:04.909173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:04.913233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:04.913843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:05.004065 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:05.325495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:05.352420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:05.355881 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fa8101d-2fbc-47d2-b88a-95d7e504571d tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "POST /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.570405 Oct 24 09:19:05.358697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:05.359224 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2931/5626] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:19:04 2022] POST /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:05.362256 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c486ab72-a290-4d07-ac23-825ec06335d6 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.470964 Oct 24 09:19:05.363829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2696/5627] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:04 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:19:05.369819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f7057fd-0f7e-4b5f-a3c4-b38debb60a86 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa368e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:05.425426 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f7057fd-0f7e-4b5f-a3c4-b38debb60a86 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.064135 Oct 24 09:19:05.426445 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2932/5628] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:05 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:06.288728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "f2654d0a-7398-4bc3-bf34-e5064dae3bef"}, {"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "d0a63b4a-baa5-4f88-b08b-25c1ebccec31"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:06.309646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:06.310592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:06.313459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:06.340363 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] Creating event network-vif-plugged:f2654d0a-7398-4bc3-bf34-e5064dae3bef for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:06.343602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] Creating event network-vif-plugged:d0a63b4a-baa5-4f88-b08b-25c1ebccec31 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:06.352705 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f6968be1-0697-4b51-8fca-4b0faa45ffc8 req-fcf25aab-9c78-4583-aee9-3b323a53f79c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067713 Oct 24 09:19:06.355832 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2697/5629] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:06.395893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:06.397286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:06.408464 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=64 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:06.412161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:06.413986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:06.416084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:06.424186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:06.424685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:06.425170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:06.439975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6cf43025-d8ff-42c2-a596-fae3530af1b9 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa0d7280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:06.666513 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6cf43025-d8ff-42c2-a596-fae3530af1b9 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 288 microversion: 2.1 time: 0.230850 Oct 24 09:19:06.667708 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2698/5630] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:06 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 288 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:19:06.698664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ddee300c-083e-4ece-b181-31fad7227762 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa0c33a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:06.922964 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ddee300c-083e-4ece-b181-31fad7227762 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 202 len: 0 microversion: 2.1 time: 0.245978 Oct 24 09:19:06.924621 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2699/5631] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:19:06 2022] DELETE /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:19:06.937131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fc50420d-f224-44de-b7a9-79e86818d357 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daaeff670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:07.073346 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fc50420d-f224-44de-b7a9-79e86818d357 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.143450 Oct 24 09:19:07.073989 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2700/5632] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:06 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:07.085327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:07.101604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:07.103386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:07.108630 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa1b6a23-cbec-4d38-8702-09dff27405aa tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 0.718111 Oct 24 09:19:07.114132 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2933/5633] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:06 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:08.086685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb7856a7-33f1-45ad-9925-f34f2884ccc2 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa0c3c10>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:08.148496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:08.149801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:08.199823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:08.201867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:08.202926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:08.204972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:08.207511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:08.208187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:08.263043 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb7856a7-33f1-45ad-9925-f34f2884ccc2 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.181579 Oct 24 09:19:08.265327 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2701/5634] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:08 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:08.405568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "a059daee-94eb-4c0c-8cdc-1fec361e5564"}, {"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-plugged", "status": "completed", "tag": "0dece821-1750-4813-947a-1f748a9717a6"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:08.445017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:08.449711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:08.450222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:08.484306 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] Creating event network-vif-plugged:a059daee-94eb-4c0c-8cdc-1fec361e5564 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:08.487239 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] Creating event network-vif-plugged:0dece821-1750-4813-947a-1f748a9717a6 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:08.501432 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0957559d-07e9-48e7-bcdc-9fa62498ccca req-251c46e6-e6ad-4535-9beb-b85195aa5fda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098329 Oct 24 09:19:08.505545 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2702/5635] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:09.189867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:09.224000 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:09.232201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:09.234729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c35a92e8-2fee-4563-a370-752c1ea476da tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 1.093953 Oct 24 09:19:09.236157 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2934/5636] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:08 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:09.277695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36044211-e44d-4496-99e5-0c0d25e3545e tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8da999e790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:09.373469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36044211-e44d-4496-99e5-0c0d25e3545e tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.100424 Oct 24 09:19:09.374082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2703/5637] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:09 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:10.270121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:10.271212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:10.348070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:10.349091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:10.354793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:10.366136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:10.367366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:10.376467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:10.394207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c5c665f-b8ce-434a-90b2-d517f1ddf697 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa032700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:10.526037 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c5c665f-b8ce-434a-90b2-d517f1ddf697 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 200 len: 287 microversion: 2.1 time: 0.143670 Oct 24 09:19:10.527414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2704/5638] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:10 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:11.543745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18c0b581-1c92-48b9-991a-3bb39bf66bce tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa0d7ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:11.592451 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-18c0b581-1c92-48b9-991a-3bb39bf66bce tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] HTTP exception thrown: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18c0b581-1c92-48b9-991a-3bb39bf66bce tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Request method failure captured: Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 HTTP/1.1 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVliCVOIbpT9X87K54y5xaGOMa7Nr6EztETOsezRv3SlJ4zUXEUW-x9znUWC5l9anwhjcr0Jd9OBvC9UGKYZfctn-25o-SUTuJJTzvrUewW5uBxlN8HXAGaaPRFThbEcF_dx4MKHyuw15ZgM462zGYT5xVMimXkYYO2tobbTdgfIvGOQ Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be810f51fba54f4b8583603cb37bdf6d"}]}] Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ab3881cebd4cce80ea1e4ba540c998 Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: exception: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '201bb202-7a2e-474c-b764-321c5146d1f8'} Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. (HTTP 404) (Request-ID: req-6ede8acb-3c9a-4f16-a500-09d02394cc7a) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:19:11.603424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18c0b581-1c92-48b9-991a-3bb39bf66bce tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Returning 404 to user: Snapshot 201bb202-7a2e-474c-b764-321c5146d1f8 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18c0b581-1c92-48b9-991a-3bb39bf66bce tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8" status: 404 len: 111 microversion: 2.1 time: 0.069737 Oct 24 09:19:11.607940 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2705/5639] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:11 2022] GET /compute/v2.1/os-snapshots/201bb202-7a2e-474c-b764-321c5146d1f8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:19:11.622897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3508e0ee-560b-46cd-b430-c0a2d83c2863 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa0f11f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:11.799922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:11.817115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:11.818611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:11.819800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6863a7ab-73b7-4ac6-bc2e-d9a917c1298c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1880 microversion: 2.32 time: 1.556999 Oct 24 09:19:11.836256 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2935/5640] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:10 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1880 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:11.853011 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3508e0ee-560b-46cd-b430-c0a2d83c2863 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 202 len: 0 microversion: 2.1 time: 0.236294 Oct 24 09:19:11.865225 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2706/5641] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:11 2022] DELETE /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:19:11.871554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2bdebf62-627f-4139-afae-3a0632c517e9 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa3683a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:11.987822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2bdebf62-627f-4139-afae-3a0632c517e9 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.120878 Oct 24 09:19:11.988750 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2936/5642] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:11 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:12.879929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:12.882330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:12.905018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:12.906643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:12.908675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:12.910908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:12.911709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:12.913756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:13.006338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8aadf787-5cb0-44c2-83c4-ad4ca833dcba tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa484160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:13.166297 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8aadf787-5cb0-44c2-83c4-ad4ca833dcba tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.165723 Oct 24 09:19:13.167958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2937/5643] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:12 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:13.351711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:13.373881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:13.378803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:13.388112 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f76b66a-9abd-47e2-b1a4-f0ead23f0747 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2831 microversion: 2.32 time: 0.516130 Oct 24 09:19:13.391109 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2707/5644] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:12 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2831 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:13.420984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:13.421588 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:13.435452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:13.440666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:13.441359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:13.445186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:13.446933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:13.451227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:14.008821 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c072290-7e52-4fa5-9fae-ca531b4bf84d tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.591920 Oct 24 09:19:14.011367 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2938/5645] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 09:19:13 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2/os-interface => generated 1828 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:14.180834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ed29409-c3f1-41c4-905b-23957f8eaeb5 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8da9971670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:14.368413 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ed29409-c3f1-41c4-905b-23957f8eaeb5 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.191144 Oct 24 09:19:14.370520 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2708/5646] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:14 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:15.389039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bca2ecd1-a4d5-4298-a352-d95d002ef253 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa368d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:15.613078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bca2ecd1-a4d5-4298-a352-d95d002ef253 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.232072 Oct 24 09:19:15.614340 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2939/5647] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:15 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:16.630256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-998b361a-9dc6-4ef2-b0ba-8761e4a87991 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa06a4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:16.828733 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-998b361a-9dc6-4ef2-b0ba-8761e4a87991 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 200 len: 345 microversion: 2.1 time: 0.204477 Oct 24 09:19:16.830103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2709/5648] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:16 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:17.845377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2609fcc9-06cf-4e43-b015-bf4444800339 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daa3e1dc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:17.931359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-2609fcc9-06cf-4e43-b015-bf4444800339 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] HTTP exception thrown: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2609fcc9-06cf-4e43-b015-bf4444800339 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Request method failure captured: Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 HTTP/1.1 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVliCVOIbpT9X87K54y5xaGOMa7Nr6EztETOsezRv3SlJ4zUXEUW-x9znUWC5l9anwhjcr0Jd9OBvC9UGKYZfctn-25o-SUTuJJTzvrUewW5uBxlN8HXAGaaPRFThbEcF_dx4MKHyuw15ZgM462zGYT5xVMimXkYYO2tobbTdgfIvGOQ Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be810f51fba54f4b8583603cb37bdf6d"}]}] Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ab3881cebd4cce80ea1e4ba540c998 Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: exception: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5'} Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. (HTTP 404) (Request-ID: req-804e77c8-bfdc-4360-ab4b-07cc9165eea5) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:19:17.937634 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:17.943081 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:17.953597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2609fcc9-06cf-4e43-b015-bf4444800339 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Returning 404 to user: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:19:17.955448 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2609fcc9-06cf-4e43-b015-bf4444800339 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 404 len: 109 microversion: 2.1 time: 0.114348 Oct 24 09:19:17.964737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2940/5649] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:17 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:19:17.967081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-673af777-b8e3-41b8-9cbc-52e0a35132dc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daaeff670>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:18.035371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-673af777-b8e3-41b8-9cbc-52e0a35132dc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] HTTP exception thrown: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-673af777-b8e3-41b8-9cbc-52e0a35132dc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Request method failure captured: Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 HTTP/1.1 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVliCVOIbpT9X87K54y5xaGOMa7Nr6EztETOsezRv3SlJ4zUXEUW-x9znUWC5l9anwhjcr0Jd9OBvC9UGKYZfctn-25o-SUTuJJTzvrUewW5uBxlN8HXAGaaPRFThbEcF_dx4MKHyuw15ZgM462zGYT5xVMimXkYYO2tobbTdgfIvGOQ Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be810f51fba54f4b8583603cb37bdf6d"}]}] Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b1ab3881cebd4cce80ea1e4ba540c998 Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: exception: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5'} Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. (HTTP 404) (Request-ID: req-4926ac35-0966-484a-a013-ef92ca4113b0) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:19:18.037483 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-673af777-b8e3-41b8-9cbc-52e0a35132dc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Returning 404 to user: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-673af777-b8e3-41b8-9cbc-52e0a35132dc tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 404 len: 109 microversion: 2.1 time: 0.075840 Oct 24 09:19:18.042216 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2710/5650] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:17 2022] DELETE /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:19:18.049990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f5b546b-672d-44fc-8032-d72d3b350715 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Calling method '.version_select at 0x7f8daae00f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:18.280260 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-7f5b546b-672d-44fc-8032-d72d3b350715 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] HTTP exception thrown: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f5b546b-672d-44fc-8032-d72d3b350715 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Request method failure captured: Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 HTTP/1.1 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVliCVOIbpT9X87K54y5xaGOMa7Nr6EztETOsezRv3SlJ4zUXEUW-x9znUWC5l9anwhjcr0Jd9OBvC9UGKYZfctn-25o-SUTuJJTzvrUewW5uBxlN8HXAGaaPRFThbEcF_dx4MKHyuw15ZgM462zGYT5xVMimXkYYO2tobbTdgfIvGOQ Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be810f51fba54f4b8583603cb37bdf6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be810f51fba54f4b8583603cb37bdf6d"}]}] Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: be810f51fba54f4b8583603cb37bdf6d Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1233330841 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b1ab3881cebd4cce80ea1e4ba540c998 Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1233330841-project Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: method: Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: exception: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5'} Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. (HTTP 404) (Request-ID: req-407672c4-6f7b-468e-87a8-086d67bdeb4e) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:19:18.282326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f5b546b-672d-44fc-8032-d72d3b350715 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] Returning 404 to user: Volume 4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f5b546b-672d-44fc-8032-d72d3b350715 tempest-VolumesSnapshotsTestJSON-1233330841 tempest-VolumesSnapshotsTestJSON-1233330841-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5" status: 404 len: 109 microversion: 2.1 time: 0.238757 Oct 24 09:19:18.289628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2941/5651] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:18 2022] GET /compute/v2.1/os-volumes/4e9ffa2d-a5a7-42e0-8d19-fd28a8d5aae5 => generated 109 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:19:18.817976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-bd216b31-408a-482c-af28-54bc374eaa30 req-d89cacd6-cde2-4006-8c45-8e5ad0ff2e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "tag": "f2654d0a-7398-4bc3-bf34-e5064dae3bef"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:18.840238 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:18.842399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bd216b31-408a-482c-af28-54bc374eaa30 req-d89cacd6-cde2-4006-8c45-8e5ad0ff2e4d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:18.842885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bd216b31-408a-482c-af28-54bc374eaa30 req-d89cacd6-cde2-4006-8c45-8e5ad0ff2e4d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:18.844921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bd216b31-408a-482c-af28-54bc374eaa30 req-d89cacd6-cde2-4006-8c45-8e5ad0ff2e4d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:18.882677 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-bd216b31-408a-482c-af28-54bc374eaa30 req-d89cacd6-cde2-4006-8c45-8e5ad0ff2e4d service nova] Creating event network-changed:f2654d0a-7398-4bc3-bf34-e5064dae3bef for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:19:18.892528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-bd216b31-408a-482c-af28-54bc374eaa30 req-d89cacd6-cde2-4006-8c45-8e5ad0ff2e4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078107 Oct 24 09:19:18.900024 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2711/5652] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:25.017907 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:25.018698 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:25.030843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:25.040620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:25.061532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:25.062067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:25.062526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:25.068424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:25.071133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:25.071599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:25.165058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-499ff8b3-72b0-4a1e-9511-2281122cc4f9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.148703 Oct 24 09:19:25.167576 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2942/5653] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:19:25 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:25.315357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:25.315932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:25.334291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:25.334801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:25.335251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:25.335976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:25.336456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:25.336866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:25.403818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b823eff1-dac6-4065-861f-1093e47ba3c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/bd1c5c1e-ea5c-4016-a04b-c677f152907b" status: 200 len: 194 microversion: 2.1 time: 0.094266 Oct 24 09:19:25.408090 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2712/5654] 10.222.0.25 () {58 vars in 1413 bytes} [Mon Oct 24 09:19:25 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/bd1c5c1e-ea5c-4016-a04b-c677f152907b => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:25.418551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:25.419703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:25.430558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:25.431306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:25.432455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:25.434134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:25.435916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:25.436456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:25.604383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lazy-loading 'services' on Instance uuid 1cb71e8c-110f-4129-b6cb-05d7422a5083 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:19:25.771773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ab97321-7907-40a0-b518-67e33d24c505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/bd1c5c1e-ea5c-4016-a04b-c677f152907b" status: 202 len: 0 microversion: 2.1 time: 0.357011 Oct 24 09:19:25.773883 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2943/5655] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:19:25 2022] DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/bd1c5c1e-ea5c-4016-a04b-c677f152907b => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:19:29.424508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:29.426517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:29.447009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:29.448085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:29.451886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:29.456084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:29.456604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:29.457059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:29.528866 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-524431e1-41e2-4f7a-ac21-0744784cd687 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments/99e5343b-e900-4cf3-a3e8-17c37ced0971" status: 200 len: 194 microversion: 2.20 time: 0.109870 Oct 24 09:19:29.535871 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2713/5656] 10.222.0.25 () {60 vars in 1454 bytes} [Mon Oct 24 09:19:29 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments/99e5343b-e900-4cf3-a3e8-17c37ced0971 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:19:29.774896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:29.777865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:29.792381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:29.795057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:29.797035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:29.798140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:29.803413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:29.804198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:30.061325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lazy-loading 'services' on Instance uuid ad46abbe-9593-4b3f-bb44-93e777c29fdf {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:19:30.266901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df0703fd-e4a2-4dfa-8ed8-7c6aaaf70b78 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments/99e5343b-e900-4cf3-a3e8-17c37ced0971" status: 202 len: 0 microversion: 2.20 time: 0.504678 Oct 24 09:19:30.267745 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2944/5657] 10.222.0.25 () {60 vars in 1457 bytes} [Mon Oct 24 09:19:29 2022] DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments/99e5343b-e900-4cf3-a3e8-17c37ced0971 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:19:30.278940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:30.281736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:30.305659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:30.305659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:30.308202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:30.309877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:30.310370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:30.316958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:30.435592 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc0ed997-72cf-40fa-acd0-cda208391332 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160712 Oct 24 09:19:30.439220 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2714/5658] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:30 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:31.456863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:31.459379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:31.473213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:31.484664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:31.487540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:31.489450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:31.491709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:31.492517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:31.608062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e0dceed-8e2c-4403-aa07-ce4f1e255766 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157818 Oct 24 09:19:31.612133 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2945/5659] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:31 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:32.625867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:32.628319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:32.642868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:32.647703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:32.648451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:32.655694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:32.656500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:32.657130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:32.773212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42dc9f21-d86c-4922-a42a-469d51590852 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151582 Oct 24 09:19:32.774726 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2715/5660] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:32 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:33.788152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:33.792560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:33.820403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:33.822532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:33.823285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:33.827389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:33.828206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:33.828803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:33.950304 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8824878e-818d-4bac-8aa4-5d28a9864b97 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.166945 Oct 24 09:19:33.950921 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2946/5661] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:33 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:34.962718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:34.965861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:34.986622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:34.987269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:34.987826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:34.989350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:34.989975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:34.990524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:35.075590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4125875-4c2b-4311-9ff7-5aa659db1b3c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116673 Oct 24 09:19:35.082223 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2716/5662] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:34 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:19:36.091513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:36.094616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:36.113523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:36.116888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:36.118407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:36.122281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:36.129093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:36.129966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:36.229583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8179b709-22cb-402c-b931-4562c171eb77 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144506 Oct 24 09:19:36.230499 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2947/5663] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:36 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:36.856141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:36.856690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:36.878079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:36.879182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:36.883102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:36.886831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:36.887954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:36.890894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:36.955880 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=48 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:36.993598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bd0c968-afd0-49ba-8f58-40eaf298aaa6 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/cb919e62-a26f-499b-9a1d-6b59c5f5d998" status: 200 len: 194 microversion: 2.1 time: 0.142551 Oct 24 09:19:36.994786 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2717/5664] 10.222.0.25 () {58 vars in 1413 bytes} [Mon Oct 24 09:19:36 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/cb919e62-a26f-499b-9a1d-6b59c5f5d998 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:37.007296 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:37.009444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:37.030881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:37.034078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:37.034552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:37.044107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:37.044867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:37.045349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:37.243128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:37.249464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:37.276547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:37.278968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:37.279431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:37.286270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:37.292565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:37.292565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:37.401815 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69bf581f-702b-4eae-aed1-595c730457f9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163050 Oct 24 09:19:37.410264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2718/5665] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:37 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:19:37.549758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lazy-loading 'services' on Instance uuid 1cb71e8c-110f-4129-b6cb-05d7422a5083 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:19:37.816618 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-344c3e40-720a-4246-93fb-10a7d3fd3e45 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/cb919e62-a26f-499b-9a1d-6b59c5f5d998" status: 202 len: 0 microversion: 2.1 time: 0.813876 Oct 24 09:19:37.819799 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2948/5666] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:19:37 2022] DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments/cb919e62-a26f-499b-9a1d-6b59c5f5d998 => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:19:37.896128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6bd33f95-5ed1-46cf-bc60-b94375fb7e98 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'create', calling method: .version_select at 0x7f8dab361ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-102929271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOwKXHJimBt54wpOxMPTVCAh5fwWIm++IHpkAcM5PqP4gfhH7581C7gShN60DXlgTbdSFlKQ9ogzkKdiSE+crZ+S3jBwoQqwB6ZTNGMk4xQnYsph6/EltM5xBZ/JhEQHQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:37.965734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6bd33f95-5ed1-46cf-bc60-b94375fb7e98 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for project 1104d284053c4625bcb91c06e3fa5848. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:19:37.991916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6bd33f95-5ed1-46cf-bc60-b94375fb7e98 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for user 9d0b4f066e344bba84c0369d4c695f8b and project 1104d284053c4625bcb91c06e3fa5848. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:19:38.088463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6bd33f95-5ed1-46cf-bc60-b94375fb7e98 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.192496 Oct 24 09:19:38.098536 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2719/5667] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:19:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:38.420355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:38.431776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:38.452921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:38.469834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:38.471125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:38.472141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:38.472895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:38.473630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:38.548724 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-88e45b2d-8a8f-4816-bea2-6eca23d90d4a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138793 Oct 24 09:19:38.552821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2949/5668] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:38 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:39.566058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:39.568299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:39.594055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:39.594604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:39.595073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:39.595833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:39.606966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:39.607442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:39.684607 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea679001-2e49-41f0-a8ad-32fbc4357c31 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124084 Oct 24 09:19:39.691581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2720/5669] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:39 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:40.698005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:40.700363 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:40.724454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:40.725067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:40.725648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:40.726640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:40.727339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:40.727877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:40.794611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e07fe006-00e3-48c1-9007-279c513f38a5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101351 Oct 24 09:19:40.796016 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2950/5670] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:40 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:19:41.546875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-451817456", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "b29e1788-6c66-430d-b593-34459d239a98"}], "key_name": "tempest-TestNetworkBasicOps-102929271", "security_groups": [{"name": "tempest-secgroup-smoke-2138814382"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:41.739078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] validate_networks() for [('b29e1788-6c66-430d-b593-34459d239a98', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:19:41.807518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:41.820199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:41.844077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:41.844581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:41.857778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:41.858577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:41.871895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:41.872442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:41.981944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9269021-3520-4488-a016-1ab5bc049614 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.178397 Oct 24 09:19:41.992134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2951/5671] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:41 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:19:43.004432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:43.007772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:43.026200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:43.027115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:43.027784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:43.029269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:43.034032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:43.034828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:43.112198 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c04962b5-3c23-4f5a-925d-d77009b7b0d9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116140 Oct 24 09:19:43.125110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2952/5672] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:42 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:19:43.457759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:19:43.468299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:19:43.469103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:19:43.470020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:19:43.470668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:19:43.496258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:43.497074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:43.499446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:43.501788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:43.503478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:43.506661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:43.574758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for project 1104d284053c4625bcb91c06e3fa5848. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:19:43.597164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for user 9d0b4f066e344bba84c0369d4c695f8b and project 1104d284053c4625bcb91c06e3fa5848. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:19:43.615448 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:19:43.621655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:19:43.705951 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d95dd707-e862-4e5c-a66f-258fdde3b1ed tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.161879 Oct 24 09:19:43.706622 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2721/5673] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:19:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:19:43.718921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-229ca354-e79e-4f6f-b074-ce18ee629bba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:43.719564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-229ca354-e79e-4f6f-b074-ce18ee629bba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:43.918504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-229ca354-e79e-4f6f-b074-ce18ee629bba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:43.926408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-229ca354-e79e-4f6f-b074-ce18ee629bba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1247 microversion: 2.1 time: 0.211551 Oct 24 09:19:43.927022 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2953/5674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:43 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1247 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:44.128476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:44.131575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:44.145196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:44.145730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:44.146178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:44.146902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:44.147364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:44.147803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:44.229963 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08241dae-2253-4634-b9f2-089aaa756478 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105578 Oct 24 09:19:44.236030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2722/5675] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:44 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:44.955262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:44.956339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:44.980470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:44.982455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:44.984358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:44.988001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:44.990579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:44.994232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:45.244966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:45.246360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:45.252630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:45.262883 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-88e0b5ad-d4e9-451e-ba70-eb957a441f38 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1243 microversion: 2.1 time: 0.313481 Oct 24 09:19:45.273056 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2954/5676] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:44 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:19:45.285727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:45.288226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:45.288985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:45.289480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:45.292688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:45.294301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:45.422502 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f091c833-d2cc-4699-a711-579fb8a735f4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.183615 Oct 24 09:19:45.425322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2723/5677] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:45 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:19:46.317720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:46.319140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:46.335618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:46.336440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:46.339152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:46.340101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:46.340842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:46.342141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:46.443599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:46.445887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:46.457148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:46.457681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:46.458136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:46.458867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:46.459329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:46.459764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:46.565731 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8dd59369-a43f-4deb-9aa7-f50e98e30a4e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.132317 Oct 24 09:19:46.573609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2724/5678] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:19:46 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:19:46.733803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:46.742741 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d589759c-5c65-4967-9989-a516ca4d5762 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1299 microversion: 2.1 time: 0.428971 Oct 24 09:19:46.743440 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2955/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:46 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1299 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:46.873839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:46.874383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:46.883678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:46.888586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:46.889023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:46.891944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:46.892510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:46.894043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:46.958116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:19:47.196326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d475b400-b793-4ea6-831f-fcfec4c8a0cb tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 204 len: 0 microversion: 2.20 time: 0.326110 Oct 24 09:19:47.197034 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2725/5680] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:19:46 2022] DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:19:47.205623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:47.206519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:47.218875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:47.219733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:47.220421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:47.221482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:47.222334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:47.223027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:47.555270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:47.569638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:47.572855 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:47.590911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c4e166a-0198-45e6-a9ba-390264842cf2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.373313 Oct 24 09:19:47.592912 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2956/5681] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:47 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:47.767481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:47.768965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:47.782584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:47.783228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:47.785067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:47.788082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:47.788734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:47.790659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:47.978266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:47.988474 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79208964-089c-41d3-85dd-76477d64a6e9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1305 microversion: 2.1 time: 0.225609 Oct 24 09:19:47.998082 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2726/5682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:47 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1305 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:48.623625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:48.624538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:48.645643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:48.646110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:48.646616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:48.653362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:48.653962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:48.654429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:48.747033 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:49.029026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:49.030295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:49.033619 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:49.063071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:49.064193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:49.064906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:49.066314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:49.070035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:49.070747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:49.701098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:49.730857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:49.732739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:49.734020 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a092ca3-3c87-49ef-97c3-48a82e4c236e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 1.114754 Oct 24 09:19:49.753164 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2957/5683] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:48 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:49.802149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:49.817650 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7f93737-695f-4f63-862f-47310879ea2b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.792094 Oct 24 09:19:49.835800 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2727/5684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:49 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:19:50.763272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:50.763951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:50.783565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:50.783966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:50.786845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:50.791699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:50.792853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:50.796468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:50.848579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:50.849517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:50.862615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:50.863564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:50.864286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:50.865950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:50.878080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:50.878919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:51.602519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:51.613247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:51.649539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:51.651716 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a526812-8fbf-4185-8507-e6cace284f30 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1724 microversion: 2.20 time: 0.892905 Oct 24 09:19:51.671957 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2958/5685] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:50 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1724 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:19:52.085392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:52.111417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c99fb0c-d13c-4cf2-acf1-5921fc92a8a7 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 1.267104 Oct 24 09:19:52.116545 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2728/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:50 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:52.695437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:52.697933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:52.715526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:52.716452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:52.717395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:52.720008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:52.720736 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:52.721623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:52.859081 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-46d9b55b-6b01-4374-84c8-b5e349e11a9f req-bbfa6843-ca1d-4f3e-a712-10a0f64305b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed30164c-2ad2-497f-b681-096e9672b260", "tag": "de3e2bcc-4b7d-4cef-b16e-13230a55be52"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:52.895939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-46d9b55b-6b01-4374-84c8-b5e349e11a9f req-bbfa6843-ca1d-4f3e-a712-10a0f64305b8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:52.908476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-46d9b55b-6b01-4374-84c8-b5e349e11a9f req-bbfa6843-ca1d-4f3e-a712-10a0f64305b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:52.913660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-46d9b55b-6b01-4374-84c8-b5e349e11a9f req-bbfa6843-ca1d-4f3e-a712-10a0f64305b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:52.937929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-46d9b55b-6b01-4374-84c8-b5e349e11a9f req-bbfa6843-ca1d-4f3e-a712-10a0f64305b8 service nova] Creating event network-changed:de3e2bcc-4b7d-4cef-b16e-13230a55be52 for instance ed30164c-2ad2-497f-b681-096e9672b260 on n-h1-master-1 Oct 24 09:19:52.960943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-46d9b55b-6b01-4374-84c8-b5e349e11a9f req-bbfa6843-ca1d-4f3e-a712-10a0f64305b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106673 Oct 24 09:19:52.963067 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2729/5687] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:19:53.135800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:53.143114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:53.147420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:53.165072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:53.174795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:53.180281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:53.182334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:53.183524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:53.185593 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a93a998d-022e-4d4e-9a07-e20993fc5dc3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1656 microversion: 2.20 time: 0.493906 Oct 24 09:19:53.191270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:53.193190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:53.199491 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2959/5688] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:52 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1656 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:53.200190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:53.537693 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:53.606636 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:54.037789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:54.052923 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5f7214cb-8524-43ff-a3b9-0550d2063c35 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.913840 Oct 24 09:19:54.059581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2730/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:53 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:19:54.224098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:54.225372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:54.234908 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:54.244601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:54.246109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:54.246646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:54.252049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:54.253883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:54.254419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:54.386144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:54.390308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:54.392767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:54.393458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lazy-loading 'fault' on Instance uuid ad46abbe-9593-4b3f-bb44-93e777c29fdf {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:19:54.554820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:54.568076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:54.571109 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:54.586572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a681ea82-9b17-4d5d-a104-142f8c4f99dc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 200 len: 1371 microversion: 2.20 time: 0.357234 Oct 24 09:19:54.589616 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2960/5690] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:54 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 1371 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:19:55.074433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1252a136-21e1-4d1b-9aab-7a59a697178c req-8dd730c4-97a6-4ae6-a351-9d30a40436f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46abbe-9593-4b3f-bb44-93e777c29fdf", "name": "network-vif-deleted", "tag": "30ca880d-1630-4c01-a6bb-d8337420f1bf"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:55.083248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:55.084715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:55.105583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:55.106703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:55.112858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:55.113749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:55.114251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:55.116019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:55.128097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1252a136-21e1-4d1b-9aab-7a59a697178c req-8dd730c4-97a6-4ae6-a351-9d30a40436f0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:55.129129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1252a136-21e1-4d1b-9aab-7a59a697178c req-8dd730c4-97a6-4ae6-a351-9d30a40436f0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:55.129800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1252a136-21e1-4d1b-9aab-7a59a697178c req-8dd730c4-97a6-4ae6-a351-9d30a40436f0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:55.175378 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1252a136-21e1-4d1b-9aab-7a59a697178c req-8dd730c4-97a6-4ae6-a351-9d30a40436f0 service nova] Creating event network-vif-deleted:30ca880d-1630-4c01-a6bb-d8337420f1bf for instance ad46abbe-9593-4b3f-bb44-93e777c29fdf on n-h2-master-1 Oct 24 09:19:55.197501 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1252a136-21e1-4d1b-9aab-7a59a697178c req-8dd730c4-97a6-4ae6-a351-9d30a40436f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125748 Oct 24 09:19:55.201601 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2731/5691] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:19:55.355763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:55.364810 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed9a44e5-64c4-4a79-89c4-555c1a6057cb tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.286101 Oct 24 09:19:55.365455 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2961/5692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:55 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:19:55.622648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:55.625494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:55.639438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:55.640341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:55.640808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:55.641781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:55.642262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:55.644302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:55.674761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] HTTP exception thrown: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Request method failure captured: Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf HTTP/1.1 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfCMLd25yo1Rx1bYq-TD2s31NmLvc8za3D_TDl22Bj2odORHPQ31iTSkk2Oe06uxlBycFEalFHAZbpO_ujdkkpbVkWD_JFnHh91LwnFkYNjmXjWnV8fL3jzhVx67cIT5uIc3rKlgGs-wh_4s7OMRLzIFHG8Q4AjybxvQ9xxxrZ_t4s Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f88028805e42a0a83e7de1f6f39d99"}]}] Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b2755c3ea93440999d287890d328ecd6 Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ad46abbe-9593-4b3f-bb44-93e777c29fdf'} Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:55.677045 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:19:55.684461 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:19:55.687004 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Returning 404 to user: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:19:55.688310 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2dc11ca6-d599-4219-ab63-237af624f115 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 404 len: 111 microversion: 2.20 time: 0.076389 Oct 24 09:19:55.689470 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2732/5693] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:19:55 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:19:55.697754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e95ffc4-0819-4ab0-bd34-9d1d9d2af669 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '.version_select at 0x7f8daae5e1f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:55.704004 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e95ffc4-0819-4ab0-bd34-9d1d9d2af669 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [9b9e3e2f-1265-43f0-954f-fe6548ce023c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:19:56.091901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:56.094877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:56.113769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:56.122851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:56.124047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:56.125489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:56.127214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:56.132593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:56.228812 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d05012c6-3a4d-4bde-bf70-742669addb36 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141604 Oct 24 09:19:56.229979 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2733/5694] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:19:56 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 09:19:56.392993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:56.393696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:56.412188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:56.414340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:56.415600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:56.418165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:56.418653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:56.419098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:56.698926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:56.713017 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e95ffc4-0819-4ab0-bd34-9d1d9d2af669 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [9b9e3e2f-1265-43f0-954f-fe6548ce023c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58508. Oct 24 09:19:56.722226 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f4afad1-fb5e-4f4e-8944-66e01f6ac7ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.329667 Oct 24 09:19:56.726152 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=45 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:56.730065 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2734/5695] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:56 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:19:56.738668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:56.749071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e95ffc4-0819-4ab0-bd34-9d1d9d2af669 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705603548" status: 204 len: 0 microversion: 2.20 time: 1.055218 Oct 24 09:19:56.750426 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2962/5696] 10.222.0.25 () {60 vars in 1259 bytes} [Mon Oct 24 09:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705603548 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:19:56.754683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:56.783081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:56.783671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:56.784134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:56.793343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:56.794383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:56.797092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:56.872133 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:56.906924 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e47d9ea7-a257-446a-8852-463014cb1c3f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.172621 Oct 24 09:19:56.908866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2735/5697] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:19:56 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:19:57.104147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:57.104654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:57.116333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:57.117096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:57.117730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:57.119145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:57.122125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:57.122747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:57.180417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:19:57.361036 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd681b41-ce82-4599-b2ef-b2a82da401ec tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 204 len: 0 microversion: 2.1 time: 0.260738 Oct 24 09:19:57.364814 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2963/5698] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:19:57 2022] DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:19:57.371153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:57.371885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:57.386784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:57.387300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:57.392892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:57.393710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:57.394202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:57.394648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:57.702080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:57.711814 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-873b2a75-8fe7-4b17-b532-535c15315a1f tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1672 microversion: 2.1 time: 0.345225 Oct 24 09:19:57.726572 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2736/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:57 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1672 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:57.753917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:57.755519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:57.773115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:57.775710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:57.777602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:57.778676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:57.779320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:57.782730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:58.280004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:58.292875 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e656d44-e9ea-4681-99b0-6ef7bb9408d4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.543187 Oct 24 09:19:58.295389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2964/5700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:57 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:58.741842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:58.742477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:58.754879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:58.757589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:58.759893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:58.761659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:58.762797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:58.764076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:58.996741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:59.011538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e0e124b6-c0bb-4203-8a08-858e0cbbc974 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1672 microversion: 2.1 time: 0.272570 Oct 24 09:19:59.013879 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2737/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:58 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:19:59.044414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-815d3f5a-ba69-4d1f-a5bd-5a01e64d6531 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'create', calling method: .version_select at 0x7f8da9becca0>, body: {"keypair": {"name": "tempest-keypair-1429986586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMBzheAdVOMWjqdfVMlChgrtaCP9MjeQ8yC4TXk3KWmPY69SJwbNqCf8ApsCMWOP7HipQ11wQWuslgdaC43HGdmS77tu1oSOKBMN8Dh8tPbs+6LfyvmxKE4R5Rt9K3vtw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:19:59.067074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-815d3f5a-ba69-4d1f-a5bd-5a01e64d6531 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:19:59.083150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-815d3f5a-ba69-4d1f-a5bd-5a01e64d6531 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for user b2755c3ea93440999d287890d328ecd6 and project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:19:59.124667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-815d3f5a-ba69-4d1f-a5bd-5a01e64d6531 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.087141 Oct 24 09:19:59.126098 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2965/5702] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Oct 24 09:19:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 09:19:59.322171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:19:59.323071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:19:59.348115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:59.350632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:59.353811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:59.355060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:19:59.359003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:19:59.360126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:19:59.651963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:19:59.663670 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7db07179-21e9-45f7-96cf-be96aa457c7b tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.347905 Oct 24 09:19:59.664266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2738/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:59 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:00.047665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:00.048299 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:00.059816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:00.064506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:00.065171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:00.066103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:00.070883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:00.076954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:00.458014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:00.508028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e68a47f8-daf9-495c-a458-e56352840e80 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1672 microversion: 2.1 time: 0.459610 Oct 24 09:20:00.514676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2966/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:00 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1672 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:00.694764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:00.695393 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:00.714629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:00.718963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:00.721799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:00.725953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:00.728669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:00.736332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:01.044629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:01.045479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:01.065509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:01.066145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:01.078151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:01.084834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:01.085441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:01.085915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:01.407877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:01.417062 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a38869fe-64e9-46c6-b230-4ddfb8b0e1ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.726073 Oct 24 09:20:01.422814 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2739/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:00 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:01.540243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:01.541132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:01.569021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:01.575299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:01.576131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:01.577107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:01.577860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:01.578528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:01.907452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6929c304ff4260b9e7c4d469b71a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee7511c75374ba599216666ba191e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:01.940980 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64a8e389-f310-498d-b8a1-5fd70d8ca8d5 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 200 len: 1604 microversion: 2.1 time: 0.404623 Oct 24 09:20:01.941870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2740/5706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:01 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 1604 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:01.956953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a74d174a-46d8-4889-bce1-ce0c6bdfda72 req-67b0c7cf-c391-451b-8419-ad4dbec610e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb71e8c-110f-4129-b6cb-05d7422a5083", "name": "network-vif-deleted", "tag": "41e1b855-88ab-4cd5-8e94-eacac4a681ea"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:01.994060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a74d174a-46d8-4889-bce1-ce0c6bdfda72 req-67b0c7cf-c391-451b-8419-ad4dbec610e4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:01.995072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a74d174a-46d8-4889-bce1-ce0c6bdfda72 req-67b0c7cf-c391-451b-8419-ad4dbec610e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:01.996439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a74d174a-46d8-4889-bce1-ce0c6bdfda72 req-67b0c7cf-c391-451b-8419-ad4dbec610e4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:02.038218 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a74d174a-46d8-4889-bce1-ce0c6bdfda72 req-67b0c7cf-c391-451b-8419-ad4dbec610e4 service nova] Creating event network-vif-deleted:41e1b855-88ab-4cd5-8e94-eacac4a681ea for instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 on n-h2-master-1 Oct 24 09:20:02.068492 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a74d174a-46d8-4889-bce1-ce0c6bdfda72 req-67b0c7cf-c391-451b-8419-ad4dbec610e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122638 Oct 24 09:20:02.070720 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2741/5707] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:02.273730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:02.297396 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:02.306145 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:02.307789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59debdf1-e9c5-4b13-ace7-ae5643e1b52e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2950 microversion: 2.32 time: 1.267798 Oct 24 09:20:02.312827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2967/5708] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:01 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2950 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:20:02.341511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:02.342210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:02.356314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:02.357185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:02.358069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:02.359071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:02.359739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:02.361130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:02.447518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:02.448222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:02.460508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:02.463230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:02.463788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:02.464617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:02.466622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:02.467328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:02.897901 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ad9f047-d84e-479f-a0db-402537ae6e34 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.561985 Oct 24 09:20:02.898649 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2742/5709] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 09:20:02 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2/os-interface => generated 1828 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:20:02.903682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-abc62517-391b-4e31-b031-0b015f5e057c req-28ecfe83-5852-4a06-83fd-d8691cbec38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed30164c-2ad2-497f-b681-096e9672b260", "name": "network-vif-plugged", "status": "completed", "tag": "de3e2bcc-4b7d-4cef-b16e-13230a55be52"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:02.925110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-abc62517-391b-4e31-b031-0b015f5e057c req-28ecfe83-5852-4a06-83fd-d8691cbec38c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:02.925815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-abc62517-391b-4e31-b031-0b015f5e057c req-28ecfe83-5852-4a06-83fd-d8691cbec38c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:02.926093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-abc62517-391b-4e31-b031-0b015f5e057c req-28ecfe83-5852-4a06-83fd-d8691cbec38c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:02.962039 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-abc62517-391b-4e31-b031-0b015f5e057c req-28ecfe83-5852-4a06-83fd-d8691cbec38c service nova] Creating event network-vif-plugged:de3e2bcc-4b7d-4cef-b16e-13230a55be52 for instance ed30164c-2ad2-497f-b681-096e9672b260 on n-h1-master-1 Oct 24 09:20:02.975268 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-abc62517-391b-4e31-b031-0b015f5e057c req-28ecfe83-5852-4a06-83fd-d8691cbec38c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075087 Oct 24 09:20:02.977741 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2743/5710] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:02.983736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:02.984451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:03.003074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:03.003839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:03.005233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:03.006570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:03.007251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:03.007869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:03.040085 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] HTTP exception thrown: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Request method failure captured: Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 HTTP/1.1 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc9db1q0thT52l3TZk3ZLADEO6QnYP5Qbaxda1FpEtywh7X49FBf8LVm5IQ1LphL7X2q2MOh_EdVOYAT34kmGEEw583XwC5xxdZ_88TDeiJbXftu2OJdB0cj_GpqJXAfNvpf8_c1JCZdRRx1IeUzQOfUj04wtJCcfJG3-o3Cvo4jHI Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee7511c75374ba599216666ba191e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee7511c75374ba599216666ba191e9e"}]}] Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: de6929c304ff4260b9e7c4d469b71a0d Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1cb71e8c-110f-4129-b6cb-05d7422a5083'} Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:03.041848 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:03.045902 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:03.047888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Returning 404 to user: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:20:03.048978 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11a4f5b7-486c-49f2-a0ab-05498136d505 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 404 len: 111 microversion: 2.1 time: 0.069672 Oct 24 09:20:03.050400 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2744/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:02 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:20:03.070209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba2a0c9c-0edb-4946-818b-1a81bb16cf33 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '.version_select at 0x7f8dab0eb700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:03.093478 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba2a0c9c-0edb-4946-818b-1a81bb16cf33 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802609745" status: 202 len: 0 microversion: 2.1 time: 0.027040 Oct 24 09:20:03.094908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2745/5712] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802609745 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:20:03.384623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:03.404419 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7168026b-b565-4814-8789-c930cfada493 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.959560 Oct 24 09:20:03.407589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2968/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:02 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:04.435423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:04.436774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:04.454544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:04.455997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:04.456649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:04.457645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:04.461218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:04.462670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:04.983882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:05.000695 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e982077c-c90c-429b-8a71-4dee770bcb19 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1373 microversion: 2.1 time: 0.571073 Oct 24 09:20:05.002605 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2746/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:04 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1373 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:05.269466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-80274878", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a59e1058-3a7b-4dd3-b40e-da035da5b278"}], "security_groups": [{"name": "tempest-securitygroup--395744008"}], "key_name": "tempest-keypair-1429986586", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:05.516426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] validate_networks() for [('a59e1058-3a7b-4dd3-b40e-da035da5b278', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:20:06.031845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:06.032464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:06.042749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:06.043794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:06.044651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:06.047832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:06.050105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:06.051782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:06.651111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:20:06.651542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:20:06.652020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:20:06.652614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:20:06.653049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:20:06.680211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:06.680747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:06.681198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:06.681993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:06.682461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:06.683024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:06.728922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:20:06.741698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Getting quotas for user b2755c3ea93440999d287890d328ecd6 and project c6f88028805e42a0a83e7de1f6f39d99. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:20:06.781237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:20:06.783908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:20:06.829468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:06.843726 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77c68d14-4522-405f-97f7-b890bb23c326 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1544 microversion: 2.1 time: 0.815674 Oct 24 09:20:06.853971 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2747/5715] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:06 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1544 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:06.888671 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:20:06.892167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:06.893125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:06.914795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:06.916766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:06.918596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:06.919460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:06.920860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:06.921970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:07.507403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:07.536657 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58e140d2-7890-4976-80a5-5ca11f616024 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1544 microversion: 2.1 time: 0.657296 Oct 24 09:20:07.537866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2748/5716] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:06 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1544 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:07.900652 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58754. Oct 24 09:20:07.908836 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e5c72a4-4d05-44e0-a288-2c6be0012815 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.645917 Oct 24 09:20:07.911807 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2969/5717] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:20:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:20:07.930646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63c88263-bf05-4654-bcbf-23f6a5c26818 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:07.934461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63c88263-bf05-4654-bcbf-23f6a5c26818 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:08.153625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63c88263-bf05-4654-bcbf-23f6a5c26818 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:08.163998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63c88263-bf05-4654-bcbf-23f6a5c26818 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:08.183883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63c88263-bf05-4654-bcbf-23f6a5c26818 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:08.189820 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63c88263-bf05-4654-bcbf-23f6a5c26818 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1280 microversion: 2.20 time: 0.267335 Oct 24 09:20:08.202724 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2970/5718] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:07 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:08.575610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5829f3f-98fe-444d-8bb7-4cd27ca160ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: .version_select at 0x7f8da99718b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2100324951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzhq/mUK8/FH/iT7l/qe1S2dtoW5NNgTcH+foi8NnXyrwr1zJcwPFzz0BJtm6BplrndskI8J+4CqKUywqcY1vjHEUNTTP9AqpP9FxAed9w1aCUR8lYP/g7CwmKkr0ykYA=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:08.629084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c5829f3f-98fe-444d-8bb7-4cd27ca160ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:20:08.642164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c5829f3f-98fe-444d-8bb7-4cd27ca160ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:20:08.715671 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5829f3f-98fe-444d-8bb7-4cd27ca160ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.869098 Oct 24 09:20:08.721935 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2749/5719] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:20:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:09.225057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef9efccb-a3c2-4fe1-a703-31c382a1ff72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:09.225717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef9efccb-a3c2-4fe1-a703-31c382a1ff72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:09.918248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef9efccb-a3c2-4fe1-a703-31c382a1ff72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:09.929409 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef9efccb-a3c2-4fe1-a703-31c382a1ff72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:09.942998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef9efccb-a3c2-4fe1-a703-31c382a1ff72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:09.942998 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef9efccb-a3c2-4fe1-a703-31c382a1ff72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1280 microversion: 2.20 time: 0.720782 Oct 24 09:20:09.962876 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2971/5720] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:09 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1280 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:10.974896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6dd54cf-cc02-4cdc-b032-e236030f28d0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:10.975645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6dd54cf-cc02-4cdc-b032-e236030f28d0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:11.393803 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6dd54cf-cc02-4cdc-b032-e236030f28d0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:11.421304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6dd54cf-cc02-4cdc-b032-e236030f28d0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:11.431307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6dd54cf-cc02-4cdc-b032-e236030f28d0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:11.432669 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6dd54cf-cc02-4cdc-b032-e236030f28d0 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1280 microversion: 2.20 time: 0.465361 Oct 24 09:20:11.457747 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2750/5721] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:10 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1280 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:12.464560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:12.465182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:12.472933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:12.473825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:12.474425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:12.475329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:12.475949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:12.476538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:12.785173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:12.815603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:12.829755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:12.831365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6132bae7-5557-49f5-9bf0-26ff35d279cd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1284 microversion: 2.20 time: 0.370735 Oct 24 09:20:12.834433 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2972/5722] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:12 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:13.484073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0ecf65ea-2609-4576-8759-56bbf2b88d3c req-a279386c-a88c-45f0-8500-929aee2d7bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed30164c-2ad2-497f-b681-096e9672b260", "tag": "de3e2bcc-4b7d-4cef-b16e-13230a55be52"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:13.513260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0ecf65ea-2609-4576-8759-56bbf2b88d3c req-a279386c-a88c-45f0-8500-929aee2d7bb3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:13.516332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0ecf65ea-2609-4576-8759-56bbf2b88d3c req-a279386c-a88c-45f0-8500-929aee2d7bb3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:13.516937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0ecf65ea-2609-4576-8759-56bbf2b88d3c req-a279386c-a88c-45f0-8500-929aee2d7bb3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:13.551109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0ecf65ea-2609-4576-8759-56bbf2b88d3c req-a279386c-a88c-45f0-8500-929aee2d7bb3 service nova] Creating event network-changed:de3e2bcc-4b7d-4cef-b16e-13230a55be52 for instance ed30164c-2ad2-497f-b681-096e9672b260 on n-h1-master-1 Oct 24 09:20:13.565080 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0ecf65ea-2609-4576-8759-56bbf2b88d3c req-a279386c-a88c-45f0-8500-929aee2d7bb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086852 Oct 24 09:20:13.568022 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2751/5723] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:20:13.863150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:13.864966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:13.880187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:13.885950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:13.888762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:13.891002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:13.891790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:13.892579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:14.060552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:14.080449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:14.087908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:14.094947 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9551ad30-6761-4a3e-b4e7-e32bb0a16845 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1332 microversion: 2.20 time: 0.236267 Oct 24 09:20:14.096487 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2973/5724] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:13 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:20:15.129871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:15.131822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:15.155820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:15.156328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:15.156776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:15.159662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:15.160173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:15.162982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:15.532942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:15.559740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:15.564053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:15.565676 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8257cb4e-8a62-4bae-8b95-3f4fa221801a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1338 microversion: 2.20 time: 0.442176 Oct 24 09:20:15.577289 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2752/5725] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:15 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1338 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:16.596244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:16.596869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:16.612242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:16.613077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:16.613999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:16.614916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:16.615541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:16.616197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:16.710494 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:16.857628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:16.870607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:16.872134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:16.883335 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08015b1b-b3b9-4fa3-893a-c63caa9064e4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1338 microversion: 2.20 time: 0.290945 Oct 24 09:20:16.889940 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2974/5726] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:16 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1338 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:17.865068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:17.866476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:17.887865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:17.888537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:17.890620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:17.891617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:17.893752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:17.896576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:17.914425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:17.915090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:17.932223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:17.932784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:17.933237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:17.934004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:17.934469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:17.934900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:17.938183 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] HTTP exception thrown: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Request method failure captured: Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 HTTP/1.1 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc9db1q0thT52l3TZk3ZLADEO6QnYP5Qbaxda1FpEtywh7X49FBf8LVm5IQ1LphL7X2q2MOh_EdVOYAT34kmGEEw583XwC5xxdZ_88TDeiJbXftu2OJdB0cj_GpqJXAfNvpf8_c1JCZdRRx1IeUzQOfUj04wtJCcfJG3-o3Cvo4jHI Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee7511c75374ba599216666ba191e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee7511c75374ba599216666ba191e9e"}]}] Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: de6929c304ff4260b9e7c4d469b71a0d Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1cb71e8c-110f-4129-b6cb-05d7422a5083'} Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:20:17.940659 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:17.945289 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:17.950158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Returning 404 to user: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:20:17.951289 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d0668197-4a77-44a3-8a22-610baac641c9 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 404 len: 111 microversion: 2.1 time: 0.095055 Oct 24 09:20:17.955745 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2753/5727] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:20:17 2022] DELETE /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:20:17.964575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:17.965552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1cb71e8c-110f-4129-b6cb-05d7422a5083] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:17.974210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:17.974714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:17.975354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:17.976298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:17.977539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:17.978405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:18.004133 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] HTTP exception thrown: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Request method failure captured: Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 HTTP/1.1 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlc9db1q0thT52l3TZk3ZLADEO6QnYP5Qbaxda1FpEtywh7X49FBf8LVm5IQ1LphL7X2q2MOh_EdVOYAT34kmGEEw583XwC5xxdZ_88TDeiJbXftu2OJdB0cj_GpqJXAfNvpf8_c1JCZdRRx1IeUzQOfUj04wtJCcfJG3-o3Cvo4jHI Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee7511c75374ba599216666ba191e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee7511c75374ba599216666ba191e9e"}]}] Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: de6929c304ff4260b9e7c4d469b71a0d Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1cb71e8c-110f-4129-b6cb-05d7422a5083'} Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:18.006588 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. Oct 24 09:20:18.012268 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:20:18.015705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Returning 404 to user: Instance 1cb71e8c-110f-4129-b6cb-05d7422a5083 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:20:18.016932 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53075c64-ea54-40b7-99d3-3974a6f35b2e tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083" status: 404 len: 111 microversion: 2.1 time: 0.060014 Oct 24 09:20:18.018406 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2754/5728] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:17 2022] GET /compute/v2.1/servers/1cb71e8c-110f-4129-b6cb-05d7422a5083 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:20:18.155583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:18.174746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:18.180031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:18.185819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e36f419-5d19-49a1-8c91-187c6cd6651f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1338 microversion: 2.20 time: 0.274094 Oct 24 09:20:18.186134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2975/5729] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:17 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:19.215662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:19.216317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:19.224233 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:19.257159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:19.259139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:19.261691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:19.263611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:19.271000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:19.271744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:20.129520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:20.140377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:20.146068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:20.152304 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6f84e6e-4661-42f9-b63d-5d4a5dd00a35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.941405 Oct 24 09:20:20.167098 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2755/5730] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:19 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:21.182903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:21.183515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:21.186482 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:21.214539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:21.215050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:21.215504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:21.216240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:21.216716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:21.226219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:21.233178 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:21.755682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:21.765071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:21.772248 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:21.778856 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9044f6b3-10b6-4f09-a173-e82416eb6c86 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.599191 Oct 24 09:20:21.799811 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2976/5731] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:21 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:22.818323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:22.819063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:22.828811 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:22.840659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:22.841534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:22.844070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:22.845149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:22.847768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:22.853141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:23.908845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:23.909987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:23.924543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:23.925256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:23.925790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:23.930485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:23.933091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:23.933760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:23.968578 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] HTTP exception thrown: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Request method failure captured: Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 HTTP/1.1 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlc9db1q0thT52l3TZk3ZLADEO6QnYP5Qbaxda1FpEtywh7X49FBf8LVm5IQ1LphL7X2q2MOh_EdVOYAT34kmGEEw583XwC5xxdZ_88TDeiJbXftu2OJdB0cj_GpqJXAfNvpf8_c1JCZdRRx1IeUzQOfUj04wtJCcfJG3-o3Cvo4jHI Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee7511c75374ba599216666ba191e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee7511c75374ba599216666ba191e9e"}]}] Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: de6929c304ff4260b9e7c4d469b71a0d Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1484921f-2743-4293-8612-41bed0f98326'} Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:20:23.971453 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:23.977261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Returning 404 to user: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:20:23.980163 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6b91600d-7e76-4a8f-9d4c-cefa85de1165 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 404 len: 111 microversion: 2.1 time: 0.075315 Oct 24 09:20:23.981511 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2977/5732] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:20:23 2022] DELETE /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:20:24.007790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:24.011540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] [instance: 1484921f-2743-4293-8612-41bed0f98326] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:24.034719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:24.035249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:24.035701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:24.036411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:24.036877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:24.037323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:24.085329 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] HTTP exception thrown: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Request method failure captured: Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 HTTP/1.1 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlc9db1q0thT52l3TZk3ZLADEO6QnYP5Qbaxda1FpEtywh7X49FBf8LVm5IQ1LphL7X2q2MOh_EdVOYAT34kmGEEw583XwC5xxdZ_88TDeiJbXftu2OJdB0cj_GpqJXAfNvpf8_c1JCZdRRx1IeUzQOfUj04wtJCcfJG3-o3Cvo4jHI Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee7511c75374ba599216666ba191e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee7511c75374ba599216666ba191e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee7511c75374ba599216666ba191e9e"}]}] Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7ee7511c75374ba599216666ba191e9e Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1596116502 Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: de6929c304ff4260b9e7c4d469b71a0d Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeTestJSON-1596116502-project Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1484921f-2743-4293-8612-41bed0f98326'} Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:20:24.088769 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. Oct 24 09:20:24.093170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:20:24.096489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] Returning 404 to user: Instance 1484921f-2743-4293-8612-41bed0f98326 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:20:24.097657 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eabc0396-e074-43f3-b0ed-33a401756180 tempest-AttachVolumeTestJSON-1596116502 tempest-AttachVolumeTestJSON-1596116502-project] 10.222.0.25 "GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326" status: 404 len: 111 microversion: 2.1 time: 0.111920 Oct 24 09:20:24.100351 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2978/5733] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:23 2022] GET /compute/v2.1/servers/1484921f-2743-4293-8612-41bed0f98326 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:20:24.234392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:24.250720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:24.256765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:24.262428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e254ccc-663d-4ff5-a811-c719b3a274c8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 1.447473 Oct 24 09:20:24.264745 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2756/5734] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:22 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:25.291025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:25.291929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:25.328639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:25.343650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:25.345897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:25.346989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:25.348566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:25.350475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:25.465978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9aa471d0-ed1d-46a9-83a7-0c5ff727fb30 req-4acc2c1a-a7b7-4cc1-ad08-3193f60987a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:25.491724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9aa471d0-ed1d-46a9-83a7-0c5ff727fb30 req-4acc2c1a-a7b7-4cc1-ad08-3193f60987a8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:25.499018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9aa471d0-ed1d-46a9-83a7-0c5ff727fb30 req-4acc2c1a-a7b7-4cc1-ad08-3193f60987a8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:25.502226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9aa471d0-ed1d-46a9-83a7-0c5ff727fb30 req-4acc2c1a-a7b7-4cc1-ad08-3193f60987a8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:25.549215 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9aa471d0-ed1d-46a9-83a7-0c5ff727fb30 req-4acc2c1a-a7b7-4cc1-ad08-3193f60987a8 service nova] Creating event network-changed:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:20:25.563839 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9aa471d0-ed1d-46a9-83a7-0c5ff727fb30 req-4acc2c1a-a7b7-4cc1-ad08-3193f60987a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101535 Oct 24 09:20:25.569057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2757/5735] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:26.051331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:26.081998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:26.091938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:26.095702 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6110829-c97a-423c-b27a-9ad30c98d636 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.809387 Oct 24 09:20:26.102402 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2979/5736] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:25 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:27.128695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:27.129868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:27.166964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:27.168698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:27.169346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:27.174662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:27.175541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:27.178748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:27.855135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:27.858176 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=90 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:27.874104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:27.878824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:27.880834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0080ce12-b988-49be-b356-79cb3ae6f250 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.757047 Oct 24 09:20:27.886333 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2758/5737] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:27 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:28.914647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:28.915305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:28.937910 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:28.950776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:28.951416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:28.951872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:28.952655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:28.955633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:28.957829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:29.288123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:29.291471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:29.308377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:29.311715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:29.313637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:29.316150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:29.319099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:29.319761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:29.482927 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14fa374b-347e-460c-9a32-3155c56a9bd9 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260/action" status: 200 len: 24570 microversion: 2.1 time: 0.199374 Oct 24 09:20:29.491029 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2759/5738] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:20:29 2022] POST /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260/action => generated 24570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:20:29.555959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:29.564884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:29.572979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:29.574191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a13a143d-c7f6-4612-9753-07bdbc4e2685 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.664227 Oct 24 09:20:29.591582 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2980/5739] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:28 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:30.604584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:30.605579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:30.620795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:30.622781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:30.623522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:30.626812 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:30.628078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:30.629851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:30.884731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:30.895024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:30.900900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:30.902500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a2977f7-3a58-455f-99a2-609de5678e0b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.304341 Oct 24 09:20:30.906080 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2760/5740] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:30 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:31.931225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:31.932481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:31.952551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:31.960786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:31.966200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:31.967392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:31.969896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:31.970874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:32.934896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:32.951998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:32.959981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:32.962867 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc23cc0c-0d47-49ac-856b-67f0b5aa37ee tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 1.036500 Oct 24 09:20:32.967051 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2981/5741] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:31 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:33.451165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1777569490", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "964ad74a-07dc-41ce-a82d-6fc67d5df722"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2100324951", "security_groups": [{"name": "tempest-secgroup-smoke-961611005"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:33.687872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] validate_networks() for [('964ad74a-07dc-41ce-a82d-6fc67d5df722', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:20:34.002196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:34.003402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:34.019407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:34.020144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:34.020694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:34.021715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:34.022439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:34.023300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:34.330595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:34.346839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:34.355482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:34.358290 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa002778-d0ad-4863-814a-390c919d5dfa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.363511 Oct 24 09:20:34.367000 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2982/5742] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:33 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:35.384372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:20:35.391638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:20:35.393078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:20:35.393656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:35.394670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:20:35.395475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:35.396048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:20:35.420884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:35.421789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:35.422200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:35.424717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:35.426711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:35.429378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:35.430601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:35.432916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:35.434912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:35.435907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:35.440378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:35.441831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:35.516855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:20:35.531926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:20:35.553171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:20:35.556876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:20:35.697080 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac731c7f-c06f-4c04-b248-661038b68ce6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.250369 Oct 24 09:20:35.721763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2761/5743] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:20:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:20:35.744956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a0d0b3f-06f5-4f30-9758-9c43e5dd7270 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:35.746365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a0d0b3f-06f5-4f30-9758-9c43e5dd7270 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:35.896480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0a0d0b3f-06f5-4f30-9758-9c43e5dd7270 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:35.911370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a0d0b3f-06f5-4f30-9758-9c43e5dd7270 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1267 microversion: 2.1 time: 0.176080 Oct 24 09:20:35.912775 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2762/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:35 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:36.036850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:36.067912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:36.075869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:36.078427 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2e34419-605f-4a56-b5bd-befe51f6cb95 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.690383 Oct 24 09:20:36.082813 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2983/5745] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:35 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:20:36.724039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2b740ee4-ff6f-4eb2-828c-0b8ffb5cf0a9 req-4510c68c-a20b-43ed-9523-de9c1715ce61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "name": "network-vif-plugged", "status": "completed", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:36.755882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2b740ee4-ff6f-4eb2-828c-0b8ffb5cf0a9 req-4510c68c-a20b-43ed-9523-de9c1715ce61 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:36.762169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2b740ee4-ff6f-4eb2-828c-0b8ffb5cf0a9 req-4510c68c-a20b-43ed-9523-de9c1715ce61 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:36.763497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2b740ee4-ff6f-4eb2-828c-0b8ffb5cf0a9 req-4510c68c-a20b-43ed-9523-de9c1715ce61 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:36.790508 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2b740ee4-ff6f-4eb2-828c-0b8ffb5cf0a9 req-4510c68c-a20b-43ed-9523-de9c1715ce61 service nova] Creating event network-vif-plugged:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:20:36.798845 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2b740ee4-ff6f-4eb2-828c-0b8ffb5cf0a9 req-4510c68c-a20b-43ed-9523-de9c1715ce61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078535 Oct 24 09:20:36.800462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2763/5746] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:36.936861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:36.938273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:36.954246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:36.954872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:36.956392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:36.957431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:36.958703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:36.960418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:37.116473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:37.118467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:37.140249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:37.141010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:37.160395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:37.163345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:37.165978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:37.166924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:37.177277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:37.199266 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7410d710-60ad-4f9f-9462-00646aa55d18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1263 microversion: 2.1 time: 0.267936 Oct 24 09:20:37.202620 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2984/5747] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:36 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:37.541141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:37.550494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:37.554166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:37.560841 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c3420e7-eec0-4b17-978c-e35117a2f842 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.449170 Oct 24 09:20:37.586577 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2764/5748] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:37 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:20:38.228961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:38.229782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:38.245641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:38.246154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:38.246587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:38.256435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:38.258033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:38.260741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:38.430257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:38.439103 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-15ba09c1-a5de-485d-9f45-06705f6bdca2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1325 microversion: 2.1 time: 0.214832 Oct 24 09:20:38.442770 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2985/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:38 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:38.588394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:38.589388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:38.608032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:38.608541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:38.611298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:38.612881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:38.615011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:38.615470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:39.422884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:39.438833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:39.459070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:39.461857 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59d2d3e9-6652-454a-92a9-aae473cb19c1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1405 microversion: 2.20 time: 0.876131 Oct 24 09:20:39.463247 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2765/5750] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:38 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1405 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:39.485613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:39.487346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:39.496749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:39.497714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:39.498409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:39.499433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:39.500538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:39.503242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:39.762025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:39.775277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74ba5420-5404-456e-a77c-047be0edc61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1325 microversion: 2.1 time: 0.292176 Oct 24 09:20:39.777473 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2986/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:39 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:40.494883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:40.495501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:40.513380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:40.527720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:40.528569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:40.529776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:40.530467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:40.531119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:40.801779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:40.803509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:40.819959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:40.821626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:40.822384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:40.824254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:40.824963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:40.825652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:40.860970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:40.875155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:40.880732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:40.888396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0553e18-1001-4a96-8e59-8fc636bf5704 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1597 microversion: 2.20 time: 0.400110 Oct 24 09:20:40.903910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2766/5752] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:20:40 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1597 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:20:40.918881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:40.919665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:40.926926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:40.927645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:40.928384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:40.929430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:40.930038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:40.930614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:41.109059 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25ed1e67-900b-4adf-bf92-35551ea343db tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.195819 Oct 24 09:20:41.110819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2767/5753] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Oct 24 09:20:40 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:20:41.401600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3250d6f2-d10b-418c-8faf-16f8220040a3 req-195668a1-dc50-4a0c-8314-eddbe051b48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:41.415784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3250d6f2-d10b-418c-8faf-16f8220040a3 req-195668a1-dc50-4a0c-8314-eddbe051b48e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:41.416637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3250d6f2-d10b-418c-8faf-16f8220040a3 req-195668a1-dc50-4a0c-8314-eddbe051b48e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:41.417736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3250d6f2-d10b-418c-8faf-16f8220040a3 req-195668a1-dc50-4a0c-8314-eddbe051b48e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:41.433243 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3250d6f2-d10b-418c-8faf-16f8220040a3 req-195668a1-dc50-4a0c-8314-eddbe051b48e service nova] Creating event network-changed:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h1-master-1 Oct 24 09:20:41.457877 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3250d6f2-d10b-418c-8faf-16f8220040a3 req-195668a1-dc50-4a0c-8314-eddbe051b48e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063452 Oct 24 09:20:41.463962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2768/5754] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:20:41.833990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:41.862372 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f991e96-f9a6-4981-8a36-0a8335317fab tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 1.058318 Oct 24 09:20:41.869505 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2987/5755] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:40 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:42.893599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:42.894314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:42.911083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:42.912523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:42.913179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:42.914927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:42.917014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:42.917987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:43.600366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:43.613640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a217680c-a157-45f4-87b8-4cc0fc6a5816 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 0.725230 Oct 24 09:20:43.614815 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2769/5756] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:42 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:44.057619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d350b51-fc91-432d-a4bf-8811ce2be899 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'create', calling method: .version_select at 0x7f8daa459af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-945001447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgsyktgGLRUKdt5tHkAAmqTBzQDfoHUs6AEaqPb9kX8rMc7c672uaBu5VAX0b2t68quItOy8vgj0ZerS7GP/WTaL6w5KM3qd4bWOjtT7FCfP1kTjY45TzrV43GwtzDybg=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:44.063768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-eeb69099-fbda-41e4-b1b1-7ff79f12dbcf req-b94c7171-abae-4727-babd-18d8118e4eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:44.097919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eeb69099-fbda-41e4-b1b1-7ff79f12dbcf req-b94c7171-abae-4727-babd-18d8118e4eb6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:44.104145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eeb69099-fbda-41e4-b1b1-7ff79f12dbcf req-b94c7171-abae-4727-babd-18d8118e4eb6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:44.104896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-eeb69099-fbda-41e4-b1b1-7ff79f12dbcf req-b94c7171-abae-4727-babd-18d8118e4eb6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:44.128724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5d350b51-fc91-432d-a4bf-8811ce2be899 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for project 1104d284053c4625bcb91c06e3fa5848. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:20:44.135221 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-eeb69099-fbda-41e4-b1b1-7ff79f12dbcf req-b94c7171-abae-4727-babd-18d8118e4eb6 service nova] Creating event network-changed:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:20:44.153284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5d350b51-fc91-432d-a4bf-8811ce2be899 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for user 9d0b4f066e344bba84c0369d4c695f8b and project 1104d284053c4625bcb91c06e3fa5848. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:20:44.167079 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-eeb69099-fbda-41e4-b1b1-7ff79f12dbcf req-b94c7171-abae-4727-babd-18d8118e4eb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106870 Oct 24 09:20:44.168318 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2770/5757] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:44.218222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d350b51-fc91-432d-a4bf-8811ce2be899 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.164951 Oct 24 09:20:44.238769 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2988/5758] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:20:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:20:44.641005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:44.641775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:44.655738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:44.657927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:44.659736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:44.662645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:44.666539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:44.668411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:45.498809 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:45.634481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:45.648976 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83191fad-19fb-4a4e-b865-35683a902eaf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 1.013031 Oct 24 09:20:45.649810 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2771/5759] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:44 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:46.680886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:46.682425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:46.715814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:46.717779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:46.720258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:46.722660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:46.723467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:46.725165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:47.637414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:47.645888 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e40d28a1-64fa-4f07-98e1-49abaf2efe44 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 0.971792 Oct 24 09:20:47.664391 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2989/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:46 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:47.701687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1633070057", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "bae2a52c-e02c-4095-98d8-d26c0ea973a0"}], "key_name": "tempest-TestNetworkBasicOps-945001447", "security_groups": [{"name": "tempest-secgroup-smoke-1353409193"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:47.753012 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:48.134988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] validate_networks() for [('bae2a52c-e02c-4095-98d8-d26c0ea973a0', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:20:48.672374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:48.673535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:48.686516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:48.687124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:48.687652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:48.689108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:48.689899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:48.693902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:48.919035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:20:48.919515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:20:48.920059 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:20:48.920475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:20:48.921019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:20:48.939119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:48.939119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:48.939119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:48.939119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:48.939119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:48.939119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:48.960641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for project 1104d284053c4625bcb91c06e3fa5848. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:20:48.975055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for user 9d0b4f066e344bba84c0369d4c695f8b and project 1104d284053c4625bcb91c06e3fa5848. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:20:48.999406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:20:49.003015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:20:49.072465 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4043549-44d5-40d4-94d3-edd0327f7793 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.384358 Oct 24 09:20:49.073799 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2772/5761] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:20:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:20:49.085615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e70078f-816d-4017-af03-26c3f4b069e8 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:49.090243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e70078f-816d-4017-af03-26c3f4b069e8 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:49.222538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e70078f-816d-4017-af03-26c3f4b069e8 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:49.231600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e70078f-816d-4017-af03-26c3f4b069e8 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1248 microversion: 2.1 time: 0.150637 Oct 24 09:20:49.234744 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2773/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:49 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1248 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:49.272386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:49.284510 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a67165f8-8ea3-44d9-b496-d83e123bc8c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 0.616436 Oct 24 09:20:49.301594 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2990/5763] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:48 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:50.258301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:50.259489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:50.266025 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:50.289054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:50.291123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:50.296293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:50.297071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:50.297645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:50.302043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:50.314081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:50.315020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:50.330426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:50.330948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:50.331505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:50.332099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:50.334246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:50.334707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:50.484737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:50.498211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b47d6437-8423-4df7-9a8b-83d6859d9d34 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1244 microversion: 2.1 time: 0.245632 Oct 24 09:20:50.513325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2774/5764] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:50 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1244 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:50.566405 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-388d4842-46ce-48c1-a261-467481291945 req-9b225eb5-d1a9-4cc8-9b38-4bab85077331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "name": "network-vif-plugged", "status": "completed", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:50.597109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-388d4842-46ce-48c1-a261-467481291945 req-9b225eb5-d1a9-4cc8-9b38-4bab85077331 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:50.598326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-388d4842-46ce-48c1-a261-467481291945 req-9b225eb5-d1a9-4cc8-9b38-4bab85077331 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:50.599064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-388d4842-46ce-48c1-a261-467481291945 req-9b225eb5-d1a9-4cc8-9b38-4bab85077331 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:50.629210 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-388d4842-46ce-48c1-a261-467481291945 req-9b225eb5-d1a9-4cc8-9b38-4bab85077331 service nova] Creating event network-vif-plugged:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h1-master-1 Oct 24 09:20:50.636186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-388d4842-46ce-48c1-a261-467481291945 req-9b225eb5-d1a9-4cc8-9b38-4bab85077331 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076737 Oct 24 09:20:50.637792 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2775/5765] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:20:50.752436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:50.767692 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc5422cc-fea9-45d9-9f0a-639c721fb66a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 0.456755 Oct 24 09:20:50.784032 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2991/5766] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:50 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:51.531742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:51.533080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:51.552608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:51.554775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:51.555678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:51.556634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:51.557340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:51.557965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:51.656193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:51.672160 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a00bad34-8773-4245-bba6-b792a97fe4d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1306 microversion: 2.1 time: 0.144086 Oct 24 09:20:51.673690 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2776/5767] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:51 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1306 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:51.796606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:51.797552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:51.817385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:51.819388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:51.820227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:51.821985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:51.823813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:51.824703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:51.843778 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=82 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:52.701816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:52.703375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:52.720721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:52.722964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:52.723646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:52.729309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:52.735021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:52.737289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:52.888941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:52.916555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4c66786-6723-4cb7-9442-3f0126b28c9e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1392 microversion: 2.1 time: 1.125212 Oct 24 09:20:52.918545 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2992/5768] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:51 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1392 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:53.646136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:53.659462 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab45f882-c00c-4f97-8f4c-ffa24ac27856 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1374 microversion: 2.1 time: 0.962937 Oct 24 09:20:53.660822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2777/5769] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:52 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1374 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:53.943408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:53.944046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:53.954952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:53.957034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:53.958643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:53.959636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:53.961413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:53.962115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:54.183229 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:54.213271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e982e905-f3e9-46d1-a4ea-3a2e3d359b6c req-a25192cc-941e-4847-825a-fe628244edc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf91ab7-3898-4339-9dc5-414e7c539e7d", "tag": "0ca722af-af8a-475b-90b1-a364ed9ae351"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:54.235737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e982e905-f3e9-46d1-a4ea-3a2e3d359b6c req-a25192cc-941e-4847-825a-fe628244edc7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:54.237395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e982e905-f3e9-46d1-a4ea-3a2e3d359b6c req-a25192cc-941e-4847-825a-fe628244edc7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:54.237897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e982e905-f3e9-46d1-a4ea-3a2e3d359b6c req-a25192cc-941e-4847-825a-fe628244edc7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:54.270403 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e982e905-f3e9-46d1-a4ea-3a2e3d359b6c req-a25192cc-941e-4847-825a-fe628244edc7 service nova] Creating event network-changed:0ca722af-af8a-475b-90b1-a364ed9ae351 for instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d on n-h2-master-1 Oct 24 09:20:54.277960 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e982e905-f3e9-46d1-a4ea-3a2e3d359b6c req-a25192cc-941e-4847-825a-fe628244edc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069090 Oct 24 09:20:54.280977 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2778/5770] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:20:54.401482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:54.415318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-17271b70-2367-45e9-a177-9c8838aea064 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1563 microversion: 2.1 time: 0.476317 Oct 24 09:20:54.417324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2993/5771] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:53 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1563 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:54.446624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:54.447326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:54.458818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:54.459559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:54.460371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:54.461598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:54.463296 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:54.464037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:54.687907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:54.688526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:54.713026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:54.713952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:54.714552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:54.715447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:54.716064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:54.716921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:54.841721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:54.856831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5215113c-57a4-4a48-8b85-b79272b296b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1563 microversion: 2.1 time: 0.415571 Oct 24 09:20:54.857459 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2779/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:54 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1563 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:56.161545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:56.180093 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0fadb3a8-d63d-46e9-a023-c144fbfe2ccf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1374 microversion: 2.1 time: 1.496581 Oct 24 09:20:56.187749 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2994/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:54 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1374 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:20:57.204304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:57.204939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:57.217817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:57.218332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:57.218782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:57.219510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:57.223904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:57.224570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:57.952815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:57.955583 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=88 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:57.965286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4d2f474-1547-47cb-b970-b8e2b96104e3 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1374 microversion: 2.1 time: 0.765796 Oct 24 09:20:57.966363 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2780/5774] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:57 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1374 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:58.992259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:20:58.993852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:20:59.011113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:59.012916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:59.014009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:59.014849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:59.016860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:59.020230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:59.430038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:20:59.445232 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cf1249e-ad29-4b50-86d0-419104ddddca tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1374 microversion: 2.1 time: 0.456721 Oct 24 09:20:59.446868 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2995/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:20:58 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1374 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:20:59.575300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1ce20c53-0a13-4a64-ac82-bec2b6dfdc25 req-72a9e45c-8a3e-4d68-b0b0-55e3fa9ffef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf91ab7-3898-4339-9dc5-414e7c539e7d", "name": "network-vif-plugged", "status": "completed", "tag": "0ca722af-af8a-475b-90b1-a364ed9ae351"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:20:59.607944 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:59.608759 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:59.623997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1ce20c53-0a13-4a64-ac82-bec2b6dfdc25 req-72a9e45c-8a3e-4d68-b0b0-55e3fa9ffef8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:20:59.624487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1ce20c53-0a13-4a64-ac82-bec2b6dfdc25 req-72a9e45c-8a3e-4d68-b0b0-55e3fa9ffef8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:20:59.624927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1ce20c53-0a13-4a64-ac82-bec2b6dfdc25 req-72a9e45c-8a3e-4d68-b0b0-55e3fa9ffef8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:20:59.670704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1ce20c53-0a13-4a64-ac82-bec2b6dfdc25 req-72a9e45c-8a3e-4d68-b0b0-55e3fa9ffef8 service nova] Creating event network-vif-plugged:0ca722af-af8a-475b-90b1-a364ed9ae351 for instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d on n-h2-master-1 Oct 24 09:20:59.685265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1ce20c53-0a13-4a64-ac82-bec2b6dfdc25 req-72a9e45c-8a3e-4d68-b0b0-55e3fa9ffef8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114365 Oct 24 09:20:59.706388 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2781/5776] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:00.468625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:00.470284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:00.473450 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:00.495701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:00.496585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:00.497442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:00.498388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:00.499086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:00.499735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:00.908775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:00.910161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:00.918907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:00.919887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:00.920541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:00.921971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:00.922700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:00.923334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:00.961551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:00.977783 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86c00af5-1e8b-48aa-96dd-49dc66b6ca7e tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1374 microversion: 2.1 time: 0.512938 Oct 24 09:21:00.989646 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2996/5777] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:00 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1374 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:01.001086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c5ba4690-17b9-4ca5-ad89-d363c1041e20 req-03a0e372-a7e2-4b66-a6c7-c8eeb02f1159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:01.022861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c5ba4690-17b9-4ca5-ad89-d363c1041e20 req-03a0e372-a7e2-4b66-a6c7-c8eeb02f1159 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:01.027863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c5ba4690-17b9-4ca5-ad89-d363c1041e20 req-03a0e372-a7e2-4b66-a6c7-c8eeb02f1159 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:01.028659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c5ba4690-17b9-4ca5-ad89-d363c1041e20 req-03a0e372-a7e2-4b66-a6c7-c8eeb02f1159 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:01.071593 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c5ba4690-17b9-4ca5-ad89-d363c1041e20 req-03a0e372-a7e2-4b66-a6c7-c8eeb02f1159 service nova] Creating event network-changed:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h1-master-1 Oct 24 09:21:01.092725 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c5ba4690-17b9-4ca5-ad89-d363c1041e20 req-03a0e372-a7e2-4b66-a6c7-c8eeb02f1159 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101372 Oct 24 09:21:01.093667 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2997/5778] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:01.227791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:01.274003 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1801c13b-da40-4260-86fd-4183d07e80d9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1563 microversion: 2.1 time: 0.366758 Oct 24 09:21:01.278116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2782/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:00 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1563 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:21:02.008112 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:02.010660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:02.025545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:02.029770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:02.030468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:02.031392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:02.035361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:02.036001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:02.329013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:02.339775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e393d15-c376-47e9-b248-5d9b655bc9b6 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1547 microversion: 2.1 time: 0.337519 Oct 24 09:21:02.354013 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2998/5780] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:02 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1547 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:02.364389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:02.366174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:02.375011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:02.375968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:02.376452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:02.377165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:02.377719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:02.378153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:02.651033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:02.664385 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c6faefa-6cd8-42b4-acfe-623618a516e5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1547 microversion: 2.1 time: 0.303653 Oct 24 09:21:02.665165 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2783/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:02 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1547 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:15.795688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:15.816926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:15.823827 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:15.826353 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=37 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:15.837287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:15.838048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:15.838701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:15.843195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:15.843859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:15.844638 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=19 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:15.845206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:15.845492 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=15 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:15.930005 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddc91aaf-c095-494b-9db4-b182d2bedb15 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action" status: 200 len: 24572 microversion: 2.1 time: 0.141721 Oct 24 09:21:15.930697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2999/5782] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:21:15 2022] POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action => generated 24572 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:21:16.313423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:16.314178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:16.321402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:16.322214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:16.323093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:16.325080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:16.326189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:16.326925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:16.363632 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c5cf1f8-680f-4565-a701-e7b74a0431bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/ips" status: 200 len: 151 microversion: 2.20 time: 0.526891 Oct 24 09:21:16.368311 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2784/5783] 10.222.0.25 () {60 vars in 1289 bytes} [Mon Oct 24 09:21:15 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/ips => generated 151 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:21:19.540304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:19.541150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:19.549563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:19.550307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:19.550999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:19.552019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:19.552843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:19.554202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:19.593642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lazy-loading 'flavor' on Instance uuid 923778c4-2232-4398-97da-6978c8355c52 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:21:19.937476 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c8eba4c-dc94-4627-bd55-53438e7094ea tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/action" status: 202 len: 0 microversion: 2.20 time: 0.400914 Oct 24 09:21:19.938381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3000/5784] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:21:19 2022] POST /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:19.947764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:19.949744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:19.968385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:19.969572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:19.970031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:19.971370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:19.971849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:19.973063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:20.292051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:20.304659 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:20.306306 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:20.307723 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c701bed-7691-481b-a28d-68ea7333d026 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.365106 Oct 24 09:21:20.308903 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2785/5785] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:19 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:21.343446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:21.346508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:21.356162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:21.358135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:21.358907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:21.360983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:21.361826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:21.362917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:21.557164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:21.572910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:21.575391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:21.576887 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a273180-e165-462b-8787-4ebd235594f8 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.240514 Oct 24 09:21:21.579213 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3001/5786] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:21 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:22.606794 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:22.607515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:22.624215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:22.624977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:22.625441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:22.626157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:22.626602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:22.627202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:22.837692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:22.846062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:22.848326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:22.849584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1147db6-b512-42d7-8632-06bb6fc94658 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.248007 Oct 24 09:21:22.851180 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2786/5787] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:22 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:23.878244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:23.880072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:23.889556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:23.890152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:23.890697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:23.891594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:23.892292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:23.892803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:24.173608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:24.185223 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:24.187084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:24.189438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3283e4eb-5782-4f26-99ac-8dc8a79b3b39 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.316750 Oct 24 09:21:24.190286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3002/5788] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:23 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:21:25.226218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:25.226825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:25.243820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:25.243959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:25.245268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:25.247380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:25.248139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:25.248775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:25.437558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:25.448528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:25.450521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:25.452339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77afba75-c8c4-4050-b9c7-8020c180fc1f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.239331 Oct 24 09:21:25.453087 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2787/5789] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:25 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:26.483256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:26.484517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:26.498786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:26.506382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:26.508502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:26.509151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:26.509657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:26.510096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:26.856293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:26.856905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:26.868776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:26.870060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:26.873509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:26.874295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:26.874771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:26.875219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:26.896304 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:26.907315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:26.912695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:26.915493 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d9b2b7a-7cd8-42d2-89b4-50f7e5408130 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.437206 Oct 24 09:21:26.916091 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3003/5790] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:26 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:27.735803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ea61976-3054-4710-a27b-a992724982a4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1833 microversion: 2.1 time: 0.882271 Oct 24 09:21:27.750295 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2788/5791] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:26 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1833 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:27.764265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:27.765686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:27.772902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:27.773691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:27.774298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:27.775249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:27.775890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:27.776483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:27.949537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:27.950282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:27.964993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:27.965673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:27.967320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:27.970738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:27.971533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:27.973689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:28.189169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:28.230842 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5ccc3d7-6541-4e9a-8d7d-11d9bd93963f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1682 microversion: 2.1 time: 0.470986 Oct 24 09:21:28.235149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3004/5792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:27 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1682 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:28.331898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:28.341557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:28.343145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:28.344352 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b254b9b-3023-4073-96d8-50ac2a7a8ba1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.399566 Oct 24 09:21:28.344932 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2789/5793] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:27 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:28.525639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:28.529436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:28.536478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:28.538662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:28.539431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:28.540519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:28.541539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:28.542286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:28.625519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-843dd57c-d1f3-49a1-8cd3-d563cf98ec73 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action" status: 200 len: 32651 microversion: 2.1 time: 0.105483 Oct 24 09:21:28.636954 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3005/5794] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:21:28 2022] POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action => generated 32651 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:21:28.772610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:28.774679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:28.782777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:28.794580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:28.795562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:28.796507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:28.797144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:28.797778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:28.926045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f96808120954544b427ca58eea40de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3aab62168a49b1a803137e7e404d53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:28.928223 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: dcca016b-676b-4236-aff9-7357332b2833] flavor_id is None. Assuming migration. {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 24 09:21:28.929827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: dcca016b-676b-4236-aff9-7357332b2833] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:21:29.374565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:29.376113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:29.384944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:29.401857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:29.402459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:29.403231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:29.403714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:29.404153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:29.516347 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c45f5aea-16b2-4905-b07f-72244be48e33 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action" status: 202 len: 0 microversion: 2.1 time: 0.749099 Oct 24 09:21:29.522166 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2790/5795] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:21:28 2022] POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:21:29.528718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:29.529716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:29.539003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:29.539724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:29.540367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:29.541323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:29.542315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:29.542950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:30.248152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:30.254848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:30.266648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:30.268368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:30.269896 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff313792-928b-475a-89ec-acf24b92ffed tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.899591 Oct 24 09:21:30.270020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9824ebe-3719-4e97-beec-87bdb52c8b3e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1691 microversion: 2.1 time: 0.744315 Oct 24 09:21:30.270634 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2791/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:29 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1691 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:30.285697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3006/5797] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:29 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:21:31.296210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:31.297626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:31.298229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:31.299343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:31.313771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:31.314372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:31.314721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:31.315445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:31.315908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:31.317442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:31.318146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:31.319308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:31.320219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:31.320845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:31.321479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:31.346375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:31.775004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:31.810324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eff13dd8-dc59-45ea-acb4-d5f13d9fb92c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1691 microversion: 2.1 time: 0.509316 Oct 24 09:21:31.821413 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3007/5798] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:31 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1691 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:31.908786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:31.919759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:31.924650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:31.925984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56e69b04-1f74-46cf-88e5-762880003275 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.633788 Oct 24 09:21:31.928689 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2792/5799] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:31 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:32.836642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:32.837266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:32.847537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:32.854892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:32.855531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:32.857499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:32.860391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:32.870033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:32.960411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:32.961058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:32.978143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:32.978829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:32.979285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:32.984189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:32.986585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:32.988061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:33.378934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:33.391134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:33.400521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:33.409859 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7dcf6c84-a08b-4dce-bcec-b7580f9e2902 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.452023 Oct 24 09:21:33.410535 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2793/5800] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:32 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:33.628443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:33.640047 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-039d4490-103f-4dc8-99bb-f914b69ab836 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1691 microversion: 2.1 time: 0.807755 Oct 24 09:21:33.640651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3008/5801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:32 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1691 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:33.855576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:33.873142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:33.913120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:33.913644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:33.914090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:33.914816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:33.915274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:33.915702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:34.038816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:21:34.252730 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14d0d91d-58a1-41f7-906a-07067982db77 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 204 len: 0 microversion: 2.1 time: 0.400837 Oct 24 09:21:34.257780 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2794/5802] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:21:33 2022] DELETE /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:34.262718 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:34.263352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:34.276798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:34.285199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:34.293050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:34.294604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:34.295101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:34.295547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:34.442041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:34.443276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:34.458433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:34.460452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:34.461334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:34.463702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:34.466307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:34.467947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:34.903638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:34.919928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:34.929133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:34.931799 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-332a44ac-22cb-44df-913a-8d3ccb26da25 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.496813 Oct 24 09:21:34.958377 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2795/5803] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:34 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:21:34.972963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:34.973878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:34.998765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:34.999256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:34.999852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:35.001078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:35.001662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:35.002097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:35.007813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:35.026803 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f17b0ef6-6f1c-4d89-a363-a5ab2d30b6d0 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1553 microversion: 2.1 time: 0.761092 Oct 24 09:21:35.031446 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3009/5804] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:34 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1553 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:35.966517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:35.967985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:35.976230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:35.977117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:35.990744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:35.997194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:35.999231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:35.999956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:36.436551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:36.446839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:36.448780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:36.450390 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a38650e7-a81e-420b-882e-36c9efe50481 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1742 microversion: 2.20 time: 0.489435 Oct 24 09:21:36.466987 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3010/5805] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:35 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1742 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:36.484129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:36.487733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:36.504181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:36.504952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:36.505786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:36.507825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:36.508581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:36.509628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:36.592027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:36.614454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ce4abe7-0eaa-48db-85f3-7e87a6d7cdfb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 1.650643 Oct 24 09:21:36.615062 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2796/5806] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:34 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:37.030984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:37.044789 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-83c586bf-98b6-4909-8d95-723ee9d864df tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1553 microversion: 2.1 time: 0.576344 Oct 24 09:21:37.048103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3011/5807] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:36 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1553 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:37.482520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:37.484211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:37.502920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:37.507994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:37.508624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:37.509573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:37.510272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:37.511965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:37.557820 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:37.643569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:37.644184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:37.659252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:37.659624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:37.660079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:37.660811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:37.661279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:37.674053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:38.266167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:38.280720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:38.282269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:38.293896 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bae827bd-eae3-4249-8717-ae8152c5a44e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1742 microversion: 2.20 time: 0.813087 Oct 24 09:21:38.294673 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2797/5808] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:37 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1742 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:38.307322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:38.312338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:38.327372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:38.329130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:38.330143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:38.332250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:38.333329 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:38.336718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:38.476397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:38.493816 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d31296c-5edf-4b29-b47f-71f5d49f6bad tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 0.849178 Oct 24 09:21:38.496427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3012/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:37 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:38.515215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-70efde30-8351-4d65-ad2f-7f641d5deaa8 req-11741de9-fd4c-454e-9854-4d6942b3798c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf91ab7-3898-4339-9dc5-414e7c539e7d", "name": "network-vif-deleted", "tag": "0ca722af-af8a-475b-90b1-a364ed9ae351"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:38.569480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70efde30-8351-4d65-ad2f-7f641d5deaa8 req-11741de9-fd4c-454e-9854-4d6942b3798c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:38.572407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70efde30-8351-4d65-ad2f-7f641d5deaa8 req-11741de9-fd4c-454e-9854-4d6942b3798c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:38.574828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-70efde30-8351-4d65-ad2f-7f641d5deaa8 req-11741de9-fd4c-454e-9854-4d6942b3798c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:38.609616 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-70efde30-8351-4d65-ad2f-7f641d5deaa8 req-11741de9-fd4c-454e-9854-4d6942b3798c service nova] Creating event network-vif-deleted:0ca722af-af8a-475b-90b1-a364ed9ae351 for instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d on n-h2-master-1 Oct 24 09:21:38.627104 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-70efde30-8351-4d65-ad2f-7f641d5deaa8 req-11741de9-fd4c-454e-9854-4d6942b3798c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124623 Oct 24 09:21:38.628661 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3013/5810] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:38.703815 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:38.713987 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-57ad71b7-521e-4535-8fbf-2b202eb77930 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 200 len: 1333 microversion: 2.1 time: 0.416326 Oct 24 09:21:38.715113 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2798/5811] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:38 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 1333 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:39.328113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:39.329191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:39.344034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:39.345780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:39.346682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:39.350668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:39.353842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:39.354573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:39.524196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:39.524797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:39.546798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:39.547660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:39.550449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:39.555244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:39.556164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:39.557017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:39.894613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:39.898827 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:39.914959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:39.916518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:39.918005 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b084d47c-42c7-4a00-a304-94dfffd064f5 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.597230 Oct 24 09:21:39.919144 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3014/5812] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:39 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:39.934200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:39.935174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 4cf91ab7-3898-4339-9dc5-414e7c539e7d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:39.953723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:39.954585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:39.955252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:39.958215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:39.959009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:39.959710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:39.995781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] HTTP exception thrown: Instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d could not be found. Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Request method failure captured: Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d HTTP/1.1 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVliWWN6p7DqdgGfi6aRK7CV9PpE3EpdBesB6-2mzeAt2U1bu08iXSlZOsAYckOh71w_jilPucdF-MgD7uRwapnw7olIIR-6mDNaxTCg-AiYdHU9WBUqzA4rP7Bb_6G4e8Vkl_ZDhY78lKuvQGWdIYRh5Ev40wjANcgtkuQn9zF6PM2I Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 1104d284053c4625bcb91c06e3fa5848 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestNetworkBasicOps-537393093 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1104d284053c4625bcb91c06e3fa5848"}]}] Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestNetworkBasicOps-537393093 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 1104d284053c4625bcb91c06e3fa5848 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestNetworkBasicOps-537393093 Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestNetworkBasicOps-537393093-project Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9d0b4f066e344bba84c0369d4c695f8b Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestNetworkBasicOps-537393093-project Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d could not be found. Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '4cf91ab7-3898-4339-9dc5-414e7c539e7d'} Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d could not be found. Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d could not be found. Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:21:40.003401 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d could not be found. Oct 24 09:21:40.007835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:21:40.010227 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Returning 404 to user: Instance 4cf91ab7-3898-4339-9dc5-414e7c539e7d could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:21:40.011355 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e378daeb-9331-4a6c-94d2-56c4e2470f44 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d" status: 404 len: 111 microversion: 2.1 time: 0.091058 Oct 24 09:21:40.015407 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3015/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:39 2022] GET /compute/v2.1/servers/4cf91ab7-3898-4339-9dc5-414e7c539e7d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:21:40.022984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:40.030566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-479a2df1-16fc-4f34-a10e-f09a9913087b req-11198b25-ba05-4bc0-84a0-7c5415361cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "name": "network-vif-plugged", "status": "completed", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:40.044001 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-938368c0-e896-4856-955a-8912dc5eff92 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 0.521505 Oct 24 09:21:40.046208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-479a2df1-16fc-4f34-a10e-f09a9913087b req-11198b25-ba05-4bc0-84a0-7c5415361cd1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:40.049245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-479a2df1-16fc-4f34-a10e-f09a9913087b req-11198b25-ba05-4bc0-84a0-7c5415361cd1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:40.050123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-479a2df1-16fc-4f34-a10e-f09a9913087b req-11198b25-ba05-4bc0-84a0-7c5415361cd1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:40.054562 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2799/5814] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:39 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:21:40.102575 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-479a2df1-16fc-4f34-a10e-f09a9913087b req-11198b25-ba05-4bc0-84a0-7c5415361cd1 service nova] Creating event network-vif-plugged:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:21:40.129360 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-479a2df1-16fc-4f34-a10e-f09a9913087b req-11198b25-ba05-4bc0-84a0-7c5415361cd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109207 Oct 24 09:21:40.137383 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3016/5815] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:40.847000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd39a63b-0612-49fa-9887-bdeb600b7142 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '.version_select at 0x7f8daa0c31f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:40.890927 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd39a63b-0612-49fa-9887-bdeb600b7142 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-945001447" status: 202 len: 0 microversion: 2.1 time: 0.048253 Oct 24 09:21:40.895667 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2800/5816] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-945001447 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:21:40.953921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:40.954467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:40.974572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:40.977610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:40.980409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:40.981181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:40.984285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:40.984747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:41.076452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:41.077128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:41.098543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:41.099295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:41.103078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:41.104014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:41.104637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:41.105227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:41.458618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:41.468353 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-085fd877-b22e-462c-af47-d512a537840c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 0.396801 Oct 24 09:21:41.468943 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2801/5817] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:41 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:41.569070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:41.590335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:41.597160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:41.600189 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22900af8-5b7e-4285-8050-02715173673d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.650716 Oct 24 09:21:41.603781 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3017/5818] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:40 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:41.769561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Calling method '.version_select at 0x7f8daaef0d30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:41.771900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:41.772403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:41.772848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:41.806003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:41.807212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:41.808148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:41.822680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:41.823581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:41.824474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:41.831237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34276b9d-e043-4bfe-be68-e264ec84703f tempest-PortsAdminExtendedAttrsTestJSON-1328708287 tempest-PortsAdminExtendedAttrsTestJSON-1328708287-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.308295 Oct 24 09:21:41.832490 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2802/5819] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:21:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:42.498338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:42.499758 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:42.509755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:42.513140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:42.515550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:42.516679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:42.521491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:42.524418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:42.651488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:42.652092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:42.669471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:42.670023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:42.670482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:42.674666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:42.675210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:42.675648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:43.117499 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:43.134158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:43.136005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:43.139239 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cb44782-14cd-47a1-8e15-58517f9d2868 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.493908 Oct 24 09:21:43.142822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2803/5820] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:42 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:43.591653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:43.600357 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9266a2e5-2593-40ab-be2e-925c2a261a34 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 1.106566 Oct 24 09:21:43.604180 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3018/5821] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:42 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:44.174186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:44.174792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:44.198660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:44.199158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:44.199593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:44.200294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:44.204240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:44.204694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:44.626832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:44.627379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:44.642729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:44.643563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:44.644203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:44.645130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:44.649052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:44.649757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:44.981697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:44.989563 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e94f6eb5-e174-486d-8eba-0b074503f10b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 0.366799 Oct 24 09:21:44.996537 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3019/5822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:44 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:21:45.263631 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:45.278215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:45.288119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:45.291317 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7bfbcc37-e19d-43b8-9f4e-eab3dc25a769 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 1.119625 Oct 24 09:21:45.300389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2804/5823] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:44 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:46.014989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:46.015615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:46.024916 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=43 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:46.033780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:46.034579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:46.035222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:46.037999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:46.041504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:46.042294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:46.344579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:46.347043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:46.352837 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:46.389046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:46.390741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:46.392774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:46.394455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:46.397145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:46.398341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:46.572052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:46.582604 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61e47e92-4a1e-4a0f-9618-dd540a640596 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1696 microversion: 2.1 time: 0.571334 Oct 24 09:21:46.593362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3020/5824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:46 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1696 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:46.953889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:46.953889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:46.953889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:46.953889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ef4721b-e2f6-4ddb-8e42-a323c4e7b764 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.619022 Oct 24 09:21:46.953889 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2805/5825] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:46 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:47.612069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:47.612682 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:47.623182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:47.627155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:47.628277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:47.630602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:47.635050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:47.635939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:47.980586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:47.981200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:47.993690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:47.994446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:47.995048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:47.995927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:47.996551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:47.997829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:48.120301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:48.146656 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f561cdff-cbed-44e1-95e1-760a038c9ab6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1695 microversion: 2.1 time: 0.539082 Oct 24 09:21:48.147521 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3021/5826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:47 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1695 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:48.646147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:48.655534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:48.660781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:48.665835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-57ded5c1-b6e5-4c4e-8872-1b27ab1e0b32 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.690150 Oct 24 09:21:48.666618 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2806/5827] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:47 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:21:48.865287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:48.865817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:48.882050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:48.882569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:48.882886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:48.883807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:48.884433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:48.885601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:48.999785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:21:49.221832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed30164c-2ad2-497f-b681-096e9672b260", "tag": "de3e2bcc-4b7d-4cef-b16e-13230a55be52"}, {"server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "name": "network-vif-unplugged", "status": "completed", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:49.243976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:49.244465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:49.247325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-513bab5f-aa11-4bd7-b827-e59807a5f60d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 204 len: 0 microversion: 2.1 time: 0.386170 Oct 24 09:21:49.247966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3022/5828] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:21:48 2022] DELETE /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:49.259214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:49.260722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:49.261871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:49.283008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:49.285218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:49.285934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:49.289427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:49.291046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:49.293316 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Creating event network-changed:de3e2bcc-4b7d-4cef-b16e-13230a55be52 for instance ed30164c-2ad2-497f-b681-096e9672b260 on n-h1-master-1 Oct 24 09:21:49.294109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Creating event network-vif-unplugged:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h2-master-1 Oct 24 09:21:49.294675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:49.313888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] Instance dcca016b-676b-4236-aff9-7357332b2833 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:21:49.340903 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a2471a06-3522-4a24-9dd8-079a6c50800b req-065fdfcf-b9c9-46f4-b5ed-cba6fdf169f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.464930 Oct 24 09:21:49.342349 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2807/5829] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:49.369486 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:49.381876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:49.397308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:49.400032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:49.404068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:49.405160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:49.406907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:49.407560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:49.983773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:49.993230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56be1511-1728-456c-bcd1-5575743468fd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1669 microversion: 2.1 time: 0.649496 Oct 24 09:21:49.994145 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2808/5830] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:49 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1669 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:49.999310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:50.000228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:50.007496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:50.009213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:50.009922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:50.010852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:50.011508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:50.012164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:50.387224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:50.402486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62a7b880-d45e-4088-be9d-dcc3f4c75a83 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1695 microversion: 2.1 time: 1.152838 Oct 24 09:21:50.402774 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3023/5831] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:49 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1695 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:50.483206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:50.495387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:50.501741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:50.509835 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa842190-c7ea-4a0e-b3e6-fecb8bff57e3 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.514265 Oct 24 09:21:50.521630 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2809/5832] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:49 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:51.021909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:51.022696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:51.032019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:51.036915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:51.040871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:51.041786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:51.042364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:51.043888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:51.437051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:51.461703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:51.494259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:51.498137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:51.499543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:51.502538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:51.506616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:51.509380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:51.931577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:51.943828 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8fc5a60e-33c0-478d-980d-b792a0996ecd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1669 microversion: 2.1 time: 0.925144 Oct 24 09:21:51.945990 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3024/5833] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:51 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1669 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:21:51.960303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:51.960938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:51.979313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:51.979832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:51.980279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:51.980999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:51.981484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:51.981924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:52.366845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:52.382275 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5495ad8d-3c59-4a29-bb1c-19818d18e0bf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1695 microversion: 2.1 time: 0.953002 Oct 24 09:21:52.408672 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2810/5834] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:51 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1695 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:52.481688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:52.502245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:52.502809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:52.503247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:52.554301 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] Creating event network-changed:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h2-master-1 Oct 24 09:21:52.574654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] Instance dcca016b-676b-4236-aff9-7357332b2833 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:21:52.611658 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-995ec3aa-8f47-4925-8aba-484d7b818392 req-9472d45a-c1b4-4419-bb7f-d4f9c98e4f68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133728 Oct 24 09:21:52.615581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2811/5835] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:21:52.855406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:52.871787 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:52.875785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:52.881224 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a901b7a-b93c-4eec-9720-36afe6078ac1 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.932430 Oct 24 09:21:52.884917 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3025/5836] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:51 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:52.973250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:52.974677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:52.994942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:53.000417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:53.002367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:53.006902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:53.009874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:53.011590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:53.352101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:53.378966 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-712d8649-e2e0-4a02-a293-8e62b24e5fae tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 200 len: 1482 microversion: 2.1 time: 0.410173 Oct 24 09:21:53.385504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2812/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:52 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 1482 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:53.425267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:53.428688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:53.462187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:53.464808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:53.465347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:53.466177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:53.467420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:53.467879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:53.915979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:53.917279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:53.927805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:53.931338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:53.932792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:53.936100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:53.937215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:53.939271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:54.385646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:54.396986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:54.400841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:54.402377 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1499c1b3-2143-45a2-ba44-b28c66af2537 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.492387 Oct 24 09:21:54.430346 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2813/5838] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:53 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:54.436271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:54.437258 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: ed30164c-2ad2-497f-b681-096e9672b260] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:54.444471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:54.445313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:54.446024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:54.446941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:54.447624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:54.448274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:54.468508 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] HTTP exception thrown: Instance ed30164c-2ad2-497f-b681-096e9672b260 could not be found. Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Request method failure captured: Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 HTTP/1.1 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVliWWN6p7DqdgGfi6aRK7CV9PpE3EpdBesB6-2mzeAt2U1bu08iXSlZOsAYckOh71w_jilPucdF-MgD7uRwapnw7olIIR-6mDNaxTCg-AiYdHU9WBUqzA4rP7Bb_6G4e8Vkl_ZDhY78lKuvQGWdIYRh5Ev40wjANcgtkuQn9zF6PM2I Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 1104d284053c4625bcb91c06e3fa5848 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestNetworkBasicOps-537393093 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1104d284053c4625bcb91c06e3fa5848"}]}] Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestNetworkBasicOps-537393093 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 1104d284053c4625bcb91c06e3fa5848 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestNetworkBasicOps-537393093 Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestNetworkBasicOps-537393093-project Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 9d0b4f066e344bba84c0369d4c695f8b Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestNetworkBasicOps-537393093-project Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ed30164c-2ad2-497f-b681-096e9672b260 could not be found. Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ed30164c-2ad2-497f-b681-096e9672b260'} Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed30164c-2ad2-497f-b681-096e9672b260 could not be found. Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed30164c-2ad2-497f-b681-096e9672b260 could not be found. Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:21:54.471150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed30164c-2ad2-497f-b681-096e9672b260 could not be found. Oct 24 09:21:54.476420 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:21:54.477944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Returning 404 to user: Instance ed30164c-2ad2-497f-b681-096e9672b260 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:21:54.478932 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-836f2be7-a7db-4d28-b103-8d78f2d31293 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260" status: 404 len: 111 microversion: 2.1 time: 0.047156 Oct 24 09:21:54.479761 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2814/5839] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:54 2022] GET /compute/v2.1/servers/ed30164c-2ad2-497f-b681-096e9672b260 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:21:54.671341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3f03bc98-f766-4fde-abc0-e93024d91f15 req-e982d118-67bd-4636-8bd9-a8800f10b6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed30164c-2ad2-497f-b681-096e9672b260", "name": "network-vif-deleted", "tag": "de3e2bcc-4b7d-4cef-b16e-13230a55be52"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:54.697376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3f03bc98-f766-4fde-abc0-e93024d91f15 req-e982d118-67bd-4636-8bd9-a8800f10b6ed service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:54.697376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3f03bc98-f766-4fde-abc0-e93024d91f15 req-e982d118-67bd-4636-8bd9-a8800f10b6ed service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:54.697376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3f03bc98-f766-4fde-abc0-e93024d91f15 req-e982d118-67bd-4636-8bd9-a8800f10b6ed service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:54.726531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3f03bc98-f766-4fde-abc0-e93024d91f15 req-e982d118-67bd-4636-8bd9-a8800f10b6ed service nova] Creating event network-vif-deleted:de3e2bcc-4b7d-4cef-b16e-13230a55be52 for instance ed30164c-2ad2-497f-b681-096e9672b260 on n-h1-master-1 Oct 24 09:21:54.738740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3f03bc98-f766-4fde-abc0-e93024d91f15 req-e982d118-67bd-4636-8bd9-a8800f10b6ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072798 Oct 24 09:21:54.743895 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2815/5840] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:21:54.961399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ef5f8b9-be60-4b0f-884f-28d577548c97 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '.version_select at 0x7f8daae42160>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:55.049777 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ef5f8b9-be60-4b0f-884f-28d577548c97 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-102929271" status: 202 len: 0 microversion: 2.1 time: 0.092359 Oct 24 09:21:55.050545 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2816/5841] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:21:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-102929271 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:21:55.436488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:55.437349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:55.461822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:55.464756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:55.466871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:55.468526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:55.471628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:55.473771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:55.513662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:55.529206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-26dcff17-8730-41a7-8455-ae154cb6476c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1695 microversion: 2.1 time: 2.118000 Oct 24 09:21:55.530525 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3026/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:53 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1695 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:55.917628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:55.931206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:55.935212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:55.939818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aeb0d27e-40ef-46fa-b7fb-710230cbf71b tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.508710 Oct 24 09:21:55.954080 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2817/5843] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:55 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:21:56.560606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:56.561231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:56.583422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:56.583932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:56.584376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:56.585105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:56.585594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:56.586033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:56.957468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:56.985106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bb796a12-265f-4b5e-bc8a-c8c2b6850661 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1693 microversion: 2.1 time: 0.426317 Oct 24 09:21:56.997542 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3027/5844] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:56 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1693 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:56.998087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:56.999578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:57.010630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:57.014653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:57.015183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:57.015930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:57.016399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:57.016829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:57.031298 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:57.928679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:57.943028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:57.944566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:57.950156 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3742acf-ceec-41ba-bf46-b39ac034b143 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.972160 Oct 24 09:21:57.951069 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2818/5845] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:56 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:21:58.012529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:58.014641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:58.026546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.029717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:58.031203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:58.041063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.044278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:58.047542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:58.420530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:58.433545 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3fbebf0e-8617-4648-8c72-a7ed70311840 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1690 microversion: 2.1 time: 0.425412 Oct 24 09:21:58.437250 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3028/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:58 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1690 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:58.465719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:21:58.466869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:58.480490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.488430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:58.492124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:58.493131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.495015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:58.499271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:58.654407 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2c716c9-df0f-4146-8e31-1ecc95695eea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action" status: 204 len: 0 microversion: 2.1 time: 0.191990 Oct 24 09:21:58.655863 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2819/5847] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:21:58 2022] POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:58.665373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:58.666011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:58.673475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.673985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:58.674438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:58.675160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.675629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:58.676530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:58.980606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:21:58.981283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:21:58.998494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:58.999244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:59.000993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:59.001880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:21:59.006575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:21:59.008669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:21:59.562113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:59.574644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5e40898-f8c4-4882-a036-204f34a2774c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1690 microversion: 2.1 time: 0.913305 Oct 24 09:21:59.575884 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3029/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:58 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1690 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:59.672650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:59.694817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:59.696546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:21:59.699920 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b366d0be-4c0b-4b18-9f97-d9fc15b4e6b4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.723514 Oct 24 09:21:59.703911 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2820/5849] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:21:58 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:22:00.286159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "name": "network-vif-plugged", "status": "completed", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:00.310693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:00.311186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:00.311627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:00.355405 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] Creating event network-vif-plugged:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h2-master-1 Oct 24 09:22:00.385465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] Instance dcca016b-676b-4236-aff9-7357332b2833 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:22:00.417840 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a4ba3272-ef5f-42f4-a209-8a21a2821aef req-695f83d7-4dff-4734-8ae7-4d14eb93b8c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135293 Oct 24 09:22:00.419267 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3030/5850] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:22:00.607335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:00.608227 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:00.622541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:00.623299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:00.623929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:00.624808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:00.625450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:00.626061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:00.732114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:00.732864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:00.748357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:00.748861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:00.749333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:00.757473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:00.761049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:00.763561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:00.832293 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:01.238265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:01.248905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:01.263491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:01.264865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1eb1d0d2-9a7f-4a2a-b789-2d1cb4f61092 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.537459 Oct 24 09:22:01.278319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3031/5851] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:00 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:02.133822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:02.143142 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88895e6e-3534-4eff-b173-187cf7b0eb90 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1690 microversion: 2.1 time: 1.539565 Oct 24 09:22:02.153642 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2821/5852] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:22:00 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1690 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:22:02.308697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:02.310088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:02.325376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:02.326177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:02.326793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:02.327675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:02.328296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:02.328895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:02.657659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:02.666534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:02.675555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:02.677677 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-011d1dc1-fdc6-4c80-b402-e2189b7c8c54 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.372828 Oct 24 09:22:02.683467 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3032/5853] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:02 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:03.173786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:03.174545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:03.192146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:03.194185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:03.196320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:03.197905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:03.202762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:03.203595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:03.708806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:03.709581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:03.720647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:03.721117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:03.721602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:03.722326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:03.727497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:03.728511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:04.123962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:04.143367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:04.159338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:04.163131 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c790551d-3228-4b12-bcee-b4ca76c2e78a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1682 microversion: 2.1 time: 0.994944 Oct 24 09:22:04.169731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:04.170714 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2822/5854] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:22:03 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1682 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:22:04.173722 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-548ef659-05e5-4ea7-8a8c-1244309f2d42 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 0.469537 Oct 24 09:22:04.176426 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3033/5855] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:03 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:05.207823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:05.208828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:05.224855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:05.225627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:05.227256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:05.229472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:05.231411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:05.232052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:06.385289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:06.402388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:06.404132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:06.414932 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ebc20afe-8440-491b-b6ed-a59613ba2e84 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1737 microversion: 2.20 time: 1.214863 Oct 24 09:22:06.417070 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2823/5856] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:05 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1737 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:07.451752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:07.451752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:07.458562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:07.459305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:07.460496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:07.464041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:07.464605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:07.468390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:07.705730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:07.723570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:07.730352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:07.731815 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bab48a1d-f2c8-44a3-bd59-16261dd34419 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1719 microversion: 2.20 time: 0.293010 Oct 24 09:22:07.733788 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3034/5857] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:07 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1719 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:08.761401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:08.762477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:08.778258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:08.778771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:08.779272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:08.780005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:08.780472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:08.780906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:09.169722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:09.188023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:09.193970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:09.197351 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d4762b2-08b3-4675-9343-15ab9f73aa00 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1719 microversion: 2.20 time: 0.441961 Oct 24 09:22:09.218101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2824/5858] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:08 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1719 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:09.850162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8a016926-42ca-46fe-847f-b208786cb83a req-6a96671b-bdce-4ad4-a4d2-4d7aa4f76bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "name": "network-vif-unplugged", "status": "completed", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:09.872287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8a016926-42ca-46fe-847f-b208786cb83a req-6a96671b-bdce-4ad4-a4d2-4d7aa4f76bb0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:09.874441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8a016926-42ca-46fe-847f-b208786cb83a req-6a96671b-bdce-4ad4-a4d2-4d7aa4f76bb0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:09.876370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8a016926-42ca-46fe-847f-b208786cb83a req-6a96671b-bdce-4ad4-a4d2-4d7aa4f76bb0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:09.915309 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8a016926-42ca-46fe-847f-b208786cb83a req-6a96671b-bdce-4ad4-a4d2-4d7aa4f76bb0 service nova] Creating event network-vif-unplugged:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:22:09.929548 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8a016926-42ca-46fe-847f-b208786cb83a req-6a96671b-bdce-4ad4-a4d2-4d7aa4f76bb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082626 Oct 24 09:22:09.930571 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3035/5859] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:22:10.226518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:10.227844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:10.240891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:10.241419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:10.241858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:10.242560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:10.243010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:10.243459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:11.251120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:11.263873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:11.267595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:11.268970 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a868a6c7-5975-4a7b-8e7e-0a7eb93412bd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1722 microversion: 2.20 time: 1.046326 Oct 24 09:22:11.269866 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2825/5860] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:10 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1722 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:11.296965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15441756-4770-473b-b5aa-1371b3e0c458"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:11.300888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:11.307816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:11.308514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:11.309119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:11.310042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:11.310665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:11.311477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:11.827179 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be4c24ec-a75a-4ddb-af8e-042cb5e9c7d4 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.535617 Oct 24 09:22:11.828941 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3036/5861] 10.222.0.25 () {62 vars in 1364 bytes} [Mon Oct 24 09:22:11 2022] POST /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-volume_attachments => generated 188 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:22:12.124283 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:12.125029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:12.133486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:12.134291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:12.134960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:12.135891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:12.136585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:12.137228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:12.652136 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6c24b34-7527-4ece-b60c-9457d3f60562 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-volume_attachments/15441756-4770-473b-b5aa-1371b3e0c458" status: 202 len: 0 microversion: 2.20 time: 0.533136 Oct 24 09:22:12.656325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2826/5862] 10.222.0.25 () {60 vars in 1457 bytes} [Mon Oct 24 09:22:12 2022] DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-volume_attachments/15441756-4770-473b-b5aa-1371b3e0c458 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:22:12.764218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:12.764807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:12.797936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:12.798475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:12.798931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:12.799663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:12.800130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:12.800569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:12.919420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126920) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 09:22:13.116001 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-beac989d-75ba-40ad-8a64-d632ba57778e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "POST /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/action" status: 202 len: 0 microversion: 2.20 time: 0.355874 Oct 24 09:22:13.121852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3037/5863] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Oct 24 09:22:12 2022] POST /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:22:13.153639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:13.154253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:13.175228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:13.175711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:13.177849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:13.186267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:13.186961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:13.190441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:13.589608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:13.610649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:13.614170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:13.617503 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-220bb481-0d77-4df6-9dc8-9dc3a835db4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1670 microversion: 2.20 time: 0.490913 Oct 24 09:22:13.631781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2827/5864] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:13 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1670 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:14.664693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:14.665978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:14.698821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:14.704257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:14.707511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:14.711279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:14.712082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:14.714875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:15.287191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:15.323699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:15.326928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:15.330071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa6590a8-e2b2-4615-a110-77d760354cbc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1670 microversion: 2.20 time: 0.674231 Oct 24 09:22:15.331296 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3038/5865] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:14 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1670 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:16.358289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:16.358898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:16.371340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:16.371825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:16.373964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:16.374831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:16.376837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:16.378075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:17.019939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:17.032273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:17.040176 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:17.043045 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32f8f59c-997e-4eb5-a804-2c450a54b30f tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.690430 Oct 24 09:22:17.047507 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2828/5866] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:16 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:18.075752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:18.076378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:18.087330 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:18.095070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:18.096295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:18.098006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:18.102588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:18.103299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:18.110576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:18.550115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:18.571134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:18.577138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:18.583687 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-14912635-5767-42a8-9a8a-b4924a93c93e tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.511865 Oct 24 09:22:18.598876 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3039/5867] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:18 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:19.632698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:19.635570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:19.649548 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:19.655552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:19.659813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:19.660600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:19.661719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:19.662629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:19.668889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:20.559336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:20.571714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:20.580686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:20.582542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5f25b678-ad94-401d-bbf8-df291d2bbe4c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.968683 Oct 24 09:22:20.586336 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2829/5868] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:19 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:21.618045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:21.618950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:21.640361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:21.641097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:21.641713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:21.645678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:21.647891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:21.658207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:23.245286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:23.256863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:23.258967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:23.260747 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-878e036c-167a-49c6-8c96-5c9560e32d35 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 1.648112 Oct 24 09:22:23.261654 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3040/5869] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:21 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:23.993542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e4daba05-7f86-4f7a-a4e0-5566ffd21dfc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'create', calling method: .version_select at 0x7f8daa12a280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1230937349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3zkrz+Q4YuIxLZdOzWvQmcVTR/L1RI7xImzg46IVHPlJbAuS8SeYEc2574vQ4JpnhDS9TsnlEMVb7Wm3A8o2CEkmti2R+7PLtHBgjkkvK684TFFSJ5MWfkphtMJkVnWw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:24.041850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e4daba05-7f86-4f7a-a4e0-5566ffd21dfc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for project 1104d284053c4625bcb91c06e3fa5848. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:22:24.062693 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e4daba05-7f86-4f7a-a4e0-5566ffd21dfc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for user 9d0b4f066e344bba84c0369d4c695f8b and project 1104d284053c4625bcb91c06e3fa5848. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:22:24.097955 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e4daba05-7f86-4f7a-a4e0-5566ffd21dfc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.110988 Oct 24 09:22:24.101108 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2830/5870] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:22:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:22:24.294649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:24.295454 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:24.322130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:24.324024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:24.324665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:24.334548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:24.338115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:24.338778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:24.448293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:24.462819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:24.474511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:24.482446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:24.483708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:24.484494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:24.484990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:24.485448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:24.671725 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b8e05a8c-7b68-482b-8c36-42e3a3bd9ed2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action" status: 200 len: 24575 microversion: 2.1 time: 0.230452 Oct 24 09:22:24.672886 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2831/5871] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:22:24 2022] POST /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833/action => generated 24575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:22:26.384052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:26.405234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:26.406919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:26.408152 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92618cef-9456-41ef-b78a-ab32be4c43bc tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 2.118491 Oct 24 09:22:26.422224 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3041/5872] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:24 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:27.438163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:27.440916 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:27.468679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:27.472084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:27.474730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:27.480179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:27.481001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:27.484775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:27.526307 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:28.612101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1091045978", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "c6374ab3-a492-400f-89fc-d62ac873aded"}], "key_name": "tempest-TestNetworkBasicOps-1230937349", "security_groups": [{"name": "tempest-secgroup-smoke-693312796"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:28.912674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:28.929950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:28.941538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:28.944344 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-54466306-9287-40ba-8469-b26478a7badd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 1.511889 Oct 24 09:22:28.984096 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2832/5873] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:27 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:29.133282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] validate_networks() for [('c6374ab3-a492-400f-89fc-d62ac873aded', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:22:29.976176 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:29.977498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:30.016312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:30.019678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:30.021485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:30.024539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:30.026516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:30.028480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:30.887627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:30.899085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:30.900558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:30.901929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4444ab6-9556-47c1-9e1d-4fff68150a18 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.930762 Oct 24 09:22:30.931072 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2833/5874] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:29 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:22:30.937401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:30.937401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:30.956739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:30.958531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:30.960946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:30.962404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:30.964599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:30.965223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:31.728880 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b654fca-de1b-4ce6-97fd-7c33045ad8bd tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1833 microversion: 2.1 time: 0.798675 Oct 24 09:22:31.738830 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2834/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:22:30 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1833 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:22:31.807656 n-d-master-1 devstack@n-api.service[126920]: Exception ignored in: . at 0x7f8dab023160> Oct 24 09:22:31.808380 n-d-master-1 devstack@n-api.service[126920]: Traceback (most recent call last): Oct 24 09:22:31.808582 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 24 09:22:31.824085 n-d-master-1 devstack@n-api.service[126920]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 24 09:22:31.824085 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 24 09:22:31.824627 n-d-master-1 devstack@n-api.service[126920]: connection_record.checkin() Oct 24 09:22:31.824627 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 24 09:22:31.825175 n-d-master-1 devstack@n-api.service[126920]: pool.dispatch.checkin(connection, self) Oct 24 09:22:31.825175 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 24 09:22:31.840648 n-d-master-1 devstack@n-api.service[126920]: fn(*args, **kw) Oct 24 09:22:31.840648 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 24 09:22:31.840648 n-d-master-1 devstack@n-api.service[126920]: time.sleep(0) Oct 24 09:22:31.840648 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 36, in sleep Oct 24 09:22:31.846444 n-d-master-1 devstack@n-api.service[126920]: hub.switch() Oct 24 09:22:31.846444 n-d-master-1 devstack@n-api.service[126920]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 313, in switch Oct 24 09:22:31.849423 n-d-master-1 devstack@n-api.service[126920]: return self.greenlet.switch() Oct 24 09:22:31.849423 n-d-master-1 devstack@n-api.service[126920]: socket.timeout: timed out Oct 24 09:22:31.935939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:31.936517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:31.947668 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:31.948625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:31.949322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:31.951478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:31.952143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:31.952657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:32.563292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:22:32.563742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:22:32.564211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:22:32.564796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:22:32.565324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:22:32.595112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:32.597424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:32.602116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:32.603081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:32.607115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:32.607660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:32.644849 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:32.692832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for project 1104d284053c4625bcb91c06e3fa5848. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:22:32.711979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Getting quotas for user 9d0b4f066e344bba84c0369d4c695f8b and project 1104d284053c4625bcb91c06e3fa5848. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:22:32.726927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:22:32.731214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:22:32.907340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:32.916160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:32.926775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:32.928331 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60f3da9d-fdc4-475d-8a09-e9a572b92de2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.998783 Oct 24 09:22:32.929463 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2835/5876] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:31 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:22:33.957973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:33.958634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:33.971578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:33.972189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:33.972626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:33.974089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:33.978215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:33.979026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:34.072574 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:34.443007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:34.464658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:34.467332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:34.469423 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e8e3a20a-6d6a-405c-801b-9a81c35dd642 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.515094 Oct 24 09:22:34.470726 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2836/5877] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:33 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:22:35.498661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:35.502143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:35.510332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:35.510957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:35.511398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:35.519824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:35.520763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:35.522435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:36.103172 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:36.130736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:36.132865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:36.137281 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f09649e5-0ac4-4018-bc0f-4437d22bfd0d tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.643567 Oct 24 09:22:36.158490 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2837/5878] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:35 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:22:36.172613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:36.173503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:36.184462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:36.185190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:36.186073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:36.186955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:36.187964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:36.188658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:36.243387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:22:36.445097 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49e94cf8-6266-4746-86f5-1b87be258a18 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 204 len: 0 microversion: 2.1 time: 0.296681 Oct 24 09:22:36.449991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2838/5879] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:22:36 2022] DELETE /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:22:36.456343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7b30852b-7ecb-4ffb-b663-d2f4cc548da3 req-e2431e4b-a1eb-4aa9-bdc0-40536de8ed31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:36.468144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7b30852b-7ecb-4ffb-b663-d2f4cc548da3 req-e2431e4b-a1eb-4aa9-bdc0-40536de8ed31 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:36.468960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7b30852b-7ecb-4ffb-b663-d2f4cc548da3 req-e2431e4b-a1eb-4aa9-bdc0-40536de8ed31 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:36.469629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7b30852b-7ecb-4ffb-b663-d2f4cc548da3 req-e2431e4b-a1eb-4aa9-bdc0-40536de8ed31 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:36.496444 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7b30852b-7ecb-4ffb-b663-d2f4cc548da3 req-e2431e4b-a1eb-4aa9-bdc0-40536de8ed31 service nova] Creating event network-changed:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h2-master-1 Oct 24 09:22:36.505222 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7b30852b-7ecb-4ffb-b663-d2f4cc548da3 req-e2431e4b-a1eb-4aa9-bdc0-40536de8ed31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053247 Oct 24 09:22:36.507788 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2839/5880] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:22:36.516269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:36.517528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:36.531653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:36.532413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:36.533125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:36.534803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:36.536095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:36.536732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:37.392553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:37.405627 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7e32675-7d62-4ad4-8000-0c51b90e9d42 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1688 microversion: 2.1 time: 0.895534 Oct 24 09:22:37.406609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2840/5881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:22:36 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1688 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:22:37.422645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:37.422645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:37.432346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:37.433660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:37.434170 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:37.435352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:37.436199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:37.439150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:38.044424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:38.060749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:38.062767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:38.063983 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61a35728-e855-4c8b-b6e3-1b2a958ebffa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.656098 Oct 24 09:22:38.077323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2841/5882] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:37 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:38.232459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1d5a7b87-90a1-4b56-98e5-292c4ba99a87 req-578090c4-e628-412c-8c7f-62be67f94be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "name": "network-vif-plugged", "status": "completed", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:38.245424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1d5a7b87-90a1-4b56-98e5-292c4ba99a87 req-578090c4-e628-412c-8c7f-62be67f94be9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:38.245913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1d5a7b87-90a1-4b56-98e5-292c4ba99a87 req-578090c4-e628-412c-8c7f-62be67f94be9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:38.246347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1d5a7b87-90a1-4b56-98e5-292c4ba99a87 req-578090c4-e628-412c-8c7f-62be67f94be9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:38.259965 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1d5a7b87-90a1-4b56-98e5-292c4ba99a87 req-578090c4-e628-412c-8c7f-62be67f94be9 service nova] Creating event network-vif-plugged:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:22:38.265062 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1d5a7b87-90a1-4b56-98e5-292c4ba99a87 req-578090c4-e628-412c-8c7f-62be67f94be9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197674 Oct 24 09:22:38.266444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2842/5883] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:22:38.446007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:38.449536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:38.462078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:38.466005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:38.466755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:38.468954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:38.469682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:38.473953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:39.292517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:39.302060 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27afe49d-801d-4837-92ff-0e8119751478 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 200 len: 1688 microversion: 2.1 time: 0.865614 Oct 24 09:22:39.303076 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2843/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:22:38 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 1688 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:22:39.315382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:39.316226 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:39.324116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:39.324696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:39.325207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:39.326368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:39.327035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:39.327613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:40.230618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:40.247255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:40.250017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:40.252548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-07813888-bbc1-47ac-9d2a-100b82322bbd tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.947045 Oct 24 09:22:40.253131 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2844/5885] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:39 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:40.591514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2bd0e49e-6878-468d-bc48-f7cc02243f98 req-6cc00a48-5938-4ef6-993d-0f95fca28a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcca016b-676b-4236-aff9-7357332b2833", "name": "network-vif-deleted", "tag": "6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:40.614889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bd0e49e-6878-468d-bc48-f7cc02243f98 req-6cc00a48-5938-4ef6-993d-0f95fca28a5a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:40.616275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bd0e49e-6878-468d-bc48-f7cc02243f98 req-6cc00a48-5938-4ef6-993d-0f95fca28a5a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:40.617508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bd0e49e-6878-468d-bc48-f7cc02243f98 req-6cc00a48-5938-4ef6-993d-0f95fca28a5a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:40.639067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2bd0e49e-6878-468d-bc48-f7cc02243f98 req-6cc00a48-5938-4ef6-993d-0f95fca28a5a service nova] Creating event network-vif-deleted:6fbf5d5a-59b4-4a00-a798-8c16fc8a5c79 for instance dcca016b-676b-4236-aff9-7357332b2833 on n-h2-master-1 Oct 24 09:22:40.648789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2bd0e49e-6878-468d-bc48-f7cc02243f98 req-6cc00a48-5938-4ef6-993d-0f95fca28a5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390575 Oct 24 09:22:40.652170 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2845/5886] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:22:40.679673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:40.680993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: dcca016b-676b-4236-aff9-7357332b2833] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:40.707177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:40.708092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:40.708676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:40.709842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:40.710376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:40.710894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:40.733204 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] HTTP exception thrown: Instance dcca016b-676b-4236-aff9-7357332b2833 could not be found. Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Request method failure captured: Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 HTTP/1.1 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVljFDFXOGs3XhEFZCXWMxvWHfJh781lcGcMgV9FXlazzOQezbj0390BG589-tgaa-HXoN5AG8VG1fwGrrM5YqXBde-HOJ8Fgsd7zGjtwxHywtiwoNfVLLzY6WysaYGKtyKkPts8MlGRWmKcz7DGX-cOyj0rWN9S41IMgA8M1Jci6EYg Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d4ea2b64dfd8408292fe8b8d44c39b59"}]}] Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b62fde68e8c747bfbea881c71421c5ae Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: exception: Instance dcca016b-676b-4236-aff9-7357332b2833 could not be found. Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'dcca016b-676b-4236-aff9-7357332b2833'} Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcca016b-676b-4236-aff9-7357332b2833 could not be found. Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcca016b-676b-4236-aff9-7357332b2833 could not be found. Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:22:40.736505 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcca016b-676b-4236-aff9-7357332b2833 could not be found. Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Returning 404 to user: Instance dcca016b-676b-4236-aff9-7357332b2833 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ed71b99-735b-4897-b7a5-c741181931ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833" status: 404 len: 111 microversion: 2.1 time: 0.083181 Oct 24 09:22:40.742732 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2846/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:22:40 2022] GET /compute/v2.1/servers/dcca016b-676b-4236-aff9-7357332b2833 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:22:41.285086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:41.285809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:41.294301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:41.297598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:41.298141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:41.298944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:41.299483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:41.299918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:41.712679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:41.728938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:41.732025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:41.733929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c8919c6-0555-4a06-8318-48f595fadac2 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1728 microversion: 2.20 time: 0.453317 Oct 24 09:22:41.758409 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2847/5888] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:41 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1728 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:22:42.646953 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:42.696343 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:42.719574 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:42.772719 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:42.784198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:42.785274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:22:42.794904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:42.795459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:42.796229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:42.801511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:22:42.802269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:22:42.802894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:22:43.123056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:43.135747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:43.137690 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:22:43.139135 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec7744ad-0869-4c89-8a02-2ef4899800b9 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1715 microversion: 2.20 time: 0.374420 Oct 24 09:22:43.163583 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2848/5889] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:22:42 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1715 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:22:52.756876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad500a3a-499f-4dec-8b01-cdc18406e8cf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '.version_select at 0x7f8daae42040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:22:52.779830 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:52.809231 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad500a3a-499f-4dec-8b01-cdc18406e8cf tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2100324951" status: 202 len: 0 microversion: 2.1 time: 0.057111 Oct 24 09:22:52.810874 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2849/5890] 10.222.0.25 () {58 vars in 1284 bytes} [Mon Oct 24 09:22:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2100324951 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:22:52.849682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df142d20-beb7-44bd-93bc-25cadd27b8b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: .version_select at 0x7f8dab04e820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1240393474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTbwJBy1WRSV/Ccv6McgX3suT6/7eP76MsGxyipOtHZNiYN0UuTAAW1Wf5r7toEFLoas/qJ6cAnSwLFK4Nb79DzmnskWrkPg8PPHzfw8NHTlvPxQyS0xBaqZUOszZBPnQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:22:52.920537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-df142d20-beb7-44bd-93bc-25cadd27b8b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:22:52.945720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-df142d20-beb7-44bd-93bc-25cadd27b8b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:22:53.002094 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df142d20-beb7-44bd-93bc-25cadd27b8b4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.157531 Oct 24 09:22:53.003802 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2850/5891] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:22:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:02.858940 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:02.956783 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:02.974923 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:03.158301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf116cf9-6d45-4835-8131-756e65708a6a tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-403514287", "availability_zone": "foo_zone"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:03.166401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.aggregate [None req-cf116cf9-6d45-4835-8131-756e65708a6a tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Generated uuid 1fe4cbf7-f230-4e7f-8c72-f0e8089381f9 for aggregate {{(pid=126919) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 09:23:03.225090 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf116cf9-6d45-4835-8131-756e65708a6a tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.372161 Oct 24 09:23:03.232398 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2851/5892] 10.222.0.25 () {60 vars in 1164 bytes} [Mon Oct 24 09:23:02 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.239018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f210aeb0-7294-4e41-b48a-61b47d92a105 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:03.274018 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f210aeb0-7294-4e41-b48a-61b47d92a105 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.040059 Oct 24 09:23:03.282199 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2852/5893] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 09:23:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.287517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:03.292194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:03.292866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:03.293580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:03.294629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:03.295591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:03.296367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:03.353330 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0006c146-258b-410c-aee0-296cb93232ae tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.069690 Oct 24 09:23:03.362909 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2853/5894] 10.222.0.25 () {58 vars in 1176 bytes} [Mon Oct 24 09:23:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.369168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac1f42b2-e619-42f4-8180-80a920d4e651 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:03.378929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac1f42b2-e619-42f4-8180-80a920d4e651 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013856 Oct 24 09:23:03.386953 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2854/5895] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 09:23:03 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.395726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc5d7ba5-6f4c-46c4-a7e5-31657c248948 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:03.431063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc5d7ba5-6f4c-46c4-a7e5-31657c248948 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:03.434355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc5d7ba5-6f4c-46c4-a7e5-31657c248948 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:03.435204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc5d7ba5-6f4c-46c4-a7e5-31657c248948 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:03.687504 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc5d7ba5-6f4c-46c4-a7e5-31657c248948 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.299379 Oct 24 09:23:03.688035 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2855/5896] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 09:23:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.704052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-285ae547-8832-4f21-b704-f5ed58c9d719 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:03.730929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-285ae547-8832-4f21-b704-f5ed58c9d719 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.035169 Oct 24 09:23:03.731940 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2856/5897] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:23:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.743074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84f16ae2-32a0-4d35-82fb-a3dbf3c0ff6d tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1040073300", "availability_zone": "foo_zone"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:03.828848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84f16ae2-32a0-4d35-82fb-a3dbf3c0ff6d tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.089166 Oct 24 09:23:03.830281 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2857/5898] 10.222.0.25 () {60 vars in 1173 bytes} [Mon Oct 24 09:23:03 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:23:03.845764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-93a22ae8-e907-43d1-9b38-f4dba5ef1c55 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:03.881882 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-93a22ae8-e907-43d1-9b38-f4dba5ef1c55 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.040907 Oct 24 09:23:03.883679 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2858/5899] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 09:23:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:23:03.902124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bca6bb09-4901-40fc-968d-d3421df02ee4 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:03.915389 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bca6bb09-4901-40fc-968d-d3421df02ee4 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.021532 Oct 24 09:23:03.924775 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2859/5900] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:23:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:03.931893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5269aaaf-a8c0-4f6a-a8e4-f73ee6ee1d31 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:03.949436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5269aaaf-a8c0-4f6a-a8e4-f73ee6ee1d31 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:03.950488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5269aaaf-a8c0-4f6a-a8e4-f73ee6ee1d31 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:03.951206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5269aaaf-a8c0-4f6a-a8e4-f73ee6ee1d31 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:04.207652 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5269aaaf-a8c0-4f6a-a8e4-f73ee6ee1d31 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.280626 Oct 24 09:23:04.217862 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2860/5901] 10.222.0.25 () {60 vars in 1194 bytes} [Mon Oct 24 09:23:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:04.230110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-978c700b-ea88-4013-96bf-301f39e2fad0 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:04.276724 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-978c700b-ea88-4013-96bf-301f39e2fad0 tempest-TestAggregatesBasicOps-1364527636 tempest-TestAggregatesBasicOps-1364527636-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.056429 Oct 24 09:23:04.278485 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2861/5902] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 09:23:04 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 09:23:07.909338 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e15357cd-be4f-46c8-a7d1-85baa65b71dd tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 39.303910 Oct 24 09:23:07.910143 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3042/5903] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:22:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 39306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:23:07.922235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f68cd16-8d15-49ee-a511-519be357d3ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:07.928323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f68cd16-8d15-49ee-a511-519be357d3ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:08.163841 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f68cd16-8d15-49ee-a511-519be357d3ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:08.171998 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f68cd16-8d15-49ee-a511-519be357d3ea tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1249 microversion: 2.1 time: 0.253885 Oct 24 09:23:08.181672 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2862/5904] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:07 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1249 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:09.202654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:09.204068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:09.224132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:09.224355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:09.224745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:09.225606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:09.225978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:09.226412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:09.648683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:09.666687 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab41287e-b712-4ebb-8f4f-46ad5a54dd7d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1301 microversion: 2.1 time: 0.473192 Oct 24 09:23:09.673629 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3043/5905] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:09 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1301 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:10.699339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:10.700075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:10.719081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:10.721500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:10.724010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:10.724767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:10.726854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:10.727811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:10.828263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:10.848527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab55ee1a-d3ab-4ded-a07e-76e7332922ec tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1307 microversion: 2.1 time: 0.154001 Oct 24 09:23:10.849673 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2863/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:10 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:11.883369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:11.884032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:11.899966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:11.900491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:11.900948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:11.901732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:11.902438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:11.902883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:13.269175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:13.283464 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3abf8fdc-2296-42c0-b11a-d79edee0479a tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 1.407951 Oct 24 09:23:13.284137 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3044/5907] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:11 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:23:14.254144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:14.258603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:14.265209 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:14.270925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.271663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.272772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.274460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.275888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.276590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.314063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:14.314772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:14.335120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.335645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.336089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.338085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.341111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.341348 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3878328-a0c1-4754-b5f8-bf6efd249f53 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.099047 Oct 24 09:23:14.341826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.351949 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2864/5908] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Oct 24 09:23:14 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:14.438564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:14.439436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:14.453242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.455165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.457953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.458950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.460465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.461147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.501920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:23:14.685040 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9f79fb6b-cb60-4e12-9565-df8ab7987eaa tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 204 len: 0 microversion: 2.20 time: 0.253829 Oct 24 09:23:14.686433 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2865/5909] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:23:14 2022] DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:23:14.702160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a5b99948-4931-4d1f-8cda-fcc9965bf92f req-f467b034-a699-4a7b-8b71-1338f55fbe2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871e9aba-3376-4ba2-89ba-df1a056d79c1", "tag": "2e5be680-3d9a-4b6d-840e-47b43bed8454"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:14.712184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a5b99948-4931-4d1f-8cda-fcc9965bf92f req-f467b034-a699-4a7b-8b71-1338f55fbe2b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.712890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a5b99948-4931-4d1f-8cda-fcc9965bf92f req-f467b034-a699-4a7b-8b71-1338f55fbe2b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.713643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a5b99948-4931-4d1f-8cda-fcc9965bf92f req-f467b034-a699-4a7b-8b71-1338f55fbe2b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.732745 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a5b99948-4931-4d1f-8cda-fcc9965bf92f req-f467b034-a699-4a7b-8b71-1338f55fbe2b service nova] Creating event network-changed:2e5be680-3d9a-4b6d-840e-47b43bed8454 for instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 on n-h2-master-1 Oct 24 09:23:14.747037 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a5b99948-4931-4d1f-8cda-fcc9965bf92f req-f467b034-a699-4a7b-8b71-1338f55fbe2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056332 Oct 24 09:23:14.747967 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2866/5910] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:14.753612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:14.755318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:14.763105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.763824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.764453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:14.765409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:14.769749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:14.770420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:15.142834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:15.151711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:15.153459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:15.154792 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77c27635-1607-4cd0-b6f2-f31db0711f2c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 0.405541 Oct 24 09:23:15.171496 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2867/5911] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:23:14 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:23:15.182239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1508499152", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "992c1f61-e8a9-44ed-9c07-fe1144eedfa3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1240393474", "security_groups": [{"name": "tempest-secgroup-smoke-393272413"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:15.375841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:15.394914 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9184940-6bbb-470b-bdbf-378a1d923ae1 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 1.087336 Oct 24 09:23:15.397486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3045/5912] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:14 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:15.884352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] validate_networks() for [('992c1f61-e8a9-44ed-9c07-fe1144eedfa3', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:23:16.201898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:16.202686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:16.239740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:16.240562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:16.242460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:16.244162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:16.244872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:16.245724 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:17.339973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:17.349666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:17.359073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:17.360475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b7eb96f-355e-444f-a143-ddc2d8070f1a tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1721 microversion: 2.20 time: 1.179024 Oct 24 09:23:17.361827 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3046/5913] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:23:16 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1721 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:23:17.367086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:17.375214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:17.396332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:17.396829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:17.400100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:17.400880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:17.402511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:17.413537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:18.172333 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:18.307666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:23:18.308148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:23:18.308646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:23:18.309034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:23:18.309671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:23:18.326251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:18.330126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:18.330583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:18.331525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:18.331860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:18.332308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:18.385028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:23:18.397593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:23:18.430504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:23:18.436402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:23:18.508325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:18.515915 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:18.527924 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06521568-4d30-4345-82f7-fb5c9697dbdf tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 1.162827 Oct 24 09:23:18.528563 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3047/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:17 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:18.545720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:18.546335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:18.570481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:18.570985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:18.575543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:18.576733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:18.578793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:18.580462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:18.594841 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2087372e-9fa9-47df-ad2a-e46694f9cf98 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.421739 Oct 24 09:23:18.596405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2868/5915] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:23:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 3424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:23:18.624855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0db0a18c-39a8-45a7-af4f-e3b5d234967d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:18.625743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0db0a18c-39a8-45a7-af4f-e3b5d234967d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:18.898827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:18.904291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0db0a18c-39a8-45a7-af4f-e3b5d234967d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:18.918862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0db0a18c-39a8-45a7-af4f-e3b5d234967d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1267 microversion: 2.1 time: 0.309186 Oct 24 09:23:18.935973 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2869/5916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:18 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:18.937042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:18.947407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2755c3ea93440999d287890d328ecd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f88028805e42a0a83e7de1f6f39d99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:18.953969 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-54c5db7a-837b-4de6-9dfa-ac822b961561 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 200 len: 1654 microversion: 2.20 time: 0.418727 Oct 24 09:23:18.956855 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3048/5917] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:23:18 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 1654 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:23:19.568201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:19.569751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:19.584036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:19.585623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:19.588937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:19.590099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:19.591066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:19.594444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:19.635056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7550c8d7-ad86-4483-ac90-ae54bcffaa86 req-3719958d-21c1-4ab9-824f-7d9f764135c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923778c4-2232-4398-97da-6978c8355c52", "name": "network-vif-deleted", "tag": "fca49377-8a9e-4b24-b01a-d634cd3381ce"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:19.654859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7550c8d7-ad86-4483-ac90-ae54bcffaa86 req-3719958d-21c1-4ab9-824f-7d9f764135c6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:19.655377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7550c8d7-ad86-4483-ac90-ae54bcffaa86 req-3719958d-21c1-4ab9-824f-7d9f764135c6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:19.659566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7550c8d7-ad86-4483-ac90-ae54bcffaa86 req-3719958d-21c1-4ab9-824f-7d9f764135c6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:19.686186 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7550c8d7-ad86-4483-ac90-ae54bcffaa86 req-3719958d-21c1-4ab9-824f-7d9f764135c6 service nova] Creating event network-vif-deleted:fca49377-8a9e-4b24-b01a-d634cd3381ce for instance 923778c4-2232-4398-97da-6978c8355c52 on n-h2-master-1 Oct 24 09:23:19.705427 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7550c8d7-ad86-4483-ac90-ae54bcffaa86 req-3719958d-21c1-4ab9-824f-7d9f764135c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072830 Oct 24 09:23:19.705427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3049/5918] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:19.948372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:19.950571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:20.003386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:20.004419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:20.004419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:20.012866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:20.013405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:20.013859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:20.669721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:20.679775 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:20.680354 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5f0eb107-2957-4cf5-ae8d-39fe7d7b8ec5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 1.128378 Oct 24 09:23:20.684869 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2870/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:19 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:20.693858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:20.700987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:20.709424 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4b43067-7599-44cb-89c3-ac24fa1ebad1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1319 microversion: 2.1 time: 0.765399 Oct 24 09:23:20.714852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3050/5920] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:19 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:23:20.716602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:20.717887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:20.718768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:20.727214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:20.732910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:20.738377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:20.783079 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] HTTP exception thrown: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Request method failure captured: Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 HTTP/1.1 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfCMLd25yo1Rx1bYq-TD2s31NmLvc8za3D_TDl22Bj2odORHPQ31iTSkk2Oe06uxlBycFEalFHAZbpO_ujdkkpbVkWD_JFnHh91LwnFkYNjmXjWnV8fL3jzhVx67cIT5uIc3rKlgGs-wh_4s7OMRLzIFHG8Q4AjybxvQ9xxxrZ_t4s Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f88028805e42a0a83e7de1f6f39d99"}]}] Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b2755c3ea93440999d287890d328ecd6 Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '923778c4-2232-4398-97da-6978c8355c52'} Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:20.802277 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Returning 404 to user: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3aa81f62-695f-48a0-a8e3-af186b240f72 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 404 len: 111 microversion: 2.20 time: 0.117616 Oct 24 09:23:20.812759 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2871/5921] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:23:20 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:23:20.818116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-513bdc2b-ce5d-4e90-a2d1-742e45c1eaff tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '.version_select at 0x7f8daa368e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:20.870793 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-513bdc2b-ce5d-4e90-a2d1-742e45c1eaff tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429986586" status: 204 len: 0 microversion: 2.20 time: 0.059375 Oct 24 09:23:20.871481 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3051/5922] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:23:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429986586 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:23:21.719372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:21.720763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:21.736092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:21.736725 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:21.747757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:21.748390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:21.748906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:21.749402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:21.750135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:21.750603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:21.750799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:21.751044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:21.751929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:21.755345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:21.757638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:21.761088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:21.957181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:21.965161 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ba9d6bf-b829-4e1f-8f67-d0be335ebec1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1325 microversion: 2.1 time: 0.232912 Oct 24 09:23:21.974755 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3052/5923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:21 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:22.732303 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:22.749255 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bce502c4-aa2b-44e2-9070-0ad3439a4779 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 1.035682 Oct 24 09:23:22.757633 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2872/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:21 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:23.013897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:23.015240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:23.041866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:23.042809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:23.043726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:23.045452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:23.046204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:23.048689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:23.199085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:23.215641 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-592d8aef-835f-4869-ae56-a88d761ea6bc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1325 microversion: 2.1 time: 0.218792 Oct 24 09:23:23.231690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3053/5925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:22 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:23.774104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:23.774896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:23.788798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:23.789323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:23.790023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:23.790886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:23.794513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:23.795059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:24.097115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-908f1426-2a9a-485e-a200-86f7d318b137 req-1fc74f88-817b-4b62-b49e-bbdc2bea02d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871e9aba-3376-4ba2-89ba-df1a056d79c1", "name": "network-vif-plugged", "status": "completed", "tag": "2e5be680-3d9a-4b6d-840e-47b43bed8454"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:24.115766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-908f1426-2a9a-485e-a200-86f7d318b137 req-1fc74f88-817b-4b62-b49e-bbdc2bea02d0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:24.116323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-908f1426-2a9a-485e-a200-86f7d318b137 req-1fc74f88-817b-4b62-b49e-bbdc2bea02d0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:24.116818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-908f1426-2a9a-485e-a200-86f7d318b137 req-1fc74f88-817b-4b62-b49e-bbdc2bea02d0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:24.136674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-908f1426-2a9a-485e-a200-86f7d318b137 req-1fc74f88-817b-4b62-b49e-bbdc2bea02d0 service nova] Creating event network-vif-plugged:2e5be680-3d9a-4b6d-840e-47b43bed8454 for instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 on n-h2-master-1 Oct 24 09:23:24.141826 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-908f1426-2a9a-485e-a200-86f7d318b137 req-1fc74f88-817b-4b62-b49e-bbdc2bea02d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048404 Oct 24 09:23:24.142816 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3054/5926] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:24.240656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:24.242297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:24.249079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:24.249820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:24.250483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:24.251191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:24.251651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:24.252123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:24.328975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:24.340552 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d138ac69-ec0a-46c4-9b8b-98a95d0c8abc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 0.570282 Oct 24 09:23:24.354448 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2873/5927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:23 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:25.085479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:25.118709 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7d4be08-755a-40bd-bf68-4b4d62b0847c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 0.878103 Oct 24 09:23:25.122389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3055/5928] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:24 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:23:25.374355 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:25.375578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:25.408426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:25.409625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:25.410295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:25.412306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:25.413011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:25.413656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:26.146306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:26.146306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:26.163023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:26.163524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:26.164055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:26.164785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:26.165624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:26.166235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:26.238970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:26.250309 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5a43583e-685b-40ba-b650-56333527a6ba tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1374 microversion: 2.1 time: 0.879834 Oct 24 09:23:26.265322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2874/5929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:25 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1374 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:27.125232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:27.140978 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efee31b6-ce88-4b65-ba19-5ac3f7f1035b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 0.998222 Oct 24 09:23:27.141665 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3056/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:26 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:23:27.281061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:27.282386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:27.343066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:27.348687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:27.349223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:27.350197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:27.352403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:27.352929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:27.762755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:27.763434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:27.775685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:27.779006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:27.779589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:27.780408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:27.782193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:27.783320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:27.825483 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] HTTP exception thrown: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Request method failure captured: Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 HTTP/1.1 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlfCMLd25yo1Rx1bYq-TD2s31NmLvc8za3D_TDl22Bj2odORHPQ31iTSkk2Oe06uxlBycFEalFHAZbpO_ujdkkpbVkWD_JFnHh91LwnFkYNjmXjWnV8fL3jzhVx67cIT5uIc3rKlgGs-wh_4s7OMRLzIFHG8Q4AjybxvQ9xxxrZ_t4s Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f88028805e42a0a83e7de1f6f39d99"}]}] Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b2755c3ea93440999d287890d328ecd6 Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '923778c4-2232-4398-97da-6978c8355c52'} Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:23:27.827068 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Returning 404 to user: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-719717d7-5c7d-44c4-999a-9e6b0a255b28 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 404 len: 111 microversion: 2.20 time: 0.078315 Oct 24 09:23:27.837781 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3057/5931] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:23:27 2022] DELETE /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:23:27.850700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:27.851646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: 923778c4-2232-4398-97da-6978c8355c52] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:27.869649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:27.870432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:27.871044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:27.871929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:27.872582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:27.874852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:27.906694 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] HTTP exception thrown: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Request method failure captured: Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 HTTP/1.1 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlfCMLd25yo1Rx1bYq-TD2s31NmLvc8za3D_TDl22Bj2odORHPQ31iTSkk2Oe06uxlBycFEalFHAZbpO_ujdkkpbVkWD_JFnHh91LwnFkYNjmXjWnV8fL3jzhVx67cIT5uIc3rKlgGs-wh_4s7OMRLzIFHG8Q4AjybxvQ9xxxrZ_t4s Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f88028805e42a0a83e7de1f6f39d99"}]}] Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b2755c3ea93440999d287890d328ecd6 Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '923778c4-2232-4398-97da-6978c8355c52'} Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.911785 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. Oct 24 09:23:27.917082 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:27.921103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Returning 404 to user: Instance 923778c4-2232-4398-97da-6978c8355c52 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:23:27.922207 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-857de4c4-7cb7-441f-9a20-be0980d8020c tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52" status: 404 len: 111 microversion: 2.20 time: 0.081625 Oct 24 09:23:27.926525 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3058/5932] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:23:27 2022] GET /compute/v2.1/servers/923778c4-2232-4398-97da-6978c8355c52 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:23:28.197858 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:28.199306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:28.218820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:28.219694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:28.220339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:28.221272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:28.221924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:28.222551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:28.367602 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:28.483644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:28.496839 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-70b76367-747d-4cca-95d2-0d060478ed27 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1546 microversion: 2.1 time: 1.221672 Oct 24 09:23:28.499401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2875/5933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:27 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1546 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:28.527829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:28.528323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:28.564661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:28.564661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:28.566672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:28.567555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:28.571930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:28.575648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:28.909972 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:29.159985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:29.173521 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac6ec5e1-9bdf-450f-9a9f-4e1c202b43fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 0.983916 Oct 24 09:23:29.191970 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3059/5934] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:28 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:29.196809 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-55e9664d-ca0c-4ea3-9c25-a948e7f67e45 req-c35200c4-d75c-48d7-8bc2-de3dc866bf70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:29.215022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55e9664d-ca0c-4ea3-9c25-a948e7f67e45 req-c35200c4-d75c-48d7-8bc2-de3dc866bf70 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:29.215513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55e9664d-ca0c-4ea3-9c25-a948e7f67e45 req-c35200c4-d75c-48d7-8bc2-de3dc866bf70 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:29.215950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55e9664d-ca0c-4ea3-9c25-a948e7f67e45 req-c35200c4-d75c-48d7-8bc2-de3dc866bf70 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:29.241049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-55e9664d-ca0c-4ea3-9c25-a948e7f67e45 req-c35200c4-d75c-48d7-8bc2-de3dc866bf70 service nova] Creating event network-changed:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:23:29.268078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-55e9664d-ca0c-4ea3-9c25-a948e7f67e45 req-c35200c4-d75c-48d7-8bc2-de3dc866bf70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074669 Oct 24 09:23:29.274235 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3060/5935] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:29.709994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:29.721759 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60e34ec5-fcf2-40d7-ae83-60823cb87084 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1546 microversion: 2.1 time: 1.203403 Oct 24 09:23:29.725648 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2876/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:28 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1546 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:30.217808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:30.219154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:30.243468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:30.244393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:30.244848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:30.245776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:30.247910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:30.248202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:31.130570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:31.142639 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f848d8a3-6c33-49d4-a04e-39798a1debbd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 0.928941 Oct 24 09:23:31.165155 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3061/5937] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:30 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:32.166045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:32.167336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:32.184183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:32.186020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:32.187424 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:32.191129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:32.195319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:32.196011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:32.467869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:32.469993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:32.489914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:32.491333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:32.492017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:32.493010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:32.493699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:32.494443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:32.509865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] HTTP exception thrown: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Request method failure captured: Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf HTTP/1.1 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlfCMLd25yo1Rx1bYq-TD2s31NmLvc8za3D_TDl22Bj2odORHPQ31iTSkk2Oe06uxlBycFEalFHAZbpO_ujdkkpbVkWD_JFnHh91LwnFkYNjmXjWnV8fL3jzhVx67cIT5uIc3rKlgGs-wh_4s7OMRLzIFHG8Q4AjybxvQ9xxxrZ_t4s Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f88028805e42a0a83e7de1f6f39d99"}]}] Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b2755c3ea93440999d287890d328ecd6 Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: exception: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ad46abbe-9593-4b3f-bb44-93e777c29fdf'} Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:23:32.512067 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.517260 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.518996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Returning 404 to user: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:23:32.520033 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1c09843-50d0-45bb-9142-cbf2a88ba644 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 404 len: 111 microversion: 2.20 time: 0.056399 Oct 24 09:23:32.521123 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3062/5938] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:23:32 2022] DELETE /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 09:23:32.543245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:32.543868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] [instance: ad46abbe-9593-4b3f-bb44-93e777c29fdf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:32.551317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:32.552033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:32.552657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:32.553953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:32.554699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:32.555287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:32.575263 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] HTTP exception thrown: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Request method failure captured: Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf HTTP/1.1 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlfCMLd25yo1Rx1bYq-TD2s31NmLvc8za3D_TDl22Bj2odORHPQ31iTSkk2Oe06uxlBycFEalFHAZbpO_ujdkkpbVkWD_JFnHh91LwnFkYNjmXjWnV8fL3jzhVx67cIT5uIc3rKlgGs-wh_4s7OMRLzIFHG8Q4AjybxvQ9xxxrZ_t4s Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f88028805e42a0a83e7de1f6f39d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f88028805e42a0a83e7de1f6f39d99"}]}] Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: c6f88028805e42a0a83e7de1f6f39d99 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1726176868 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b2755c3ea93440999d287890d328ecd6 Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1726176868-project Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: exception: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ad46abbe-9593-4b3f-bb44-93e777c29fdf'} Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.577249 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] Returning 404 to user: Instance ad46abbe-9593-4b3f-bb44-93e777c29fdf could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:23:32.583467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97b19bba-5908-4fad-b79f-1db5f216b067 tempest-AttachVolumeShelveTestJSON-1726176868 tempest-AttachVolumeShelveTestJSON-1726176868-project] 10.222.0.25 "GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf" status: 404 len: 111 microversion: 2.20 time: 0.044428 Oct 24 09:23:32.584946 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3063/5939] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:23:32 2022] GET /compute/v2.1/servers/ad46abbe-9593-4b3f-bb44-93e777c29fdf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:23:33.327835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:33.329992 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:33.347732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15ecf6c8-4dc7-4f3d-ac7c-7a98b546d758 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 1.185478 Oct 24 09:23:33.348979 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2877/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:32 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:34.379214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:34.381581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:34.385764 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:34.392027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:34.393819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:34.394387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:34.395222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:34.395909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:34.396521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:34.402530 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=93 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:34.884949 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:34.896014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0dea512-2368-4af5-828e-7c72a61965a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 0.521417 Oct 24 09:23:34.926372 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3064/5941] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:34 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:34.985784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-05bcf436-384a-4e6f-96f5-afe7ab749d3f req-9e99db99-84ab-4af4-9420-71f39bd72834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871e9aba-3376-4ba2-89ba-df1a056d79c1", "tag": "2e5be680-3d9a-4b6d-840e-47b43bed8454"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:35.011042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-05bcf436-384a-4e6f-96f5-afe7ab749d3f req-9e99db99-84ab-4af4-9420-71f39bd72834 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:35.012637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-05bcf436-384a-4e6f-96f5-afe7ab749d3f req-9e99db99-84ab-4af4-9420-71f39bd72834 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:35.012637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-05bcf436-384a-4e6f-96f5-afe7ab749d3f req-9e99db99-84ab-4af4-9420-71f39bd72834 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:35.025974 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-05bcf436-384a-4e6f-96f5-afe7ab749d3f req-9e99db99-84ab-4af4-9420-71f39bd72834 service nova] Creating event network-changed:2e5be680-3d9a-4b6d-840e-47b43bed8454 for instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 on n-h2-master-1 Oct 24 09:23:35.039095 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-05bcf436-384a-4e6f-96f5-afe7ab749d3f req-9e99db99-84ab-4af4-9420-71f39bd72834 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056813 Oct 24 09:23:35.040506 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2878/5942] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:35.580770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-dd9a2ffa-4e48-4c64-9e28-caf8640b9a46 req-82a28f9f-e222-4258-a14c-b11f336fff67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "name": "network-vif-plugged", "status": "completed", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:35.593373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd9a2ffa-4e48-4c64-9e28-caf8640b9a46 req-82a28f9f-e222-4258-a14c-b11f336fff67 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:35.594233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd9a2ffa-4e48-4c64-9e28-caf8640b9a46 req-82a28f9f-e222-4258-a14c-b11f336fff67 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:35.595336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-dd9a2ffa-4e48-4c64-9e28-caf8640b9a46 req-82a28f9f-e222-4258-a14c-b11f336fff67 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:35.613313 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-dd9a2ffa-4e48-4c64-9e28-caf8640b9a46 req-82a28f9f-e222-4258-a14c-b11f336fff67 service nova] Creating event network-vif-plugged:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:23:35.620895 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-dd9a2ffa-4e48-4c64-9e28-caf8640b9a46 req-82a28f9f-e222-4258-a14c-b11f336fff67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048281 Oct 24 09:23:35.622610 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3065/5943] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:35.929358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:35.930249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:35.946494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:35.949865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:35.950411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:35.951171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:35.951640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:35.952064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:36.899521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:36.919440 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a16cb4d-278a-4e8f-9c2e-34d727510508 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1392 microversion: 2.1 time: 0.995047 Oct 24 09:23:36.920202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2879/5944] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:35 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1392 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:37.962401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:37.965201 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:37.975318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:37.976214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:37.977671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:37.978665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:37.979429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:37.980329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:38.542871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:38.556605 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c0506a7-7a33-46d4-9f65-418a273a8e72 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1564 microversion: 2.1 time: 0.615587 Oct 24 09:23:38.560109 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3066/5945] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:37 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1564 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:38.583414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:38.584078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:38.606862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:38.607667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:38.608303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:38.609261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:38.610073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:38.612589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:39.159664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:39.203890 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a3a7f6e-7b0e-4f77-9a0d-42b4aac6d132 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1564 microversion: 2.1 time: 0.621655 Oct 24 09:23:39.204578 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2880/5946] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:38 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1564 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:23:45.573361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:45.574060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:45.584270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3d2285dc-2f7f-49d3-ad42-773252192513 req-023b4e7f-7f0f-4eec-b3c5-32b279862eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:45.610967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:45.611509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:45.611957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:45.612676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:45.616609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d2285dc-2f7f-49d3-ad42-773252192513 req-023b4e7f-7f0f-4eec-b3c5-32b279862eca service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:45.617404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:45.618027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:45.618673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d2285dc-2f7f-49d3-ad42-773252192513 req-023b4e7f-7f0f-4eec-b3c5-32b279862eca service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:45.624856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d2285dc-2f7f-49d3-ad42-773252192513 req-023b4e7f-7f0f-4eec-b3c5-32b279862eca service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:45.660422 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3d2285dc-2f7f-49d3-ad42-773252192513 req-023b4e7f-7f0f-4eec-b3c5-32b279862eca service nova] Creating event network-changed:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:23:45.685797 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3d2285dc-2f7f-49d3-ad42-773252192513 req-023b4e7f-7f0f-4eec-b3c5-32b279862eca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105315 Oct 24 09:23:45.685941 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2881/5947] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:23:46.019364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:46.033972 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7b147c4-e9b0-40ce-9d7e-09db3ef2bb22 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1564 microversion: 2.1 time: 0.464170 Oct 24 09:23:46.035238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3067/5948] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:45 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1564 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:47.078655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-743727843", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "d23c46a2-3566-482e-9aaa-bbf9a87fa77b"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:47.192042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] validate_networks() for [('d23c46a2-3566-482e-9aaa-bbf9a87fa77b', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:23:48.480217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-736f5982-c95c-4f42-8d92-0a8de78c3a68 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Action: 'create', calling method: .version_select at 0x7f8daf2bc700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-450159696", "metadata": {"Type": "work"}}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:48.768781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:23:48.770368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:23:48.771020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:23:48.771683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:23:48.772320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:23:48.776167 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=31 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:48.790139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:48.791157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:48.791797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:48.792813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:48.793483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:48.794097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:48.824347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Getting quotas for project a3f2fcdaa9cd434797881937ea940b89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:23:48.831458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Getting quotas for user 47cc2bea7f764515920d59cae9ef0111 and project a3f2fcdaa9cd434797881937ea940b89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:23:48.848212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:23:48.852646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:23:48.912085 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-736f5982-c95c-4f42-8d92-0a8de78c3a68 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.569471 Oct 24 09:23:48.913253 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3068/5949] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:23:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 24 09:23:48.928466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4a9cb42-042d-4ab6-a742-6c772ad6230b tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daf0e6790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:48.956096 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-95b38a8f-bdf3-4765-b50c-75715f29341e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.169682 Oct 24 09:23:48.961829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2882/5950] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:23:48.973565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25c7c88c-459c-49d7-9f8c-384b95d66a47 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:48.974189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25c7c88c-459c-49d7-9f8c-384b95d66a47 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:49.017280 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4a9cb42-042d-4ab6-a742-6c772ad6230b tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 352 microversion: 2.1 time: 0.094553 Oct 24 09:23:49.025789 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3069/5951] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:48 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:23:49.177009 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25c7c88c-459c-49d7-9f8c-384b95d66a47 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:49.185874 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25c7c88c-459c-49d7-9f8c-384b95d66a47 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1214 microversion: 2.1 time: 0.220058 Oct 24 09:23:49.201338 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2883/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:48 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:50.034103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f816033-6b36-403a-969d-3b6974e2cae6 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daa3e1040>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:50.195800 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f816033-6b36-403a-969d-3b6974e2cae6 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 352 microversion: 2.1 time: 0.166590 Oct 24 09:23:50.197017 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3070/5953] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:50 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:50.212762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:50.213699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:50.229900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:50.230698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:50.231971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:50.234530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:50.235373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:50.238356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:50.546003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:50.554364 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a21cdb5-3d0e-4922-a2dc-fb02b57453a4 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1266 microversion: 2.1 time: 0.347461 Oct 24 09:23:50.566953 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2884/5954] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:50 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:51.210721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b47a499d-95a9-4b0d-a682-393e4942df4a tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daf2bc3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:51.284904 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b47a499d-95a9-4b0d-a682-393e4942df4a tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 353 microversion: 2.1 time: 0.078221 Oct 24 09:23:51.286352 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3071/5955] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:51 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:51.300764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4683bfa8-5c5b-4904-8c2c-fca381a10c0e tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daa0e6940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:51.389460 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4683bfa8-5c5b-4904-8c2c-fca381a10c0e tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 353 microversion: 2.1 time: 0.092371 Oct 24 09:23:51.392361 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2885/5956] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:51 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:51.420596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9586fa63-47aa-4b61-b64f-cb7121a08920 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8dab456430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:51.567668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9586fa63-47aa-4b61-b64f-cb7121a08920 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 202 len: 0 microversion: 2.1 time: 0.162750 Oct 24 09:23:51.568381 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3072/5957] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:23:51 2022] DELETE /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:23:51.578191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3959b61e-2773-4036-bf80-cad9af56e3ce tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daae523a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:51.628209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:51.630116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:51.658396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:51.661604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:51.662057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:51.662804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:51.663291 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:51.664167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:51.731747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3959b61e-2773-4036-bf80-cad9af56e3ce tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 352 microversion: 2.1 time: 0.158665 Oct 24 09:23:51.732581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2886/5958] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:51 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:51.921671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:51.931681 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24cf9d46-13ce-4fbc-bbd4-105b32278753 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1272 microversion: 2.1 time: 0.339384 Oct 24 09:23:51.943767 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3073/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:51 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:52.748121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1191e15b-76bc-480d-a1c5-7be48298e884 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8dab242af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:52.848784 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1191e15b-76bc-480d-a1c5-7be48298e884 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 352 microversion: 2.1 time: 0.105499 Oct 24 09:23:52.849773 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2887/5960] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:52 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:52.960135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:52.961573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:53.011444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:53.015130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:53.015750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:53.020621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:53.022806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:53.024783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:53.032610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:53.035845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:53.053598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:53.055720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:53.058933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:53.060375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:53.062378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:53.063543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:53.163306 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3abe0d1-49dd-4441-90ab-97ccfe7b0b12 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1/action" status: 200 len: 24568 microversion: 2.1 time: 0.135101 Oct 24 09:23:53.164162 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2888/5961] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:23:53 2022] POST /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1/action => generated 24568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:23:53.838457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:53.847980 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-930a9f67-aa96-428d-983a-d20cb5384bc0 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 0.892622 Oct 24 09:23:53.852632 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3074/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:52 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:53.872821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ae405cc4-b934-4928-8341-5794361e3889 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daf24cc10>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:53.980443 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ae405cc4-b934-4928-8341-5794361e3889 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 200 len: 352 microversion: 2.1 time: 0.113451 Oct 24 09:23:53.992491 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2889/5963] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:53 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:54.879968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:54.881191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:54.896654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:54.897248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:54.900063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:54.901132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:54.910310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:54.911166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:54.998864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85e117f8-4690-4229-add0-d7edff3bea03 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Calling method '.version_select at 0x7f8daf24c4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:55.056549 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-85e117f8-4690-4229-add0-d7edff3bea03 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] HTTP exception thrown: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85e117f8-4690-4229-add0-d7edff3bea03 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Request method failure captured: Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a HTTP/1.1 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlmkDw2hW2Iml0anqVFBokcHVzGLO1YgFOAlBuAX0ZRj9Xg_OxYDodwub7nBjrgf_-xwvLFTxdPgrHErO5kc-qATXdIu-zGnxRyPgUOUv6tDVT2K_gey8egyq6hr04pACSjqc-lZNBMLp6CLmflxF4OLt8A_UVDVAUHsr08-UEhT5tI Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: f7321d20739d490aac91ec5bd124711c Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesGetTestJSON-1229139505 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7321d20739d490aac91ec5bd124711c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7321d20739d490aac91ec5bd124711c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7321d20739d490aac91ec5bd124711c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7321d20739d490aac91ec5bd124711c"}]}] Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesGetTestJSON-1229139505 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: f7321d20739d490aac91ec5bd124711c Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesGetTestJSON-1229139505 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesGetTestJSON-1229139505-project Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ac39ca0b94dd496cbdef568156fd9731 Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesGetTestJSON-1229139505-project Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: method: Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: exception: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '2c195598-6aad-4f7f-a428-aea5ccbe2b0a'} Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. (HTTP 404) (Request-ID: req-c6a62b68-9981-486c-a80c-1661542d2762) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 09:23:55.058890 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:23:55.065254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85e117f8-4690-4229-add0-d7edff3bea03 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] Returning 404 to user: Volume 2c195598-6aad-4f7f-a428-aea5ccbe2b0a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:23:55.068725 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85e117f8-4690-4229-add0-d7edff3bea03 tempest-VolumesGetTestJSON-1229139505 tempest-VolumesGetTestJSON-1229139505-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a" status: 404 len: 109 microversion: 2.1 time: 0.070604 Oct 24 09:23:55.071353 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2890/5964] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:23:54 2022] GET /compute/v2.1/os-volumes/2c195598-6aad-4f7f-a428-aea5ccbe2b0a => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:23:56.024066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:56.046259 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1210ee8-c339-4184-b9fd-cf635bf44f6d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 1.168692 Oct 24 09:23:56.048529 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3075/5965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:54 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:23:56.176781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-dcab8ddf-62bd-402d-9345-c94577659c8f req-ee103a7a-024a-4eb2-a1f1-157dd37d9e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b516f31b-5685-462a-822e-ad4f76e3feed", "tag": "309cbda4-5775-453c-81de-868a3372ccad"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:23:56.192262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dcab8ddf-62bd-402d-9345-c94577659c8f req-ee103a7a-024a-4eb2-a1f1-157dd37d9e08 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:56.193510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dcab8ddf-62bd-402d-9345-c94577659c8f req-ee103a7a-024a-4eb2-a1f1-157dd37d9e08 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:56.197262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dcab8ddf-62bd-402d-9345-c94577659c8f req-ee103a7a-024a-4eb2-a1f1-157dd37d9e08 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:56.233763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-dcab8ddf-62bd-402d-9345-c94577659c8f req-ee103a7a-024a-4eb2-a1f1-157dd37d9e08 service nova] Creating event network-changed:309cbda4-5775-453c-81de-868a3372ccad for instance b516f31b-5685-462a-822e-ad4f76e3feed on n-h2-master-1 Oct 24 09:23:56.247058 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-dcab8ddf-62bd-402d-9345-c94577659c8f req-ee103a7a-024a-4eb2-a1f1-157dd37d9e08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089997 Oct 24 09:23:56.248372 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2891/5966] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:23:57.088553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:57.089166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:57.103514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:57.104270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:57.105098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:57.106886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:57.107562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:57.108321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:57.658841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:57.669710 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4f774a0-3e00-498c-aea8-e8395a0b0ebe tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 0.596252 Oct 24 09:23:57.670591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3076/5967] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:57 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:23:58.695983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:23:58.697073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:23:58.717139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:58.717658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:58.718288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:58.719179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:23:58.719797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:23:58.720935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:23:58.814704 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:59.145830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:23:59.158446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a566dc85-15e9-46cb-af2a-676689df8a7e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 0.467535 Oct 24 09:23:59.160554 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2892/5968] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:23:58 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:00.186762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:00.188205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:00.212214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:00.215405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:00.217533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:00.219644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:00.221721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:00.222523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:00.666284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:00.674958 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-46b8fb6e-4b9b-41a8-acee-1c2c0c2b5443 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 0.494423 Oct 24 09:24:00.686512 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3077/5969] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:00 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:01.700827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:01.701586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:01.703453 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:01.719588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:01.719906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:01.720998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:01.721884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:01.722352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:01.722780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:02.297961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:02.306864 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-669d0f6c-6e93-40e7-871e-5979af2abb8f tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 0.609778 Oct 24 09:24:02.307473 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2893/5970] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:01 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:02.854840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:02.857197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:02.879989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:02.880515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:02.889407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:02.890355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:02.890858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:02.891307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:03.096404 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1411ba19-ee03-4ccc-a181-8d92c238e47a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action" status: 200 len: 24536 microversion: 2.1 time: 0.245629 Oct 24 09:24:03.104015 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3078/5971] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:02 2022] POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action => generated 24536 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:24:03.119606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-111201ec-efaa-4fcf-bd50-666a8b05698d req-f6d4ffe7-f1eb-41bf-b8ef-68704312a4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b516f31b-5685-462a-822e-ad4f76e3feed", "name": "network-vif-plugged", "status": "completed", "tag": "309cbda4-5775-453c-81de-868a3372ccad"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:03.140494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-111201ec-efaa-4fcf-bd50-666a8b05698d req-f6d4ffe7-f1eb-41bf-b8ef-68704312a4d6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:03.141317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-111201ec-efaa-4fcf-bd50-666a8b05698d req-f6d4ffe7-f1eb-41bf-b8ef-68704312a4d6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:03.141987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-111201ec-efaa-4fcf-bd50-666a8b05698d req-f6d4ffe7-f1eb-41bf-b8ef-68704312a4d6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:03.155132 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-111201ec-efaa-4fcf-bd50-666a8b05698d req-f6d4ffe7-f1eb-41bf-b8ef-68704312a4d6 service nova] Creating event network-vif-plugged:309cbda4-5775-453c-81de-868a3372ccad for instance b516f31b-5685-462a-822e-ad4f76e3feed on n-h2-master-1 Oct 24 09:24:03.160625 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-111201ec-efaa-4fcf-bd50-666a8b05698d req-f6d4ffe7-f1eb-41bf-b8ef-68704312a4d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064131 Oct 24 09:24:03.161815 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2894/5972] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:24:03.343689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:03.345612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:03.364860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:03.373662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:03.376863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:03.378993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:03.382520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:03.383695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:03.986208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:04.000999 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-690a485a-287b-461b-9dd9-ad85344b88cc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1314 microversion: 2.1 time: 0.665954 Oct 24 09:24:04.017103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3079/5973] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:03 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:04.487671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:04.495481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:04.521337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:04.521496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:04.522897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:04.526100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:04.527419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:04.527937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:04.639434 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c90ee973-e352-4ca5-9100-09252d27dfa4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "POST /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1/action" status: 200 len: 32639 microversion: 2.1 time: 0.159970 Oct 24 09:24:04.640121 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2895/5974] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:04 2022] POST /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1/action => generated 32639 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:24:05.024221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:05.026148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:05.046924 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=22 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:05.049986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:05.051436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:05.052811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:05.053649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:05.073882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:05.074393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:05.102213 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=60 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:05.357829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:05.373566 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6bdc66e3-117f-41da-b30a-9f6024910b1d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1502 microversion: 2.1 time: 0.354181 Oct 24 09:24:05.375536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3080/5975] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:05 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1502 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:05.400068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:05.400955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:05.417595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:05.418498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:05.419174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:05.420801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:05.421550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:05.430224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:05.863161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:05.873680 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-599986a5-4217-4cff-bc80-f803c4978e35 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1502 microversion: 2.1 time: 0.478066 Oct 24 09:24:05.889340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2896/5976] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:05 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1502 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:05.902484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:05.903043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:05.913153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:05.913701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:05.914110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:05.914842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:05.915312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:05.915837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:05.971368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lazy-loading 'flavor' on Instance uuid b516f31b-5685-462a-822e-ad4f76e3feed {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:24:06.167878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9053cac-e3d1-4a99-aac3-b63d38cb8874 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action" status: 202 len: 0 microversion: 2.1 time: 0.271522 Oct 24 09:24:06.170377 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3081/5977] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:05 2022] POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:24:06.178769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:06.179652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:06.194112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:06.195125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:06.196343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:06.197550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:06.198419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:06.199204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:06.231981 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=56 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:06.478529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:06.492365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-020bf7fe-bede-4846-be17-f008872d0313 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1510 microversion: 2.1 time: 0.317262 Oct 24 09:24:06.493983 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2897/5978] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:06 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:07.521797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:07.522517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:07.537034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:07.537563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:07.537999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:07.538910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:07.539634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:07.540234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.010252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:08.035899 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3d1e74d-7441-4a88-801f-f87e13a8278e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1493 microversion: 2.1 time: 0.519693 Oct 24 09:24:08.049322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3082/5979] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:07 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1493 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:08.067137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:08.070131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:08.082579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.083263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.084181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.085821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.086461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.087092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.192676 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9a8e4a5-7495-48f2-a31a-ae21744819dc tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action" status: 202 len: 0 microversion: 2.1 time: 0.130648 Oct 24 09:24:08.194352 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2898/5980] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:08 2022] POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:24:08.202618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:08.203325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:08.214487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.215050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.215488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.226799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.227385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.227747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.665436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:08.674985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb2cf06b-a2f1-4c9c-9867-63eb12fdb5ce tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.476417 Oct 24 09:24:08.687910 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3083/5981] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:08 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:08.723697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:08.735444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c29ea7a4-9e59-4967-8728-a577ff1eb1ce req-fd979af1-28c9-4def-955e-04a58e36d32a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871e9aba-3376-4ba2-89ba-df1a056d79c1", "tag": "2e5be680-3d9a-4b6d-840e-47b43bed8454"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:08.740860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:08.767261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.778038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.778980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.780039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.780767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c29ea7a4-9e59-4967-8728-a577ff1eb1ce req-fd979af1-28c9-4def-955e-04a58e36d32a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:08.780961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.781611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.783368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c29ea7a4-9e59-4967-8728-a577ff1eb1ce req-fd979af1-28c9-4def-955e-04a58e36d32a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:08.784912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c29ea7a4-9e59-4967-8728-a577ff1eb1ce req-fd979af1-28c9-4def-955e-04a58e36d32a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:08.812520 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c29ea7a4-9e59-4967-8728-a577ff1eb1ce req-fd979af1-28c9-4def-955e-04a58e36d32a service nova] Creating event network-changed:2e5be680-3d9a-4b6d-840e-47b43bed8454 for instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 on n-h2-master-1 Oct 24 09:24:08.834456 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c29ea7a4-9e59-4967-8728-a577ff1eb1ce req-fd979af1-28c9-4def-955e-04a58e36d32a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104155 Oct 24 09:24:08.835665 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3084/5982] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:24:08.855573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:24:09.083030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-74c416bc-cbd3-4389-bd7f-f545ff543708 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 204 len: 0 microversion: 2.1 time: 0.368918 Oct 24 09:24:09.085461 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2899/5983] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:24:08 2022] DELETE /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:24:09.095956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:09.097017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:09.120900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:09.121446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:09.121902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:09.122635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:09.123650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:09.128833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:09.530215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:09.531075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:09.544726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:09.560919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:09.565153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:09.567398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:09.573183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:09.575140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:09.798997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:09.820864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6b9a2270-4a17-4e0a-8f8a-c9f06cbd35a5 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1670 microversion: 2.1 time: 0.730925 Oct 24 09:24:09.821993 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3085/5984] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:09 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1670 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:09.842878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:09.843848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:09.853469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:09.853973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:09.858280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:09.859318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:09.860039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:09.861233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:09.982545 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64b0507b-45b5-4ede-b993-3432d1542fa4 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1833 microversion: 2.1 time: 0.457550 Oct 24 09:24:09.984030 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2900/5985] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:09 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1833 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:10.012753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:10.013762 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:10.023905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:10.024829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:10.025539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:10.026969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:10.027672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:10.028297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:10.300210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:10.348876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfbf2977-d77f-452c-bb5e-cfd463a24bae tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.523928 Oct 24 09:24:10.350104 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3086/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:09 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:10.498064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:10.520424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01e02a95-3db5-49af-9b8d-65cdab1e3de1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1682 microversion: 2.1 time: 0.508924 Oct 24 09:24:10.526675 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2901/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:10 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1682 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:10.849719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:10.852447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:10.877723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:10.882164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:10.884519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:10.894046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:10.894046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:10.894046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:10.920261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:10.928158 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:10.948944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:10.949538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:10.951367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:10.952142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:10.952557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:10.958479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:11.102735 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0be66e47-9c4b-4d1a-bcad-d5503a67416e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action" status: 200 len: 32608 microversion: 2.1 time: 0.186846 Oct 24 09:24:11.106031 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2902/5988] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:10 2022] POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action => generated 32608 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 09:24:11.269742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:11.270648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:11.287255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:11.289406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:11.290263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:11.292401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:11.293767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:11.295388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:11.382363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f96808120954544b427ca58eea40de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3aab62168a49b1a803137e7e404d53', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:11.383433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] flavor_id is None. Assuming migration. {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 24 09:24:11.385142 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:24:11.625522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e103889-fb66-4c0c-925c-5e25737dee04 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action" status: 202 len: 0 microversion: 2.1 time: 0.366115 Oct 24 09:24:11.630602 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2903/5989] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:11 2022] POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:24:11.636938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:11.637577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:11.651344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:11.651835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:11.653655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:11.655447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:11.656309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:11.656817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:11.674181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:11.694412 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c6b76a1-3552-4bee-85cb-4e054be7637d tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1670 microversion: 2.1 time: 0.849294 Oct 24 09:24:11.697835 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3087/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:10 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1670 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:11.723480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:11.724156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:11.740748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:11.742057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:11.742497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:11.745821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:11.750294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:11.751882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:12.340731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:12.356276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9beb1841-923e-4bfd-bf8b-478aabfc4074 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.721482 Oct 24 09:24:12.359774 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2904/5991] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:11 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:12.549733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7e8d0eca-1e36-418e-98f5-04fdf2c7ee4c req-bc0f0a01-c324-4a1d-8f5c-48c781bf1bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871e9aba-3376-4ba2-89ba-df1a056d79c1", "name": "network-vif-deleted", "tag": "2e5be680-3d9a-4b6d-840e-47b43bed8454"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:12.571864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7e8d0eca-1e36-418e-98f5-04fdf2c7ee4c req-bc0f0a01-c324-4a1d-8f5c-48c781bf1bbf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:12.574046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7e8d0eca-1e36-418e-98f5-04fdf2c7ee4c req-bc0f0a01-c324-4a1d-8f5c-48c781bf1bbf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:12.574735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7e8d0eca-1e36-418e-98f5-04fdf2c7ee4c req-bc0f0a01-c324-4a1d-8f5c-48c781bf1bbf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:12.611394 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7e8d0eca-1e36-418e-98f5-04fdf2c7ee4c req-bc0f0a01-c324-4a1d-8f5c-48c781bf1bbf service nova] Creating event network-vif-deleted:2e5be680-3d9a-4b6d-840e-47b43bed8454 for instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 on n-h2-master-1 Oct 24 09:24:12.629542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7e8d0eca-1e36-418e-98f5-04fdf2c7ee4c req-bc0f0a01-c324-4a1d-8f5c-48c781bf1bbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086632 Oct 24 09:24:12.634827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2905/5992] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:24:12.730541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:12.731259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:12.750180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:12.756224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:12.759990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:12.769681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:12.770175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:12.770616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:12.888411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:12.890206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:12.897373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:12.898459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lazy-loading 'fault' on Instance uuid 871e9aba-3376-4ba2-89ba-df1a056d79c1 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:24:13.020506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0b4f066e344bba84c0369d4c695f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104d284053c4625bcb91c06e3fa5848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:13.031722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20c6579c-0c91-42db-adb4-573eb5f6aea4 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 200 len: 1339 microversion: 2.1 time: 0.309172 Oct 24 09:24:13.034803 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2906/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:12 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 1339 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:13.102374 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:13.118910 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-276063b8-5c4a-4e77-a206-9b0aa1b92efb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1691 microversion: 2.1 time: 1.408323 Oct 24 09:24:13.121585 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3088/5994] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:11 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1691 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:13.387887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:13.391257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:13.413339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:13.416262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:13.418499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:13.420344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:13.422178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:13.423794 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:13.962604 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:13.973507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3735367-2bcf-4bd4-b3f2-1a40330a948d tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.596996 Oct 24 09:24:13.975164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2907/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:13 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:14.066540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:14.067314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] [instance: 871e9aba-3376-4ba2-89ba-df1a056d79c1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:14.096011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:14.098584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:14.099396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:14.100801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:14.102947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:14.105269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:14.155187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:14.156528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:14.163741 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] HTTP exception thrown: Instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 could not be found. Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Request method failure captured: Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 HTTP/1.1 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVliWWN6p7DqdgGfi6aRK7CV9PpE3EpdBesB6-2mzeAt2U1bu08iXSlZOsAYckOh71w_jilPucdF-MgD7uRwapnw7olIIR-6mDNaxTCg-AiYdHU9WBUqzA4rP7Bb_6G4e8Vkl_ZDhY78lKuvQGWdIYRh5Ev40wjANcgtkuQn9zF6PM2I Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 1104d284053c4625bcb91c06e3fa5848 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestNetworkBasicOps-537393093 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1104d284053c4625bcb91c06e3fa5848"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1104d284053c4625bcb91c06e3fa5848"}]}] Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestNetworkBasicOps-537393093 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 1104d284053c4625bcb91c06e3fa5848 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestNetworkBasicOps-537393093 Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestNetworkBasicOps-537393093-project Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 9d0b4f066e344bba84c0369d4c695f8b Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestNetworkBasicOps-537393093-project Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 could not be found. Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '871e9aba-3376-4ba2-89ba-df1a056d79c1'} Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 could not be found. Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 could not be found. Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:24:14.167664 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 could not be found. Oct 24 09:24:14.172413 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:14.174407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:14.174407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:14.177077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:14.181630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:14.182316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Returning 404 to user: Instance 871e9aba-3376-4ba2-89ba-df1a056d79c1 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:24:14.186426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:14.191298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:14.192174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a53720d7-780c-432b-9489-d2222f930802 tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1" status: 404 len: 111 microversion: 2.1 time: 0.124778 Oct 24 09:24:14.217441 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3089/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:14 2022] GET /compute/v2.1/servers/871e9aba-3376-4ba2-89ba-df1a056d79c1 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:24:14.842829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:14.853996 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0d09ccc-cdd3-4437-b13c-cd48f1b942f5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1691 microversion: 2.1 time: 0.705141 Oct 24 09:24:14.873947 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2908/5997] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:14 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1691 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:14.998908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:14.999542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:15.026339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.026853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.037196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.038326 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.039664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.040132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.232805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27f5b8de-b622-43e8-a0ba-2f12bfadd1bc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] Calling method '.version_select at 0x7f8da9e06af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:15.271343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27f5b8de-b622-43e8-a0ba-2f12bfadd1bc tempest-TestNetworkBasicOps-537393093 tempest-TestNetworkBasicOps-537393093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1230937349" status: 202 len: 0 microversion: 2.1 time: 0.042471 Oct 24 09:24:15.272206 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2909/5998] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1230937349 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:24:15.527853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:15.546985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6da0f16d-d2b9-44e1-a171-0c6aefb75ab3 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1502 microversion: 2.1 time: 0.552156 Oct 24 09:24:15.551182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3090/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:14 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1502 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:15.572510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:15.574144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:15.583718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.584457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.585122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.586095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.586813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.587496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.618839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lazy-loading 'flavor' on Instance uuid b516f31b-5685-462a-822e-ad4f76e3feed {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:24:15.645915 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:15.769264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ffd6da4d-7909-4e50-a8ae-c27f6e156a04 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action" status: 202 len: 0 microversion: 2.1 time: 0.201302 Oct 24 09:24:15.770019 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2910/6000] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:15 2022] POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:24:15.787349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:15.788529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:15.812416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.812945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.815617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.816576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.821921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.825072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.885328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:15.886324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:15.895545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.903907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.905780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:15.913282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:15.914386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:15.916774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:16.219669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:16.227654 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86dfcd39-6ed9-40ec-8439-b340004caeba tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1510 microversion: 2.1 time: 0.453367 Oct 24 09:24:16.241674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3091/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:15 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:16.573427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:16.583325 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c821dcb-f3c4-4481-b405-9fc4d10fff5c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1691 microversion: 2.1 time: 0.702530 Oct 24 09:24:16.594080 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2911/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:15 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1691 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:17.260413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:17.261039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:17.278407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.279240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.279892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.280787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.281438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.282147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.620143 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:17.620834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:17.628536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.629118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.630471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.631703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.632158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.632591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.700215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:17.712296 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca66ce9b-6b5f-4568-b9a9-a279e2b49341 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1493 microversion: 2.1 time: 0.456717 Oct 24 09:24:17.730328 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3092/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:17 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1493 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:17.741832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:17.742459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:17.752866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.753590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.754994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.757846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.758630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.759222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.894819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-905d41dd-4a1c-4e73-a459-a63e4717404e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action" status: 202 len: 0 microversion: 2.1 time: 0.156784 Oct 24 09:24:17.895992 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3093/6004] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:17 2022] POST /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:24:17.923449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:17.925431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:17.943011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.943560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.944876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:17.947136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:17.947685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:17.949569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:18.101966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:18.117638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82e6bd84-2a25-44cf-9c93-d4ea9dfcdb0e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1691 microversion: 2.1 time: 0.501298 Oct 24 09:24:18.127345 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2912/6005] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:17 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1691 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:18.446964 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:18.467878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf18d35e-0100-4654-acc5-a15dfbbf8c31 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.562243 Oct 24 09:24:18.487003 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3094/6006] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:17 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:19.159725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:19.161521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:19.170498 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:19.173220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:19.174042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:19.174715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:19.175619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:19.176319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:19.176932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:19.492419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:19.493048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:19.506846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:19.522173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:19.522649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:19.523430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:19.523900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:19.524561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:19.584882 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:20.165257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:20.184122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:20.194456 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-844c36f0-73c0-4b20-aca9-05db0c76feed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 1.053896 Oct 24 09:24:20.194688 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc8ce79f-eab8-4e98-b57f-45b8e426250c tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.706094 Oct 24 09:24:20.211770 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2913/6007] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:19 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:20.213544 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3095/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:19 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:21.223485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:21.224105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:21.224230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:21.225130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:21.236967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:21.242939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:21.245964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:21.247598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:21.249457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:21.250139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:21.260133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:21.265541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:21.271572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:21.274745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:21.276713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:21.278553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:21.832512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:21.850305 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37592e92-7a2c-4db5-8549-b9f4b4bc097a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1499 microversion: 2.1 time: 0.634957 Oct 24 09:24:21.853169 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2914/6009] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:21 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1499 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:22.291826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:22.301762 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8e43c8c-ee6f-4168-9c72-0bf1593bb78d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 1.082746 Oct 24 09:24:22.303402 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3096/6010] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:21 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:22.888666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:22.890039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:22.903731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:22.909180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:22.909802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:22.910655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:22.913877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:22.915291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:23.331065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:23.331693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:23.342625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:23.345591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:23.350634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:23.351623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:23.352278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:23.352899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:23.498323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:23.507083 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-621d0ddb-0fb6-4ad8-ac25-ca9743c9b4b6 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1502 microversion: 2.1 time: 0.634356 Oct 24 09:24:23.513836 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2915/6011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:22 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1502 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:23.538968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:23.539469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:23.548725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:23.549717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:23.551673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:23.554387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:23.555558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:23.556230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:23.592662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:24:23.647389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:23.658652 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b3f3c80-36d9-4b86-8c7d-85c426a2b413 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 0.332375 Oct 24 09:24:23.674944 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3097/6012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:23 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:23.732795 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30a6f024-626a-4575-9d56-ebc50fa6640e tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 204 len: 0 microversion: 2.1 time: 0.196685 Oct 24 09:24:23.733780 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2916/6013] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:24:23 2022] DELETE /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:24:23.742585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:23.743585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:23.750312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:23.751737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:23.752449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:23.753471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:23.754160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:23.754834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:24.095473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:24.123193 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41002c92-cb6f-42e5-971e-9415b604a1c5 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1508 microversion: 2.1 time: 0.382431 Oct 24 09:24:24.126803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3098/6014] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:23 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:24.683653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:24.684359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:24.692047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:24.693230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:24.693893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:24.694874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:24.695502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:24.698869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:25.150681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:25.151261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:25.162906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:25.163787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:25.164439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:25.169389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:25.170117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:25.170728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:25.698727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:25.724024 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa74f59d-09a7-4695-8d72-f83a47f863e6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 1.044111 Oct 24 09:24:25.747498 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2917/6015] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:24 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:26.139448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:26.188983 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77a6ab52-b50d-4898-8a0e-3af7446f2dac tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1508 microversion: 2.1 time: 1.039855 Oct 24 09:24:26.215757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3099/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:25 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1508 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:26.755598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:26.757891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:26.779009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:26.780083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:26.783100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:26.788477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:26.789359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:26.793880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:27.221484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:27.222220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:27.243768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:27.247536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:27.255680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:27.257969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:27.259420 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f97b9aa6-79d8-46c5-a5db-9cd0ebbb566c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 0.507128 Oct 24 09:24:27.260099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:27.262429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:27.264023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:27.276690 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2918/6017] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:26 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:28.174523 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:28.198400 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-370dc283-96f4-44df-b524-1ad8ab01b034 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1508 microversion: 2.1 time: 0.984031 Oct 24 09:24:28.200817 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3100/6018] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:27 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1508 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:28.294536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:28.295217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:28.310367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:28.310968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:28.313739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:28.314891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:28.317043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:28.319303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:28.879348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c414987c-92ea-4505-bd87-d9357aada9a5 req-8b08c15e-ba19-44c0-bab8-940da90ccbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b516f31b-5685-462a-822e-ad4f76e3feed", "name": "network-vif-deleted", "tag": "309cbda4-5775-453c-81de-868a3372ccad"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:28.932438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c414987c-92ea-4505-bd87-d9357aada9a5 req-8b08c15e-ba19-44c0-bab8-940da90ccbec service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:28.932938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c414987c-92ea-4505-bd87-d9357aada9a5 req-8b08c15e-ba19-44c0-bab8-940da90ccbec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:28.939643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c414987c-92ea-4505-bd87-d9357aada9a5 req-8b08c15e-ba19-44c0-bab8-940da90ccbec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:28.985641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:28.994066 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c414987c-92ea-4505-bd87-d9357aada9a5 req-8b08c15e-ba19-44c0-bab8-940da90ccbec service nova] Creating event network-vif-deleted:309cbda4-5775-453c-81de-868a3372ccad for instance b516f31b-5685-462a-822e-ad4f76e3feed on n-h2-master-1 Oct 24 09:24:29.004936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3a7115d-5c51-42b3-96ce-854ff6ea27cd tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 0.722088 Oct 24 09:24:29.019110 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c414987c-92ea-4505-bd87-d9357aada9a5 req-8b08c15e-ba19-44c0-bab8-940da90ccbec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141400 Oct 24 09:24:29.020415 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3101/6019] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:24:29.027641 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2919/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:28 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:29.230747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:29.232091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:29.266068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:29.266585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:29.267047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:29.273096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:29.274308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:29.279887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:29.387034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:29.387528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:29.387976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:29.388443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lazy-loading 'fault' on Instance uuid b516f31b-5685-462a-822e-ad4f76e3feed {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:24:29.539599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47cc2bea7f764515920d59cae9ef0111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f2fcdaa9cd434797881937ea940b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:29.557353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e223d48-431c-4f00-8446-84f21032fbd9 tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 200 len: 1304 microversion: 2.1 time: 0.329500 Oct 24 09:24:29.557999 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3102/6021] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:29 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 1304 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:30.032188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:30.032795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:30.052295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:30.052598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:30.053045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:30.066199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:30.066709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:30.067299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:30.581872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:30.583386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] [instance: b516f31b-5685-462a-822e-ad4f76e3feed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:30.599616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:30.601594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:30.602271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:30.603209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:30.605618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:30.606265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:30.647875 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] HTTP exception thrown: Instance b516f31b-5685-462a-822e-ad4f76e3feed could not be found. Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Request method failure captured: Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed HTTP/1.1 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlmeA8WAQW2OdW8pwGIGEcOEmnMOxhI8WwmW0V0yPMrfT0ByCBnrwqLR9k4CeEu3U431YLpE4VARjC9a3C-e4_kqh_bdiezDHUhT9h_rI7dFuUagjmBIBzM4_u5lE4qVC8Qsuaob0WQE7hvl_fkPLSAUndopTHISHWD3sUNPisgK9Go Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: a3f2fcdaa9cd434797881937ea940b89 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestServerAdvancedOps-334154812 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3f2fcdaa9cd434797881937ea940b89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3f2fcdaa9cd434797881937ea940b89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3f2fcdaa9cd434797881937ea940b89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3f2fcdaa9cd434797881937ea940b89"}]}] Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestServerAdvancedOps-334154812 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: a3f2fcdaa9cd434797881937ea940b89 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestServerAdvancedOps-334154812 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestServerAdvancedOps-334154812-project Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 47cc2bea7f764515920d59cae9ef0111 Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestServerAdvancedOps-334154812-project Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b516f31b-5685-462a-822e-ad4f76e3feed could not be found. Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b516f31b-5685-462a-822e-ad4f76e3feed'} Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b516f31b-5685-462a-822e-ad4f76e3feed could not be found. Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b516f31b-5685-462a-822e-ad4f76e3feed could not be found. Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:24:30.654951 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b516f31b-5685-462a-822e-ad4f76e3feed could not be found. Oct 24 09:24:30.660752 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:24:30.662760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] Returning 404 to user: Instance b516f31b-5685-462a-822e-ad4f76e3feed could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:24:30.664634 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d60db6aa-883d-4ad5-ab00-46c5e37c1c0a tempest-TestServerAdvancedOps-334154812 tempest-TestServerAdvancedOps-334154812-project] 10.222.0.25 "GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed" status: 404 len: 111 microversion: 2.1 time: 0.088013 Oct 24 09:24:30.679641 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3103/6022] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:30 2022] GET /compute/v2.1/servers/b516f31b-5685-462a-822e-ad4f76e3feed => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:24:31.077173 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:31.085789 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ec6db69-56d5-4f4f-8cf9-dc8a4097a47e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1696 microversion: 2.1 time: 1.057332 Oct 24 09:24:31.090959 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2920/6023] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:30 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1696 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:32.116761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:32.117701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:32.135147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:32.135853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:32.136307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:32.137036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:32.137536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:32.137982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:33.207701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:33.222107 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4aeced26-82d4-4b45-baf3-f738c1493741 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1695 microversion: 2.1 time: 1.110442 Oct 24 09:24:33.237358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3104/6024] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:32 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1695 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:33.747255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "name": "network-vif-unplugged", "status": "completed", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:33.786743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:33.788509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:33.789658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:33.828002 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] Creating event network-vif-unplugged:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h2-master-1 Oct 24 09:24:33.842993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] Instance 834a9723-d8c8-49cc-9353-8b0693221e7c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:24:33.873604 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7a411a7a-6d7e-4fc4-9d12-c209aa91e644 req-4c6bd3e4-bd67-43b9-82ea-1fed9bf82228 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131570 Oct 24 09:24:33.874747 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2921/6025] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:24:34.253471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:34.254090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:34.270629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:34.281403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:34.282093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:34.282869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:34.283349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:34.283785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:34.566344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:34.581005 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d52432f2-5b7c-473b-ba87-76a303932bc4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1695 microversion: 2.1 time: 0.332426 Oct 24 09:24:34.581635 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3105/6026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:34 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1695 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:35.607098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:35.607813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:35.623295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:35.624470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:35.624927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:35.626356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:35.626899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:35.630068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:35.926320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:35.937497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:35.938235 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=54 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:35.948800 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05dc66a3-7e92-4856-84de-6bcc7b00195c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1695 microversion: 2.1 time: 0.347212 Oct 24 09:24:35.951883 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2922/6027] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:35 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1695 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:35.957017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:35.957539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:35.957977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:35.982637 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] Creating event network-changed:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h2-master-1 Oct 24 09:24:35.995707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] Instance 834a9723-d8c8-49cc-9353-8b0693221e7c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:24:36.023955 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9f3b720f-41de-455f-b42a-cbfd7a3149e2 req-afdbbb90-2ee2-47db-8027-6d60e3b72a0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102102 Oct 24 09:24:36.027697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3106/6028] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:24:36.979942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:36.980577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:36.994555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:36.995616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:36.995977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:36.996705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:36.997272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:37.002932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:37.840028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:37.858599 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5793ccb6-9a65-4d32-bce7-2c50a618b61e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1693 microversion: 2.1 time: 0.882629 Oct 24 09:24:37.859282 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2923/6029] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:36 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1693 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:38.888504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:38.889825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:38.898420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:38.898420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:38.898420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:38.899082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:38.899547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:38.899995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:39.660936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:39.678072 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6857d5d4-fdcc-4eb4-80f4-6fc6c8ef8498 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1690 microversion: 2.1 time: 0.793813 Oct 24 09:24:39.680821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3107/6030] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:38 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1690 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:39.715281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:39.715854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:39.745982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:39.754210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:39.754759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:39.761511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:39.762076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:39.772399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:39.912869 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:40.174685 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a142bfb-83df-4272-af03-071f68b20b70 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action" status: 202 len: 0 microversion: 2.1 time: 0.460119 Oct 24 09:24:40.184805 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:40.186341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:40.192033 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2924/6031] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:24:39 2022] POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:24:40.200360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:40.202527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:40.204235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:40.207168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:40.209157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:40.211209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:41.085264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:41.103011 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f2206b8-e410-427c-8761-4f5b6cdd900c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.922588 Oct 24 09:24:41.103877 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3108/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:40 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:41.369030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "name": "network-vif-plugged", "status": "completed", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:41.383660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:41.384150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:41.384586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:41.399645 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] Creating event network-vif-plugged:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h2-master-1 Oct 24 09:24:41.407010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] Instance 834a9723-d8c8-49cc-9353-8b0693221e7c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:24:41.418494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-78b7f207-595b-4b69-960b-c692486b2bbb req-e2bfaafd-7a1e-4225-8444-4692b6553215 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053432 Oct 24 09:24:41.419984 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2925/6033] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:24:42.132619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:42.133489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:42.151967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:42.151967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:42.151967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:42.151967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:42.151967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:42.151967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:42.497565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:42.506315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a6b28222-8597-4554-bc6e-c0501312813e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.377629 Oct 24 09:24:42.507328 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3109/6034] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:42 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:43.532977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:43.533710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:43.548637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:43.549707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:43.549707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:43.550285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:43.550736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:43.552826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:44.064557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:44.088340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2f058d4-4409-49a9-92e1-29f2cd813c2f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.561897 Oct 24 09:24:44.091954 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2926/6035] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:43 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:45.115329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:45.115959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:45.126907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:45.127407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:45.127850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:45.130054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:45.130673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:45.131504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:46.189452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:46.206362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7d1d78a-7e3d-4975-8df6-aedeb98640e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 1.097980 Oct 24 09:24:46.222052 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3110/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:45 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:47.234064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:47.235919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:47.244458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:47.253844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:47.254667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:47.255656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:47.256622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:47.257423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:49.352746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:49.365935 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23be95ce-5a3c-4aad-bd84-dae1b0e1f842 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 2.135720 Oct 24 09:24:49.369252 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2927/6037] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:47 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:50.087220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "name": "network-vif-unplugged", "status": "completed", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:50.128553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:50.129476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:50.131042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:50.138036 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=86 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:50.156349 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] Creating event network-vif-unplugged:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:24:50.168022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] Instance 834a9723-d8c8-49cc-9353-8b0693221e7c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:24:50.183758 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-14664863-606d-4f47-ab27-7c0a7940c39f req-e0a61fcd-a63a-47eb-9ce7-235ed902bb67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100723 Oct 24 09:24:50.185800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3111/6038] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:24:50.399811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:50.400842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:50.407412 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:50.422430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:50.424907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:50.426346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:50.429178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:50.429890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:50.434445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:51.310141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:51.324533 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e7dd46b-6183-478a-949b-da2054873f69 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.929681 Oct 24 09:24:51.326501 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2928/6039] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:50 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:52.350930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:52.361121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:52.371598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:52.372304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:52.372935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:52.373871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:52.375281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:52.375906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:52.887098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:52.903482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3a4b269-9a22-493b-b12c-b63ac3262405 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.556601 Oct 24 09:24:52.907073 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3112/6040] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:52 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:53.045681 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:24:53.081384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:53.082001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:53.082455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:53.118180 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] Creating event network-changed:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:24:53.133316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] Instance 834a9723-d8c8-49cc-9353-8b0693221e7c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:24:53.204788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e970f39c-9dd9-43cb-b73e-2d183121b8e8 req-70ed44b4-acfb-4a70-b9cc-164176d796e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163107 Oct 24 09:24:53.205436 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2929/6041] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:24:53.933332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:53.934580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:53.952045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:53.955018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:53.955778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:53.958061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:53.958737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:53.961445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:54.793940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:54.811734 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3df2805-c021-4ed8-9334-d3f1bd4e1bc8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.874678 Oct 24 09:24:54.813391 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3113/6042] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:53 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:24:55.847549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:55.848449 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:55.866905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:55.867434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:55.870742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:55.871529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:55.875894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:55.876408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:56.468942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:56.491214 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6559f3f-387d-4b34-863e-d12e6abff0ff tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1689 microversion: 2.1 time: 0.649802 Oct 24 09:24:56.495332 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2930/6043] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:55 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1689 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:57.518301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:24:57.519002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:24:57.543171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:57.543690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:57.544137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:57.544877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:24:57.545383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:24:57.551982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:24:58.053480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:24:58.065400 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6b13a17f-3c96-457c-94c9-89f53fbed2b1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1682 microversion: 2.1 time: 0.551079 Oct 24 09:24:58.066339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3114/6044] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:24:57 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1682 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:25:04.476016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f80ea47f-0ec8-4d28-8316-883d8b8779b4 req-ce611ad0-1989-43be-919f-4243d71a9af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "name": "network-vif-plugged", "status": "completed", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:25:04.494827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f80ea47f-0ec8-4d28-8316-883d8b8779b4 req-ce611ad0-1989-43be-919f-4243d71a9af9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:04.497838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f80ea47f-0ec8-4d28-8316-883d8b8779b4 req-ce611ad0-1989-43be-919f-4243d71a9af9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:04.499286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f80ea47f-0ec8-4d28-8316-883d8b8779b4 req-ce611ad0-1989-43be-919f-4243d71a9af9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:04.526963 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f80ea47f-0ec8-4d28-8316-883d8b8779b4 req-ce611ad0-1989-43be-919f-4243d71a9af9 service nova] Creating event network-vif-plugged:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:25:04.538117 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f80ea47f-0ec8-4d28-8316-883d8b8779b4 req-ce611ad0-1989-43be-919f-4243d71a9af9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066690 Oct 24 09:25:04.541580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2931/6045] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:25:22.469612 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=17 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:22.470915 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=21 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:22.758907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:25:22.761230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:22.767553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:22.768238 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:22.768876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:22.769621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:22.770229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:22.770661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:22.844606 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb0b457c-ad2b-444c-84d0-4a8acfc57df3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action" status: 200 len: 63183 microversion: 2.1 time: 0.380033 Oct 24 09:25:22.845995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3115/6046] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:25:22 2022] POST /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c/action => generated 63183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:25:29.285199 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=7 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:29.286256 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:29.534502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:29.535505 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:29.543912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:29.544870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:29.546089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:29.547179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:29.547652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:29.548043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:29.713250 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f0644d0-f60d-4c44-b697-81caef5a859f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1833 microversion: 2.1 time: 0.434015 Oct 24 09:25:29.713985 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2932/6047] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:25:29 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1833 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:25:31.471790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:31.472950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:31.493763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:31.494742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1768996d-51f5-42cf-8d97-6ea793fbe296 req-8048214d-7eee-48c6-a2c3-b6475318a647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:25:31.534174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:31.551432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:31.553350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:31.555506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:31.556113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:31.566103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1768996d-51f5-42cf-8d97-6ea793fbe296 req-8048214d-7eee-48c6-a2c3-b6475318a647 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:31.567663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1768996d-51f5-42cf-8d97-6ea793fbe296 req-8048214d-7eee-48c6-a2c3-b6475318a647 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:31.571431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1768996d-51f5-42cf-8d97-6ea793fbe296 req-8048214d-7eee-48c6-a2c3-b6475318a647 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:31.601563 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1768996d-51f5-42cf-8d97-6ea793fbe296 req-8048214d-7eee-48c6-a2c3-b6475318a647 service nova] Creating event network-changed:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:25:31.617559 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1768996d-51f5-42cf-8d97-6ea793fbe296 req-8048214d-7eee-48c6-a2c3-b6475318a647 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128362 Oct 24 09:25:31.629950 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2933/6048] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:25:31.632615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:25:31.816067 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6b66fcfe-8c74-4e12-a8c5-a27074a14c84 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 204 len: 0 microversion: 2.1 time: 0.349345 Oct 24 09:25:31.817230 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3116/6049] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:25:31 2022] DELETE /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:25:31.828163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:31.828871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:31.851228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:31.851775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:31.852221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:31.856539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:31.857030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:31.857529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:32.199384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:25:32.223320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-568a7348-31f2-47a5-a169-25ae1558737f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1688 microversion: 2.1 time: 0.401010 Oct 24 09:25:32.223907 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2934/6050] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:25:31 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1688 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:25:33.252035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:33.252753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:33.271831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:33.272331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:33.272774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:33.273509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:33.274129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:33.274704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:33.711701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:25:33.724256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ace40e0e-1fc2-47d9-9353-9957f4bdf7cc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1688 microversion: 2.1 time: 0.476357 Oct 24 09:25:33.725416 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3117/6051] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:25:33 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1688 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:25:34.283572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4e428950-e35f-437d-a1f1-0670f900b60c req-0c9ff12d-5576-41e5-9a71-dad7c91597ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a9723-d8c8-49cc-9353-8b0693221e7c", "name": "network-vif-deleted", "tag": "32eae0fb-78ca-413b-9a2f-2c5e06127543"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:25:34.299191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e428950-e35f-437d-a1f1-0670f900b60c req-0c9ff12d-5576-41e5-9a71-dad7c91597ec service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:34.300171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e428950-e35f-437d-a1f1-0670f900b60c req-0c9ff12d-5576-41e5-9a71-dad7c91597ec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:34.300844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4e428950-e35f-437d-a1f1-0670f900b60c req-0c9ff12d-5576-41e5-9a71-dad7c91597ec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:34.323038 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4e428950-e35f-437d-a1f1-0670f900b60c req-0c9ff12d-5576-41e5-9a71-dad7c91597ec service nova] Creating event network-vif-deleted:32eae0fb-78ca-413b-9a2f-2c5e06127543 for instance 834a9723-d8c8-49cc-9353-8b0693221e7c on n-h1-master-1 Oct 24 09:25:34.332494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4e428950-e35f-437d-a1f1-0670f900b60c req-0c9ff12d-5576-41e5-9a71-dad7c91597ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054426 Oct 24 09:25:34.334279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2935/6052] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:25:34.755595 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:34.756757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:34.778594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:34.779571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:34.780616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:34.781604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:34.782307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:34.783173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:34.860469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:34.861208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:34.861887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:34.863344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lazy-loading 'fault' on Instance uuid 834a9723-d8c8-49cc-9353-8b0693221e7c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:25:34.942336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:25:34.956266 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a83a932-7706-4ec6-9d5a-1cff89cf1937 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 200 len: 1357 microversion: 2.1 time: 0.204685 Oct 24 09:25:34.957589 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3118/6053] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:25:34 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:25:35.985477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:35.986718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 834a9723-d8c8-49cc-9353-8b0693221e7c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:36.015539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:36.017656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:36.018378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:36.019934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:36.021016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:36.022577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:36.052720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] HTTP exception thrown: Instance 834a9723-d8c8-49cc-9353-8b0693221e7c could not be found. Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Request method failure captured: Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c HTTP/1.1 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVljFDFXOGs3XhEFZCXWMxvWHfJh781lcGcMgV9FXlazzOQezbj0390BG589-tgaa-HXoN5AG8VG1fwGrrM5YqXBde-HOJ8Fgsd7zGjtwxHywtiwoNfVLLzY6WysaYGKtyKkPts8MlGRWmKcz7DGX-cOyj0rWN9S41IMgA8M1Jci6EYg Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d4ea2b64dfd8408292fe8b8d44c39b59"}]}] Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b62fde68e8c747bfbea881c71421c5ae Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 834a9723-d8c8-49cc-9353-8b0693221e7c could not be found. Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '834a9723-d8c8-49cc-9353-8b0693221e7c'} Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834a9723-d8c8-49cc-9353-8b0693221e7c could not be found. Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834a9723-d8c8-49cc-9353-8b0693221e7c could not be found. Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:25:36.054798 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834a9723-d8c8-49cc-9353-8b0693221e7c could not be found. Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Returning 404 to user: Instance 834a9723-d8c8-49cc-9353-8b0693221e7c could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-072c5c32-51d2-4c34-b7cc-ef2113257254 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c" status: 404 len: 111 microversion: 2.1 time: 0.076806 Oct 24 09:25:36.062735 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2936/6054] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:25:35 2022] GET /compute/v2.1/servers/834a9723-d8c8-49cc-9353-8b0693221e7c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:42.010666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45bb3555-c32d-4be3-b352-90115c2e146d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '.version_select at 0x7f8daf0e6ca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:42.068556 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-45bb3555-c32d-4be3-b352-90115c2e146d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1240393474" status: 202 len: 0 microversion: 2.1 time: 0.061851 Oct 24 09:25:42.073960 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3119/6055] 10.222.0.25 () {58 vars in 1284 bytes} [Mon Oct 24 09:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1240393474 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:25:42.120703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc71dd03-b3e4-4251-a09b-20d58a57ab76 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: .version_select at 0x7f8daa3bb430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1377689933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgoDinRpppHbn6MJwVeJYeUHrq0c/wgXrhLlcw9o4drMesbjMarM6fc9QgCNuo33DTsmXCOH1w3UC8r82ncx0lCjG/lqdLPpF/zNn4BtGBO6gR3M3qUn7/NSnBpHZFOiQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:25:42.173763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bc71dd03-b3e4-4251-a09b-20d58a57ab76 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:25:42.179447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-bc71dd03-b3e4-4251-a09b-20d58a57ab76 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:25:42.213765 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc71dd03-b3e4-4251-a09b-20d58a57ab76 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.096119 Oct 24 09:25:42.214680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2937/6056] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:25:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:25:55.414813 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:55.415931 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:55.424228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-100364456", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "df39aef2-574a-405c-9b90-33659a71f71f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1377689933", "security_groups": [{"name": "tempest-secgroup-smoke-1350111555"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:25:56.242171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] validate_networks() for [('df39aef2-574a-405c-9b90-33659a71f71f', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:25:57.931557 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:25:57.932665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:25:57.933399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:25:57.934151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:25:57.934770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:25:57.957495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:57.958591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:57.959259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:57.960300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:25:57.960998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:25:57.963473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:25:58.008472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:25:58.025152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:25:58.086275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:25:58.090433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:25:58.274302 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb57dcfd-946c-47c4-a1b1-4af4b22ff669 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.863099 Oct 24 09:25:58.279314 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3120/6057] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:25:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:25:58.290391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-07f6046f-7589-417b-b054-809e4f4bf10a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:25:58.291008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-07f6046f-7589-417b-b054-809e4f4bf10a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:25:58.300025 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=18 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:58.309858 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:58.311429 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:59.682174 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-07f6046f-7589-417b-b054-809e4f4bf10a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:25:59.722977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-07f6046f-7589-417b-b054-809e4f4bf10a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1266 microversion: 2.1 time: 1.409231 Oct 24 09:25:59.723661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2938/6058] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:25:58 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1266 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:00.753487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:00.761150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:00.793629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:00.796126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:00.796583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:00.797348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:00.801514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:00.802000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:01.092427 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:01.103921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e502133-f254-4b65-9ceb-b46fee5b60d6 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1336 microversion: 2.1 time: 0.356913 Oct 24 09:26:01.104720 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3121/6059] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:00 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1336 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:02.132830 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:02.134367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:02.148365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:02.152544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:02.166496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:02.169976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:02.170657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:02.189557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:02.754217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:02.768585 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a3d14d81-bc13-49c9-9793-67f24d000437 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.638335 Oct 24 09:26:02.768898 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2939/6060] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:02 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:03.796713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:03.797463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:03.824687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:03.826464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:03.828988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:03.831206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:03.841909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:03.863086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:04.712568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:04.722211 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4bd356ac-e7bf-4d38-9089-713cbdfae272 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.930882 Oct 24 09:26:04.722810 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3122/6061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:03 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:05.131576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e3ff5611-aede-42ce-ba5b-4a8f4fefcf64 req-450ccb56-5a26-4387-a1c1-1e10b2adf00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:05.202640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e3ff5611-aede-42ce-ba5b-4a8f4fefcf64 req-450ccb56-5a26-4387-a1c1-1e10b2adf00f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.203697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e3ff5611-aede-42ce-ba5b-4a8f4fefcf64 req-450ccb56-5a26-4387-a1c1-1e10b2adf00f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.204461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e3ff5611-aede-42ce-ba5b-4a8f4fefcf64 req-450ccb56-5a26-4387-a1c1-1e10b2adf00f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:05.253542 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e3ff5611-aede-42ce-ba5b-4a8f4fefcf64 req-450ccb56-5a26-4387-a1c1-1e10b2adf00f service nova] Creating event network-changed:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h2-master-1 Oct 24 09:26:05.264231 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e3ff5611-aede-42ce-ba5b-4a8f4fefcf64 req-450ccb56-5a26-4387-a1c1-1e10b2adf00f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137611 Oct 24 09:26:05.265558 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3123/6062] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:26:05.320853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:05.321391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:05.335538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.336051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.336498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:05.340982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.342047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.347115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:05.469876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:26:05.743004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5cb30458-7318-40b7-b9f0-55e520624614 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 204 len: 0 microversion: 2.32 time: 1.372617 Oct 24 09:26:05.743004 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2940/6063] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:26:04 2022] DELETE /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 0 bytes in 1375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:26:05.751101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:05.751825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:05.754225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:05.755219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:05.766807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.770105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.772177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:05.773227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.773935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.774442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:05.775169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.775631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.776066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:05.778298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:05.779543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:05.779989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:06.167605 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:06.177209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:06.203394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:06.211471 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f1dd871-7f9f-407a-9a03-715965d9b6ad tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2956 microversion: 2.32 time: 0.458382 Oct 24 09:26:06.212124 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2941/6064] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:05 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2956 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:06.496216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:06.511353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8872cf0-a1a0-4210-8bb6-e6868f487bed tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.764458 Oct 24 09:26:06.515241 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3124/6065] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:05 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:07.249257 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:07.250540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:07.260923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:07.261832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:07.262434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:07.263891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:07.264618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:07.266287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:07.539952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:07.540581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:07.554357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:07.571602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:07.578200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:07.584766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:07.585277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:07.585748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:07.586504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:07.586968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:07.587401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:07.590766 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-42dfae12-5164-4e75-be45-0bcdad2a32af tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2956 microversion: 2.32 time: 0.339307 Oct 24 09:26:07.605818 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2942/6066] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:07 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2956 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:07.988928 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:08.046284 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:08.503662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:08.519668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abba9d04-1533-47c0-ba91-38cde19ae0a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.984198 Oct 24 09:26:08.520844 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3125/6067] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:07 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:26:08.628413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:08.630157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:08.646931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:08.648507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:08.650244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:08.654026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:08.654689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:08.657534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:09.262640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:09.284259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:09.285808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:09.293381 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b60238b-e3cf-4d09-9b02-8825465a7a91 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2956 microversion: 2.32 time: 0.670535 Oct 24 09:26:09.297401 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2943/6068] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:08 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2956 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:09.378526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1468976775", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "95d90748-81c8-4918-aa6d-6da90ceb199e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:09.538903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] validate_networks() for [('95d90748-81c8-4918-aa6d-6da90ceb199e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:26:09.551271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:09.552157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:09.570771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:09.571339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:09.571854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:09.572579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:09.573041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:09.573501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:09.703555 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:10.040431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:10.049023 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5795973c-f7ee-44c9-ac9c-b983183b75ea tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.505203 Oct 24 09:26:10.053680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2944/6069] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:09 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:10.328070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:10.328884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:10.338933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:10.351267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:10.351874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:10.352756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:10.353562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:10.354114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:10.832922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:26:10.833989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:26:10.834622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:26:10.835193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:26:10.835762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:26:10.853531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:10.854199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:10.854795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:10.856348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:10.858036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:10.860735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:10.904226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Getting quotas for project 36d827271fb5462b9271fa0aad666949. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:26:10.916527 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Getting quotas for user eff0a34acf48466689c201d876a0cda4 and project 36d827271fb5462b9271fa0aad666949. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:26:10.931167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:26:10.933773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:26:11.016813 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc951fca-b309-45b8-9eca-9bdced92d03b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.924558 Oct 24 09:26:11.017784 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3126/6070] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:26:11.030517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-72eae3c0-b172-4dd4-b138-6e22dd3a34c6 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:11.035908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-72eae3c0-b172-4dd4-b138-6e22dd3a34c6 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:11.304319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-72eae3c0-b172-4dd4-b138-6e22dd3a34c6 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:11.312773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-72eae3c0-b172-4dd4-b138-6e22dd3a34c6 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1214 microversion: 2.1 time: 0.286227 Oct 24 09:26:11.320264 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3127/6071] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:11 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:11.338283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:11.338857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:11.365466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:11.368218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:11.370107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:11.373071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:11.383007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:11.384348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:11.385644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:11.400352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:11.406282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:11.415887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88d82e8b-d4f4-4242-9c64-025e74567a8b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2935 microversion: 2.32 time: 1.092316 Oct 24 09:26:11.433858 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2945/6072] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:10 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2935 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:26:12.330866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:12.349756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:12.350380 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:12.375417 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a9b382f-63c1-4f92-9b8d-26b616ae70e4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 1.053672 Oct 24 09:26:12.376034 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3128/6073] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:11 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:12.378898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:12.379923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:12.380514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:12.381719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:12.383833 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:12.384651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:12.452913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:12.453617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:12.471569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:12.473969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:12.476247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:12.477168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:12.482952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:12.483617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:12.715088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:12.725106 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e396c33-3d8a-46a0-8256-a78d679c507b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1210 microversion: 2.1 time: 0.382512 Oct 24 09:26:12.729338 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2946/6074] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:12 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1210 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:13.024757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2f008aaa-1340-4718-8e46-7f093aa39f73 req-156480c9-bdc3-4eec-80ff-85502b2720ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-deleted", "tag": "d0a63b4a-baa5-4f88-b08b-25c1ebccec31"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:13.045871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2f008aaa-1340-4718-8e46-7f093aa39f73 req-156480c9-bdc3-4eec-80ff-85502b2720ab service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:13.050708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2f008aaa-1340-4718-8e46-7f093aa39f73 req-156480c9-bdc3-4eec-80ff-85502b2720ab service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:13.059234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2f008aaa-1340-4718-8e46-7f093aa39f73 req-156480c9-bdc3-4eec-80ff-85502b2720ab service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:13.101266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2f008aaa-1340-4718-8e46-7f093aa39f73 req-156480c9-bdc3-4eec-80ff-85502b2720ab service nova] Creating event network-vif-deleted:d0a63b4a-baa5-4f88-b08b-25c1ebccec31 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:13.115445 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2f008aaa-1340-4718-8e46-7f093aa39f73 req-156480c9-bdc3-4eec-80ff-85502b2720ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094246 Oct 24 09:26:13.120821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2947/6075] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:13.226327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:13.254818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:13.261773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:13.275666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd630f60-d37f-4ed3-b22a-197903dc704c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2867 microversion: 2.32 time: 0.826400 Oct 24 09:26:13.277734 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3129/6076] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:12 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2867 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:13.402852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:13.403608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:13.419517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:13.420015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:13.425990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:13.426769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:13.427246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:13.427682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:13.766007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:13.769417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:13.791108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:13.794044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:13.794666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:13.795610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:13.797948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:13.801583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:13.950753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:13.959952 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd700c11-1687-4e2f-8a60-3d02de44a5d7 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.562139 Oct 24 09:26:13.966316 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2948/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:13 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:13.978157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b0e68907-b913-44c7-b5bd-b154893861b2 req-0ae1de68-34b4-4a84-b3b1-d0e4ca3d28fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "d9553579-010c-403c-9d62-6db9a95fe868"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:14.013328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b0e68907-b913-44c7-b5bd-b154893861b2 req-0ae1de68-34b4-4a84-b3b1-d0e4ca3d28fe service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:14.017097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b0e68907-b913-44c7-b5bd-b154893861b2 req-0ae1de68-34b4-4a84-b3b1-d0e4ca3d28fe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:14.017600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b0e68907-b913-44c7-b5bd-b154893861b2 req-0ae1de68-34b4-4a84-b3b1-d0e4ca3d28fe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:14.056006 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b0e68907-b913-44c7-b5bd-b154893861b2 req-0ae1de68-34b4-4a84-b3b1-d0e4ca3d28fe service nova] Creating event network-vif-unplugged:d9553579-010c-403c-9d62-6db9a95fe868 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:14.081389 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b0e68907-b913-44c7-b5bd-b154893861b2 req-0ae1de68-34b4-4a84-b3b1-d0e4ca3d28fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109237 Oct 24 09:26:14.091551 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2949/6078] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:14.093136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:14.104817 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-afa82572-c67f-4402-9ff6-b5a36a479e75 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1272 microversion: 2.1 time: 0.349039 Oct 24 09:26:14.108410 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3130/6079] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:13 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1272 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:14.315928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:14.317154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:14.330982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:14.334529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:14.339016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:14.341639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:14.347651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:14.349612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:14.994532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:14.995460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:15.023792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:15.024800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:15.025740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:15.026681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:15.028949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:15.033790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:15.389332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:15.405812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:15.415066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:15.420225 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0cff097a-b007-4161-adce-599cd11acedb tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2706 microversion: 2.32 time: 1.107165 Oct 24 09:26:15.424038 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2950/6080] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:14 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2706 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:15.435402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:15.437060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:15.452134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:15.457078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:15.458422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:15.459331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:15.459957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:15.460569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:15.599053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:15.608365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c33a48d-f2ea-44db-a6d5-82e1dc66f951 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.620379 Oct 24 09:26:15.617652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3131/6081] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:14 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:15.631441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5578375c-1e91-4aab-8055-4b26c9c017f1 req-35e9516b-6757-485b-ac69-776a21ad3613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-deleted", "tag": "d9553579-010c-403c-9d62-6db9a95fe868"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:15.648293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5578375c-1e91-4aab-8055-4b26c9c017f1 req-35e9516b-6757-485b-ac69-776a21ad3613 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:15.651063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5578375c-1e91-4aab-8055-4b26c9c017f1 req-35e9516b-6757-485b-ac69-776a21ad3613 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:15.652568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5578375c-1e91-4aab-8055-4b26c9c017f1 req-35e9516b-6757-485b-ac69-776a21ad3613 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:15.682643 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5578375c-1e91-4aab-8055-4b26c9c017f1 req-35e9516b-6757-485b-ac69-776a21ad3613 service nova] Creating event network-vif-deleted:d9553579-010c-403c-9d62-6db9a95fe868 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:15.699185 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5578375c-1e91-4aab-8055-4b26c9c017f1 req-35e9516b-6757-485b-ac69-776a21ad3613 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079999 Oct 24 09:26:15.700875 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3132/6082] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:15.875642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:15.887578 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b0ec1b80-d4bc-41ed-8617-79918ec5936c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.461535 Oct 24 09:26:15.888804 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2951/6083] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:15 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:16.236412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e354223e-e93f-4b0c-89eb-3dd0fa97dca7 req-0d3bd4d6-a6cc-41d3-baee-14ce2edc2844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "f2654d0a-7398-4bc3-bf34-e5064dae3bef"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:16.252476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e354223e-e93f-4b0c-89eb-3dd0fa97dca7 req-0d3bd4d6-a6cc-41d3-baee-14ce2edc2844 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:16.253232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e354223e-e93f-4b0c-89eb-3dd0fa97dca7 req-0d3bd4d6-a6cc-41d3-baee-14ce2edc2844 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:16.254042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e354223e-e93f-4b0c-89eb-3dd0fa97dca7 req-0d3bd4d6-a6cc-41d3-baee-14ce2edc2844 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:16.269607 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e354223e-e93f-4b0c-89eb-3dd0fa97dca7 req-0d3bd4d6-a6cc-41d3-baee-14ce2edc2844 service nova] Creating event network-vif-unplugged:f2654d0a-7398-4bc3-bf34-e5064dae3bef for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:16.276278 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e354223e-e93f-4b0c-89eb-3dd0fa97dca7 req-0d3bd4d6-a6cc-41d3-baee-14ce2edc2844 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051927 Oct 24 09:26:16.277801 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3133/6084] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:16.453411 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:16.454202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:16.468949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:16.470757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:16.472944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:16.476585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:16.478304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:16.478940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:16.648607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:16.649907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:16.669756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:16.670502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:16.671138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:16.674067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:16.674738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:16.675851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:17.004753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:17.018765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:17.026821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:17.028690 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33284f67-57d4-434f-a0ee-69ce74086004 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2593 microversion: 2.32 time: 0.579988 Oct 24 09:26:17.038674 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2952/6085] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:16 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2593 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:17.067777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:17.068651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:17.091438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:17.092715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:17.093556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:17.094488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:17.096705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:17.099956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:17.383774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:17.395967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c878d08-b47d-4cf0-b6f7-50de651b62c0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.753301 Oct 24 09:26:17.396914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3134/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:16 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:17.603805 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:17.624352 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b367816-30b8-48c6-8a48-858f79ad83aa tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.581951 Oct 24 09:26:17.630540 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2953/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:17 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:17.956992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-626ad776-d18a-4aa4-b0d9-929b2eabb41e req-9d1846c7-7f82-4392-a6b7-c5c9fde44556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a", "tag": "cf64be16-cb82-4ed3-af1b-68f7d2530feb"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:17.975096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-626ad776-d18a-4aa4-b0d9-929b2eabb41e req-9d1846c7-7f82-4392-a6b7-c5c9fde44556 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:17.978026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-626ad776-d18a-4aa4-b0d9-929b2eabb41e req-9d1846c7-7f82-4392-a6b7-c5c9fde44556 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:17.979561 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-626ad776-d18a-4aa4-b0d9-929b2eabb41e req-9d1846c7-7f82-4392-a6b7-c5c9fde44556 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.010168 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-626ad776-d18a-4aa4-b0d9-929b2eabb41e req-9d1846c7-7f82-4392-a6b7-c5c9fde44556 service nova] Creating event network-changed:cf64be16-cb82-4ed3-af1b-68f7d2530feb for instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a on n-h1-master-1 Oct 24 09:26:18.023830 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-626ad776-d18a-4aa4-b0d9-929b2eabb41e req-9d1846c7-7f82-4392-a6b7-c5c9fde44556 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070809 Oct 24 09:26:18.024938 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3135/6088] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:18.060961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:18.063977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:18.076233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.076840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.077282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.078031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.078492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.078923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.312126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "a059daee-94eb-4c0c-8cdc-1fec361e5564"}, {"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "0dece821-1750-4813-947a-1f748a9717a6"}, {"server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "name": "network-vif-plugged", "status": "completed", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:18.332172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.341751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.342498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.358881 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Creating event network-vif-unplugged:a059daee-94eb-4c0c-8cdc-1fec361e5564 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:18.359393 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Creating event network-vif-unplugged:0dece821-1750-4813-947a-1f748a9717a6 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:18.359905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] Creating event network-vif-plugged:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h2-master-1 Oct 24 09:26:18.383611 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1a686bba-c0ef-4b88-9555-7b3bc10fac38 req-0563c97b-35bb-4435-b916-a0a0e0931bcf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.075281 Oct 24 09:26:18.385095 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3136/6089] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:18.433387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:18.436394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:18.446240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.446922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.447933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.449779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.450444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.451059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.456645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:18.483083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:18.484745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:18.486076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-693dd8cf-8b2e-43ed-9cce-4b11ff0cd8e5 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2546 microversion: 2.32 time: 0.429774 Oct 24 09:26:18.486642 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2954/6090] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:18 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2546 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:18.655674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:18.657032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:18.670182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.670694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.671139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.671958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:18.672307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:18.672739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:18.681134 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:19.010029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:19.020055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b31754b-56b0-4b39-b43d-b17a9034ca73 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.368886 Oct 24 09:26:19.026013 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2955/6091] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:18 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:26:19.042010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6ebf0033-7f84-480f-b524-0e7849944843 req-f98ceedd-0a14-43f9-bac8-6b1065d4005a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-deleted", "tag": "f2654d0a-7398-4bc3-bf34-e5064dae3bef"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:19.063974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6ebf0033-7f84-480f-b524-0e7849944843 req-f98ceedd-0a14-43f9-bac8-6b1065d4005a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:19.064475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6ebf0033-7f84-480f-b524-0e7849944843 req-f98ceedd-0a14-43f9-bac8-6b1065d4005a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:19.065538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6ebf0033-7f84-480f-b524-0e7849944843 req-f98ceedd-0a14-43f9-bac8-6b1065d4005a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:19.096052 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6ebf0033-7f84-480f-b524-0e7849944843 req-f98ceedd-0a14-43f9-bac8-6b1065d4005a service nova] Creating event network-vif-deleted:f2654d0a-7398-4bc3-bf34-e5064dae3bef for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:19.110638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6ebf0033-7f84-480f-b524-0e7849944843 req-f98ceedd-0a14-43f9-bac8-6b1065d4005a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082703 Oct 24 09:26:19.111573 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2956/6092] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:19.133043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:19.149481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95f13078-dcdc-4531-a4ce-58b1e36b10a9 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.729261 Oct 24 09:26:19.150492 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3137/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:18 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:19.524076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:19.524875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:19.540443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:19.542331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:19.544702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:19.548100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:19.549890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:19.550354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:19.775600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:19.788651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:19.792331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:19.796339 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92e465f8-288b-42e5-9359-114c1c80d822 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2546 microversion: 2.32 time: 0.278426 Oct 24 09:26:19.802994 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2957/6094] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:19 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2546 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:20.053785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:20.063690 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:20.072840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:20.073869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:20.074495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:20.076062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:20.076699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:20.077327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:20.174022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:20.174645 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:20.183740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:20.184876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:20.186551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:20.190310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:20.191217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:20.191948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:20.606210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:20.619640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-198ed7eb-de45-4d7c-b1fb-292df33e22fc tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1392 microversion: 2.1 time: 0.448933 Oct 24 09:26:20.623624 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2958/6095] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:20 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1392 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:20.756971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:20.765720 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2925b213-56df-495b-add3-51aa747c548b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.716312 Oct 24 09:26:20.770025 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3138/6096] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:20 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:20.831477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:20.832713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:20.860261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:20.860502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:20.860902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:20.861967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:20.862610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:20.863196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:21.123881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:21.138260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:21.140373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:21.146165 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ddf74b6-1cd8-4537-91f1-c95d206c13f2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 2212 microversion: 2.32 time: 0.314453 Oct 24 09:26:21.147406 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2959/6097] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:20 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 2212 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:21.164260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a5cb0a56-3b9b-481b-8dad-ac10c090f21d req-24729d95-89a4-46fb-80c4-59be53700a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-deleted", "tag": "0dece821-1750-4813-947a-1f748a9717a6"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:21.184613 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:21.188107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a5cb0a56-3b9b-481b-8dad-ac10c090f21d req-24729d95-89a4-46fb-80c4-59be53700a5f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:21.188666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a5cb0a56-3b9b-481b-8dad-ac10c090f21d req-24729d95-89a4-46fb-80c4-59be53700a5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:21.189287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a5cb0a56-3b9b-481b-8dad-ac10c090f21d req-24729d95-89a4-46fb-80c4-59be53700a5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:21.203416 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a5cb0a56-3b9b-481b-8dad-ac10c090f21d req-24729d95-89a4-46fb-80c4-59be53700a5f service nova] Creating event network-vif-deleted:0dece821-1750-4813-947a-1f748a9717a6 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:21.214728 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a5cb0a56-3b9b-481b-8dad-ac10c090f21d req-24729d95-89a4-46fb-80c4-59be53700a5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054029 Oct 24 09:26:21.216490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3139/6098] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:21.648260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:21.648882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:21.659307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:21.659753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:21.663815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:21.665077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:21.665739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:21.666501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:21.792005 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:21.800311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:21.801461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:21.814280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:21.814950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:21.815591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:21.816446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:21.817084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:21.817999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:22.061245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:22.076182 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53b176ae-17a3-4612-be67-01a4133bcb36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1565 microversion: 2.1 time: 0.432869 Oct 24 09:26:22.076798 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2960/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:21 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1565 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:22.103635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:22.104548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:22.115996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:22.121784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:22.122731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:22.123722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:22.124430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:22.125244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:22.389156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:22.397917 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c7344f2-a12c-4c7f-b90c-f9d33224d332 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.606405 Oct 24 09:26:22.400621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3140/6100] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:21 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:26:22.410039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:22.410655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:22.429222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:22.429759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:22.430201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:22.430910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:22.431366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:22.431792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:22.552237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:22.568229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:22.570776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:22.572091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31749b83-44d3-4ac7-a559-9d164dbf8502 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.170457 Oct 24 09:26:22.572726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3141/6101] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:22 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:22.641469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:22.650967 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aab4cab3-be26-4edf-b60c-ac001996c001 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1565 microversion: 2.1 time: 0.553612 Oct 24 09:26:22.662685 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2961/6102] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:22 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1565 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:23.245883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-66b64d07-2e83-4a19-b22d-0bd66f0cfd03 req-4f946b51-182d-440d-b3ba-8a15be1bbd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e15026-5b9f-4c76-85ab-f4865e5ab6a2", "name": "network-vif-deleted", "tag": "a059daee-94eb-4c0c-8cdc-1fec361e5564"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:23.268777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-66b64d07-2e83-4a19-b22d-0bd66f0cfd03 req-4f946b51-182d-440d-b3ba-8a15be1bbd27 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:23.269206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-66b64d07-2e83-4a19-b22d-0bd66f0cfd03 req-4f946b51-182d-440d-b3ba-8a15be1bbd27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:23.273463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-66b64d07-2e83-4a19-b22d-0bd66f0cfd03 req-4f946b51-182d-440d-b3ba-8a15be1bbd27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:23.316598 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-66b64d07-2e83-4a19-b22d-0bd66f0cfd03 req-4f946b51-182d-440d-b3ba-8a15be1bbd27 service nova] Creating event network-vif-deleted:a059daee-94eb-4c0c-8cdc-1fec361e5564 for instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 on n-h1-master-1 Oct 24 09:26:23.328277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-66b64d07-2e83-4a19-b22d-0bd66f0cfd03 req-4f946b51-182d-440d-b3ba-8a15be1bbd27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086639 Oct 24 09:26:23.331124 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3142/6103] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:23.420431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:23.421040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:23.429216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:23.429723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:23.430336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:23.431180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:23.431784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:23.432348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:23.601387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:23.602104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:23.633223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:23.634805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:23.636018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:23.638419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:23.639543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:23.640487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:23.688628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:23.696739 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d0a6c1de-90cf-4236-aa5b-5501b72b675a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.280292 Oct 24 09:26:23.698486 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2962/6104] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:23 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:23.705521 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:23.796696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:23.849446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:23.865116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:23.866714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24ed6105-5683-461c-92fa-e5ef12bf8289 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.270999 Oct 24 09:26:23.867272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3143/6105] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:23 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:26:24.332292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-36a76ae4-f46a-49cb-9148-4f4b5e5f43eb req-456f2def-5b0e-4b26-b6af-7b9aadf00fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a", "name": "network-vif-plugged", "status": "completed", "tag": "cf64be16-cb82-4ed3-af1b-68f7d2530feb"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:24.361516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36a76ae4-f46a-49cb-9148-4f4b5e5f43eb req-456f2def-5b0e-4b26-b6af-7b9aadf00fc1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:24.362227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36a76ae4-f46a-49cb-9148-4f4b5e5f43eb req-456f2def-5b0e-4b26-b6af-7b9aadf00fc1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:24.364343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36a76ae4-f46a-49cb-9148-4f4b5e5f43eb req-456f2def-5b0e-4b26-b6af-7b9aadf00fc1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:24.404813 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-36a76ae4-f46a-49cb-9148-4f4b5e5f43eb req-456f2def-5b0e-4b26-b6af-7b9aadf00fc1 service nova] Creating event network-vif-plugged:cf64be16-cb82-4ed3-af1b-68f7d2530feb for instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a on n-h1-master-1 Oct 24 09:26:24.411999 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-36a76ae4-f46a-49cb-9148-4f4b5e5f43eb req-456f2def-5b0e-4b26-b6af-7b9aadf00fc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083454 Oct 24 09:26:24.413840 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2963/6106] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:24.722679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:24.723919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:24.732147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:24.732613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:24.733233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:24.734246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:24.734865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:24.735451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:24.896315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:24.897031 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:24.909866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:24.910366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:24.910799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:24.915244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:24.915920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:24.916517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:25.101447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:25.125185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:25.126938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:25.128313 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-becc89a3-30da-4603-afcb-459c4722c921 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.238168 Oct 24 09:26:25.141592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:25.142254 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2964/6107] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:24 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:26:25.151541 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87450df6-52ca-4539-a8ce-a32156106f3a tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.432693 Oct 24 09:26:25.156396 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3144/6108] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:24 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:26.158273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:26.158880 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:26.174359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.174359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.174359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.174359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.174359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.174850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.180701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:26.181083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:26.183647 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:26.202320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.202800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.203248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.203968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.204431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.204864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.262265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:26.274293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:26.275675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:26.276917 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27e7aadc-9bab-4a54-975a-270f688f3465 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.122588 Oct 24 09:26:26.277537 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2965/6109] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:26 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:26.488995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:26.489911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:26.504932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.506442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.507872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.508831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.511391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.512069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.613525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:26.639206 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcbedf1a-828a-48a8-9bc8-20c3ed8b091c tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1314 microversion: 2.1 time: 0.462738 Oct 24 09:26:26.649413 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3145/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:26 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:26:26.658779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8f5d5f80-87c7-47e4-81b3-4af14dc0e41d req-2eaacf61-acd5-48db-9627-20334595b41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:26.686501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8f5d5f80-87c7-47e4-81b3-4af14dc0e41d req-2eaacf61-acd5-48db-9627-20334595b41e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:26.710015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8f5d5f80-87c7-47e4-81b3-4af14dc0e41d req-2eaacf61-acd5-48db-9627-20334595b41e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:26.710664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8f5d5f80-87c7-47e4-81b3-4af14dc0e41d req-2eaacf61-acd5-48db-9627-20334595b41e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:26.741325 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8f5d5f80-87c7-47e4-81b3-4af14dc0e41d req-2eaacf61-acd5-48db-9627-20334595b41e service nova] Creating event network-changed:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h2-master-1 Oct 24 09:26:26.752993 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8f5d5f80-87c7-47e4-81b3-4af14dc0e41d req-2eaacf61-acd5-48db-9627-20334595b41e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109374 Oct 24 09:26:26.786143 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3146/6111] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:27.072824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:27.087500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1164929-4f55-49f7-970d-369be9d94d1b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1565 microversion: 2.1 time: 0.604044 Oct 24 09:26:27.091238 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2966/6112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:26 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1565 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:26:27.308580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:27.309765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:27.331352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:27.332167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:27.332767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:27.333717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:27.334350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:27.334943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:27.504596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:27.522333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:27.522894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:27.534982 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c49f9c4-694f-4e6c-a051-6e2992ac7d51 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.230652 Oct 24 09:26:27.535803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3147/6113] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:27 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:27.666536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:27.667728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:27.681798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:27.684745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:27.686037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:27.688619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:27.689257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:27.691061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:28.132630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:28.144341 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-04564d5a-6902-488c-8190-dabf44646f26 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1498 microversion: 2.1 time: 0.481832 Oct 24 09:26:28.144950 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2967/6114] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:27 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1498 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:28.567618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:28.568443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:28.596829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:28.605503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:28.607008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:28.612848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:28.613393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:28.613843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:28.818372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:28.845134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:28.847121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:28.848784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca8435c1-5d2b-4b9d-bf2b-d195e5348fab tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.286520 Oct 24 09:26:28.850398 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3148/6115] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:28 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:29.884677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:29.885397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:29.897283 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:29.899192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:29.903150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:29.904022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:29.904913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:29.907055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:29.907664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:30.198396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:30.212147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:30.214536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:30.216421 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5fc34bae-6c71-41fc-b9fc-7f61013dfff0 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.335966 Oct 24 09:26:30.217316 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2968/6116] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:29 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:31.256989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:31.257673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:31.282425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:31.282938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:31.283383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:31.290296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:31.290800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:31.291253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:31.404178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:31.418091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:31.421437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:31.425037 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ccfe5466-c11a-432c-bcbc-79028125db27 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.176835 Oct 24 09:26:31.425847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3149/6117] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:31 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:32.454417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:32.455797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:32.464312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:32.465986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:32.466661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:32.467588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:32.468189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:32.468790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:32.599637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:32.617644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:32.619883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:32.621273 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ba6306b-7710-4098-95f7-3f7624497347 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.171251 Oct 24 09:26:32.622402 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2969/6118] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:32 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:32.867031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:32.867714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:32.879787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:32.881116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:32.881921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:32.883072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:32.883718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:32.884509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:32.923900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:26:33.036177 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90ee2290-2613-4a12-b94a-985054fc8db3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 204 len: 0 microversion: 2.1 time: 0.176702 Oct 24 09:26:33.037068 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3150/6119] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:26:32 2022] DELETE /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:26:33.046116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:33.046739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:33.056109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:33.056614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:33.057062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:33.057902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:33.058253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:33.058688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:33.260218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:33.269116 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02e38678-f893-4d30-9e37-8ca28d837c1b tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1504 microversion: 2.1 time: 0.227646 Oct 24 09:26:33.270272 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2970/6120] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:33 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:33.648563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:33.649535 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:33.655834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:33.656453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:33.656990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:33.658121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:33.658685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:33.659476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:33.764014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:33.774732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:33.776457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:33.777918 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf0653d5-6e18-442b-8e52-d6a10cf7cb81 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.133855 Oct 24 09:26:33.778480 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3151/6121] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:33 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:34.293545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:34.294156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:34.313107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:34.313640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:34.314968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:34.315680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:34.316312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:34.316738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:34.482042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:34.491463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d623044d-4555-465d-a86b-2230f75c76a3 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1504 microversion: 2.1 time: 0.201993 Oct 24 09:26:34.507851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2971/6122] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:34 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:34.805890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:34.807080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:34.825476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:34.825901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:34.826339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:34.829701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:34.830156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:34.833939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:34.948367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:34.963797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:34.967603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:34.969810 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-294e350a-fb18-4c56-b11f-4bcc07e1f693 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.167782 Oct 24 09:26:34.993796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3152/6123] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:34 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:35.235671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b1c62122-2b16-4bc9-8430-17c649efd378 req-ecd6c21e-0b62-4a18-846e-c6d29c0fff6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a", "name": "network-vif-deleted", "tag": "cf64be16-cb82-4ed3-af1b-68f7d2530feb"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:35.260486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b1c62122-2b16-4bc9-8430-17c649efd378 req-ecd6c21e-0b62-4a18-846e-c6d29c0fff6b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:35.271158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b1c62122-2b16-4bc9-8430-17c649efd378 req-ecd6c21e-0b62-4a18-846e-c6d29c0fff6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:35.272230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b1c62122-2b16-4bc9-8430-17c649efd378 req-ecd6c21e-0b62-4a18-846e-c6d29c0fff6b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:35.285400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b1c62122-2b16-4bc9-8430-17c649efd378 req-ecd6c21e-0b62-4a18-846e-c6d29c0fff6b service nova] Creating event network-vif-deleted:cf64be16-cb82-4ed3-af1b-68f7d2530feb for instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a on n-h1-master-1 Oct 24 09:26:35.292747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b1c62122-2b16-4bc9-8430-17c649efd378 req-ecd6c21e-0b62-4a18-846e-c6d29c0fff6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061063 Oct 24 09:26:35.297133 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2972/6124] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:26:35.516401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:35.516900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:35.524510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:35.525246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:35.526082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:35.527192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:35.528341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:35.528923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:35.571144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:35.571969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:35.572600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:35.573263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lazy-loading 'fault' on Instance uuid 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:26:35.636986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0a34acf48466689c201d876a0cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d827271fb5462b9271fa0aad666949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:35.650944 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-042d1424-64d5-49b7-adcc-c6a943dad113 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 200 len: 1304 microversion: 2.1 time: 0.138943 Oct 24 09:26:35.653224 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3153/6125] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:35 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:36.002662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:36.003285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:36.016559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:36.023065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:36.024776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:36.025766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:36.026767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:36.027695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:36.124968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:36.128787 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:36.141353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:36.144520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:36.146498 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4205dadc-e8e6-40d6-aab6-595bd206bc00 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.150111 Oct 24 09:26:36.154762 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2973/6126] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:35 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:36.679849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:36.680747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] [instance: 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:36.697891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:36.700196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:36.700665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:36.704769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:36.705477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:36.706093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:36.728714 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] HTTP exception thrown: Instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a could not be found. Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Request method failure captured: Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a HTTP/1.1 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlosTqz5RiQzZXO3NV_kkyGeanNPabIdo8SkH6FHdcc7V6NKD-mVSgTUrzRRoj0F6fCY9oSG43E03KJOuzqp-sDkoDTldQvhwNQRXF5uqlPYvp2h2KzPoRKYCM9Op-x0ueapzfahdEJSen9rwkT4ySmDVdS8i1-6GougARAol3x3iK4 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 36d827271fb5462b9271fa0aad666949 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesActionsTest-629674533 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36d827271fb5462b9271fa0aad666949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36d827271fb5462b9271fa0aad666949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36d827271fb5462b9271fa0aad666949"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36d827271fb5462b9271fa0aad666949"}]}] Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesActionsTest-629674533 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 36d827271fb5462b9271fa0aad666949 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesActionsTest-629674533 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesActionsTest-629674533-project Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: eff0a34acf48466689c201d876a0cda4 Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesActionsTest-629674533-project Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a could not be found. Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a'} Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a could not be found. Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a could not be found. Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:36.731114 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a could not be found. Oct 24 09:26:36.735354 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:36.736274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] Returning 404 to user: Instance 7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:26:36.738031 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce44bbba-2985-4e1e-b6c8-0af1c9f36177 tempest-VolumesActionsTest-629674533 tempest-VolumesActionsTest-629674533-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a" status: 404 len: 111 microversion: 2.1 time: 0.062241 Oct 24 09:26:36.739084 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3154/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:36 2022] GET /compute/v2.1/servers/7fe2e6f3-01b6-4f1d-90e3-a23de47fb95a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:26:37.182360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:37.184387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:37.206215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:37.208124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:37.208584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:37.209455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:37.210678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:37.213746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:37.346213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:37.358523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:37.360073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:37.361442 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52cb070e-4186-4ee0-b026-5c0bfe221ef9 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.186525 Oct 24 09:26:37.362488 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2974/6128] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:37 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:38.392881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:38.393930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:38.405936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:38.406455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:38.408212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:38.409010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:38.409588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:38.410022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:38.531176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:38.548075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:38.551032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:38.553217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f8827b4-3f7e-47a5-9293-fa0215db427b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.164469 Oct 24 09:26:38.556959 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3155/6129] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:38 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:39.595086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:39.596381 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:39.611641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:39.612566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:39.616311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:39.618349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:39.618867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:39.620720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:39.767464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:39.781578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:39.783520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:39.785011 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7cce452b-de04-4e86-9ab7-22b063df45f8 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.195167 Oct 24 09:26:39.797366 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2975/6130] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:39 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:40.816082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:40.817520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:40.829201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:40.830760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:40.831371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:40.833789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:40.835114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:40.835608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:40.976837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:40.991803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:40.995881 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:40.997180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e435275-4e11-4ed7-ab04-7d06f5a689c2 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.185225 Oct 24 09:26:40.998099 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3156/6131] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:40 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:42.026352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:42.026926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:42.038360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:42.039778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:42.040709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:42.042153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:42.044356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:42.045035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:42.170234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:42.198392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:42.202414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:42.205588 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-21091fed-c208-4ff5-bfbd-15b0bea5f299 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.185057 Oct 24 09:26:42.206329 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2976/6132] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:42 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:43.260522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:43.262063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:43.272153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:43.278509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:43.279494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:43.282040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:43.282848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:43.284695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:43.404707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:43.417118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:43.419156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:43.420649 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc301b20-4538-4527-a5ab-f6e170d2f32c tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.165348 Oct 24 09:26:43.435711 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3157/6133] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:43 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:44.451198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:44.452921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:44.468739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:44.469701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:44.470866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:44.471917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:44.472943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:44.473732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:44.558891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:44.569221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:44.576358 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:44.576358 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18ffe5ed-0a6a-49f3-a74c-e72bc8431b4b tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1605 microversion: 2.32 time: 0.127819 Oct 24 09:26:44.576358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2977/6134] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:44 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:45.600437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:45.602989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:45.620164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:45.622137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:45.622779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:45.624162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:45.627631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:45.628462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:45.734212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:45.736529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:45.738092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:45.739669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lazy-loading 'fault' on Instance uuid c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:26:45.862642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:45.885465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:45.888126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fd438c83414de8b742cfc444739fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49837016a43847f0b145aa177b5bc08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:45.891940 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f41bc0e-623e-4de8-a2a3-6bc3d3dee017 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 200 len: 1610 microversion: 2.32 time: 0.297343 Oct 24 09:26:45.896373 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3158/6135] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:45 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 1610 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:26:46.925313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:46.928658 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:46.945512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:46.946181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:46.946631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:46.947360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:46.947821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:46.948250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:46.986103 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] HTTP exception thrown: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Request method failure captured: Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 HTTP/1.1 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfh5iNZnBMNviWMfppMOpCsUO3q93GFiI5z4fMyBrVtFFTTj7FtcAi9GlFFqlnyGc210nXsq30JjkeUBtyF_lsrZFPhf5BKmeB20QljfNjgxq7X9si7gaOYbhElVIhSG0Nb1wDnXrhObdGgJXFmIEzkFoB3ZqVIjEd9GKrpQF6znFw Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.32 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 49837016a43847f0b145aa177b5bc08d Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49837016a43847f0b145aa177b5bc08d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49837016a43847f0b145aa177b5bc08d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49837016a43847f0b145aa177b5bc08d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49837016a43847f0b145aa177b5bc08d"}]}] Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 49837016a43847f0b145aa177b5bc08d Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TaggedBootDevicesTest-2052484564-project Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e1fd438c83414de8b742cfc444739fd8 Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TaggedBootDevicesTest-2052484564-project Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c8e15026-5b9f-4c76-85ab-f4865e5ab6a2'} Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:46.988562 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:46.992195 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:46.994570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Returning 404 to user: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:26:46.995749 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-670df55b-bde4-42c1-b56f-7fc62ed644ef tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 404 len: 111 microversion: 2.32 time: 0.075036 Oct 24 09:26:46.996923 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2978/6136] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:46 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:26:47.008503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92abccfd-bb28-4396-b7f2-74964d917e5e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '.version_select at 0x7f8daa5c8af0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:47.046928 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92abccfd-bb28-4396-b7f2-74964d917e5e tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138506613" status: 204 len: 0 microversion: 2.32 time: 0.045511 Oct 24 09:26:47.048077 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3159/6137] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Oct 24 09:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138506613 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:26:48.202939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:48.205189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:48.226141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:48.226627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:48.227065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:48.227786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:48.228245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:48.228675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:48.322925 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1856e12-0a51-4908-8aff-3eb0650b2989 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action" status: 200 len: 24580 microversion: 2.1 time: 0.125083 Oct 24 09:26:48.323833 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2979/6138] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:26:48 2022] POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action => generated 24580 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:26:53.548303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:53.549716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:53.561438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:53.562207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:53.562796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:53.563685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:53.564303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:53.564885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:53.596803 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:53.598742 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] HTTP exception thrown: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Request method failure captured: Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 HTTP/1.1 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlfh5iNZnBMNviWMfppMOpCsUO3q93GFiI5z4fMyBrVtFFTTj7FtcAi9GlFFqlnyGc210nXsq30JjkeUBtyF_lsrZFPhf5BKmeB20QljfNjgxq7X9si7gaOYbhElVIhSG0Nb1wDnXrhObdGgJXFmIEzkFoB3ZqVIjEd9GKrpQF6znFw Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.32 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 49837016a43847f0b145aa177b5bc08d Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49837016a43847f0b145aa177b5bc08d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49837016a43847f0b145aa177b5bc08d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49837016a43847f0b145aa177b5bc08d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49837016a43847f0b145aa177b5bc08d"}]}] Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 49837016a43847f0b145aa177b5bc08d Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TaggedBootDevicesTest-2052484564-project Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e1fd438c83414de8b742cfc444739fd8 Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TaggedBootDevicesTest-2052484564-project Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: exception: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'c8e15026-5b9f-4c76-85ab-f4865e5ab6a2'} Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:26:53.600838 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Returning 404 to user: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:26:53.606648 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21e4ade8-f2c3-4746-b765-d71126f87c26 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 404 len: 111 microversion: 2.32 time: 0.058864 Oct 24 09:26:53.611357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3160/6139] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:26:53 2022] DELETE /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:26:53.622071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:53.623460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] [instance: c8e15026-5b9f-4c76-85ab-f4865e5ab6a2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:53.643936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:53.644681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:53.645538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:53.646473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:53.647144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:53.647783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:53.686463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] HTTP exception thrown: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Request method failure captured: Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 HTTP/1.1 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlfh5iNZnBMNviWMfppMOpCsUO3q93GFiI5z4fMyBrVtFFTTj7FtcAi9GlFFqlnyGc210nXsq30JjkeUBtyF_lsrZFPhf5BKmeB20QljfNjgxq7X9si7gaOYbhElVIhSG0Nb1wDnXrhObdGgJXFmIEzkFoB3ZqVIjEd9GKrpQF6znFw Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.32 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 49837016a43847f0b145aa177b5bc08d Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49837016a43847f0b145aa177b5bc08d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49837016a43847f0b145aa177b5bc08d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49837016a43847f0b145aa177b5bc08d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49837016a43847f0b145aa177b5bc08d"}]}] Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 49837016a43847f0b145aa177b5bc08d Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2052484564 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TaggedBootDevicesTest-2052484564-project Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e1fd438c83414de8b742cfc444739fd8 Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TaggedBootDevicesTest-2052484564-project Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c8e15026-5b9f-4c76-85ab-f4865e5ab6a2'} Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.696972 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] Returning 404 to user: Instance c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:26:53.700578 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c38b66ed-cd6c-41fb-9a31-a48864c24326 tempest-TaggedBootDevicesTest-2052484564 tempest-TaggedBootDevicesTest-2052484564-project] 10.222.0.25 "GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2" status: 404 len: 111 microversion: 2.32 time: 0.082565 Oct 24 09:26:53.713536 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2980/6140] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:26:53 2022] GET /compute/v2.1/servers/c8e15026-5b9f-4c76-85ab-f4865e5ab6a2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:26:59.328628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:26:59.330379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:59.341600 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:59.356643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:59.357641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:59.358322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:59.361536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:59.362448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:59.364992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:59.650385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:26:59.666256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-68aee306-fc8d-4c59-9e99-b695dbd2d1fe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1684 microversion: 2.1 time: 0.339679 Oct 24 09:26:59.668175 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3161/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:26:59 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1684 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:26:59.925572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:26:59.927779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:26:59.931741 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=26 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:59.962139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:59.963912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:59.965224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:26:59.966317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:26:59.966948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:26:59.967583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:00.045087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96b77e5b-0863-4a6e-becf-8eec32ca3ea2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action" status: 200 len: 32649 microversion: 2.1 time: 0.122938 Oct 24 09:27:00.046319 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2981/6142] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:26:59 2022] POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action => generated 32649 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:27:00.242701 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:00.243681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:00.250581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:00.251374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:00.252044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:00.253083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:00.253809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:00.254511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:00.421213 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ead83c7-1879-4a57-b0cc-44a294355496 tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1835 microversion: 2.1 time: 0.182234 Oct 24 09:27:00.435035 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3162/6143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:00 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1835 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:00.458079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:00.460632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:00.479645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:00.480571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:00.481235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:00.482235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:00.483095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:00.483749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:00.513782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lazy-loading 'flavor' on Instance uuid 0611292c-ea7b-471a-8288-86b2118523e1 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:27:00.529413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Going to try to live migrate instance to another host {{(pid=126919) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 24 09:27:04.907269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c3e1207-161a-4741-83f3-0fe418e9895f tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action" status: 202 len: 0 microversion: 2.1 time: 4.453481 Oct 24 09:27:04.908990 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2982/6144] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:27:00 2022] POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action => generated 0 bytes in 4456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:27:04.922047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:04.923570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:04.937086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:04.937950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:04.938957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:04.940472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:04.957559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:04.958913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:05.304260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:05.315086 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d4a66e0-59d8-415b-bd6e-53aeebf18544 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.399392 Oct 24 09:27:05.329496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3163/6145] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:04 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:06.351539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:06.352154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:06.366009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:06.366740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:06.369005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:06.370555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:06.373895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:06.374558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:06.378385 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:06.733816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:06.742323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9b4b467-5790-4062-a3a6-dfae2e654f23 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.394528 Oct 24 09:27:06.742912 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2983/6146] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:06 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:07.258034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ef686af9-bad0-447a-9d3c-772ba65071f9 req-142b3560-f09a-44f5-9d48-e361cd6f3465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "name": "network-vif-unplugged", "status": "completed", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:07.294442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ef686af9-bad0-447a-9d3c-772ba65071f9 req-142b3560-f09a-44f5-9d48-e361cd6f3465 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:07.297703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ef686af9-bad0-447a-9d3c-772ba65071f9 req-142b3560-f09a-44f5-9d48-e361cd6f3465 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:07.299433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ef686af9-bad0-447a-9d3c-772ba65071f9 req-142b3560-f09a-44f5-9d48-e361cd6f3465 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:07.354469 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ef686af9-bad0-447a-9d3c-772ba65071f9 req-142b3560-f09a-44f5-9d48-e361cd6f3465 service nova] Creating event network-vif-unplugged:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h2-master-1 Oct 24 09:27:07.378041 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ef686af9-bad0-447a-9d3c-772ba65071f9 req-142b3560-f09a-44f5-9d48-e361cd6f3465 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123946 Oct 24 09:27:07.379128 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3164/6147] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:27:07.772291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:07.773195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:07.780584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:07.781554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:07.782209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:07.783293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:07.783959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:07.784627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:07.990759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:08.004449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f3eec02-3bf5-4f86-922f-267f38a59a9f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.236693 Oct 24 09:27:08.006323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2984/6148] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:07 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:09.035923 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:09.036687 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:09.066667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:09.080388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:09.085662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:09.092044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:09.098685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:09.100747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:09.396034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:09.406769 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc3bc628-bda4-4604-9192-931cbb76603b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.376843 Oct 24 09:27:09.426425 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3165/6149] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:09 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:09.433662 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ea6c04eb-4d49-49cd-a2d6-199d9e596fa9 req-eaed21b0-3233-43c2-831c-6e21b2537755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:09.469772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea6c04eb-4d49-49cd-a2d6-199d9e596fa9 req-eaed21b0-3233-43c2-831c-6e21b2537755 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:09.470369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea6c04eb-4d49-49cd-a2d6-199d9e596fa9 req-eaed21b0-3233-43c2-831c-6e21b2537755 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:09.473448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea6c04eb-4d49-49cd-a2d6-199d9e596fa9 req-eaed21b0-3233-43c2-831c-6e21b2537755 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:09.511711 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ea6c04eb-4d49-49cd-a2d6-199d9e596fa9 req-eaed21b0-3233-43c2-831c-6e21b2537755 service nova] Creating event network-changed:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h2-master-1 Oct 24 09:27:09.544777 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ea6c04eb-4d49-49cd-a2d6-199d9e596fa9 req-eaed21b0-3233-43c2-831c-6e21b2537755 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115494 Oct 24 09:27:09.545437 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2985/6150] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:27:10.434317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:10.434948 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:10.453193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:10.453927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:10.454545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:10.455472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:10.457188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:10.457654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:11.128433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:11.151166 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fce11a1b-59eb-4906-95ba-ee46189da075 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.710985 Oct 24 09:27:11.171467 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3166/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:10 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:12.178958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:12.179674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:12.203236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:12.203717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:12.204397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:12.205365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:12.206046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:12.206699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:12.554447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:12.568460 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a779093-e883-4326-aff6-b28ca3e15865 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.393547 Oct 24 09:27:12.605553 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2986/6152] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:12 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:13.600716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:13.601414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:13.631209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:13.631715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:13.632167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:13.638105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:13.638763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:13.639230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:14.279608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:14.288681 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f541c1e-9d36-46d9-a3f5-7c84ed9e4f12 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.694466 Oct 24 09:27:14.314723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3167/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:13 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:15.320950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:15.322480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:15.350070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:15.350538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:15.350984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:15.351701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:15.357041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:15.359283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:15.904798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:15.921996 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-375f13e9-6f3d-4719-8ffc-8ba721a9f4d3 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 0.604600 Oct 24 09:27:15.943163 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2987/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:15 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:16.951163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:16.951968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:16.972800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:16.974455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:16.975496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:16.979067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:16.979924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:16.981805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:18.148353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:18.183767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2f3a8c5-6256-4d09-9acc-7cc606d6e2e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1694 microversion: 2.1 time: 1.238368 Oct 24 09:27:18.185140 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3168/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:16 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1694 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:19.209037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:19.210812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:19.231139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:19.231669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:19.236476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:19.237380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:19.237879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:19.253160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:19.861339 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:19.873266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b4ab04e-df5a-404b-8e51-47dd00024580 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1684 microversion: 2.1 time: 0.667798 Oct 24 09:27:19.902497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:19.904123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:19.910935 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2988/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:19 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1684 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:19.923793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:19.926737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:19.928293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:19.930148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:19.935989 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:19.936658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:21.027778 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a575338-9dbe-4199-be3a-52b31d6231ee tempest-TestNetworkAdvancedServerOps-856241553 tempest-TestNetworkAdvancedServerOps-856241553-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1835 microversion: 2.1 time: 1.130048 Oct 24 09:27:21.028726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3169/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:19 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1835 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:21.052538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:21.053052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:21.083724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:21.088600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:21.089357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:21.090270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:21.092853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:21.094924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:21.901733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:21.913172 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-40a2bd9a-dfb2-46bd-85e3-e97397778889 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1684 microversion: 2.1 time: 0.863018 Oct 24 09:27:21.938023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2989/6158] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:21 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1684 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:22.161662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:22.164647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:22.181035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:22.183946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:22.184440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:22.185178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:22.188515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:22.188964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:22.301023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb5fcee4-6572-4b10-8f49-317770c2afd2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action" status: 200 len: 38604 microversion: 2.1 time: 0.144197 Oct 24 09:27:22.309515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3170/6159] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:27:22 2022] POST /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1/action => generated 38604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:27:25.223228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:25.223847 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:25.237864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:25.238879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:25.271767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:25.275699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:25.276743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:25.277584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:25.362641 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:27:25.615230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f5acd52-bfaa-41d8-a38e-b55c24cd489f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 204 len: 0 microversion: 2.1 time: 0.397254 Oct 24 09:27:25.617193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2990/6160] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:27:25 2022] DELETE /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:27:25.627665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b7f2fac1-e204-4833-b46d-df59206f944f req-bd5421a9-286f-474e-95de-833152ccb36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:25.628214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:25.629026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:25.644767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:25.646533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:25.647430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:25.649748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:25.650999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:25.651603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:25.665436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7f2fac1-e204-4833-b46d-df59206f944f req-bd5421a9-286f-474e-95de-833152ccb36f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:25.671926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7f2fac1-e204-4833-b46d-df59206f944f req-bd5421a9-286f-474e-95de-833152ccb36f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:25.672386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b7f2fac1-e204-4833-b46d-df59206f944f req-bd5421a9-286f-474e-95de-833152ccb36f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:25.711749 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b7f2fac1-e204-4833-b46d-df59206f944f req-bd5421a9-286f-474e-95de-833152ccb36f service nova] Creating event network-changed:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h1-master-1 Oct 24 09:27:25.735217 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b7f2fac1-e204-4833-b46d-df59206f944f req-bd5421a9-286f-474e-95de-833152ccb36f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.487013 Oct 24 09:27:25.737398 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3171/6161] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:27:26.059942 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:26.072027 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ce1cf8c2-5f00-43f4-b721-17a32620742a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1690 microversion: 2.1 time: 0.449557 Oct 24 09:27:26.078683 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2991/6162] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:25 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1690 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:27.102456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:27.104491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:27.118510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:27.119317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:27.120678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:27.130254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:27.131194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:27.131799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:27.803696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9d45209a-5840-4cd8-92d1-53e97738a080 req-2a31c6d7-ca44-456d-8cd4-77cfc92787ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611292c-ea7b-471a-8288-86b2118523e1", "name": "network-vif-deleted", "tag": "487fb7dc-9608-484d-9db5-cf2a52a3166f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:27.848298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:27.859842 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-745c8341-497c-4a93-b4bd-5c6f490029e2 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 200 len: 1690 microversion: 2.1 time: 0.764707 Oct 24 09:27:27.887271 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3172/6163] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:27 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 1690 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:27.949838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9d45209a-5840-4cd8-92d1-53e97738a080 req-2a31c6d7-ca44-456d-8cd4-77cfc92787ab service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:27.951459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9d45209a-5840-4cd8-92d1-53e97738a080 req-2a31c6d7-ca44-456d-8cd4-77cfc92787ab service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:27.953268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9d45209a-5840-4cd8-92d1-53e97738a080 req-2a31c6d7-ca44-456d-8cd4-77cfc92787ab service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:27.999510 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9d45209a-5840-4cd8-92d1-53e97738a080 req-2a31c6d7-ca44-456d-8cd4-77cfc92787ab service nova] Creating event network-vif-deleted:487fb7dc-9608-484d-9db5-cf2a52a3166f for instance 0611292c-ea7b-471a-8288-86b2118523e1 on n-h1-master-1 Oct 24 09:27:28.017263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9d45209a-5840-4cd8-92d1-53e97738a080 req-2a31c6d7-ca44-456d-8cd4-77cfc92787ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214406 Oct 24 09:27:28.022136 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2992/6164] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:27:28.894876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:28.895420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: 0611292c-ea7b-471a-8288-86b2118523e1] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:28.915841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:28.916374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:28.917772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:28.918254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:28.918616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:28.919042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:28.962137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] HTTP exception thrown: Instance 0611292c-ea7b-471a-8288-86b2118523e1 could not be found. Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Request method failure captured: Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 HTTP/1.1 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVljFDFXOGs3XhEFZCXWMxvWHfJh781lcGcMgV9FXlazzOQezbj0390BG589-tgaa-HXoN5AG8VG1fwGrrM5YqXBde-HOJ8Fgsd7zGjtwxHywtiwoNfVLLzY6WysaYGKtyKkPts8MlGRWmKcz7DGX-cOyj0rWN9S41IMgA8M1Jci6EYg Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d4ea2b64dfd8408292fe8b8d44c39b59"}]}] Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b62fde68e8c747bfbea881c71421c5ae Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0611292c-ea7b-471a-8288-86b2118523e1 could not be found. Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0611292c-ea7b-471a-8288-86b2118523e1'} Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0611292c-ea7b-471a-8288-86b2118523e1 could not be found. Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0611292c-ea7b-471a-8288-86b2118523e1 could not be found. Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:28.964412 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0611292c-ea7b-471a-8288-86b2118523e1 could not be found. Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Returning 404 to user: Instance 0611292c-ea7b-471a-8288-86b2118523e1 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:27:28.968938 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e1d91fb-a505-400c-971b-3d1f259820a0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1" status: 404 len: 111 microversion: 2.1 time: 0.075230 Oct 24 09:27:28.980552 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3173/6165] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:28 2022] GET /compute/v2.1/servers/0611292c-ea7b-471a-8288-86b2118523e1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:27:35.544763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78db0ba1-f375-4d19-b675-609cf848d788 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1015663594", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:35.548659 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-78db0ba1-f375-4d19-b675-609cf848d788 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] HTTP exception thrown: min_count must be <= max_count Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78db0ba1-f375-4d19-b675-609cf848d788 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Request method failure captured: Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 184 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlqGk5MAFeyof0aJ8Aca0osiSTCiT_dUqCTe_rjK6jx6vrkfvh6ArSIwulpeZbp2bcIjmE_JwhofyMwT19HdDm579Esrhgb9vVxIb0c72X4yVwePeC9yt4WaJ7IeEiuhaSf6NBL3RiwdUUl6v4NooQlX56u5S4u6XPq2bXfQXhIzMYc Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fc73d09f98c45aaae7504eda24392e0"}]}] Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7eca02d78b1c406098b67617d072ee0c Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1015663594", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: exception: min_count must be <= max_count Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1015663594', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 24 09:27:35.558386 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.563289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78db0ba1-f375-4d19-b675-609cf848d788 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Returning 400 to user: min_count must be <= max_count {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:27:35.563289 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78db0ba1-f375-4d19-b675-609cf848d788 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.329531 Oct 24 09:27:35.563289 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2993/6166] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:35 2022] POST /compute/v2.1/servers => generated 74 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:35.653561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b4e0b6a-4108-434f-97bd-befb0a5f670e tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-27428199", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "max_count": 0}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b4e0b6a-4108-434f-97bd-befb0a5f670e tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Request method failure captured: Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 166 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlqGk5MAFeyof0aJ8Aca0osiSTCiT_dUqCTe_rjK6jx6vrkfvh6ArSIwulpeZbp2bcIjmE_JwhofyMwT19HdDm579Esrhgb9vVxIb0c72X4yVwePeC9yt4WaJ7IeEiuhaSf6NBL3RiwdUUl6v4NooQlX56u5S4u6XPq2bXfQXhIzMYc Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fc73d09f98c45aaae7504eda24392e0"}]}] Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7eca02d78b1c406098b67617d072ee0c Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-27428199", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "max_count": 0}} Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-27428199', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'max_count': 0}}} Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 0 Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:27:35.660431 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 24 09:27:35.664999 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.668693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b4e0b6a-4108-434f-97bd-befb0a5f670e tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:27:35.669951 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b4e0b6a-4108-434f-97bd-befb0a5f670e tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022556 Oct 24 09:27:35.671103 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3174/6167] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:27:35.757626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-390cdbfe-ee7d-4100-824e-ea4cf9513443 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-798446697", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "max_count": 2.5}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-390cdbfe-ee7d-4100-824e-ea4cf9513443 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Request method failure captured: Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 169 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlqGk5MAFeyof0aJ8Aca0osiSTCiT_dUqCTe_rjK6jx6vrkfvh6ArSIwulpeZbp2bcIjmE_JwhofyMwT19HdDm579Esrhgb9vVxIb0c72X4yVwePeC9yt4WaJ7IeEiuhaSf6NBL3RiwdUUl6v4NooQlX56u5S4u6XPq2bXfQXhIzMYc Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fc73d09f98c45aaae7504eda24392e0"}]}] Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7eca02d78b1c406098b67617d072ee0c Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-798446697", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "max_count": 2.5}} Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-798446697', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'max_count': 2.5}}} Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 2.5 Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:27:35.771837 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 09:27:35.776278 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.784462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-390cdbfe-ee7d-4100-824e-ea4cf9513443 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:27:35.786626 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-390cdbfe-ee7d-4100-824e-ea4cf9513443 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032511 Oct 24 09:27:35.800870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2994/6168] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:27:35.870216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de973eb8-a994-439a-b655-743387af9804 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-970100174", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 0}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de973eb8-a994-439a-b655-743387af9804 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Request method failure captured: Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 167 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlqGk5MAFeyof0aJ8Aca0osiSTCiT_dUqCTe_rjK6jx6vrkfvh6ArSIwulpeZbp2bcIjmE_JwhofyMwT19HdDm579Esrhgb9vVxIb0c72X4yVwePeC9yt4WaJ7IeEiuhaSf6NBL3RiwdUUl6v4NooQlX56u5S4u6XPq2bXfQXhIzMYc Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fc73d09f98c45aaae7504eda24392e0"}]}] Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7eca02d78b1c406098b67617d072ee0c Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-970100174", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 0}} Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-970100174', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'min_count': 0}}} Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi 0 Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:27:35.882998 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de973eb8-a994-439a-b655-743387af9804 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de973eb8-a994-439a-b655-743387af9804 tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020962 Oct 24 09:27:35.898862 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3175/6169] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:27:35.977674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c144fa60-7b03-4ba8-8925-243b1dc8702d tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1949654662", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 2.5}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c144fa60-7b03-4ba8-8925-243b1dc8702d tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Request method failure captured: Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 170 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlqGk5MAFeyof0aJ8Aca0osiSTCiT_dUqCTe_rjK6jx6vrkfvh6ArSIwulpeZbp2bcIjmE_JwhofyMwT19HdDm579Esrhgb9vVxIb0c72X4yVwePeC9yt4WaJ7IeEiuhaSf6NBL3RiwdUUl6v4NooQlX56u5S4u6XPq2bXfQXhIzMYc Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fc73d09f98c45aaae7504eda24392e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fc73d09f98c45aaae7504eda24392e0"}]}] Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5fc73d09f98c45aaae7504eda24392e0 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1101546715 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7eca02d78b1c406098b67617d072ee0c Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1101546715-project Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1949654662", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "min_count": 2.5}} Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1949654662', 'imageRef': 'a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2', 'flavorRef': '452', 'min_count': 2.5}}} Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi 2.5 Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:27:35.997572 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:27:36.002129 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c144fa60-7b03-4ba8-8925-243b1dc8702d tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:27:36.010858 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c144fa60-7b03-4ba8-8925-243b1dc8702d tempest-MultipleCreateNegativeTestJSON-1101546715 tempest-MultipleCreateNegativeTestJSON-1101546715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039577 Oct 24 09:27:36.014376 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2995/6170] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:27:36.983438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8407c095-53d2-4668-b8e1-c22d0d36ad0b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '.version_select at 0x7f8daa2ee700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:37.013721 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=26 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:37.063697 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8407c095-53d2-4668-b8e1-c22d0d36ad0b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1377689933" status: 202 len: 0 microversion: 2.1 time: 0.101171 Oct 24 09:27:37.065060 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3176/6171] 10.222.0.25 () {58 vars in 1284 bytes} [Mon Oct 24 09:27:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1377689933 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:27:37.102190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41088dd1-75c2-4dc3-8631-0230a1d8aa5b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: .version_select at 0x7f8dab1f9e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1854018419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISL3Gect/Ebzm0Iy6gcPKWpS6Eoi88kR5mPf1sDHUXMqRh0XVlKql3g2X4uAWhb1ujoFOkwBYrRppMYaDqp1/6PC1fP4XLwF7hJ8OlZ3QRXyjbw3NxCZyu9PAIBOGF89w=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:37.160856 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:37.198877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-41088dd1-75c2-4dc3-8631-0230a1d8aa5b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:27:37.214496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-41088dd1-75c2-4dc3-8631-0230a1d8aa5b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:27:37.309449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41088dd1-75c2-4dc3-8631-0230a1d8aa5b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.215599 Oct 24 09:27:37.310852 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2996/6172] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:27:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:27:53.900547 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=64 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:53.902217 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:54.633330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1063904107", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "77c5ca52-2b75-45d7-bb16-0d4908853a37"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:54.780270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] validate_networks() for [('77c5ca52-2b75-45d7-bb16-0d4908853a37', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:27:55.770754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-525473561", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "328b36bc-29ca-435d-8b88-c735474a6324"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1854018419", "security_groups": [{"name": "tempest-secgroup-smoke-1213673267"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:27:55.798091 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:55.813392 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:55.814122 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:55.931285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:27:55.931845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:27:55.932492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:27:55.932913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:27:55.933411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:27:55.966446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:55.966871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:55.967320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:55.974388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:55.977430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:55.977905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:56.081065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Getting quotas for project db7dde4daed04adab9bcfc786c9ac13a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:27:56.115403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Getting quotas for user 070aabe58ef941449e499ba6eccf5c48 and project db7dde4daed04adab9bcfc786c9ac13a. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:27:56.146857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:27:56.149999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:27:56.310176 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] validate_networks() for [('328b36bc-29ca-435d-8b88-c735474a6324', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:27:56.332543 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5ddc92f-8e9d-4cb6-8ebb-0bccaed75f0b tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.428879 Oct 24 09:27:56.346953 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3177/6173] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:27:56.372542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80f4e320-65f4-4aba-97f9-607765268e71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:56.374251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80f4e320-65f4-4aba-97f9-607765268e71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:56.741707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80f4e320-65f4-4aba-97f9-607765268e71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:56.761987 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80f4e320-65f4-4aba-97f9-607765268e71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1216 microversion: 2.1 time: 0.413428 Oct 24 09:27:56.762528 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3178/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:56 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1216 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:57.788572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-510b6a4d-1f2b-4885-810d-918966ff161a tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:57.789315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-510b6a4d-1f2b-4885-810d-918966ff161a tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:58.029199 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-510b6a4d-1f2b-4885-810d-918966ff161a tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:58.063336 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-510b6a4d-1f2b-4885-810d-918966ff161a tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1216 microversion: 2.1 time: 0.275685 Oct 24 09:27:58.089129 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3179/6175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:57 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:27:58.479011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:27:58.479488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:27:58.479890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:27:58.480434 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:27:58.481071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:27:58.502069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:58.516678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:58.517415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:58.518411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:58.519023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:58.525682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:58.578125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:27:58.594050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Getting quotas for user b62fde68e8c747bfbea881c71421c5ae and project d4ea2b64dfd8408292fe8b8d44c39b59. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:27:58.656480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:27:58.665093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:27:58.816707 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7716b610-9c6b-4435-ad18-7675ce46257a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.048417 Oct 24 09:27:58.819524 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2997/6176] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:27:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 3054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:27:58.836312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8baecfb8-5058-494e-b3a2-c454ebc51389 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:58.838582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8baecfb8-5058-494e-b3a2-c454ebc51389 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:59.089529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8baecfb8-5058-494e-b3a2-c454ebc51389 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:59.091573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:27:59.092319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:27:59.107938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:59.113681 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8baecfb8-5058-494e-b3a2-c454ebc51389 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1266 microversion: 2.1 time: 0.283827 Oct 24 09:27:59.114698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:59.114818 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3180/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:58 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:27:59.115496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:59.120385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:27:59.121092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:27:59.122684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:27:59.236429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:27:59.250821 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f8fa7f2-4b52-477d-acf6-d66d3b97c55f tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1268 microversion: 2.1 time: 0.159018 Oct 24 09:27:59.267992 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2998/6178] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:27:59 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:00.149520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:00.149520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:00.198824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:00.202060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:00.202528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:00.203295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:00.203775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:00.204209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:00.276117 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:00.276717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:00.334399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:00.343357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:00.346066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:00.353595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:00.354331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:00.358969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:00.519680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:00.532497 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed59a095-4bc4-4200-9464-2340c2d1780a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1270 microversion: 2.1 time: 0.397133 Oct 24 09:28:00.549741 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3181/6179] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:00 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1270 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:01.266318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:01.308205 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac05cd2d-c7c9-4626-878e-ed83ec7fdfac tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1274 microversion: 2.1 time: 1.037083 Oct 24 09:28:01.311271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2999/6180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:00 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1274 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:01.565922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:01.566723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:01.590307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:01.596061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:01.599222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:01.600245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:01.601130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:01.601871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:02.200821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:02.210017 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-695db4b6-1593-401f-83b3-f0ef43f9650a tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1336 microversion: 2.1 time: 0.648003 Oct 24 09:28:02.233914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3182/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:01 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1336 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:02.334561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:02.335195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:02.354215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:02.354710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:02.375672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:02.377008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:02.380847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:02.384508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:02.884220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:02.908536 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3121ba3c-4361-4b0a-b8bb-fea0846c037d tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1316 microversion: 2.1 time: 0.576521 Oct 24 09:28:02.919718 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3000/6182] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:02 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:03.258578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:03.260661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:03.280895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:03.285072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:03.286871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:03.288375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:03.296816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:03.300762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:03.604857 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-36c53193-08ad-448a-8503-63a087425182 req-8b2f79de-73db-41fb-a613-5d1706796fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db653bfa-27a8-4bdd-881c-50d4216ebf65", "tag": "2c910918-7dd0-4950-95a2-d137defe9e23"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:03.631538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36c53193-08ad-448a-8503-63a087425182 req-8b2f79de-73db-41fb-a613-5d1706796fd5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:03.632020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36c53193-08ad-448a-8503-63a087425182 req-8b2f79de-73db-41fb-a613-5d1706796fd5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:03.650321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36c53193-08ad-448a-8503-63a087425182 req-8b2f79de-73db-41fb-a613-5d1706796fd5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:03.686742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-36c53193-08ad-448a-8503-63a087425182 req-8b2f79de-73db-41fb-a613-5d1706796fd5 service nova] Creating event network-changed:2c910918-7dd0-4950-95a2-d137defe9e23 for instance db653bfa-27a8-4bdd-881c-50d4216ebf65 on n-h1-master-1 Oct 24 09:28:03.707944 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-36c53193-08ad-448a-8503-63a087425182 req-8b2f79de-73db-41fb-a613-5d1706796fd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108579 Oct 24 09:28:03.708868 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3001/6183] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:28:03.867585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:03.887816 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b8e2064-8f34-46c8-ade4-87b50757bbc5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.623771 Oct 24 09:28:03.889008 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3183/6184] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:03 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:03.936146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:03.936863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:03.954748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:03.958342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:03.958342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:03.958342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:03.958342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:03.958342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:04.169118 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1564927366", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:04.255874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] validate_networks() for None {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:28:04.677421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:04.696371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d97e6a3c-91b7-4bb0-abef-bfd0930c5c99 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1316 microversion: 2.1 time: 0.764047 Oct 24 09:28:04.697041 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3002/6185] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:03 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1316 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:04.918366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:28:04.918862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:28:04.919255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:28:04.919667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:28:04.920096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:28:04.921627 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:04.923134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:04.943235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:04.943745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:04.944193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:04.944932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:04.945501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:04.945921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:04.953910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:04.957805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:04.958523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:04.963809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:04.964579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:04.965209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:04.985607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Getting quotas for project da1a94dd119e49ce96801f1a73cfe31d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:28:05.007222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Getting quotas for user 88764310cfd74578976cca63fd41458f and project da1a94dd119e49ce96801f1a73cfe31d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:28:05.044455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:28:05.050603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:28:05.179568 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dcb99dca-48a7-45cc-adef-4bdef48024de tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015179 Oct 24 09:28:05.180616 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3184/6186] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:28:05.195542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-336b8edb-dbef-45e3-8942-2a12277937d1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:05.196171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-336b8edb-dbef-45e3-8942-2a12277937d1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:05.416764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:05.440585 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1df46a1-2caa-44b7-8ed3-605a8dd91825 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.523732 Oct 24 09:28:05.455789 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3003/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:04 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:05.616640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-336b8edb-dbef-45e3-8942-2a12277937d1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:05.627337 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-336b8edb-dbef-45e3-8942-2a12277937d1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1214 microversion: 2.1 time: 0.435491 Oct 24 09:28:05.628159 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3185/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:05 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:05.736888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:05.741612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:05.778013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:05.778505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:05.778941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:05.779645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:05.780100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:05.780522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:06.332090 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:06.345289 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-991ee9de-c406-453f-b608-a51061697d12 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1316 microversion: 2.1 time: 0.621014 Oct 24 09:28:06.348653 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3004/6189] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:05 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:06.489482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:06.491607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:06.526188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:06.527250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:06.527798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:06.528581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:06.529062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:06.529520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:06.995628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ce252d32-8635-48bf-8e5d-2b05fc6ca132 req-ea5f725a-5c18-4297-8324-adadb7d12093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:07.021916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ce252d32-8635-48bf-8e5d-2b05fc6ca132 req-ea5f725a-5c18-4297-8324-adadb7d12093 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:07.022525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ce252d32-8635-48bf-8e5d-2b05fc6ca132 req-ea5f725a-5c18-4297-8324-adadb7d12093 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:07.023075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ce252d32-8635-48bf-8e5d-2b05fc6ca132 req-ea5f725a-5c18-4297-8324-adadb7d12093 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:07.059092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ce252d32-8635-48bf-8e5d-2b05fc6ca132 req-ea5f725a-5c18-4297-8324-adadb7d12093 service nova] Creating event network-changed:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:28:07.080520 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ce252d32-8635-48bf-8e5d-2b05fc6ca132 req-ea5f725a-5c18-4297-8324-adadb7d12093 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553882 Oct 24 09:28:07.091088 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3005/6190] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:28:07.116222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:07.117256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:07.159666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:07.170619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:07.171237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:07.172018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:07.172504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:07.172948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:07.202400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:07.214822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2917ec4d-a00c-4d24-897e-8c9ab6bbd875 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.748739 Oct 24 09:28:07.216314 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3186/6191] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:06 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:07.382990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:07.383815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:07.392110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:07.392622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:07.393158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:07.393895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:07.394533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:07.394981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:07.507410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:07.516372 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-16545be7-ba34-4a96-98ee-cfce94b957a6 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1266 microversion: 2.1 time: 0.423667 Oct 24 09:28:07.516973 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3006/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:07 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1266 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:07.876238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:07.888603 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c5cf8b63-ccda-40b0-bef9-a025f7a01fd6 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1316 microversion: 2.1 time: 0.510802 Oct 24 09:28:07.889758 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3187/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:07 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:08.244364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:08.246539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:08.255010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.256241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.256925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:08.258039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.259426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.260162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:08.552840 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:08.607852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:08.622579 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4d90726-f8c1-46a8-825d-d10044dd0ff5 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.380764 Oct 24 09:28:08.638623 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3007/6194] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:08 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:08.645883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:08.649966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:08.663597 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:08.667790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.669425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.669878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:08.671074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.671643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.672476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:08.716959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-14fa9145-7987-40a6-8e30-4111148128e0 req-bf9e9475-163d-4089-a854-284f47d03bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db653bfa-27a8-4bdd-881c-50d4216ebf65", "name": "network-vif-plugged", "status": "completed", "tag": "2c910918-7dd0-4950-95a2-d137defe9e23"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:08.736386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-14fa9145-7987-40a6-8e30-4111148128e0 req-bf9e9475-163d-4089-a854-284f47d03bee service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.736887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-14fa9145-7987-40a6-8e30-4111148128e0 req-bf9e9475-163d-4089-a854-284f47d03bee service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.737482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-14fa9145-7987-40a6-8e30-4111148128e0 req-bf9e9475-163d-4089-a854-284f47d03bee service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:08.755447 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-14fa9145-7987-40a6-8e30-4111148128e0 req-bf9e9475-163d-4089-a854-284f47d03bee service nova] Creating event network-vif-plugged:2c910918-7dd0-4950-95a2-d137defe9e23 for instance db653bfa-27a8-4bdd-881c-50d4216ebf65 on n-h1-master-1 Oct 24 09:28:08.762723 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-14fa9145-7987-40a6-8e30-4111148128e0 req-bf9e9475-163d-4089-a854-284f47d03bee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.344145 Oct 24 09:28:08.763568 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3188/6195] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:28:08.917275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:08.918748 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:08.932045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.935721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.936388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:08.937671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:08.942997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:08.943749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:09.236654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:09.246790 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2788b3ef-ffd2-49a4-982b-0d65ac19719b tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1272 microversion: 2.1 time: 0.606803 Oct 24 09:28:09.252897 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3008/6196] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:08 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1272 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:09.450724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:09.466082 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1288f382-5288-4c12-b909-4143625ba0b0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1316 microversion: 2.1 time: 0.553818 Oct 24 09:28:09.478902 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3189/6197] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:08 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:09.652818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:09.653936 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:09.670370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:09.673445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:09.674249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:09.678208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:09.678944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:09.679576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:10.074541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:10.083657 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e5e6327-d14d-4287-bdeb-2fda68150ffe tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.436912 Oct 24 09:28:10.088788 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3009/6198] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:09 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:10.280806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:10.283004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:10.300705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:10.301772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:10.302716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:10.303936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:10.313713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:10.319066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:10.494925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:10.496147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:10.506607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:10.510429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:10.511092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:10.511990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:10.517243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:10.517928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:10.864672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:10.877943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7e4f65d-e3e0-4458-b5ec-ab95ce99a6f1 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1316 microversion: 2.1 time: 0.387913 Oct 24 09:28:10.894161 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3010/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:10 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:11.115971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:11.116835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:11.129165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:11.130065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:11.134485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:11.135847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:11.136488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:11.137081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:11.522458 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:11.531308 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8ff7bc1e-ef02-4968-a498-f6d48dd29ad1 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1314 microversion: 2.1 time: 1.256659 Oct 24 09:28:11.532623 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3190/6200] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:10 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1314 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:11.549389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ff3b51fd-452e-41e2-8856-ab9c106862f0 req-b4462d96-e30a-4bec-952a-9673803af19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d529e593-80db-4efc-b50a-c02255c552da", "tag": "a6d9c923-c6f8-4ba7-8c69-fbcbb18cdc17"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:11.575717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ff3b51fd-452e-41e2-8856-ab9c106862f0 req-b4462d96-e30a-4bec-952a-9673803af19c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:11.576522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ff3b51fd-452e-41e2-8856-ab9c106862f0 req-b4462d96-e30a-4bec-952a-9673803af19c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:11.577247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ff3b51fd-452e-41e2-8856-ab9c106862f0 req-b4462d96-e30a-4bec-952a-9673803af19c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:11.611974 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ff3b51fd-452e-41e2-8856-ab9c106862f0 req-b4462d96-e30a-4bec-952a-9673803af19c service nova] Creating event network-changed:a6d9c923-c6f8-4ba7-8c69-fbcbb18cdc17 for instance d529e593-80db-4efc-b50a-c02255c552da on n-h1-master-1 Oct 24 09:28:11.618231 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ff3b51fd-452e-41e2-8856-ab9c106862f0 req-b4462d96-e30a-4bec-952a-9673803af19c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084216 Oct 24 09:28:11.619035 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3191/6201] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:11.754990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:11.765021 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a17ba3d9-2f16-4c76-8e27-381fa5585aef tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.653021 Oct 24 09:28:11.766642 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3011/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:11 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:11.910102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:11.910816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:11.921273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:11.924714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:11.925843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:11.933655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:11.934763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:11.935391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.230056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:12.239194 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28887613-dca5-4da5-a3c5-4f9e0b6cbd59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1504 microversion: 2.1 time: 0.335962 Oct 24 09:28:12.240110 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3192/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:11 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:12.267219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:12.268062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:12.280697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.281415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.282347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.283448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.284237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.285158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.420695 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a932a5dc-189c-489a-aa4c-d31abbf4cb59 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.157424 Oct 24 09:28:12.424067 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3012/6204] 10.222.0.25 () {58 vars in 1296 bytes} [Mon Oct 24 09:28:12 2022] DELETE /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65/os-server-password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:28:12.433931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:12.434669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:12.444417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.448750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.456609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.457753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.458417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.459183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.497892 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8d165c0d-ac4a-4a44-98d7-97a239117ce0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.068453 Oct 24 09:28:12.498999 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3193/6205] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:28:12 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65/os-server-password => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:28:12.512375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:12.512875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:12.520529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.521356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.521946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.522853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.523457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.524075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.557559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:28:12.560165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:12.560869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:12.570497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.573225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.574462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.576100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.576807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.577492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.604351 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:12.685504 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-258bc7b7-e4dc-4d06-9592-43dd01530b74 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 204 len: 0 microversion: 2.1 time: 0.176647 Oct 24 09:28:12.686735 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3013/6206] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:28:12 2022] DELETE /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:28:12.714943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:12.718080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:12.737023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.738039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.738730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.740944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:12.741544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:12.744253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:12.964575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:12.973358 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ce41cf2-c81a-4ece-bf91-078c4ff41425 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1314 microversion: 2.1 time: 0.418088 Oct 24 09:28:12.977984 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3194/6207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:12 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:12.992931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:12.994144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:13.007540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:13.008068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:13.008497 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:13.012361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:13.013011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:13.013648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:13.067911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:13.081267 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b98a3f97-7699-4a3b-bf66-c2b3fd494a71 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1510 microversion: 2.1 time: 0.389006 Oct 24 09:28:13.082323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3014/6208] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:12 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:13.241154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:13.252788 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d0663ba4-208b-4ac8-8c47-4b723d0cdc09 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.273334 Oct 24 09:28:13.253441 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3195/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:12 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:13.490331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7c4fb032-37ed-4c0f-a10e-adfc38e4342c req-124de7e9-14af-4d0b-a603-6397120f6a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "name": "network-vif-plugged", "status": "completed", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:13.511109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7c4fb032-37ed-4c0f-a10e-adfc38e4342c req-124de7e9-14af-4d0b-a603-6397120f6a68 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:13.513542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7c4fb032-37ed-4c0f-a10e-adfc38e4342c req-124de7e9-14af-4d0b-a603-6397120f6a68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:13.516584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7c4fb032-37ed-4c0f-a10e-adfc38e4342c req-124de7e9-14af-4d0b-a603-6397120f6a68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:13.544454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7c4fb032-37ed-4c0f-a10e-adfc38e4342c req-124de7e9-14af-4d0b-a603-6397120f6a68 service nova] Creating event network-vif-plugged:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:28:13.554979 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7c4fb032-37ed-4c0f-a10e-adfc38e4342c req-124de7e9-14af-4d0b-a603-6397120f6a68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069273 Oct 24 09:28:13.555697 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3015/6210] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:13.996982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:13.997649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:14.013511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:14.014079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:14.018815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:14.019859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:14.020507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:14.021156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:14.111291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:14.111994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:14.131861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:14.132383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:14.142043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:14.143078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:14.143724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:14.144337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:14.328940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:14.338195 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b64b0f0-a4c6-4bf1-945c-4bf396af89ec tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1314 microversion: 2.1 time: 0.345960 Oct 24 09:28:14.338786 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3196/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:13 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:14.354730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:14.355612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:14.373218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:14.374725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:14.375344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:14.377021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:14.377690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:14.378488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:14.539293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:14.560527 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88202658-c7c1-460c-b584-376b159be4c3 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1510 microversion: 2.1 time: 0.455623 Oct 24 09:28:14.561129 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3016/6212] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:14 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:14.687108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:14.698058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9db0faad-8748-4187-a5ca-e75239b40964 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1392 microversion: 2.1 time: 0.347513 Oct 24 09:28:14.699449 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3197/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:14 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1392 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:15.365484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:15.367195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:15.381186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:15.382040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:15.382644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:15.383522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:15.384923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:15.386516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:15.585324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:15.586688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:15.589680 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:15.604270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:15.609609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:15.610779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:15.611544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:15.612015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:15.612610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:15.622960 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=20 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:15.894464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070aabe58ef941449e499ba6eccf5c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7dde4daed04adab9bcfc786c9ac13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:15.908177 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35dd0721-6885-43bf-b196-de9f36416de0 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 200 len: 1468 microversion: 2.1 time: 0.327518 Oct 24 09:28:15.909859 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3198/6214] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:15 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:15.924473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:15.929577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:15.944174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:15.947040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:15.947751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:15.948738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:15.949466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:15.950160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:15.998804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:16.008682 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-480f55e0-38f0-422d-bff0-4b5a40a00704 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1314 microversion: 2.1 time: 0.648448 Oct 24 09:28:16.021403 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3017/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:15 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:16.021403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-16794551-726b-4314-a937-73d9132eb4a8 req-ee129b0f-400f-478f-85ee-d79a9c6b6b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db653bfa-27a8-4bdd-881c-50d4216ebf65", "name": "network-vif-deleted", "tag": "2c910918-7dd0-4950-95a2-d137defe9e23"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:16.032998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-16794551-726b-4314-a937-73d9132eb4a8 req-ee129b0f-400f-478f-85ee-d79a9c6b6b88 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:16.033526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-16794551-726b-4314-a937-73d9132eb4a8 req-ee129b0f-400f-478f-85ee-d79a9c6b6b88 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:16.034004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-16794551-726b-4314-a937-73d9132eb4a8 req-ee129b0f-400f-478f-85ee-d79a9c6b6b88 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:16.080892 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-16794551-726b-4314-a937-73d9132eb4a8 req-ee129b0f-400f-478f-85ee-d79a9c6b6b88 service nova] Creating event network-vif-deleted:2c910918-7dd0-4950-95a2-d137defe9e23 for instance db653bfa-27a8-4bdd-881c-50d4216ebf65 on n-h1-master-1 Oct 24 09:28:16.114143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-16794551-726b-4314-a937-73d9132eb4a8 req-ee129b0f-400f-478f-85ee-d79a9c6b6b88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082362 Oct 24 09:28:16.117116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3018/6216] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:16.252528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:16.266053 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9d7ec01-1eb8-43fa-89bc-1d1865ed1b05 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1565 microversion: 2.1 time: 0.354232 Oct 24 09:28:16.266927 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3199/6217] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:15 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1565 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:16.291369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:16.292347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:16.312330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:16.312330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:16.312330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:16.312330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:16.312330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:16.312330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:16.558320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:16.567322 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b41e3c5c-e08e-422d-b635-d6d760ce7133 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1565 microversion: 2.1 time: 0.280240 Oct 24 09:28:16.590583 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3019/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:16 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1565 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:16.910529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3792c479-4887-4008-8964-84ca561bbd8f req-a2c43798-3faf-4b19-93a8-6d7c9bd23da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d529e593-80db-4efc-b50a-c02255c552da", "name": "network-vif-plugged", "status": "completed", "tag": "a6d9c923-c6f8-4ba7-8c69-fbcbb18cdc17"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:16.932900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:16.933546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] [instance: db653bfa-27a8-4bdd-881c-50d4216ebf65] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:16.943408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3792c479-4887-4008-8964-84ca561bbd8f req-a2c43798-3faf-4b19-93a8-6d7c9bd23da7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:16.943924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3792c479-4887-4008-8964-84ca561bbd8f req-a2c43798-3faf-4b19-93a8-6d7c9bd23da7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:16.944464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3792c479-4887-4008-8964-84ca561bbd8f req-a2c43798-3faf-4b19-93a8-6d7c9bd23da7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:16.950627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:16.951453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:16.952373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:16.953429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:16.954300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:16.958164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:16.975169 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3792c479-4887-4008-8964-84ca561bbd8f req-a2c43798-3faf-4b19-93a8-6d7c9bd23da7 service nova] Creating event network-vif-plugged:a6d9c923-c6f8-4ba7-8c69-fbcbb18cdc17 for instance d529e593-80db-4efc-b50a-c02255c552da on n-h1-master-1 Oct 24 09:28:16.986376 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3792c479-4887-4008-8964-84ca561bbd8f req-a2c43798-3faf-4b19-93a8-6d7c9bd23da7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079465 Oct 24 09:28:16.990834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] HTTP exception thrown: Instance db653bfa-27a8-4bdd-881c-50d4216ebf65 could not be found. Oct 24 09:28:16.991213 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3200/6219] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Request method failure captured: Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 HTTP/1.1 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlqZ-m9zNAoWNBOOcX5Huuo5IOuozSTaXIcpos2pDhX2CR0g24Fvd9EFG0psG1DYqayH1ubMBu00lVMnsYhaYTM1OJ5Yqh13xM58gVZrxDz5jsYRJWmPYoVmGyndm5Q_OM1VVSci4_8M2I0q_Gof3UmpvPzlTD7QrZMcss7tuuZb9_c Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: db7dde4daed04adab9bcfc786c9ac13a Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerPasswordTestJSON-148792938 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db7dde4daed04adab9bcfc786c9ac13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_db7dde4daed04adab9bcfc786c9ac13a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db7dde4daed04adab9bcfc786c9ac13a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/db7dde4daed04adab9bcfc786c9ac13a"}]}] Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerPasswordTestJSON-148792938 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: db7dde4daed04adab9bcfc786c9ac13a Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerPasswordTestJSON-148792938 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerPasswordTestJSON-148792938-project Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 070aabe58ef941449e499ba6eccf5c48 Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerPasswordTestJSON-148792938-project Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: exception: Instance db653bfa-27a8-4bdd-881c-50d4216ebf65 could not be found. Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'db653bfa-27a8-4bdd-881c-50d4216ebf65'} Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db653bfa-27a8-4bdd-881c-50d4216ebf65 could not be found. Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db653bfa-27a8-4bdd-881c-50d4216ebf65 could not be found. Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:28:16.999061 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db653bfa-27a8-4bdd-881c-50d4216ebf65 could not be found. Oct 24 09:28:17.004181 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:28:17.006330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] Returning 404 to user: Instance db653bfa-27a8-4bdd-881c-50d4216ebf65 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:28:17.013271 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6f9b717-872e-4646-9e2d-e03724a18f95 tempest-ServerPasswordTestJSON-148792938 tempest-ServerPasswordTestJSON-148792938-project] 10.222.0.25 "GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65" status: 404 len: 111 microversion: 2.1 time: 0.079999 Oct 24 09:28:17.017451 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3020/6220] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:16 2022] GET /compute/v2.1/servers/db653bfa-27a8-4bdd-881c-50d4216ebf65 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:28:17.049640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:17.050833 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:17.079879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:17.080593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:17.081221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:17.082164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:17.087815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:17.088558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:17.110223 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:17.708719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:17.719994 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63182841-fe8f-4fdc-8798-6ce37e3c726d tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1314 microversion: 2.1 time: 0.687326 Oct 24 09:28:17.737594 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3201/6221] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:17 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:18.756311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:18.757720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:18.777078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:18.777992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:18.778698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:18.779697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:18.784277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:18.785428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:19.142100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:19.155478 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bfb48462-4ea2-4278-8f41-bd0b5fa47b0f tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1464 microversion: 2.1 time: 0.410388 Oct 24 09:28:19.159940 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3021/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:18 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1464 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:19.189073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1259ffc8-00e6-41f9-93ed-6100612c27f0", "device": "/dev/sdb"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:19.193020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:19.204684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:19.205920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:19.206531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:19.207480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:19.208181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:19.208810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:19.754684 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ffc3d324-cd1a-405a-a5f0-5f024763345c tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "POST /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572150 Oct 24 09:28:19.756750 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3202/6223] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:28:19 2022] POST /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:24.213537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:24.214733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:24.220970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c927ce80-19a4-46e1-912a-8166c2441360 req-51489831-4368-4f98-9b1a-8e7255ba46ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:24.241347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:24.241347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:24.241347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:24.241895 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:24.242052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:24.251224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:24.252385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c927ce80-19a4-46e1-912a-8166c2441360 req-51489831-4368-4f98-9b1a-8e7255ba46ba service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:24.253067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c927ce80-19a4-46e1-912a-8166c2441360 req-51489831-4368-4f98-9b1a-8e7255ba46ba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:24.254195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:24.256236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c927ce80-19a4-46e1-912a-8166c2441360 req-51489831-4368-4f98-9b1a-8e7255ba46ba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:24.307028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c927ce80-19a4-46e1-912a-8166c2441360 req-51489831-4368-4f98-9b1a-8e7255ba46ba service nova] Creating event network-changed:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:28:24.331644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c927ce80-19a4-46e1-912a-8166c2441360 req-51489831-4368-4f98-9b1a-8e7255ba46ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118037 Oct 24 09:28:24.335164 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3203/6224] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:25.240120 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:25.306643 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44727656-eb57-4b79-8c22-7046c8ea785c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1565 microversion: 2.1 time: 1.097806 Oct 24 09:28:25.307268 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3022/6225] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:24 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1565 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:33.189011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:33.191891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:33.192710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:33.193376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:33.194604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:33.196392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:33.197487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:33.227013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-476957680", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": "none"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:33.239511 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:33.246281 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac2a7df9-c151-474d-99da-1f2eeb7a86cc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.445007 Oct 24 09:28:33.247220 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3204/6226] 10.222.0.25 () {58 vars in 1185 bytes} [Mon Oct 24 09:28:32 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:33.304513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:28:33.305521 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:28:33.306000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:28:33.316778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:28:33.317265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:28:33.329261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:33.330076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:33.330815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:33.331744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:33.332387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:33.332982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:33.360488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Getting quotas for project 3553c0c16fe44590b3fa8a2b35a2bf5a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:28:33.370833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Getting quotas for user 5d7a7f0f195d400c983cf3fdc0834ad2 and project 3553c0c16fe44590b3fa8a2b35a2bf5a. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:28:33.425611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1396550597", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "d5cd3aae-262a-4781-8ce3-37bed596212e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:33.434860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:28:33.437767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:28:33.514348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] validate_networks() for [('d5cd3aae-262a-4781-8ce3-37bed596212e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:28:33.554469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38dbce76-dc74-47ee-a6a3-f1dd219aa012 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.456921 Oct 24 09:28:33.562010 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3023/6227] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Oct 24 09:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 09:28:33.571839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c33e6e5b-97c1-410c-a2b1-3357038647b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:33.573414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c33e6e5b-97c1-410c-a2b1-3357038647b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:33.700446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c33e6e5b-97c1-410c-a2b1-3357038647b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:33.714981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c33e6e5b-97c1-410c-a2b1-3357038647b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:33.719234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c33e6e5b-97c1-410c-a2b1-3357038647b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:33.726980 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c33e6e5b-97c1-410c-a2b1-3357038647b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1277 microversion: 2.57 time: 0.163325 Oct 24 09:28:33.728421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3024/6228] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:33 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:34.042779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:28:34.043204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:28:34.043677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:28:34.044418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:28:34.045025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:28:34.057037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:34.057893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:34.058487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:34.059485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:34.060114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:34.060734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:34.087244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Getting quotas for project 26367ce15733448f9ef5df16108e6e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:28:34.094932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Getting quotas for user de34d05a20f44bc5a79cceb18813433b and project 26367ce15733448f9ef5df16108e6e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:28:34.112327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:28:34.114958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:28:34.207905 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65ba60cb-1567-40da-a0f4-6bdaf1e078aa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783083 Oct 24 09:28:34.208935 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3205/6229] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:28:34.220688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76103157-4498-4f58-84b0-ce6213d0729c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:34.221349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76103157-4498-4f58-84b0-ce6213d0729c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:34.317094 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76103157-4498-4f58-84b0-ce6213d0729c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1329 microversion: 2.1 time: 0.100987 Oct 24 09:28:34.329390 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3025/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:34 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:34.758802 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:34.760205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:34.767604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:34.768536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:34.769148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:34.770954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:34.771719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:34.772836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:34.931162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:34.949134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:34.952633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:34.954660 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-39c3ae32-91d9-4811-b8db-10b934c048ae tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1273 microversion: 2.57 time: 0.201669 Oct 24 09:28:34.957416 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3206/6231] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:34 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:35.377233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:35.381698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:35.415297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:35.416759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:35.417663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:35.420748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:35.421562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:35.422166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:35.525851 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0892ef54-f4d9-4260-9a85-57026684ea2a tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1338 microversion: 2.1 time: 0.185374 Oct 24 09:28:35.529612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3026/6232] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:35 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:35.983522 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:35.984804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:35.995361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:35.996104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:35.996550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:35.997272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:35.997776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:35.998212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:36.082703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:36.091723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:36.093162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:36.095830 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e152f887-983e-47a0-a964-b1502a600711 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1335 microversion: 2.57 time: 0.116215 Oct 24 09:28:36.109319 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3207/6233] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:35 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:36.555868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:36.556492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:36.564135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:36.564907 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:36.565543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:36.566414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:36.567018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:36.567595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:36.654041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c128789-abe0-47f0-b332-f671c9063de3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1416 microversion: 2.1 time: 0.101823 Oct 24 09:28:36.654861 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3027/6234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:36 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1416 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:37.130076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:37.131038 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:37.139423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:37.140382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:37.141406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:37.142330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:37.143009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:37.143942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:37.266928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:37.279622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:37.281615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:37.283533 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e7f2a5c-6390-4160-a21c-fa549ea6c196 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1335 microversion: 2.57 time: 0.158293 Oct 24 09:28:37.284692 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3208/6235] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:37 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1335 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:37.679053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:37.680862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:37.692193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:37.696080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:37.699760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:37.700726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:37.701528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:37.703631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:37.815326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4043b94e-f5b3-49be-8472-7fa848f4f9be tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1424 microversion: 2.1 time: 0.140172 Oct 24 09:28:37.823863 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3028/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:37 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1424 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:38.311958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:38.312674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:38.323926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:38.330422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:38.331252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:38.332060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:38.332577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:38.333015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:38.412074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:38.423392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:38.425063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:38.426811 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c91f6679-a9c1-4d9b-adc8-fe6046bfeeb1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1335 microversion: 2.57 time: 0.118664 Oct 24 09:28:38.442419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3209/6237] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:38 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:38.841274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:38.841913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:38.856826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:38.857445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:38.864608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:38.870153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:38.870962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:38.872301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.157872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84572323-46d6-4512-bade-593f0514db59 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1464 microversion: 2.1 time: 0.319946 Oct 24 09:28:39.176846 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3029/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:38 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:39.455222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:39.456507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:39.464812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.465722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.466439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.467379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.468601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.469258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.558252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:39.571796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:39.573693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:39.576196 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52d7108c-9304-480c-b14b-c1584ffc5b71 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1356 microversion: 2.57 time: 0.124142 Oct 24 09:28:39.596691 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3210/6239] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:39 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1356 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:39.606543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:39.609850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:39.616106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.617954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.618609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.619487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.619948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.620379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.647087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0c318f6e-43c3-4905-b04e-a5f5155536a9 req-35fed46e-c7d9-4f92-995a-ef57f9456ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ae36bc-739f-42f7-acdb-0dbcc21d9882", "tag": "f028985e-111f-4cdf-9c10-c4d8d18a9972"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:39.663747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c318f6e-43c3-4905-b04e-a5f5155536a9 req-35fed46e-c7d9-4f92-995a-ef57f9456ea4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.664991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c318f6e-43c3-4905-b04e-a5f5155536a9 req-35fed46e-c7d9-4f92-995a-ef57f9456ea4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.672435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0c318f6e-43c3-4905-b04e-a5f5155536a9 req-35fed46e-c7d9-4f92-995a-ef57f9456ea4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.687172 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0c318f6e-43c3-4905-b04e-a5f5155536a9 req-35fed46e-c7d9-4f92-995a-ef57f9456ea4 service nova] Creating event network-changed:f028985e-111f-4cdf-9c10-c4d8d18a9972 for instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 on n-h1-master-1 Oct 24 09:28:39.717920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0c318f6e-43c3-4905-b04e-a5f5155536a9 req-35fed46e-c7d9-4f92-995a-ef57f9456ea4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072894 Oct 24 09:28:39.718563 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3211/6240] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:28:39.734998 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:28:39.735664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:28:39.736484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:28:39.737133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:28:39.737863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:28:39.850507 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:39.881022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.881627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.889024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.890525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:39.891031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:39.891489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:39.961810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10b21544-a65b-4c8a-abb0-2d7423f30fa1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "POST /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98/action" status: 202 len: 1137 microversion: 2.57 time: 0.359462 Oct 24 09:28:39.965107 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3030/6241] 10.222.0.25 () {62 vars in 1320 bytes} [Mon Oct 24 09:28:39 2022] POST /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98/action => generated 1137 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 09:28:40.034129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:40.036002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:40.049091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:40.050805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:40.051451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:40.054441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:40.055162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:40.055766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:40.182462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:40.183461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:40.192547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:40.193406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:40.195923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:40.196882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:40.199336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:40.199988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:40.242389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:40.261518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:40.270856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:40.272260 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06837f77-b884-48c1-adf4-dec10763603b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.273781 Oct 24 09:28:40.273337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3212/6242] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:39 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:40.522216 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:40.534031 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bcfdfe87-0f04-484d-b22d-f5e1db5ec791 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1464 microversion: 2.1 time: 0.356192 Oct 24 09:28:40.535474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3031/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:40 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1464 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:41.300874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:41.301731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:41.325317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:41.326072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:41.328805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:41.330094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:41.330764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:41.333382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:41.418592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:41.426407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:41.427860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:41.429029 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84ca8820-84d4-4b64-8653-1420f145e8e7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.132941 Oct 24 09:28:41.433904 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3213/6244] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:41 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:41.558986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:41.561563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:41.572244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:41.572887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:41.573560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:41.574443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:41.575023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:41.578714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:42.090497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:42.092774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:42.108140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:42.113703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:42.113703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:42.113703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:42.113703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:42.113703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:42.191013 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59b4b789-a8a2-45f7-bc6c-167d04e94670 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb/action" status: 200 len: 24569 microversion: 2.1 time: 0.105318 Oct 24 09:28:42.192279 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3214/6245] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:28:42 2022] POST /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb/action => generated 24569 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:28:42.245699 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4c7cba3-dc13-441a-a293-ada1b681fe75 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1464 microversion: 2.1 time: 0.691188 Oct 24 09:28:42.246797 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3032/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:41 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1464 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:42.461944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:42.462709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:42.494674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:42.495457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:42.496075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:42.497408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:42.498139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:42.498732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:42.624376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:42.647649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:42.653883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:42.658300 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55833d4b-1671-41cb-b0f5-45d8c6edef53 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.201841 Oct 24 09:28:42.659508 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3215/6247] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:42 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:43.276517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:43.277394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:43.294008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:43.295355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:43.295875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:43.296713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:43.297492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:43.298135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:43.356980 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:43.514068 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f87ea9e1-9efd-4646-b518-c3c978c8ffb0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1464 microversion: 2.1 time: 0.247654 Oct 24 09:28:43.514762 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3033/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:43 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:43.688169 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:43.688800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:43.697079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:43.697627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:43.698069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:43.698777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:43.699235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:43.699754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:43.778514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:43.787137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:43.788582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:43.790130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fad35928-7bad-45a2-897d-3b0b500df55a tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.105805 Oct 24 09:28:43.813676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3216/6249] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:43 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:44.552035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:44.554064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:44.565114 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:44.572975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:44.574030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:44.575054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:44.576495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:44.578935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:44.579656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:44.796457 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e34d31ff-5994-4bf6-9f56-6222ec7c6c9c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1464 microversion: 2.1 time: 0.258589 Oct 24 09:28:44.798732 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3034/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:44 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:44.826200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:44.827750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:44.827889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-21fb9025-1eaf-4d94-a180-d3e776775817 req-8671efe2-4e86-419e-b4d6-ddc474972af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ae36bc-739f-42f7-acdb-0dbcc21d9882", "name": "network-vif-plugged", "status": "completed", "tag": "f028985e-111f-4cdf-9c10-c4d8d18a9972"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:44.841799 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:44.844914 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:44.849478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-21fb9025-1eaf-4d94-a180-d3e776775817 req-8671efe2-4e86-419e-b4d6-ddc474972af9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:44.851161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:44.851848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:44.852497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-21fb9025-1eaf-4d94-a180-d3e776775817 req-8671efe2-4e86-419e-b4d6-ddc474972af9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:44.853092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-21fb9025-1eaf-4d94-a180-d3e776775817 req-8671efe2-4e86-419e-b4d6-ddc474972af9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:44.854801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:44.856869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:44.856869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:44.856869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:44.890689 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-21fb9025-1eaf-4d94-a180-d3e776775817 req-8671efe2-4e86-419e-b4d6-ddc474972af9 service nova] Creating event network-vif-plugged:f028985e-111f-4cdf-9c10-c4d8d18a9972 for instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 on n-h1-master-1 Oct 24 09:28:44.903069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-21fb9025-1eaf-4d94-a180-d3e776775817 req-8671efe2-4e86-419e-b4d6-ddc474972af9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084761 Oct 24 09:28:44.903917 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3035/6251] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:44.968071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:44.977657 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:44.980477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:44.983377 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9edb0f74-bf8e-401b-909b-f3c7c71417c7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.167445 Oct 24 09:28:44.999324 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3217/6252] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:44 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:45.822491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:45.827086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:45.841645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:45.847005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:45.849236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:45.850252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:45.852676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:45.853974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:46.013312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:46.013719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:46.021375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:46.022301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:46.023794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:46.024645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:46.025246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:46.025898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:46.084418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7071d74c-8f5d-4e21-8956-a8c803bd9bb6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1464 microversion: 2.1 time: 0.266713 Oct 24 09:28:46.101980 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3036/6253] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:45 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1464 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:46.145868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:46.198167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:46.203897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:46.205614 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f35ced8-5155-4907-b0ed-bb1fccab43dd tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.197402 Oct 24 09:28:46.220690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3218/6254] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:46 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:28:47.108063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:47.108680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:47.123809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.124541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.125200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.126292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.126972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.127787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.252563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:47.255246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:47.278177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.279554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.281249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.282729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.283428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.284020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.327329 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:47.380707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:47.390468 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:47.392237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:47.403410 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c41a4b1-18a2-42ae-a9a2-e59332f778f7 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.160976 Oct 24 09:28:47.418522 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3219/6255] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:47 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:47.429746 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc6e4d77-d02b-437c-92e2-9a43fe1fff6b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1648 microversion: 2.1 time: 0.325221 Oct 24 09:28:47.442175 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3037/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:47 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1648 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:47.476658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:47.483275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:47.506428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.506927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.507367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.508680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.509246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.509582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.697961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-047ceb91-a85b-4c1c-acee-45a4f24f684b tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1648 microversion: 2.1 time: 0.233416 Oct 24 09:28:47.698558 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3220/6257] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:47 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1648 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:47.762404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:47.765925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:47.783289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.783497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.787817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:47.789824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:47.793321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:47.793765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:48.036899 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbf4e4fe-484d-4abc-b35f-0107a634e483 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1648 microversion: 2.1 time: 0.286476 Oct 24 09:28:48.038099 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3038/6258] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:47 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1648 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:48.142737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1281045355", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "d5cd3aae-262a-4781-8ce3-37bed596212e"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:48.251111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] validate_networks() for [('d5cd3aae-262a-4781-8ce3-37bed596212e', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:28:48.432187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:48.433707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:48.441872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:48.442772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:48.443316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:48.444140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:48.445755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:48.446467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:48.557623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:48.567977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:48.571514 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:48.572913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28889332-1d91-4a89-b419-2e739a17a71b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.145843 Oct 24 09:28:48.574062 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3039/6259] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:48 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:48.808534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:28:48.813185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:28:48.814596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:28:48.815187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:28:48.819788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:28:48.843861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:48.846767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:48.847637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:48.848205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:48.851894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:48.853534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:48.917193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Getting quotas for project 26367ce15733448f9ef5df16108e6e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:28:48.925009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Getting quotas for user de34d05a20f44bc5a79cceb18813433b and project 26367ce15733448f9ef5df16108e6e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:28:48.940692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:28:48.943488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:28:49.003976 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92cd5316-b004-4b0c-ab4a-50b151bcfb00 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864885 Oct 24 09:28:49.005281 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3221/6260] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:28:49.020987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a47847a-77b8-4fe8-9acd-3a5d0ce941f6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:49.021940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a47847a-77b8-4fe8-9acd-3a5d0ce941f6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:49.143893 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a47847a-77b8-4fe8-9acd-3a5d0ce941f6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1329 microversion: 2.1 time: 0.126468 Oct 24 09:28:49.158486 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3040/6261] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:49 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:49.605220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:49.606443 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:49.631541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:49.636581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:49.641196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:49.642103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:49.643075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:49.643453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:49.790352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:49.799046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:49.800752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:49.802180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2a03b4d-b116-4b1f-99a4-ce37ac13b1e5 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.202034 Oct 24 09:28:49.803393 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3222/6262] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:49 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:50.169612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:50.170161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:50.200122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:50.200987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:50.201469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:50.202499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:50.204700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:50.205511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:50.326362 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-197ddf1a-af21-47c2-9153-629c815770f5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1416 microversion: 2.1 time: 0.157467 Oct 24 09:28:50.327331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3041/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:50 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:50.832442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:50.833659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:50.845698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:50.852392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:50.853041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:50.853964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:50.854579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:50.855194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:50.959898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:50.968355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:50.972228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:50.981339 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3458f42-992a-4b42-bb80-6899d606758b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.145173 Oct 24 09:28:50.993337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3223/6264] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:50 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:51.361792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:51.363302 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:51.379288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:51.379894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:51.395552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:51.400022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:51.400520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:51.400968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:51.683380 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3829a185-a55e-4e66-9ac3-42594ba4019c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.330801 Oct 24 09:28:51.709943 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3042/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:51 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:52.017276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:52.018979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:52.028470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:52.029124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:52.029722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:52.030632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:52.031193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:52.031716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:52.133624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:52.146390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:52.153870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:52.156033 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c347316b-ef98-41f6-9024-8032083e0184 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.144626 Oct 24 09:28:52.169966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3224/6266] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:52 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:52.629682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5357413f-acb6-4637-b38e-db3bee74832d req-b64dd572-2b3c-4a6b-832a-3297bfc9391f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb74a64-4126-4842-af00-10554fc07c84", "tag": "2c03e0f6-9b81-4790-bb6a-ba98e082a998"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:52.681786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5357413f-acb6-4637-b38e-db3bee74832d req-b64dd572-2b3c-4a6b-832a-3297bfc9391f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:52.693950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5357413f-acb6-4637-b38e-db3bee74832d req-b64dd572-2b3c-4a6b-832a-3297bfc9391f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:52.694642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5357413f-acb6-4637-b38e-db3bee74832d req-b64dd572-2b3c-4a6b-832a-3297bfc9391f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:52.712663 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5357413f-acb6-4637-b38e-db3bee74832d req-b64dd572-2b3c-4a6b-832a-3297bfc9391f service nova] Creating event network-changed:2c03e0f6-9b81-4790-bb6a-ba98e082a998 for instance 7eb74a64-4126-4842-af00-10554fc07c84 on n-h2-master-1 Oct 24 09:28:52.719492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:52.724210 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:52.731740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5357413f-acb6-4637-b38e-db3bee74832d req-b64dd572-2b3c-4a6b-832a-3297bfc9391f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103680 Oct 24 09:28:52.734103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3043/6267] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:52.737205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:52.739083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:52.739083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:52.739083 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:52.739966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:52.740490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:52.990438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06fcb483-db9f-4847-9565-fbf7812350fc tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.276018 Oct 24 09:28:52.992515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3225/6268] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:52 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:53.030470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:53.044107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:53.063139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.064509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.065347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.066241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.067073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.067951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.190232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:53.191128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:53.206287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.206781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.207224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.207931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.208403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.208827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.222790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:28:53.223228 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:28:53.231092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:28:53.231709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:28:53.232301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:28:53.359876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:53.373671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.374166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.374659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.375299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.375749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.376171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.400019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:53.410446 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ce9094c1-3f8d-4e95-b315-5c0d6b397a36 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb/action" status: 202 len: 1137 microversion: 2.1 time: 0.394291 Oct 24 09:28:53.411550 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3044/6269] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:28:53 2022] POST /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb/action => generated 1137 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 09:28:53.431869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:53.433045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:53.433706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:53.435243 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8bab1117-4386-422d-9191-d6891ac929de tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.252547 Oct 24 09:28:53.435875 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3226/6270] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:53 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:53.440278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:53.459888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.461671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.463564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.464688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:53.465167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:53.465627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:53.634506 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:53.644575 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-81cb6b36-19c6-47ba-b8cb-28ad973a2b1c tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.215790 Oct 24 09:28:53.645959 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3045/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:53 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:54.018938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:54.019912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:54.030111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:54.030939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:54.031521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:54.032468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:54.032997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:54.034047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:54.241245 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff22101e-5606-4194-b79b-d20d8fbcafae tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.229266 Oct 24 09:28:54.252067 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3227/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:54 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:54.465325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:54.466254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:54.477369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:54.483773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:54.484292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:54.485225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:54.489993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:54.490447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:54.630374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:54.643836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:54.651503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:54.653026 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06ab3767-19d3-48cc-b934-d4395836b910 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.193133 Oct 24 09:28:54.680012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:54.682487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:54.688608 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3046/6273] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:54 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:54.691653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:54.692409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:54.693013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:54.693940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:54.694551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:54.695662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:54.986609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:54.996467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-727eb54c-b68d-4468-bcb7-7dc5b1b605e1 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.326455 Oct 24 09:28:55.007867 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3228/6274] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:54 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:55.274895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:55.275802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:55.285845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:55.287303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:55.288252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:55.290036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:55.294242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:55.294937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:55.672044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb578bbd-7d7a-43f1-b79d-a1115594ae43 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.401245 Oct 24 09:28:55.689717 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3047/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:55 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:55.699157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:55.700366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:55.716478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:55.717189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:55.717776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:55.718590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:55.719909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:55.722429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:55.836996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:55.850537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:55.855181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:55.856503 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e10d7f57-72da-491b-8cae-6e8a0ade61b6 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.175526 Oct 24 09:28:55.859322 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3229/6276] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:55 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:28:56.024245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:56.025270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:56.037322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:56.037825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:56.038464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:56.040074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:56.040715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:56.041837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:56.204012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:56.210225 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:56.215363 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-adea6f9e-2200-428e-831a-c3a0ab6b77ca tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.196779 Oct 24 09:28:56.216146 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3048/6277] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:56 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:56.699532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:56.702646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:56.709263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:56.709786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:56.710230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:56.710968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:56.711432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:56.711862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:56.851682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e889c2c-51d4-4964-ba02-19007ff3d148 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.154757 Oct 24 09:28:56.852503 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3230/6278] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:56 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:28:56.887428 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:56.888545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:56.896839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:56.897604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:56.898507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:56.899324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:56.899888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:56.900450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:56.979063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:56.993598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:56.993598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:56.993598 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5adbf538-a5cd-4f94-863d-f665b4fb6893 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.108951 Oct 24 09:28:56.993598 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3049/6279] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:56 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:57.238548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:57.239190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:57.245551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:57.246327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:57.246930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:57.247919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:57.248531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:57.249114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:57.405890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:57.415003 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94403d8e-3677-48b4-a3f7-b151d874395f tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.180493 Oct 24 09:28:57.416127 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3231/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:57 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:57.877697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:57.878314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:57.887160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:57.887805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:57.888375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:57.889160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:57.889766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:57.890310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:58.017022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:58.017693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:58.036226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:58.036725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:58.037166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:58.038251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:58.039327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:58.039826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:58.052386 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-772d9b36-0e17-4dd6-b4cc-1d9758aff80c tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.180351 Oct 24 09:28:58.053832 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3050/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:57 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:58.137097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:58.147300 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:58.150047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:58.151501 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cce9f4a9-feff-41e4-8d7e-57b074c417c9 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.138752 Oct 24 09:28:58.155190 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3232/6282] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:58 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:28:58.439559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:58.440215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:58.446672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:58.447156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:58.447788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:58.448738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:58.449201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:58.449820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:58.605149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:58.613628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-355b3402-9cf9-484d-a571-eb660ef4c08e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.178507 Oct 24 09:28:58.614233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3051/6283] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:58 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:59.076385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:59.081027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:59.089775 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:59.090863 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:59.093578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.094203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.094768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.095585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.096164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.096697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.182297 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:59.183576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:59.191174 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:59.193408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.194189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.195127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.196472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.197331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.197986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.312606 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4cddc53e-f31c-464c-aca8-fce823f58360 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.239965 Oct 24 09:28:59.327695 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3233/6284] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:59 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:28:59.347885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:59.357243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:59.359480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:59.361824 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43a493e5-e984-40ba-98a0-39f4c9960d97 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.185281 Oct 24 09:28:59.374103 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3052/6285] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:28:59 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:28:59.474876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-da7d8c99-e303-436d-9a43-d7c090c37439 req-683c333e-e36d-485f-8c71-64dfdf10a7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb74a64-4126-4842-af00-10554fc07c84", "name": "network-vif-plugged", "status": "completed", "tag": "2c03e0f6-9b81-4790-bb6a-ba98e082a998"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:28:59.488856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da7d8c99-e303-436d-9a43-d7c090c37439 req-683c333e-e36d-485f-8c71-64dfdf10a7da service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.502057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da7d8c99-e303-436d-9a43-d7c090c37439 req-683c333e-e36d-485f-8c71-64dfdf10a7da service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.506018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da7d8c99-e303-436d-9a43-d7c090c37439 req-683c333e-e36d-485f-8c71-64dfdf10a7da service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.541438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-da7d8c99-e303-436d-9a43-d7c090c37439 req-683c333e-e36d-485f-8c71-64dfdf10a7da service nova] Creating event network-vif-plugged:2c03e0f6-9b81-4790-bb6a-ba98e082a998 for instance 7eb74a64-4126-4842-af00-10554fc07c84 on n-h2-master-1 Oct 24 09:28:59.547454 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-da7d8c99-e303-436d-9a43-d7c090c37439 req-683c333e-e36d-485f-8c71-64dfdf10a7da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076411 Oct 24 09:28:59.550621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3234/6286] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:28:59.638087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:28:59.638706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:28:59.648286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.649215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.649935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.650918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:28:59.651642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:28:59.652294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:28:59.836006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:28:59.845179 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c533e822-0af4-47c9-8f8a-b87872c4018e tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.210822 Oct 24 09:28:59.847613 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3053/6287] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:28:59 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:00.344834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:00.345847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:00.354057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:00.354944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:00.355543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:00.357251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:00.357907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:00.358552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:00.390351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:00.392295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:00.402971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:00.403691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:00.404344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:00.405285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:00.405960 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:00.407007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:00.508430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:00.534967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:00.536827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:00.538435 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c788596a-b7fe-47b6-b6b0-6b2c0b66a92b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.152154 Oct 24 09:29:00.554008 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3054/6288] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:00 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:00.665091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aaf8261e-f131-40c0-bd10-5558cf5529c7 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1464 microversion: 2.1 time: 0.324342 Oct 24 09:29:00.667297 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3235/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:00 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:00.870553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:00.872105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:00.887695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:00.896939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:00.905667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:00.908057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:00.912018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:00.912593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:01.130325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:01.143981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a8c19e5-86fd-4421-8a89-c23864e92400 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.277883 Oct 24 09:29:01.145331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3055/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:00 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:01.577906 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:01.580446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:01.609906 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:01.611820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:01.612529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:01.613189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:01.614197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:01.614849 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:01.615628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:01.704818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:01.706130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:01.725028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:01.728418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:01.728875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:01.738919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:01.739431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:01.739881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:01.781180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:01.798941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:01.803108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:01.806492 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-026f7c72-fc72-4cfd-bdb2-3970ec0b25b1 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.239742 Oct 24 09:29:01.819844 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3236/6291] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:01 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:01.996272 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-647d64f9-2c6d-4a12-a36a-97c7c8ca1965 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1649 microversion: 2.1 time: 0.311266 Oct 24 09:29:01.997331 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3056/6292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:01 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1649 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:02.022420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:02.024167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:02.034855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.036583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.037700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.040007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.040973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.044893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.052588 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:02.177446 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:02.178074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:02.188544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.189047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.189527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.195518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.196004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.196576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.267495 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9db16a65-763c-4430-b964-b0d71bd19084 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1649 microversion: 2.1 time: 0.250654 Oct 24 09:29:02.270169 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3237/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:02 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1649 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:02.291106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:02.291805 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:02.298899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.301969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.302624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.303535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.304107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.304686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.443840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:02.462698 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1f6afad-e7fa-4ec3-b54f-d9b322114280 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.280140 Oct 24 09:29:02.469971 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3057/6294] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:02 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:02.520453 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfc3bfd9-b19a-443e-a0c7-9e45dfafde16 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1649 microversion: 2.1 time: 0.233726 Oct 24 09:29:02.521236 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3238/6295] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:02 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1649 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:02.543954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:02.544586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:02.551922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.552822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.553442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.554419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.555005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.555598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.582245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:29:02.666995 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:02.690696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4f0cbc5-ac0e-420c-8e7b-07598e23b8f8 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 204 len: 0 microversion: 2.1 time: 0.149201 Oct 24 09:29:02.691358 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3058/6296] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:29:02 2022] DELETE /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:29:02.700101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:02.700722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:02.725058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.725578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.726593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.727311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.727769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.728201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.849452 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:02.851493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:02.870169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.873880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.874347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.875132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:02.875538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:02.875967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:02.884125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d786fc55-2b91-482a-866a-f9e1768273c5 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1655 microversion: 2.1 time: 0.188195 Oct 24 09:29:02.885403 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3239/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:02 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1655 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:02.978385 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:02.987883 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:02.989508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:02.990931 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9147e821-7b34-43f5-8063-28aa14368251 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.146590 Oct 24 09:29:02.992930 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3059/6298] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:02 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:29:03.496050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:03.496679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:03.503064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:03.503779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:03.504406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:03.505319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:03.506203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:03.506801 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:03.651313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:03.659405 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d84ee4f4-7653-44f2-bdb0-029b0b6da923 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.167667 Oct 24 09:29:03.660302 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3240/6299] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:03 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:03.925731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:03.926553 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:03.948300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:03.949072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:03.949714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:03.950598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:03.951249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:03.951848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:04.024104 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:04.025035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:04.035492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:04.036334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:04.036979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:04.037773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:04.039474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:04.041345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:04.183090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:04.198774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:04.202616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:04.204748 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-977a73a0-faeb-4324-a826-c2aa8248ae44 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.188637 Oct 24 09:29:04.207753 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3241/6300] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:04 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:29:04.329343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af38caa7-5369-4fab-8b28-67f1b2125bf3 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1655 microversion: 2.1 time: 0.421940 Oct 24 09:29:04.329995 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3060/6301] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:03 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1655 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:04.685135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:04.685788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:04.709010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:04.712268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:04.712979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:04.715155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:04.717564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:04.719016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:04.874367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d3643dde-a66b-4137-8a95-ae1e54737b9f req-e6f49863-706a-4243-9db8-40a86e5c9455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb74a64-4126-4842-af00-10554fc07c84", "name": "network-vif-deleted", "tag": "2c03e0f6-9b81-4790-bb6a-ba98e082a998"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:04.899108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d3643dde-a66b-4137-8a95-ae1e54737b9f req-e6f49863-706a-4243-9db8-40a86e5c9455 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:04.904826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d3643dde-a66b-4137-8a95-ae1e54737b9f req-e6f49863-706a-4243-9db8-40a86e5c9455 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:04.907086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d3643dde-a66b-4137-8a95-ae1e54737b9f req-e6f49863-706a-4243-9db8-40a86e5c9455 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:04.929445 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d3643dde-a66b-4137-8a95-ae1e54737b9f req-e6f49863-706a-4243-9db8-40a86e5c9455 service nova] Creating event network-vif-deleted:2c03e0f6-9b81-4790-bb6a-ba98e082a998 for instance 7eb74a64-4126-4842-af00-10554fc07c84 on n-h2-master-1 Oct 24 09:29:04.947128 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d3643dde-a66b-4137-8a95-ae1e54737b9f req-e6f49863-706a-4243-9db8-40a86e5c9455 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077037 Oct 24 09:29:04.950392 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3061/6302] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:05.024455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:05.055024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-38fac771-9d4e-4a0f-b1a9-9d6407781a4b tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.373460 Oct 24 09:29:05.056596 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3242/6303] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:04 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:05.233161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:05.234044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:05.250789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:05.251454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:05.252002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:05.253549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:05.254265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:05.254915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:05.354080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:05.354967 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:05.358211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:05.371101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:05.371532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:05.372152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:05.373061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:05.373786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:05.374398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:05.379481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:05.382838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:05.384211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-55ca5a5b-de46-4da8-a5d3-9c7f1c149311 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.155438 Oct 24 09:29:05.385352 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3062/6304] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:05 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:05.484858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1156379866", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:05.493664 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77752205-1de0-4813-be22-ab654b1a2fde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1613 microversion: 2.1 time: 0.143008 Oct 24 09:29:05.507085 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3243/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:05 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1613 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:05.564423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:29:05.822534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:29:05.822961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:29:05.823440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:29:05.823846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:29:05.824570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:29:05.839626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:05.840193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:05.841069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:05.841970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:05.842527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:05.843079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:05.864653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Getting quotas for project 443e55a070a345829f873546f6474ffe. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:29:05.871772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Getting quotas for user 79533b1e3d2049e69af8cf57a08ee1f3 and project 443e55a070a345829f873546f6474ffe. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:29:05.888318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:29:05.892347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:29:05.973441 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3104e877-c0c4-40b5-a2bb-42b541eec870 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492727 Oct 24 09:29:05.980531 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3063/6306] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:29:05.994306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-804f8f58-17be-4947-a41f-cf3f8120f2ba tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:05.995383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-804f8f58-17be-4947-a41f-cf3f8120f2ba tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:06.073223 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-804f8f58-17be-4947-a41f-cf3f8120f2ba tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:06.080011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:06.083716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:06.094529 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-804f8f58-17be-4947-a41f-cf3f8120f2ba tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1215 microversion: 2.1 time: 0.105317 Oct 24 09:29:06.096446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.097152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.097611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.098366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.098819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.099431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3244/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:05 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:06.100024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.428220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:06.428372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:06.429230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:06.439213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb5c9191-1e69-4461-9adc-5216eacbc565 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1692 microversion: 2.1 time: 0.363039 Oct 24 09:29:06.440240 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3064/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:06 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1692 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:06.446413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.449244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.449824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.451434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.452504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.453890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.525064 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:06.525854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:06.540268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.543440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.544055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.546327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.547717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.552616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.561529 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:06.597846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:06.610613 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:06.618133 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:06.619673 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1a0ffef-f979-4319-8200-c76f9a04aa76 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1365 microversion: 2.57 time: 0.210366 Oct 24 09:29:06.620114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:06.620427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3245/6309] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:06 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:29:06.621090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:06.621716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:06.622323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lazy-loading 'fault' on Instance uuid 7eb74a64-4126-4842-af00-10554fc07c84 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:29:06.687631 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3aa0bb07-0078-48fe-9ef9-ca47ea6c7460 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1454 microversion: 2.1 time: 0.172615 Oct 24 09:29:06.688996 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3065/6310] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:06 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:07.126188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:07.126970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:07.134925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.135540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.136082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.137314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.137640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.138177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.210640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:07.219420 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b154960-6832-4448-be8b-a65b4126bb5a tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1219 microversion: 2.1 time: 0.098033 Oct 24 09:29:07.220074 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3246/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:07 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:07.336037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e1b048e3-86dc-40ab-8ef1-a2d0b8318cc6 req-69df41b2-3e76-4af8-85e8-b3fc6e0d1598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "name": "network-vif-unplugged", "status": "completed", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:07.347359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e1b048e3-86dc-40ab-8ef1-a2d0b8318cc6 req-69df41b2-3e76-4af8-85e8-b3fc6e0d1598 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.348173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e1b048e3-86dc-40ab-8ef1-a2d0b8318cc6 req-69df41b2-3e76-4af8-85e8-b3fc6e0d1598 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.348680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e1b048e3-86dc-40ab-8ef1-a2d0b8318cc6 req-69df41b2-3e76-4af8-85e8-b3fc6e0d1598 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.368872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e1b048e3-86dc-40ab-8ef1-a2d0b8318cc6 req-69df41b2-3e76-4af8-85e8-b3fc6e0d1598 service nova] Creating event network-vif-unplugged:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:29:07.374747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e1b048e3-86dc-40ab-8ef1-a2d0b8318cc6 req-69df41b2-3e76-4af8-85e8-b3fc6e0d1598 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043677 Oct 24 09:29:07.378171 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3066/6312] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:07.463539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:07.464158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:07.470633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.471134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.473027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.473961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.474758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.475019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.632335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:07.640850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef5378a1-d9cb-4b8c-886d-c9df69db0aa4 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1698 microversion: 2.1 time: 0.182058 Oct 24 09:29:07.641552 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3247/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:07 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:07.649791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:07.650522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:07.658367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.659124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.659558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.660272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.660726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.661379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.716975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:07.717769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:07.724162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.725064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.726697 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.727554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.728297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.728874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.742420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:07.751950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:07.759172 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:07.760871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ff9e91f3-0e42-438c-bec9-8f09fec3aec2 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1371 microversion: 2.57 time: 0.116217 Oct 24 09:29:07.761974 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3067/6314] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:07 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:07.770600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:07.771050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:07.771647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:07.772095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lazy-loading 'fault' on Instance uuid 7eb74a64-4126-4842-af00-10554fc07c84 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:29:07.824132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b65f96f2-a3b8-42aa-9660-e7f014e0bbde tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 200 len: 1454 microversion: 2.1 time: 0.111235 Oct 24 09:29:07.833491 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3248/6315] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:07 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:08.245342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:08.246104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:08.256328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.258375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.259058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.259988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.261386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.262046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.346409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:08.356209 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94d8eb0d-3e47-4e8d-9a14-59df42e753f3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1267 microversion: 2.1 time: 0.116255 Oct 24 09:29:08.356884 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3068/6316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:08 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:08.666746 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:08.667369 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:08.674279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.674767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.675218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.675919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.676383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.676818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.787535 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:08.788211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:08.795035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.795524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.795962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.796877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.797506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.797937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.814556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:08.823744 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8589d19b-7216-40df-a07e-60bb998ef9e0 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1698 microversion: 2.1 time: 0.161487 Oct 24 09:29:08.824414 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3249/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:08 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:08.849325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:08.849960 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 7eb74a64-4126-4842-af00-10554fc07c84] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:08.856660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.857155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.857632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.858481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.858946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.859375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.871084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:08.876746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] HTTP exception thrown: Instance 7eb74a64-4126-4842-af00-10554fc07c84 could not be found. Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Request method failure captured: Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 HTTP/1.1 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlrA7pvQEigaYgk1ASuj40pjcmGOIsQTcaFXiah8cD3F_-H5h0-D59qGr0NyIOWh8CG2sO6sG9inC12N9Y2GbORZB0iEal2enLB5Idv5nEEHcyYGvO0O_PETjgXnFOCUsQ9eoMFrPTY-hMYzfvEqEcRO77X-muY0kwJZJXTE7ZlL6pw Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 26367ce15733448f9ef5df16108e6e0d Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestServerMultinode-434781327 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26367ce15733448f9ef5df16108e6e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26367ce15733448f9ef5df16108e6e0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26367ce15733448f9ef5df16108e6e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26367ce15733448f9ef5df16108e6e0d"}]}] Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestServerMultinode-434781327 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 26367ce15733448f9ef5df16108e6e0d Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestServerMultinode-434781327 Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestServerMultinode-434781327-project-admin Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: de34d05a20f44bc5a79cceb18813433b Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestServerMultinode-434781327-project-admin Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 7eb74a64-4126-4842-af00-10554fc07c84 could not be found. Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '7eb74a64-4126-4842-af00-10554fc07c84'} Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb74a64-4126-4842-af00-10554fc07c84 could not be found. Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb74a64-4126-4842-af00-10554fc07c84 could not be found. Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:08.878487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb74a64-4126-4842-af00-10554fc07c84 could not be found. Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Returning 404 to user: Instance 7eb74a64-4126-4842-af00-10554fc07c84 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:29:08.886864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91bcd3b7-8b42-4786-b502-0edbb8810f11 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84" status: 404 len: 111 microversion: 2.1 time: 0.036756 Oct 24 09:29:08.887570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:08.887679 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3250/6318] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:08 2022] GET /compute/v2.1/servers/7eb74a64-4126-4842-af00-10554fc07c84 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:29:08.887778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:08.887778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de270557-2a73-4ef7-a367-78fcbcea9836 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1371 microversion: 2.57 time: 0.100030 Oct 24 09:29:08.887778 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3069/6319] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:08 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 09:29:08.901205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:08.902762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:08.910060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.910653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.911103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.911829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:08.912294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:08.912728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:08.942084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:29:09.021988 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-600e9f43-38c7-45fc-b40e-1e8afa8b3fc6 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 204 len: 0 microversion: 2.1 time: 0.136265 Oct 24 09:29:09.022745 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3251/6320] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:29:08 2022] DELETE /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:29:09.031238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:09.031392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:09.044597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:09.045089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:09.045560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:09.046257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:09.046721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:09.047125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:09.201509 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27c3cbf0-6334-4397-a2c8-a059e6f8caf0 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1654 microversion: 2.1 time: 0.174333 Oct 24 09:29:09.202822 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3070/6321] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:09 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1654 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:09.321482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1123366176", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "af89ed0a-8003-44fc-8c16-a40692554bce"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:09.382221 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:09.382944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:09.385224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] validate_networks() for [('af89ed0a-8003-44fc-8c16-a40692554bce', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:29:09.395696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:09.396423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:09.397046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:09.398469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:09.401474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:09.402132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:09.582813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:09.593213 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c55ad99b-6e4a-44a6-84a2-84cfcaeb4388 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1285 microversion: 2.1 time: 0.215584 Oct 24 09:29:09.594729 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3071/6322] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:09 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:09.853742 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:09.854862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:09.862487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:09.863995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:09.864616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:09.865664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:09.866909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:09.867547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.047703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:10.057388 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd12e6dc-a8dd-4a6d-bc6f-9ed4fc86a409 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1683 microversion: 2.1 time: 0.210753 Oct 24 09:29:10.071360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3072/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:09 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:10.078103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:10.079027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:10.086289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.086865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.087526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.088404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.088916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.089568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.181669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:29:10.182653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:29:10.183599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:29:10.184414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:29:10.185379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:29:10.196108 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:10.197848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.198792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.199488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.200548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.201091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.201843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.225511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Getting quotas for project 5ffa591ecfaa48ada907a639b45d07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:29:10.229184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:10.230665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:10.231858 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b8e563fd-d318-4a13-bdbb-e67891fcd4dc tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1371 microversion: 2.57 time: 0.159571 Oct 24 09:29:10.232428 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3073/6324] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:10 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:10.232608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Getting quotas for user e2fc124049504d579f6513b5cac00bdf and project 5ffa591ecfaa48ada907a639b45d07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:29:10.236890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:10.246018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:10.254926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:29:10.255098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.255748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.256438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.257940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.258550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.258674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:29:10.259246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.313351 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce567204-6ba4-4423-aaa4-8fd6c71e5a06 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996571 Oct 24 09:29:10.314712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3252/6325] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:29:10.327549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e976702d-be73-422c-a0b2-a04dafa0d1b0 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:10.328350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e976702d-be73-422c-a0b2-a04dafa0d1b0 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:10.454831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c483d48f-99b8-4434-8eb7-4afdec4821fa tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1654 microversion: 2.1 time: 0.221101 Oct 24 09:29:10.468146 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3074/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:10 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1654 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:10.523076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e976702d-be73-422c-a0b2-a04dafa0d1b0 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:10.540074 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e976702d-be73-422c-a0b2-a04dafa0d1b0 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1219 microversion: 2.1 time: 0.217777 Oct 24 09:29:10.541122 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3253/6327] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:10 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:10.619999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:10.620624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:10.628507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.629007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.629487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:10.630347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:10.631216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:10.631659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.136006 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:11.153718 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30ad9806-e3c2-4f44-8578-988cf4e116d6 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.538985 Oct 24 09:29:11.169320 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3075/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:10 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:11.260559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:11.262025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:11.281212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.282320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.284118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.286981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.287728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.290033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.389909 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:11.406299 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:11.412322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:11.415029 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-569d94f8-824f-4303-8387-343b9cf6faef tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1356 microversion: 2.57 time: 0.159794 Oct 24 09:29:11.416899 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3254/6329] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:11 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:11.451145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:11.451811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:11.466476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.467241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.469252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.470293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.473094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.473844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.480309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:11.481021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:11.491016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.496922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.497566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.498349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.498823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.502391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.519406 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:11.564525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:29:11.758717 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a1f4153-22d0-42a9-b009-c31ca25e8201 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 204 len: 0 microversion: 2.57 time: 0.314715 Oct 24 09:29:11.762513 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3076/6330] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Oct 24 09:29:11 2022] DELETE /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 09:29:11.772941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-87e903be-97a0-4701-86c0-2196ed61a827 req-d7af93fc-8415-4ac3-a00b-801d813f3c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "name": "network-vif-plugged", "status": "completed", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:11.775751 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2742f30-9965-4627-8940-d5e2c2ca74a1 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1612 microversion: 2.1 time: 0.296538 Oct 24 09:29:11.788201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-87e903be-97a0-4701-86c0-2196ed61a827 req-d7af93fc-8415-4ac3-a00b-801d813f3c6a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.788938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-87e903be-97a0-4701-86c0-2196ed61a827 req-d7af93fc-8415-4ac3-a00b-801d813f3c6a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.789556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-87e903be-97a0-4701-86c0-2196ed61a827 req-d7af93fc-8415-4ac3-a00b-801d813f3c6a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.793480 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3255/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:11 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1612 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:11.800046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:11.800864 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:11.808764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.809616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.810234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.811106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.811769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.813027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.813335 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-87e903be-97a0-4701-86c0-2196ed61a827 req-d7af93fc-8415-4ac3-a00b-801d813f3c6a service nova] Creating event network-vif-plugged:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:29:11.818719 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-87e903be-97a0-4701-86c0-2196ed61a827 req-d7af93fc-8415-4ac3-a00b-801d813f3c6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054654 Oct 24 09:29:11.820005 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3077/6332] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:11.839877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-910dac96-95f6-403f-844d-beed2d59e8bb req-a65c1f7a-3e5a-4789-a92b-1194d5792253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ae36bc-739f-42f7-acdb-0dbcc21d9882", "name": "network-vif-deleted", "tag": "f028985e-111f-4cdf-9c10-c4d8d18a9972"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:11.877077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-910dac96-95f6-403f-844d-beed2d59e8bb req-a65c1f7a-3e5a-4789-a92b-1194d5792253 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.877077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-910dac96-95f6-403f-844d-beed2d59e8bb req-a65c1f7a-3e5a-4789-a92b-1194d5792253 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.877077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-910dac96-95f6-403f-844d-beed2d59e8bb req-a65c1f7a-3e5a-4789-a92b-1194d5792253 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.900001 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-910dac96-95f6-403f-844d-beed2d59e8bb req-a65c1f7a-3e5a-4789-a92b-1194d5792253 service nova] Creating event network-vif-deleted:f028985e-111f-4cdf-9c10-c4d8d18a9972 for instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 on n-h1-master-1 Oct 24 09:29:11.911384 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-910dac96-95f6-403f-844d-beed2d59e8bb req-a65c1f7a-3e5a-4789-a92b-1194d5792253 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089677 Oct 24 09:29:11.916367 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3078/6333] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:11.938780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:11.940378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:11.949432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.950310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.951167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.952147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:11.952808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:11.953492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:11.959084 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:11.969900 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9bc52363-7311-44d5-912f-8ba683513bc8 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1271 microversion: 2.1 time: 0.175219 Oct 24 09:29:11.970498 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3256/6334] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:11 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:12.185537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:12.189579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:12.202402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:12.205544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:12.206274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:12.212285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:12.213039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:12.213711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:12.271455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:12.281320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:12.289426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:12.290929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-848ae411-e9a1-4f5e-a375-f6b34fd9726b tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1362 microversion: 2.57 time: 0.372453 Oct 24 09:29:12.291554 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3079/6335] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:11 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:12.296369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-40515ab3-65a6-4d86-98a0-526f9b904c4d req-a3ba8537-3955-4b42-b87c-28882f4b03a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ec66b6-62e7-4664-926e-7fdd8ab5f27c", "tag": "d851a59f-56e8-4b41-bcdb-9324e17e0a62"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:12.307020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-40515ab3-65a6-4d86-98a0-526f9b904c4d req-a3ba8537-3955-4b42-b87c-28882f4b03a0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:12.307731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-40515ab3-65a6-4d86-98a0-526f9b904c4d req-a3ba8537-3955-4b42-b87c-28882f4b03a0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:12.310777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-40515ab3-65a6-4d86-98a0-526f9b904c4d req-a3ba8537-3955-4b42-b87c-28882f4b03a0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:12.323426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-40515ab3-65a6-4d86-98a0-526f9b904c4d req-a3ba8537-3955-4b42-b87c-28882f4b03a0 service nova] Creating event network-changed:d851a59f-56e8-4b41-bcdb-9324e17e0a62 for instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c on n-h2-master-1 Oct 24 09:29:12.328076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-40515ab3-65a6-4d86-98a0-526f9b904c4d req-a3ba8537-3955-4b42-b87c-28882f4b03a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035177 Oct 24 09:29:12.328987 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3080/6336] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:12.648568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:12.658461 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-923d324a-89da-402f-b79a-c8ed1f6b1648 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.483534 Oct 24 09:29:12.659630 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3257/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:12 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:12.801922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:12.802782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:12.810404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:12.811099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:12.811539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:12.812236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:12.812717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:12.813139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:12.846297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:12.846791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:12.847221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:12.847865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lazy-loading 'fault' on Instance uuid 18ae36bc-739f-42f7-acdb-0dbcc21d9882 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:29:12.918741 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-608d6c19-4786-4031-9e69-339326c7a109 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 200 len: 1454 microversion: 2.1 time: 0.120816 Oct 24 09:29:12.920080 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3081/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:12 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:13.003549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:13.006745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:13.032666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.033627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.039602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.041419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.042775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.043580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.180538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:13.189791 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7cc78e12-3b17-4ec4-88b4-5c9197e2ad8d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1277 microversion: 2.1 time: 0.193204 Oct 24 09:29:13.190616 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3258/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:12 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:13.321105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:13.322012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:13.328397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.328962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.329755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.331744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.332374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.332966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.339882 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:13.417890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:13.426276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:13.427719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d7a7f0f195d400c983cf3fdc0834ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:13.429542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77d53329-177e-4249-84ee-b46f8301fc61 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 200 len: 1362 microversion: 2.57 time: 0.112597 Oct 24 09:29:13.430057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3082/6340] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:13 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 1362 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 09:29:13.683436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:13.684405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:13.692230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.692716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.693149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.693911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.695023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.695445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.833503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:13.841479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c5d15d1-022e-4937-9f22-2413321eb6de tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.163014 Oct 24 09:29:13.846558 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3259/6341] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:13 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:13.944032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:13.945988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] [instance: 18ae36bc-739f-42f7-acdb-0dbcc21d9882] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:13.953077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.953684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.954275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.955198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:13.955719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:13.956211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:13.970556 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] HTTP exception thrown: Instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 could not be found. Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Request method failure captured: Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 HTTP/1.1 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlrA7pvQEigaYgk1ASuj40pjcmGOIsQTcaFXiah8cD3F_-H5h0-D59qGr0NyIOWh8CG2sO6sG9inC12N9Y2GbORZB0iEal2enLB5Idv5nEEHcyYGvO0O_PETjgXnFOCUsQ9eoMFrPTY-hMYzfvEqEcRO77X-muY0kwJZJXTE7ZlL6pw Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 26367ce15733448f9ef5df16108e6e0d Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestServerMultinode-434781327 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26367ce15733448f9ef5df16108e6e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26367ce15733448f9ef5df16108e6e0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26367ce15733448f9ef5df16108e6e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26367ce15733448f9ef5df16108e6e0d"}]}] Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestServerMultinode-434781327 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 26367ce15733448f9ef5df16108e6e0d Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestServerMultinode-434781327 Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestServerMultinode-434781327-project-admin Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: de34d05a20f44bc5a79cceb18813433b Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestServerMultinode-434781327-project-admin Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 could not be found. Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '18ae36bc-739f-42f7-acdb-0dbcc21d9882'} Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 could not be found. Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 could not be found. Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:13.972282 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 could not be found. Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] Returning 404 to user: Instance 18ae36bc-739f-42f7-acdb-0dbcc21d9882 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:29:13.978624 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20d5bd80-0a3e-44e8-bce4-d921800ed730 tempest-TestServerMultinode-434781327 tempest-TestServerMultinode-434781327-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882" status: 404 len: 111 microversion: 2.1 time: 0.034321 Oct 24 09:29:13.981128 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3083/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:13 2022] GET /compute/v2.1/servers/18ae36bc-739f-42f7-acdb-0dbcc21d9882 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:14.218074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:14.218908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:14.228856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:14.229578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:14.230273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:14.231136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:14.232350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:14.232942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:14.462965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:14.463532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] [instance: 3d5a374f-46b0-4284-8f9d-f370a79e3b98] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:14.478594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:14.479108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:14.479547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:14.480331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:14.480779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:14.481339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:14.497917 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] HTTP exception thrown: Instance 3d5a374f-46b0-4284-8f9d-f370a79e3b98 could not be found. Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Request method failure captured: Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 HTTP/1.1 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlrATC-nrSyiJbb6QIZh-fPidWdl1zzFBH6TG8zEKVNP4F7JGxBat7f9_rSx2VqVs2c97RVpWasBiZoq9NCbKiMS3U-e9hijstivSNc3bSoWLsTcA0P52cidLfy3nun4dxJtYnDhBI3JhKYhDhiXQArWrBvWYz09PbJHKeRYooRI3XU Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.57 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3553c0c16fe44590b3fa8a2b35a2bf5a Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerShowV257Test-2014386129 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3553c0c16fe44590b3fa8a2b35a2bf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3553c0c16fe44590b3fa8a2b35a2bf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3553c0c16fe44590b3fa8a2b35a2bf5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3553c0c16fe44590b3fa8a2b35a2bf5a"}]}] Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerShowV257Test-2014386129 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3553c0c16fe44590b3fa8a2b35a2bf5a Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerShowV257Test-2014386129 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerShowV257Test-2014386129-project Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 5d7a7f0f195d400c983cf3fdc0834ad2 Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerShowV257Test-2014386129-project Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 3d5a374f-46b0-4284-8f9d-f370a79e3b98 could not be found. Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3d5a374f-46b0-4284-8f9d-f370a79e3b98'} Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5a374f-46b0-4284-8f9d-f370a79e3b98 could not be found. Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5a374f-46b0-4284-8f9d-f370a79e3b98 could not be found. Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:14.499725 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5a374f-46b0-4284-8f9d-f370a79e3b98 could not be found. Oct 24 09:29:14.504711 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:14.507647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] Returning 404 to user: Instance 3d5a374f-46b0-4284-8f9d-f370a79e3b98 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:29:14.508661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9f83b54d-4a3e-4614-b844-d2cbeee78635 tempest-ServerShowV257Test-2014386129 tempest-ServerShowV257Test-2014386129-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98" status: 404 len: 111 microversion: 2.57 time: 0.056050 Oct 24 09:29:14.512849 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3084/6343] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Oct 24 09:29:14 2022] GET /compute/v2.1/servers/3d5a374f-46b0-4284-8f9d-f370a79e3b98 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:29:14.867085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:14.868264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:14.879287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:14.881723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:14.884551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:14.888807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:14.889334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:14.890819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:15.049107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:15.064156 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c32fe43b-b256-42f3-89bf-4b0460f0939a tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.854799 Oct 24 09:29:15.064752 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3260/6344] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:14 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:15.517691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:15.529891 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d14e3c7-dc08-4831-b7bd-8b2184cd6b63 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.668440 Oct 24 09:29:15.545775 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3085/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:14 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:15.856954 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-73493e0c-41f8-47fd-acf7-aff6406399c0 req-7e3aaa8b-a22f-4cef-9404-9294179c608d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93", "tag": "2dbf9616-e723-4a5b-97ff-36b6157323b1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:15.886752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-73493e0c-41f8-47fd-acf7-aff6406399c0 req-7e3aaa8b-a22f-4cef-9404-9294179c608d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:15.887508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-73493e0c-41f8-47fd-acf7-aff6406399c0 req-7e3aaa8b-a22f-4cef-9404-9294179c608d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:15.888138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-73493e0c-41f8-47fd-acf7-aff6406399c0 req-7e3aaa8b-a22f-4cef-9404-9294179c608d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:15.902911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-73493e0c-41f8-47fd-acf7-aff6406399c0 req-7e3aaa8b-a22f-4cef-9404-9294179c608d service nova] Creating event network-changed:2dbf9616-e723-4a5b-97ff-36b6157323b1 for instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 on n-h2-master-1 Oct 24 09:29:15.922832 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-73493e0c-41f8-47fd-acf7-aff6406399c0 req-7e3aaa8b-a22f-4cef-9404-9294179c608d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069466 Oct 24 09:29:15.926873 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3261/6346] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:16.088089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:16.088216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:16.096782 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:16.097964 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:16.101738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:16.102253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:16.102674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:16.103388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:16.103842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:16.104270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:16.412947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:16.421076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3f2fc06e-da42-4005-9ea9-70bde19cdf52 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.338024 Oct 24 09:29:16.429940 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3086/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:16 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:16.557729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:16.558503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:16.572975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:16.574614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:16.575244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:16.577331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:16.578571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:16.581641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:16.861997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:16.874035 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e766b924-0644-48b5-b82e-7badeecb3330 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.322729 Oct 24 09:29:16.877348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3262/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:16 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:17.451373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:17.453145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:17.469855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:17.470948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:17.471502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:17.472406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:17.473121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:17.473820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:17.769476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-429e96af-3580-4fa9-86ee-996b122eeecb req-89298c34-c062-42d7-8179-685e6abaf2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ec66b6-62e7-4664-926e-7fdd8ab5f27c", "name": "network-vif-plugged", "status": "completed", "tag": "d851a59f-56e8-4b41-bcdb-9324e17e0a62"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:17.784369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:17.789287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-429e96af-3580-4fa9-86ee-996b122eeecb req-89298c34-c062-42d7-8179-685e6abaf2db service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:17.790147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-429e96af-3580-4fa9-86ee-996b122eeecb req-89298c34-c062-42d7-8179-685e6abaf2db service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:17.791154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-429e96af-3580-4fa9-86ee-996b122eeecb req-89298c34-c062-42d7-8179-685e6abaf2db service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:17.812057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5942705-609d-4ab1-8439-f56a765293c4 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.367630 Oct 24 09:29:17.814754 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-429e96af-3580-4fa9-86ee-996b122eeecb req-89298c34-c062-42d7-8179-685e6abaf2db service nova] Creating event network-vif-plugged:d851a59f-56e8-4b41-bcdb-9324e17e0a62 for instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c on n-h2-master-1 Oct 24 09:29:17.818819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3087/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:17 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:17.831403 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-429e96af-3580-4fa9-86ee-996b122eeecb req-89298c34-c062-42d7-8179-685e6abaf2db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065592 Oct 24 09:29:17.837654 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3263/6350] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:17.904508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:17.905498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:17.926453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:17.928090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:17.929459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:17.933090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:17.933624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:17.934221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:18.191890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:18.201276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78e40467-5544-44df-8687-f2494c9ef7b3 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.301554 Oct 24 09:29:18.204295 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3088/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:17 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:18.851473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:18.852896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:18.863043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:18.864234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:18.864862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:18.866556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:18.867244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:18.867962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:19.224349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:19.226202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:19.241751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:19.242447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:19.243057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:19.243935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:19.244549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:19.245135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:19.456670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:19.473756 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56f086e3-df10-47dc-939a-0b33029ce685 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.623911 Oct 24 09:29:19.475876 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3264/6352] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:18 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:19.686396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:19.702051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59c65937-2912-43d7-b10d-5cd462b90561 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1315 microversion: 2.1 time: 0.481741 Oct 24 09:29:19.706157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3089/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:19 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:20.509856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:20.511279 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:20.520902 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:20.523567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:20.524068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:20.525094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:20.543266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:20.543860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:20.544390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:20.545996 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:20.731454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:20.732057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:20.755027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:20.755860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:20.756293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:20.757098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:20.757686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:20.757996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:20.983610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:20.999077 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d804aa06-9a25-40aa-b7a6-52d3ac266975 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1465 microversion: 2.1 time: 0.270890 Oct 24 09:29:21.001864 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3090/6354] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:20 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1465 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:29:21.064023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:21.064746 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:21.071306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:21.072190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:21.072731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:21.073645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:21.074183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:21.074669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:21.103781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:29:21.133500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:21.144686 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be944539-aa29-4936-a7f6-7595e47477a6 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.641847 Oct 24 09:29:21.146778 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3265/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:20 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:21.238724 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:21.245947 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1fcbd070-58bb-45bc-9178-3848191dfd31 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 204 len: 0 microversion: 2.1 time: 0.197119 Oct 24 09:29:21.249602 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3091/6356] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:29:21 2022] DELETE /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:29:21.257654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:21.258351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:21.276765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:21.277367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:21.277880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:21.281988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:21.282540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:21.283123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:21.634551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:21.646070 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd8f2d35-5730-4d36-a81a-8d250ba24a10 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1471 microversion: 2.1 time: 0.394337 Oct 24 09:29:21.646664 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3266/6357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:21 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:21.708509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-bc65b6b6-3d9f-49a5-96fe-a351fd5d0013 req-4e09c249-3338-4d8c-b0dd-c06e9606257c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93", "name": "network-vif-plugged", "status": "completed", "tag": "2dbf9616-e723-4a5b-97ff-36b6157323b1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:21.727875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bc65b6b6-3d9f-49a5-96fe-a351fd5d0013 req-4e09c249-3338-4d8c-b0dd-c06e9606257c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:21.728744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bc65b6b6-3d9f-49a5-96fe-a351fd5d0013 req-4e09c249-3338-4d8c-b0dd-c06e9606257c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:21.729498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-bc65b6b6-3d9f-49a5-96fe-a351fd5d0013 req-4e09c249-3338-4d8c-b0dd-c06e9606257c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:21.766431 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-bc65b6b6-3d9f-49a5-96fe-a351fd5d0013 req-4e09c249-3338-4d8c-b0dd-c06e9606257c service nova] Creating event network-vif-plugged:2dbf9616-e723-4a5b-97ff-36b6157323b1 for instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 on n-h2-master-1 Oct 24 09:29:21.783971 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-bc65b6b6-3d9f-49a5-96fe-a351fd5d0013 req-4e09c249-3338-4d8c-b0dd-c06e9606257c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083036 Oct 24 09:29:21.786925 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3092/6358] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:22.170667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:22.171747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:22.182793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:22.185550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:22.186090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:22.186717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:22.187668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:22.188105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:22.503876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:22.514063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53e9af19-2243-4573-ac17-caace3391aa1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.347894 Oct 24 09:29:22.518119 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3267/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:22 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:22.676284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:22.676992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:22.695731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:22.696896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:22.697385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:22.698243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:22.698710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:22.699135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:22.865678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:22.875406 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd3ed3a1-614f-47ca-9391-bde6eb701879 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1471 microversion: 2.1 time: 0.204220 Oct 24 09:29:22.876583 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3093/6360] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:22 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:23.546127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:23.547831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:23.568153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:23.569859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:23.570308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:23.571295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:23.571759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:23.572244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:23.856620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2bca72cd-c4eb-44a6-ab5b-997acf9b3294 req-3267b0c1-1d49-4071-b255-5d326e5c0121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ec66b6-62e7-4664-926e-7fdd8ab5f27c", "name": "network-vif-deleted", "tag": "d851a59f-56e8-4b41-bcdb-9324e17e0a62"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:23.908026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bca72cd-c4eb-44a6-ab5b-997acf9b3294 req-3267b0c1-1d49-4071-b255-5d326e5c0121 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:23.908026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bca72cd-c4eb-44a6-ab5b-997acf9b3294 req-3267b0c1-1d49-4071-b255-5d326e5c0121 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:23.910728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bca72cd-c4eb-44a6-ab5b-997acf9b3294 req-3267b0c1-1d49-4071-b255-5d326e5c0121 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:23.940565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2bca72cd-c4eb-44a6-ab5b-997acf9b3294 req-3267b0c1-1d49-4071-b255-5d326e5c0121 service nova] Creating event network-vif-deleted:d851a59f-56e8-4b41-bcdb-9324e17e0a62 for instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c on n-h2-master-1 Oct 24 09:29:23.947041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2bca72cd-c4eb-44a6-ab5b-997acf9b3294 req-3267b0c1-1d49-4071-b255-5d326e5c0121 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097245 Oct 24 09:29:23.948303 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3094/6361] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:29:23.953987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:23.955475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:23.963659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:23.964404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:23.965211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:23.966176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:23.967226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:23.968226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:24.020773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:24.031955 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de817dde-2deb-431e-9706-455cffb01f72 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1319 microversion: 2.1 time: 0.496143 Oct 24 09:29:24.033097 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3268/6362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:23 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:24.208981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:24.226810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73db5450-5b1e-49a8-a863-cd1061c5b672 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1300 microversion: 2.1 time: 0.277009 Oct 24 09:29:24.227408 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3095/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:23 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:25.069061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:25.070064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:25.096182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:25.097910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:25.101984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:25.102731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:25.103201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:25.103647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:25.253504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:25.254130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:25.263472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:25.263962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:25.264929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:25.266656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:25.268825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:25.270126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:25.359157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:25.360530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:25.361160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:25.361826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lazy-loading 'fault' on Instance uuid 62ec66b6-62e7-4664-926e-7fdd8ab5f27c {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:29:25.420117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:25.431553 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bc068955-aaa0-425d-877a-29507ee87846 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1508 microversion: 2.1 time: 0.368828 Oct 24 09:29:25.432828 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3269/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:25 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:25.516219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79533b1e3d2049e69af8cf57a08ee1f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443e55a070a345829f873546f6474ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:25.530087 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5d61c8b-e652-4b76-ae6b-1b673fb679bf tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 200 len: 1305 microversion: 2.1 time: 0.278712 Oct 24 09:29:25.532028 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3096/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:25 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 1305 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:26.558681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:26.559365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] [instance: 62ec66b6-62e7-4664-926e-7fdd8ab5f27c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:26.583938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:26.585030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:26.585571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:26.586577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:26.588222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:26.589069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:26.626754 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] HTTP exception thrown: Instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c could not be found. Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Request method failure captured: Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c HTTP/1.1 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlrec9__5s0hgVwwaUUkRQtV54NhmXQGiXMFuADdR6fAxJQD7TWTxAIGBZFgX55vauB0rDlwZeVFirZwSdgJJ0NbfiqSJbKpaEO-alZ8QQK1ImBa9j5wWf8vsRCn92gRbd6uMWDanN8NrmrA5AJ24cK00fd5CK4dkypKfLa2fRMamg0 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 443e55a070a345829f873546f6474ffe Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesNegativeTest-764018649 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/443e55a070a345829f873546f6474ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_443e55a070a345829f873546f6474ffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/443e55a070a345829f873546f6474ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/443e55a070a345829f873546f6474ffe"}]}] Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesNegativeTest-764018649 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 443e55a070a345829f873546f6474ffe Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesNegativeTest-764018649 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesNegativeTest-764018649-project Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 79533b1e3d2049e69af8cf57a08ee1f3 Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesNegativeTest-764018649-project Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c could not be found. Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '62ec66b6-62e7-4664-926e-7fdd8ab5f27c'} Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c could not be found. Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c could not be found. Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:26.629451 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c could not be found. Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] Returning 404 to user: Instance 62ec66b6-62e7-4664-926e-7fdd8ab5f27c could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:29:26.637060 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-082f3c7d-60e2-4e45-8151-ec1d19339c34 tempest-VolumesNegativeTest-764018649 tempest-VolumesNegativeTest-764018649-project] 10.222.0.25 "GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c" status: 404 len: 111 microversion: 2.1 time: 0.077462 Oct 24 09:29:26.641358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3270/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:26 2022] GET /compute/v2.1/servers/62ec66b6-62e7-4664-926e-7fdd8ab5f27c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:36.311001 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=13 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:36.312317 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:36.317748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:36.320137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:36.340492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:36.342763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:36.344463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:36.345407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:36.347697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:36.348223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:36.417678 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29e95583-8d70-499c-89cd-dc1085c743fb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "POST /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb/action" status: 200 len: 24558 microversion: 2.1 time: 0.108996 Oct 24 09:29:36.419313 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3097/6367] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:29:36 2022] POST /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb/action => generated 24558 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 09:29:47.315292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:47.316264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:47.319491 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:47.321058 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=83 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:47.327060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:47.327647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:47.328263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:47.329144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:47.329788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:47.330373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:47.434831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lazy-loading 'services' on Instance uuid d529e593-80db-4efc-b50a-c02255c552da {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:29:47.552950 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92dba3d6-8d88-40db-b22b-33471ba1ba97 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da/os-volume_attachments/1259ffc8-00e6-41f9-93ed-6100612c27f0" status: 202 len: 0 microversion: 2.1 time: 0.242704 Oct 24 09:29:47.554134 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3271/6368] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:29:47 2022] DELETE /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da/os-volume_attachments/1259ffc8-00e6-41f9-93ed-6100612c27f0 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:29:48.523197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:48.523782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:48.526788 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:29:48.526941 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:29:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb (ip 10.222.0.25) !!! Oct 24 09:29:48.527076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-50cee176-f5a4-468e-b721-5e265635b696 req-98d49d0f-0d7a-4499-a524-d369330c56be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:48.531393 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:48.533286 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:48.546142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:48.546546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:48.546976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:48.547672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:48.548123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:48.548544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:48.555597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-50cee176-f5a4-468e-b721-5e265635b696 req-98d49d0f-0d7a-4499-a524-d369330c56be service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:48.557629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-50cee176-f5a4-468e-b721-5e265635b696 req-98d49d0f-0d7a-4499-a524-d369330c56be service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:48.558102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-50cee176-f5a4-468e-b721-5e265635b696 req-98d49d0f-0d7a-4499-a524-d369330c56be service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:48.597446 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-50cee176-f5a4-468e-b721-5e265635b696 req-98d49d0f-0d7a-4499-a524-d369330c56be service nova] Creating event network-changed:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:29:48.603024 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-50cee176-f5a4-468e-b721-5e265635b696 req-98d49d0f-0d7a-4499-a524-d369330c56be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081429 Oct 24 09:29:48.604528 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3272/6369] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:29:48.606282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:29:48.794396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f762d7a-3a54-4617-a0b8-01eeb0e9c093 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 204 len: 0 microversion: 2.1 time: 0.276250 Oct 24 09:29:48.795372 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3098/6370] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:29:48 2022] DELETE /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:29:48.821699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:48.822515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:48.831097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:48.835468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:48.839612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:48.840496 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:48.841250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:48.841837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:49.115163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acd84feb-2145-4c53-8317-e46def39460d", "device": "/dev/sdb"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:49.118703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:49.135153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:49.135643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:49.136277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:49.137161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:49.137965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:49.138547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:49.174596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:49.185508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b0f8b97-4df6-42af-b0cf-2ca989fbee5d tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1689 microversion: 2.1 time: 0.368493 Oct 24 09:29:49.202650 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3273/6371] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:48 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1689 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:50.150855 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-57c95425-2099-47d0-9028-066b9a89cadb tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "POST /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.040037 Oct 24 09:29:50.156821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3099/6372] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:29:49 2022] POST /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:50.212399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:50.212997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:50.221147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:50.221994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:50.222628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:50.223508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:50.224121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:50.224761 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:50.979714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:50.991100 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e2d06d5-fc63-4fa3-b039-a898623fa217 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1689 microversion: 2.1 time: 0.784046 Oct 24 09:29:51.001690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3274/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:50 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1689 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:51.531813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9e34e6ee-468c-47a6-9666-b8c458f99682 req-656daef3-c773-4d76-b5d6-f20a288e85d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78f722f-3ef8-49d5-b8de-41c391ff2dfb", "name": "network-vif-deleted", "tag": "25f70c79-d014-4b86-a400-99feef57df92"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:51.543527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9e34e6ee-468c-47a6-9666-b8c458f99682 req-656daef3-c773-4d76-b5d6-f20a288e85d2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:51.544249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9e34e6ee-468c-47a6-9666-b8c458f99682 req-656daef3-c773-4d76-b5d6-f20a288e85d2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:51.544846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9e34e6ee-468c-47a6-9666-b8c458f99682 req-656daef3-c773-4d76-b5d6-f20a288e85d2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:51.558761 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9e34e6ee-468c-47a6-9666-b8c458f99682 req-656daef3-c773-4d76-b5d6-f20a288e85d2 service nova] Creating event network-vif-deleted:25f70c79-d014-4b86-a400-99feef57df92 for instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb on n-h2-master-1 Oct 24 09:29:51.565036 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9e34e6ee-468c-47a6-9666-b8c458f99682 req-656daef3-c773-4d76-b5d6-f20a288e85d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036513 Oct 24 09:29:51.565878 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3275/6374] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:51.601672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Calling method '.version_select at 0x7f8da99674c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:51.604440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:51.604965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:51.605573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:51.622611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:51.623160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:51.623596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:51.638271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:51.638767 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:51.639211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:51.646380 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7af831d5-1eb3-4061-b680-ded9d96b8f67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-36587679-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.256136 Oct 24 09:29:51.647007 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3100/6375] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:29:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:52.026006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:52.026724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:52.038233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:52.038733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:52.039178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:52.039916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:52.040449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:52.040816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:52.080228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:52.080790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:52.081450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:52.082259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lazy-loading 'fault' on Instance uuid a78f722f-3ef8-49d5-b8de-41c391ff2dfb {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:29:52.138550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62fde68e8c747bfbea881c71421c5ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:52.151125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce65a812-1282-42d8-bc6e-87853795e1d8 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 200 len: 1356 microversion: 2.1 time: 0.138486 Oct 24 09:29:52.158526 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3276/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:52 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:52.945239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:52.946140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:52.960414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:52.961904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:52.963121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:52.964744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:52.966356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:52.967168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:53.004471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:29:53.107837 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b403e7f-8288-46be-b5ba-46429efec178 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 204 len: 0 microversion: 2.1 time: 0.168836 Oct 24 09:29:53.108434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3101/6377] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:29:52 2022] DELETE /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:29:53.117488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:53.118101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:53.125807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:53.126376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:53.126883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:53.127652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:53.128781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:53.129276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:53.176548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:53.178098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [instance: a78f722f-3ef8-49d5-b8de-41c391ff2dfb] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:53.184311 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:53.185017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:53.185670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:53.186528 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:53.187259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:53.187687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:53.204396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] HTTP exception thrown: Instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb could not be found. Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Request method failure captured: Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb HTTP/1.1 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVljFDFXOGs3XhEFZCXWMxvWHfJh781lcGcMgV9FXlazzOQezbj0390BG589-tgaa-HXoN5AG8VG1fwGrrM5YqXBde-HOJ8Fgsd7zGjtwxHywtiwoNfVLLzY6WysaYGKtyKkPts8MlGRWmKcz7DGX-cOyj0rWN9S41IMgA8M1Jci6EYg Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4ea2b64dfd8408292fe8b8d44c39b59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d4ea2b64dfd8408292fe8b8d44c39b59"}]}] Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d4ea2b64dfd8408292fe8b8d44c39b59 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1762434817 Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b62fde68e8c747bfbea881c71421c5ae Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1762434817-project Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb could not be found. Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a78f722f-3ef8-49d5-b8de-41c391ff2dfb'} Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb could not be found. Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb could not be found. Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:53.206330 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb could not be found. Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Returning 404 to user: Instance a78f722f-3ef8-49d5-b8de-41c391ff2dfb could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f502689-861c-45f2-b22d-45abbab227cb tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb" status: 404 len: 111 microversion: 2.1 time: 0.036369 Oct 24 09:29:53.215612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3102/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:53 2022] GET /compute/v2.1/servers/a78f722f-3ef8-49d5-b8de-41c391ff2dfb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:53.387062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:53.396012 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e470eb37-1ab2-443d-8e1c-25abd3645e96 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1470 microversion: 2.1 time: 0.282938 Oct 24 09:29:53.397737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3277/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:53 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:54.419423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:54.420119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:54.427885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:54.428696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:54.429197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:54.429993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:54.430513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:54.431178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:54.724903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:54.732906 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b59dcb9c-f261-4e0a-b14a-350621932594 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1470 microversion: 2.1 time: 0.317224 Oct 24 09:29:54.734104 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3103/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:54 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:55.756635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:55.757241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:55.764369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:55.764862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:55.765318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:55.772378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:55.779664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:55.780338 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:55.954544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2ac82b72-c23b-4ed3-b755-c9e5c5ba4410 req-f355fc93-fb02-4427-b7c4-936f50eea8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d529e593-80db-4efc-b50a-c02255c552da", "name": "network-vif-deleted", "tag": "a6d9c923-c6f8-4ba7-8c69-fbcbb18cdc17"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:29:55.969358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2ac82b72-c23b-4ed3-b755-c9e5c5ba4410 req-f355fc93-fb02-4427-b7c4-936f50eea8ec service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:55.970176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2ac82b72-c23b-4ed3-b755-c9e5c5ba4410 req-f355fc93-fb02-4427-b7c4-936f50eea8ec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:55.970801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2ac82b72-c23b-4ed3-b755-c9e5c5ba4410 req-f355fc93-fb02-4427-b7c4-936f50eea8ec service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:55.982161 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88764310cfd74578976cca63fd41458f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a94dd119e49ce96801f1a73cfe31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:29:55.989420 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2ac82b72-c23b-4ed3-b755-c9e5c5ba4410 req-f355fc93-fb02-4427-b7c4-936f50eea8ec service nova] Creating event network-vif-deleted:a6d9c923-c6f8-4ba7-8c69-fbcbb18cdc17 for instance d529e593-80db-4efc-b50a-c02255c552da on n-h1-master-1 Oct 24 09:29:55.992187 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a399ab04-4c8c-4119-af15-cdb9ca2923d8 tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 200 len: 1428 microversion: 2.1 time: 0.239911 Oct 24 09:29:55.998085 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2ac82b72-c23b-4ed3-b755-c9e5c5ba4410 req-f355fc93-fb02-4427-b7c4-936f50eea8ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048688 Oct 24 09:29:55.999096 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3104/6381] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:29:56.007936 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3278/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:55 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 1428 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:29:57.032273 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:57.033744 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] [instance: d529e593-80db-4efc-b50a-c02255c552da] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:29:57.048897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:57.061000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:57.063139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:57.064012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:29:57.069137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:29:57.069831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:29:57.147618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] HTTP exception thrown: Instance d529e593-80db-4efc-b50a-c02255c552da could not be found. Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Request method failure captured: Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da HTTP/1.1 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlqfrEsxZ5vyb_Y7pXTRBOeXufjJXQs--UWq8YYl_qgRqcrMrnYkguq4eQ5Jb-5etNB7hvprWNCv0e-tQcw5VR7QPjfaUnxM92I1Jh3fv1G1B-x-o0giXDOd8uio5oVE5sSiNC0aHSDRFtfjFtoHSHw_hNRRRChcKd26uiA68Cr-M-Q Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: da1a94dd119e49ce96801f1a73cfe31d Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesBackupsTest-225330370 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da1a94dd119e49ce96801f1a73cfe31d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da1a94dd119e49ce96801f1a73cfe31d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da1a94dd119e49ce96801f1a73cfe31d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da1a94dd119e49ce96801f1a73cfe31d"}]}] Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesBackupsTest-225330370 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: da1a94dd119e49ce96801f1a73cfe31d Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesBackupsTest-225330370 Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesBackupsTest-225330370-project Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 88764310cfd74578976cca63fd41458f Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesBackupsTest-225330370-project Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: exception: Instance d529e593-80db-4efc-b50a-c02255c552da could not be found. Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'd529e593-80db-4efc-b50a-c02255c552da'} Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d529e593-80db-4efc-b50a-c02255c552da could not be found. Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d529e593-80db-4efc-b50a-c02255c552da could not be found. Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:29:57.166144 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d529e593-80db-4efc-b50a-c02255c552da could not be found. Oct 24 09:29:57.171337 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:29:57.172689 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] Returning 404 to user: Instance d529e593-80db-4efc-b50a-c02255c552da could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:29:57.174360 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-937f22ab-4089-482f-b53a-733192aee1bb tempest-VolumesBackupsTest-225330370 tempest-VolumesBackupsTest-225330370-project] 10.222.0.25 "GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da" status: 404 len: 111 microversion: 2.1 time: 0.147525 Oct 24 09:29:57.176473 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3105/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:57 2022] GET /compute/v2.1/servers/d529e593-80db-4efc-b50a-c02255c552da => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:58.731681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd8fe016-66c9-4f56-b5dd-a0d3bf8e4878 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] Calling method '.version_select at 0x7f8daa2eef70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:29:58.740841 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd8fe016-66c9-4f56-b5dd-a0d3bf8e4878 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [9b9e3e2f-1265-43f0-954f-fe6548ce023c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:29:59.750627 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd8fe016-66c9-4f56-b5dd-a0d3bf8e4878 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] [9b9e3e2f-1265-43f0-954f-fe6548ce023c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48832. Oct 24 09:29:59.775571 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd8fe016-66c9-4f56-b5dd-a0d3bf8e4878 tempest-TestNetworkAdvancedServerOps-1762434817 tempest-TestNetworkAdvancedServerOps-1762434817-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1854018419" status: 202 len: 0 microversion: 2.1 time: 1.049263 Oct 24 09:29:59.776398 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3279/6384] 10.222.0.25 () {58 vars in 1284 bytes} [Mon Oct 24 09:29:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1854018419 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:30:24.746083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:24.747166 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:24.751877 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:24.759195 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:24.771567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:24.772340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:24.772789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:24.773563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:24.774016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:24.774552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:24.986785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lazy-loading 'services' on Instance uuid 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:30:25.136961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-730c945a-f3dc-4e41-bbc5-625a09099121 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93/os-volume_attachments/acd84feb-2145-4c53-8317-e46def39460d" status: 202 len: 0 microversion: 2.1 time: 0.397855 Oct 24 09:30:25.137599 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3106/6385] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:30:24 2022] DELETE /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93/os-volume_attachments/acd84feb-2145-4c53-8317-e46def39460d => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:30:31.807979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:31.809343 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:31.814033 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:31.815671 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:31.820506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:31.821188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:31.821850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:31.822862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:31.823521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:31.824166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:31.893984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:30:32.006752 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-229036d7-6714-45fd-8a73-731a0a33cf32 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 204 len: 0 microversion: 2.1 time: 0.206654 Oct 24 09:30:32.007647 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3280/6386] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:30:31 2022] DELETE /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:30:32.016526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:32.017386 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:32.025756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:32.026660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:32.027337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:32.028308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:32.029010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:32.030301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:32.213666 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:32.222291 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-980daf3b-e2f8-4e99-ac11-61e989c2c85d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1514 microversion: 2.1 time: 0.209986 Oct 24 09:30:32.223929 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3107/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:32 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:30:33.246605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:33.248220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:33.255955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:33.256690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:33.257396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:33.258297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:33.258915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:33.259616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:33.610192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:33.620741 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ab9fd4f-1ffe-4a85-a2e4-74e0ae979776 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1514 microversion: 2.1 time: 0.378135 Oct 24 09:30:33.622573 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3281/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:33 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:34.419962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-269fabdc-ab83-4399-a0c9-6055ca5a30f8 req-1fd714df-60f2-4261-af11-f3e70a6e73e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93", "name": "network-vif-deleted", "tag": "2dbf9616-e723-4a5b-97ff-36b6157323b1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:30:34.437538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-269fabdc-ab83-4399-a0c9-6055ca5a30f8 req-1fd714df-60f2-4261-af11-f3e70a6e73e5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:34.438554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-269fabdc-ab83-4399-a0c9-6055ca5a30f8 req-1fd714df-60f2-4261-af11-f3e70a6e73e5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:34.454423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-269fabdc-ab83-4399-a0c9-6055ca5a30f8 req-1fd714df-60f2-4261-af11-f3e70a6e73e5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:34.493788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-269fabdc-ab83-4399-a0c9-6055ca5a30f8 req-1fd714df-60f2-4261-af11-f3e70a6e73e5 service nova] Creating event network-vif-deleted:2dbf9616-e723-4a5b-97ff-36b6157323b1 for instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 on n-h2-master-1 Oct 24 09:30:34.503030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-269fabdc-ab83-4399-a0c9-6055ca5a30f8 req-1fd714df-60f2-4261-af11-f3e70a6e73e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086045 Oct 24 09:30:34.510188 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3108/6389] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:30:34.644061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:34.645394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:34.654036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:34.654889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:34.655709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:34.656637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:34.657263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:34.657887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:34.696262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:34.696995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:34.697626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:34.698251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lazy-loading 'fault' on Instance uuid 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:30:34.756732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:34.765555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5f0d8626-0da3-4ace-933e-d9d341f7f2bc tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 200 len: 1309 microversion: 2.1 time: 0.125101 Oct 24 09:30:34.768358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3282/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:34 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:35.793188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:35.793954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:35.800896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:35.802025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:35.802546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:35.803499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:35.804110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:35.804603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:35.822581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] HTTP exception thrown: Instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 could not be found. Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Request method failure captured: Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 HTTP/1.1 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlqBkli-fxlsfnDWympPv-ldT1IrBQ7iVb677HUrEk4OA_CKX7ZB1fBs_uUvQqZpNc8I_ZauCRzrdqsVmOq2OZci7ps3GG4cpDoieRGvDW4LuXJcP8p5TDs9q7ulj10ebnZvcp9pay2bcJ2WRDtqI5LP8p870pT6A2sRu_ZOvHu39bI Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 5ffa591ecfaa48ada907a639b45d07f7 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-804369085 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ffa591ecfaa48ada907a639b45d07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ffa591ecfaa48ada907a639b45d07f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ffa591ecfaa48ada907a639b45d07f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ffa591ecfaa48ada907a639b45d07f7"}]}] Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotTestJSON-804369085 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 5ffa591ecfaa48ada907a639b45d07f7 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-804369085 Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotTestJSON-804369085-project Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e2fc124049504d579f6513b5cac00bdf Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotTestJSON-804369085-project Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 could not be found. Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93'} Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 could not be found. Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 could not be found. Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:30:35.824630 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 could not be found. Oct 24 09:30:35.832480 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:30:35.834375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Returning 404 to user: Instance 2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:30:35.835463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3543a0a2-3489-4f7b-bc03-216cfa8c9366 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93" status: 404 len: 111 microversion: 2.1 time: 0.047482 Oct 24 09:30:35.836106 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3109/6391] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:35 2022] GET /compute/v2.1/servers/2bde56ce-7bfa-4654-ac28-d9bc7e4ffe93 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:30:42.991792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1109342640", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "af89ed0a-8003-44fc-8c16-a40692554bce"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:30:43.072420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] validate_networks() for [('af89ed0a-8003-44fc-8c16-a40692554bce', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:30:43.942762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:30:43.943445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:30:43.943981 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:30:43.944397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:30:43.945124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:30:43.955976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:43.956593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:43.957751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:43.958605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:43.965364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:43.965987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:44.006780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Getting quotas for project 5ffa591ecfaa48ada907a639b45d07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:30:44.018626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Getting quotas for user e2fc124049504d579f6513b5cac00bdf and project 5ffa591ecfaa48ada907a639b45d07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:30:44.048558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:30:44.056890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:30:44.134559 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-781a40b1-9af9-4f44-ae75-f7180dc83c26 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146877 Oct 24 09:30:44.141627 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3283/6392] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:30:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:30:44.148691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-772e8536-9c7d-4aae-b20c-e1294bab2034 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:44.149409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-772e8536-9c7d-4aae-b20c-e1294bab2034 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:44.279647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-772e8536-9c7d-4aae-b20c-e1294bab2034 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:44.293016 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-772e8536-9c7d-4aae-b20c-e1294bab2034 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1219 microversion: 2.1 time: 0.149900 Oct 24 09:30:44.318821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3110/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:44 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:45.320365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:45.320997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:45.334300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:45.334794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:45.335241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:45.335951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:45.336412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:45.338894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:45.492011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:45.503780 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03eca71c-ed8b-49b2-b929-f65984adea74 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1271 microversion: 2.1 time: 0.187572 Oct 24 09:30:45.504958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3284/6394] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:45 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:46.530052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:46.531887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:46.543068 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:46.545233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:46.552410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:46.553171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:46.554152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:46.554819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:46.555465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:46.680068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:46.688140 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1968a8e-ba24-43ba-825f-fa9829d43e1d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1277 microversion: 2.1 time: 0.161834 Oct 24 09:30:46.692156 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3111/6395] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:46 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:47.718583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:47.719107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:47.736411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:47.736913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:47.737376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:47.738124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:47.738594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:47.739005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:48.184485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:48.195118 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8b788248-9adb-4da2-b5cd-d685b741399d tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1319 microversion: 2.1 time: 0.480420 Oct 24 09:30:48.197756 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3285/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:47 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:48.564184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a0a7092b-f9c9-42b7-af6c-fefc51c382f5 req-fccf9fe3-4af4-4f7d-9fa3-e5759cf340d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6548c001-2a18-40c6-abd3-87929becd17b", "tag": "4d775880-bdd4-4ea2-912c-ae04c12a891a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:30:48.586866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a0a7092b-f9c9-42b7-af6c-fefc51c382f5 req-fccf9fe3-4af4-4f7d-9fa3-e5759cf340d5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:48.587815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a0a7092b-f9c9-42b7-af6c-fefc51c382f5 req-fccf9fe3-4af4-4f7d-9fa3-e5759cf340d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:48.588481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a0a7092b-f9c9-42b7-af6c-fefc51c382f5 req-fccf9fe3-4af4-4f7d-9fa3-e5759cf340d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:48.618245 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a0a7092b-f9c9-42b7-af6c-fefc51c382f5 req-fccf9fe3-4af4-4f7d-9fa3-e5759cf340d5 service nova] Creating event network-changed:4d775880-bdd4-4ea2-912c-ae04c12a891a for instance 6548c001-2a18-40c6-abd3-87929becd17b on n-h1-master-1 Oct 24 09:30:48.624030 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a0a7092b-f9c9-42b7-af6c-fefc51c382f5 req-fccf9fe3-4af4-4f7d-9fa3-e5759cf340d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063234 Oct 24 09:30:48.625198 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3112/6397] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:30:49.221850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:49.224693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:49.236225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:49.236931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:49.238304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:49.239205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:49.240666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:49.241553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:49.449578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:49.463239 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae7ef128-f5ed-4978-b6b1-97a5ef98f8f1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1319 microversion: 2.1 time: 0.246912 Oct 24 09:30:49.463936 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3286/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:49 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:50.489165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:50.490388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:50.505583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:50.506210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:50.506777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:50.508409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:50.509025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:50.511174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:50.893969 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:50.902078 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ad7a73e-615d-4e26-8dc3-4e527073a733 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1319 microversion: 2.1 time: 0.417574 Oct 24 09:30:50.903079 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3113/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:50 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:51.926632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:51.928130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:51.935553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:51.936853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:51.937651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:51.938575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:51.939207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:51.939806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:52.103594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:52.114487 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a403edf-b46d-4978-b2a5-0897e1a3504c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1319 microversion: 2.1 time: 0.193354 Oct 24 09:30:52.129633 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3287/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:51 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:53.140807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:53.141459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:53.154166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:53.154829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:53.155281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:53.155997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:53.156455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:53.157016 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:53.393703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-bbab22f6-be1f-484d-b2bc-39a5fbc09e4e req-aad7e2e4-140e-4702-962a-a6a2197d62dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6548c001-2a18-40c6-abd3-87929becd17b", "name": "network-vif-plugged", "status": "completed", "tag": "4d775880-bdd4-4ea2-912c-ae04c12a891a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:30:53.412779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bbab22f6-be1f-484d-b2bc-39a5fbc09e4e req-aad7e2e4-140e-4702-962a-a6a2197d62dc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:53.416621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bbab22f6-be1f-484d-b2bc-39a5fbc09e4e req-aad7e2e4-140e-4702-962a-a6a2197d62dc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:53.417223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bbab22f6-be1f-484d-b2bc-39a5fbc09e4e req-aad7e2e4-140e-4702-962a-a6a2197d62dc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:53.418866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:53.430111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b1638af-1168-4f28-9f5f-8e179246f7a2 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1319 microversion: 2.1 time: 0.293704 Oct 24 09:30:53.433653 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3114/6401] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:53 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:53.450536 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-bbab22f6-be1f-484d-b2bc-39a5fbc09e4e req-aad7e2e4-140e-4702-962a-a6a2197d62dc service nova] Creating event network-vif-plugged:4d775880-bdd4-4ea2-912c-ae04c12a891a for instance 6548c001-2a18-40c6-abd3-87929becd17b on n-h1-master-1 Oct 24 09:30:53.470812 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-bbab22f6-be1f-484d-b2bc-39a5fbc09e4e req-aad7e2e4-140e-4702-962a-a6a2197d62dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081281 Oct 24 09:30:53.471860 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3288/6402] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:30:54.453945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:54.455122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:54.461987 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:54.464120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:54.464895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:54.465576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:54.466468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:54.467092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:54.467686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:54.719903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:54.729250 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11472b7d-f970-49bd-ae87-63605e0279ed tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1319 microversion: 2.1 time: 0.279052 Oct 24 09:30:54.733228 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3115/6403] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:54 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:55.756914 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:30:55.758406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:55.768496 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:55.770702 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:55.777047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:55.778602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:55.781103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:55.782175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:55.782722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:55.786155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:55.946878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:30:55.959705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59ca69db-09be-4803-a5c9-6a28b848a6e9 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1508 microversion: 2.1 time: 0.207160 Oct 24 09:30:55.961092 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3289/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:30:55 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:30:55.985272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45d35af9-0c2e-4123-95b0-482ff86d5360", "device": "/dev/sdb"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:30:55.991783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:30:56.001125 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=23 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:56.004265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:56.005148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:56.006107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:56.008395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:30:56.009445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:30:56.010389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:30:56.464898 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-912703d0-7cf9-449b-9b62-d9a2bb73abfd tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "POST /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448990 Oct 24 09:30:56.473369 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3116/6405] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:30:55 2022] POST /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:31:22.322375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:31:22.323451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:31:22.336733 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:22.339011 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:22.343276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:22.345078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:22.347895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:22.349032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:22.349680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:22.350270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:23.011142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lazy-loading 'services' on Instance uuid 6548c001-2a18-40c6-abd3-87929becd17b {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:31:23.238179 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dc71774-5d31-4e08-8355-ba6e23140ae1 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b/os-volume_attachments/45d35af9-0c2e-4123-95b0-482ff86d5360" status: 202 len: 0 microversion: 2.1 time: 0.919202 Oct 24 09:31:23.239944 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3290/6406] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:31:22 2022] DELETE /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b/os-volume_attachments/45d35af9-0c2e-4123-95b0-482ff86d5360 => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:31:31.209763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:31:31.210483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:31:31.217571 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:31.218661 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:31.222545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:31.223138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:31.223939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:31.225065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:31.225798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:31.226401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:31.280048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:31:31.396661 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d47d5fd1-c728-450e-adc7-19c44be9f175 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 204 len: 0 microversion: 2.1 time: 0.191209 Oct 24 09:31:31.400556 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3117/6407] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:31:31 2022] DELETE /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:31:31.407484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:31:31.409422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:31:31.423119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:31.423618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:31.424930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:31.425843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:31.426466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:31.427063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:31.619661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:31:31.629558 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3b1964c-e155-48f6-83a1-539d0e736290 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1514 microversion: 2.1 time: 0.227382 Oct 24 09:31:31.646026 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3291/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:31:31 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:31:32.655912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:31:32.656649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:31:32.668407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:32.669398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:32.670058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:32.670946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:32.671626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:32.672222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:33.129706 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:31:33.139501 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e22ae24-66f7-4721-8f1e-2cb628506835 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1514 microversion: 2.1 time: 0.488091 Oct 24 09:31:33.155395 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3118/6409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:31:32 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1514 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:31:34.166135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:31:34.166818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:31:34.178494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:34.187487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:34.188151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:34.188978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:34.189580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:34.190067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:34.295750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fc124049504d579f6513b5cac00bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffa591ecfaa48ada907a639b45d07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:31:34.317490 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-930960a2-52de-41d1-a4ea-5b7cf5d4113c tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 200 len: 1472 microversion: 2.1 time: 0.152400 Oct 24 09:31:34.319810 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3292/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:31:34 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:31:34.358637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-94d49ec8-3fe2-4236-b63d-11b34df926d3 req-e055fb85-3ae6-4aad-9524-16c76976fc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6548c001-2a18-40c6-abd3-87929becd17b", "name": "network-vif-deleted", "tag": "4d775880-bdd4-4ea2-912c-ae04c12a891a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:31:34.373987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-94d49ec8-3fe2-4236-b63d-11b34df926d3 req-e055fb85-3ae6-4aad-9524-16c76976fc68 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:34.375126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-94d49ec8-3fe2-4236-b63d-11b34df926d3 req-e055fb85-3ae6-4aad-9524-16c76976fc68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:34.376037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-94d49ec8-3fe2-4236-b63d-11b34df926d3 req-e055fb85-3ae6-4aad-9524-16c76976fc68 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:34.427608 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-94d49ec8-3fe2-4236-b63d-11b34df926d3 req-e055fb85-3ae6-4aad-9524-16c76976fc68 service nova] Creating event network-vif-deleted:4d775880-bdd4-4ea2-912c-ae04c12a891a for instance 6548c001-2a18-40c6-abd3-87929becd17b on n-h1-master-1 Oct 24 09:31:34.435192 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-94d49ec8-3fe2-4236-b63d-11b34df926d3 req-e055fb85-3ae6-4aad-9524-16c76976fc68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081176 Oct 24 09:31:34.436580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3119/6411] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:31:35.344765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:31:35.346536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] [instance: 6548c001-2a18-40c6-abd3-87929becd17b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:31:35.360620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:35.362028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:35.362765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:35.365971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:31:35.366645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:31:35.367254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:31:35.397601 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] HTTP exception thrown: Instance 6548c001-2a18-40c6-abd3-87929becd17b could not be found. Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Request method failure captured: Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b HTTP/1.1 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlqBkli-fxlsfnDWympPv-ldT1IrBQ7iVb677HUrEk4OA_CKX7ZB1fBs_uUvQqZpNc8I_ZauCRzrdqsVmOq2OZci7ps3GG4cpDoieRGvDW4LuXJcP8p5TDs9q7ulj10ebnZvcp9pay2bcJ2WRDtqI5LP8p870pT6A2sRu_ZOvHu39bI Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 5ffa591ecfaa48ada907a639b45d07f7 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-804369085 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ffa591ecfaa48ada907a639b45d07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ffa591ecfaa48ada907a639b45d07f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ffa591ecfaa48ada907a639b45d07f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ffa591ecfaa48ada907a639b45d07f7"}]}] Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesSnapshotTestJSON-804369085 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 5ffa591ecfaa48ada907a639b45d07f7 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-804369085 Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesSnapshotTestJSON-804369085-project Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: e2fc124049504d579f6513b5cac00bdf Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesSnapshotTestJSON-804369085-project Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 6548c001-2a18-40c6-abd3-87929becd17b could not be found. Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6548c001-2a18-40c6-abd3-87929becd17b'} Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6548c001-2a18-40c6-abd3-87929becd17b could not be found. Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6548c001-2a18-40c6-abd3-87929becd17b could not be found. Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:31:35.402896 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6548c001-2a18-40c6-abd3-87929becd17b could not be found. Oct 24 09:31:35.407902 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:31:35.411027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] Returning 404 to user: Instance 6548c001-2a18-40c6-abd3-87929becd17b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:31:35.412054 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-33e066d4-9905-4872-8ea3-f18136d2cb25 tempest-VolumesSnapshotTestJSON-804369085 tempest-VolumesSnapshotTestJSON-804369085-project] 10.222.0.25 "GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b" status: 404 len: 111 microversion: 2.1 time: 0.071795 Oct 24 09:31:35.413449 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3293/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:31:35 2022] GET /compute/v2.1/servers/6548c001-2a18-40c6-abd3-87929becd17b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:32:47.528112 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:47.529520 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:47.535910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3dbc967-3c69-4dd8-b837-13ab3c66dbcd tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Action: 'create', calling method: .version_select at 0x7f8da996a4c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2131407824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIixLkUhJRWyYKCq9A/jaPZr4GCasxsrcqCIxitZoAfBlWjWhogRZRHJMY1J0WSxUzWjkyF80JTK+H1dyWDy+hRG3VNfOrRC9E+Lpi1cID1S6vFGg52xLuCbYGutX9suNA=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:32:47.555764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f3dbc967-3c69-4dd8-b837-13ab3c66dbcd tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Getting quotas for project 3914ae4ecd694d7ead85824e88749b39. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:32:47.561933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f3dbc967-3c69-4dd8-b837-13ab3c66dbcd tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Getting quotas for user 1731f53174b745b19f6b8529f8681311 and project 3914ae4ecd694d7ead85824e88749b39. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:32:47.594238 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3dbc967-3c69-4dd8-b837-13ab3c66dbcd tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067360 Oct 24 09:32:47.594847 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3120/6413] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:32:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:32:48.854826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1501463312", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1edca6a6-24e7-4f07-90b2-feba89957b89", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2131407824", "security_groups": [{"name": "tempest-secgroup-smoke-1299843175"}], "networks": [{"uuid": "18ce88be-3fc9-4af4-96f2-d7efc55f69f7"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:32:48.870206 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:48.870968 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:48.992168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] validate_networks() for [('18ce88be-3fc9-4af4-96f2-d7efc55f69f7', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:32:49.561721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:32:49.562344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:32:49.562903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:32:49.563385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:32:49.564391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:32:49.573737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:49.574298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:49.574812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:49.575626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:49.576320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:49.576812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:49.595929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Getting quotas for project 3914ae4ecd694d7ead85824e88749b39. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:32:49.601402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Getting quotas for user 1731f53174b745b19f6b8529f8681311 and project 3914ae4ecd694d7ead85824e88749b39. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:32:49.662655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:32:49.664903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1edca6a6-24e7-4f07-90b2-feba89957b89',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:32:49.815098 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd763ba8-d1e3-44e9-ae11-ff871da5c709 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.968114 Oct 24 09:32:49.815098 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3294/6414] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:32:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:32:49.825084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9ffd974-c0ab-4925-af5c-da3a6ff5f45d tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:49.825862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9ffd974-c0ab-4925-af5c-da3a6ff5f45d tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:49.831298 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 09:32:49.923054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d9ffd974-c0ab-4925-af5c-da3a6ff5f45d tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:49.932899 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9ffd974-c0ab-4925-af5c-da3a6ff5f45d tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1099 microversion: 2.1 time: 0.111354 Oct 24 09:32:49.934127 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3121/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:49 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1099 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:50.958452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:50.959292 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:50.970144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:50.970981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:50.971529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:50.972629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:50.973323 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:50.974165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:51.080609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:51.093065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8136776-63d6-416a-b8ad-c3f630832608 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1197 microversion: 2.1 time: 0.137135 Oct 24 09:32:51.107306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3295/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:50 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:52.125905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:52.127102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:52.136681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:52.137167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:52.137860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:52.138736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:52.141077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:52.141749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:52.168545 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 53194. Oct 24 09:32:52.364379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:52.373523 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c54036d3-9ce0-4a4b-8f16-fd528ad7a2e9 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1283 microversion: 2.1 time: 0.252291 Oct 24 09:32:52.374500 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3122/6417] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:52 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1283 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:53.398674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:53.399941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:53.420991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:53.424125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:53.425428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:53.426923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:53.427666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:53.433314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:53.485764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-91ed5a83-64a2-4c25-8276-a9a530fd10e6 req-447a569e-3dc7-4c40-a5bb-ae324fecdc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:32:53.498201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91ed5a83-64a2-4c25-8276-a9a530fd10e6 req-447a569e-3dc7-4c40-a5bb-ae324fecdc44 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:53.505524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91ed5a83-64a2-4c25-8276-a9a530fd10e6 req-447a569e-3dc7-4c40-a5bb-ae324fecdc44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:53.507142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-91ed5a83-64a2-4c25-8276-a9a530fd10e6 req-447a569e-3dc7-4c40-a5bb-ae324fecdc44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:53.525092 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-91ed5a83-64a2-4c25-8276-a9a530fd10e6 req-447a569e-3dc7-4c40-a5bb-ae324fecdc44 service nova] Creating event network-changed:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:32:53.539330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-91ed5a83-64a2-4c25-8276-a9a530fd10e6 req-447a569e-3dc7-4c40-a5bb-ae324fecdc44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373247 Oct 24 09:32:53.540964 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3296/6418] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:32:53.759722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:53.772372 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e2af2090-9a8c-494e-ab47-1cb61258b6a0 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1283 microversion: 2.1 time: 0.377435 Oct 24 09:32:53.779504 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3123/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:53 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1283 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:32:54.798045 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:54.799448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:54.806128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:54.806930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:54.807621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:54.808563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:54.809289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:54.809982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:54.959487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:54.969071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7131f206-06aa-4b57-8129-ecb0e82f02f3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1283 microversion: 2.1 time: 0.176076 Oct 24 09:32:54.977460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3297/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:54 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1283 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:56.004881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:56.005797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:56.020752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:56.021249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:56.021716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:56.022430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:56.022889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:56.023314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:56.245437 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:56.255674 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6cefe4e9-5a90-454e-85aa-895f96d3d69e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1283 microversion: 2.1 time: 0.254602 Oct 24 09:32:56.257100 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3124/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:55 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:57.279944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:57.281151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:57.290706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:57.291346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:57.291935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:57.292669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:57.293101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:57.293748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:57.441525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:57.449665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0fadb476-9c15-45d4-9161-ef035cbb6dd3 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.173519 Oct 24 09:32:57.461777 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3298/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:57 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:58.474332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:58.475050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:58.482739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:58.483545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:58.485741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:58.486494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:58.486963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:58.487400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:58.676525 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:58.685763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4035634-572e-431e-94e4-f7bfbcf8eb30 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.215444 Oct 24 09:32:58.686360 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3125/6423] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:58 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:32:59.708565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:32:59.709189 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:32:59.712144 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:59.713357 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:59.719075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:59.719577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:59.720019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:59.720738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:32:59.723060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:32:59.723745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:32:59.898294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:32:59.912411 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4884c18-934c-4d31-b07c-24d6873391a1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.206739 Oct 24 09:32:59.913752 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3299/6424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:32:59 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:00.938473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:00.939076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:00.942158 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:00.947997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:00.948509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:00.948944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:00.949672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:00.950453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:00.950940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:01.109415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:01.117754 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cbb6c7d-e192-496f-b996-2dcfdc14f4d1 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.183281 Oct 24 09:33:01.118577 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3126/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:00 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:01.852269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-379723502", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "5cfd9bbc-d928-4530-bc5b-ceaf7c1b5bd6"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:01.908932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] validate_networks() for [('5cfd9bbc-d928-4530-bc5b-ceaf7c1b5bd6', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:33:02.141394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:02.142798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:02.149903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:02.150618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:02.151235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:02.152107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:02.152875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:02.153729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:02.294684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:33:02.295114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:33:02.295601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:33:02.296103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:33:02.297028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:33:02.301823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:02.306328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:02.306820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:02.307261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:02.307991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:02.308647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:02.309088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:02.310463 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2b44e83-50b0-4acb-a50e-c5e1e2eb9d79 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.173032 Oct 24 09:33:02.321323 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3127/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:02 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:02.329212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Getting quotas for project f150cc8e16184031894ee0ff01ba8fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:33:02.334470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Getting quotas for user a67ee3d388da46189643fad999dd135c and project f150cc8e16184031894ee0ff01ba8fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:33:02.347501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:33:02.349841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:33:02.361752 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:33:02.361921 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:33:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 24 09:33:02.400406 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-84f8751c-d9a6-4f61-aea5-1351e227f3ad tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552131 Oct 24 09:33:02.401386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3300/6427] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:33:02.413190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe6d01d6-6160-47e1-8477-03c76f02a93a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:02.414426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe6d01d6-6160-47e1-8477-03c76f02a93a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:02.491079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe6d01d6-6160-47e1-8477-03c76f02a93a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:02.498832 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe6d01d6-6160-47e1-8477-03c76f02a93a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1213 microversion: 2.1 time: 0.089788 Oct 24 09:33:02.499872 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3128/6428] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:02 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:03.335665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:03.336225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:03.343614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:03.344068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:03.344508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:03.345204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:03.345693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:03.346126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:03.484174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:03.493688 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f613c6e-d2f7-4fab-9929-88af610369ce tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.162793 Oct 24 09:33:03.494364 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3301/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:03 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:03.522361 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:03.522968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:03.531430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:03.531915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:03.532560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:03.533502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:03.533957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:03.534381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:03.615935 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:03.624028 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d447fa6-56b2-44af-b1ae-800a45c1ccaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1265 microversion: 2.1 time: 0.105567 Oct 24 09:33:03.625149 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3129/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:03 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:04.516114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:04.517414 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:04.525848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:04.526342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:04.526781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:04.527615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:04.528081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:04.528505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:04.649595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:04.651096 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:04.659260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:04.659883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:04.660467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:04.661461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:04.662063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:04.662563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:04.795089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:04.807374 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f4dfb14-9f56-4e76-904c-c44fba8a500f tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.294959 Oct 24 09:33:04.808692 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3302/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:04 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:04.810685 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:04.819750 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46df30d9-924f-4786-87a7-5238aaa97fa5 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.174850 Oct 24 09:33:04.821683 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3130/6432] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:04 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:05.467870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5ac89df5-92a6-4a5f-95b3-e099cfc4475a req-59e952fc-42d3-44b6-8cfa-d047de4e7e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91a14a6-61dc-4ca2-8558-fa958cec4dd5", "tag": "0407cf4f-856d-4b17-bd79-14638a604c5c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:05.478379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5ac89df5-92a6-4a5f-95b3-e099cfc4475a req-59e952fc-42d3-44b6-8cfa-d047de4e7e4b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:05.478945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5ac89df5-92a6-4a5f-95b3-e099cfc4475a req-59e952fc-42d3-44b6-8cfa-d047de4e7e4b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:05.479452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5ac89df5-92a6-4a5f-95b3-e099cfc4475a req-59e952fc-42d3-44b6-8cfa-d047de4e7e4b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:05.492090 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5ac89df5-92a6-4a5f-95b3-e099cfc4475a req-59e952fc-42d3-44b6-8cfa-d047de4e7e4b service nova] Creating event network-changed:0407cf4f-856d-4b17-bd79-14638a604c5c for instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 on n-h2-master-1 Oct 24 09:33:05.512099 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5ac89df5-92a6-4a5f-95b3-e099cfc4475a req-59e952fc-42d3-44b6-8cfa-d047de4e7e4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047996 Oct 24 09:33:05.513078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3303/6433] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:05.830731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:05.831984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:05.845567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:05.846984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:05.852746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:05.856118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:05.856886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:05.858076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:05.860381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:05.861053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:05.861772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:05.865234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:05.866043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:05.867070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:05.867704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:05.871232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:06.045186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:06.055636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13cf1b2f-6292-4d05-bc3c-afb5d85a08ca tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.228636 Oct 24 09:33:06.069964 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3131/6434] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:05 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:06.078150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-78baff4b-35a0-40b9-a031-665d302435e2 req-c95b2d6e-c316-483b-b176-38cf239aab3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "name": "network-vif-plugged", "status": "completed", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:06.088984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78baff4b-35a0-40b9-a031-665d302435e2 req-c95b2d6e-c316-483b-b176-38cf239aab3c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:06.089992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78baff4b-35a0-40b9-a031-665d302435e2 req-c95b2d6e-c316-483b-b176-38cf239aab3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:06.090808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-78baff4b-35a0-40b9-a031-665d302435e2 req-c95b2d6e-c316-483b-b176-38cf239aab3c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:06.097566 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:06.103602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-78baff4b-35a0-40b9-a031-665d302435e2 req-c95b2d6e-c316-483b-b176-38cf239aab3c service nova] Creating event network-vif-plugged:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:33:06.109274 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5a6dd7ff-2118-443c-b0e3-cf18c8d11aa7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.268755 Oct 24 09:33:06.109751 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-78baff4b-35a0-40b9-a031-665d302435e2 req-c95b2d6e-c316-483b-b176-38cf239aab3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037320 Oct 24 09:33:06.110439 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3132/6435] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:06.123024 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3304/6436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:05 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:07.084989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:07.085785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:07.092485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:07.093901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:07.094680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:07.095893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:07.099693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:07.100310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:07.133910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:07.135874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:07.177484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:07.178209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:07.178871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:07.179626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:07.180088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:07.180523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:07.280602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:07.302568 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f49f2028-7c33-4d16-be9c-afb5b4b24779 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1271 microversion: 2.1 time: 0.222800 Oct 24 09:33:07.304203 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3133/6437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:07 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:07.436351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:07.446771 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cbcfdd02-a893-46d8-b63b-3e213e97b6df tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.318316 Oct 24 09:33:07.459230 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3305/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:07 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:08.327992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:08.328701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:08.335554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:08.336050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:08.336493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:08.337197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:08.337681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:08.338113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:08.472022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:08.473743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:08.483702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:08.484477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:08.485100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:08.486024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:08.486660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:08.487400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:08.494130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:08.502995 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba8dda77-aa54-4666-ab77-e75385a391de tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1460 microversion: 2.1 time: 0.179500 Oct 24 09:33:08.515157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3134/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:08 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1460 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:08.527018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:08.528798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:08.536796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:08.537645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:08.538529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:08.539477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:08.540406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:08.541254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:08.631889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:08.640717 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7fbdf11-eaec-4a98-9831-8c54450395f6 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.172326 Oct 24 09:33:08.641170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3306/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:08 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:08.691047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:08.702055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d15f1519-0def-4e81-b6fa-44e40c9cc1a7 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1460 microversion: 2.1 time: 0.179518 Oct 24 09:33:08.702754 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3135/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:08 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1460 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:09.664076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:09.664744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:09.672414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:09.672945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:09.673428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:09.674067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:09.675372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:09.675816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:09.837901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:09.846197 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8240920e-e123-4d7b-a5ec-8f9c73e4fb24 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.186044 Oct 24 09:33:09.846766 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3307/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:09 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:10.654579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b7469fdc-1575-4977-8618-f7551994ad7f req-10c8769c-7682-49a2-9e48-aa2ed45eb265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91a14a6-61dc-4ca2-8558-fa958cec4dd5", "name": "network-vif-plugged", "status": "completed", "tag": "0407cf4f-856d-4b17-bd79-14638a604c5c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:10.664241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b7469fdc-1575-4977-8618-f7551994ad7f req-10c8769c-7682-49a2-9e48-aa2ed45eb265 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:10.664821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b7469fdc-1575-4977-8618-f7551994ad7f req-10c8769c-7682-49a2-9e48-aa2ed45eb265 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:10.665342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b7469fdc-1575-4977-8618-f7551994ad7f req-10c8769c-7682-49a2-9e48-aa2ed45eb265 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:10.677184 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b7469fdc-1575-4977-8618-f7551994ad7f req-10c8769c-7682-49a2-9e48-aa2ed45eb265 service nova] Creating event network-vif-plugged:0407cf4f-856d-4b17-bd79-14638a604c5c for instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 on n-h2-master-1 Oct 24 09:33:10.682259 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b7469fdc-1575-4977-8618-f7551994ad7f req-10c8769c-7682-49a2-9e48-aa2ed45eb265 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200270 Oct 24 09:33:10.683269 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3136/6443] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:10.846897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c9bd95ae-f56f-4e60-9ecb-84e146be4391 req-b9caf75c-e830-4a97-b49d-f129d5c7f946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:10.859105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c9bd95ae-f56f-4e60-9ecb-84e146be4391 req-b9caf75c-e830-4a97-b49d-f129d5c7f946 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:10.859591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c9bd95ae-f56f-4e60-9ecb-84e146be4391 req-b9caf75c-e830-4a97-b49d-f129d5c7f946 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:10.860927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c9bd95ae-f56f-4e60-9ecb-84e146be4391 req-b9caf75c-e830-4a97-b49d-f129d5c7f946 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:10.870048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:10.871118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:10.875126 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c9bd95ae-f56f-4e60-9ecb-84e146be4391 req-b9caf75c-e830-4a97-b49d-f129d5c7f946 service nova] Creating event network-changed:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:33:10.878293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:10.879015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:10.879692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:10.881014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:10.881737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:10.882148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c9bd95ae-f56f-4e60-9ecb-84e146be4391 req-b9caf75c-e830-4a97-b49d-f129d5c7f946 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039554 Oct 24 09:33:10.882642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:10.883118 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3308/6444] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:11.172735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:11.181113 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-185787c8-2814-4d5a-9f48-4a890a51af8f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.315287 Oct 24 09:33:11.182056 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3137/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:10 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:12.204382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:12.206271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2d079051-e153-43b7-aa41-be3b2a1aa331 req-3e9efb30-f10e-4d99-8ef9-f7ccd7192f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:12.207378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:12.227686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:12.228220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:12.228870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:12.231711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:12.232442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:12.232646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:12.241569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2d079051-e153-43b7-aa41-be3b2a1aa331 req-3e9efb30-f10e-4d99-8ef9-f7ccd7192f93 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:12.242543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2d079051-e153-43b7-aa41-be3b2a1aa331 req-3e9efb30-f10e-4d99-8ef9-f7ccd7192f93 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:12.243381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2d079051-e153-43b7-aa41-be3b2a1aa331 req-3e9efb30-f10e-4d99-8ef9-f7ccd7192f93 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:12.255629 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2d079051-e153-43b7-aa41-be3b2a1aa331 req-3e9efb30-f10e-4d99-8ef9-f7ccd7192f93 service nova] Creating event network-changed:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:33:12.261160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2d079051-e153-43b7-aa41-be3b2a1aa331 req-3e9efb30-f10e-4d99-8ef9-f7ccd7192f93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165787 Oct 24 09:33:12.262190 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3309/6446] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:12.496955 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:12.511319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:12.524516 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ffe9c246-b5fd-43f2-a46f-7bc6e1dff1b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1313 microversion: 2.1 time: 0.324380 Oct 24 09:33:12.537614 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3138/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:12 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:13.544870 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:13.545716 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:13.551150 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:13.551862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:13.558936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:13.559425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:13.559867 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:13.560563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:13.561031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:13.561492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:13.695049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:13.703886 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ccfbd40-ff69-4ea4-bc15-1a7e71a6dc1a tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1497 microversion: 2.1 time: 0.159854 Oct 24 09:33:13.704673 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3310/6448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:13 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:14.077771 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:14.078268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:14.085511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:14.085994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:14.086428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:14.087119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:14.087570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:14.087995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:14.116977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:33:14.150956 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:14.195390 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab360c1c-ed0c-44a2-ba33-ca60b08b56e2 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 204 len: 0 microversion: 2.1 time: 0.121150 Oct 24 09:33:14.199451 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3139/6449] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:33:14 2022] DELETE /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:33:14.204508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:14.205196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:14.211366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:14.211873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:14.212316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:14.213023 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:14.213519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:14.213949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:14.288099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-55a75211-5e5a-412f-8c13-13f8998f02b4 req-52adb67c-7d86-46b5-85c7-ee8ca2223317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:14.299698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-55a75211-5e5a-412f-8c13-13f8998f02b4 req-52adb67c-7d86-46b5-85c7-ee8ca2223317 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:14.300678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-55a75211-5e5a-412f-8c13-13f8998f02b4 req-52adb67c-7d86-46b5-85c7-ee8ca2223317 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:14.301183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-55a75211-5e5a-412f-8c13-13f8998f02b4 req-52adb67c-7d86-46b5-85c7-ee8ca2223317 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:14.313724 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-55a75211-5e5a-412f-8c13-13f8998f02b4 req-52adb67c-7d86-46b5-85c7-ee8ca2223317 service nova] Creating event network-changed:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:33:14.318616 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-55a75211-5e5a-412f-8c13-13f8998f02b4 req-52adb67c-7d86-46b5-85c7-ee8ca2223317 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Oct 24 09:33:14.319226 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3140/6450] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:33:14.361243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:14.369488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a147d8be-ad5a-4471-8e0c-5d2cb764a952 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1503 microversion: 2.1 time: 0.168918 Oct 24 09:33:14.370296 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3311/6451] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:14 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:15.395412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:15.396105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:15.402634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:15.403260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:15.403698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:15.404388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:15.404843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:15.405886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:15.548640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:15.556713 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-612e3d75-152b-4c14-bc29-cdfaa5dde1c7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1503 microversion: 2.1 time: 0.166356 Oct 24 09:33:15.557314 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3141/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:15 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:16.336645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-42b4e4de-f947-4557-ac0b-1f3de4dca0ea req-9ebdc228-598e-4fd9-804d-e2caa7df8d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91a14a6-61dc-4ca2-8558-fa958cec4dd5", "name": "network-vif-deleted", "tag": "0407cf4f-856d-4b17-bd79-14638a604c5c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:16.347943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-42b4e4de-f947-4557-ac0b-1f3de4dca0ea req-9ebdc228-598e-4fd9-804d-e2caa7df8d76 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:16.348421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-42b4e4de-f947-4557-ac0b-1f3de4dca0ea req-9ebdc228-598e-4fd9-804d-e2caa7df8d76 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:16.348848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-42b4e4de-f947-4557-ac0b-1f3de4dca0ea req-9ebdc228-598e-4fd9-804d-e2caa7df8d76 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:16.360381 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-42b4e4de-f947-4557-ac0b-1f3de4dca0ea req-9ebdc228-598e-4fd9-804d-e2caa7df8d76 service nova] Creating event network-vif-deleted:0407cf4f-856d-4b17-bd79-14638a604c5c for instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 on n-h2-master-1 Oct 24 09:33:16.365483 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-42b4e4de-f947-4557-ac0b-1f3de4dca0ea req-9ebdc228-598e-4fd9-804d-e2caa7df8d76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032560 Oct 24 09:33:16.366210 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3312/6453] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:16.582334 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:16.584368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:16.594591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:16.595530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:16.596150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:16.597101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:16.597604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:16.598024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:16.632258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:16.633013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:16.633736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:16.634186 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lazy-loading 'fault' on Instance uuid f91a14a6-61dc-4ca2-8558-fa958cec4dd5 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:33:16.687947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:16.696211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fec78484-47d0-49b2-a389-21faf433ec36 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 200 len: 1303 microversion: 2.1 time: 0.119890 Oct 24 09:33:16.696791 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3142/6454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:16 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:17.722146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:17.722958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: f91a14a6-61dc-4ca2-8558-fa958cec4dd5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:17.729284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:17.729915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:17.730419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:17.731188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:17.731649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:17.732254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:17.746359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] HTTP exception thrown: Instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 could not be found. Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Request method failure captured: Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 HTTP/1.1 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlvMCAWYAs8aFJskt6HTJ2jLLVOB4hlGf4lpuikqQQGaP7LMXNQzUv00f36gf7dD2Xbj28L_RxaA3_zSzDrfyg7q0DkO6ddfJyqmJUUITqRcMD6K3QbeA6vv8kuUhXLL_lTZbjonbBG2GlhohOVmG8Bhx7qk3ldSvhW6krxI2HOnqbE Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f150cc8e16184031894ee0ff01ba8fd7 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesActionsTest-67976462 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f150cc8e16184031894ee0ff01ba8fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f150cc8e16184031894ee0ff01ba8fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f150cc8e16184031894ee0ff01ba8fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f150cc8e16184031894ee0ff01ba8fd7"}]}] Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesActionsTest-67976462 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f150cc8e16184031894ee0ff01ba8fd7 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesActionsTest-67976462 Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesActionsTest-67976462-project Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a67ee3d388da46189643fad999dd135c Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesActionsTest-67976462-project Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: exception: Instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 could not be found. Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'f91a14a6-61dc-4ca2-8558-fa958cec4dd5'} Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 could not be found. Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 could not be found. Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:33:17.748019 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 could not be found. Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Returning 404 to user: Instance f91a14a6-61dc-4ca2-8558-fa958cec4dd5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53fc7682-baf3-4051-9913-43324dc5c92e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5" status: 404 len: 111 microversion: 2.1 time: 0.033644 Oct 24 09:33:17.755878 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3313/6455] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:17 2022] GET /compute/v2.1/servers/f91a14a6-61dc-4ca2-8558-fa958cec4dd5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:33:17.804644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1581727003", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "5cfd9bbc-d928-4530-bc5b-ceaf7c1b5bd6"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:17.816613 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:17.874258 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] validate_networks() for [('5cfd9bbc-d928-4530-bc5b-ceaf7c1b5bd6', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:33:18.341119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:33:18.341777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:33:18.342319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:33:18.343412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:33:18.343937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:33:18.362508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:18.363067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:18.363633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:18.364383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:18.364839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:18.365482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:18.386193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Getting quotas for project f150cc8e16184031894ee0ff01ba8fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:33:18.392714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Getting quotas for user a67ee3d388da46189643fad999dd135c and project f150cc8e16184031894ee0ff01ba8fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:33:18.407311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:33:18.409962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:33:18.462354 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0c1378d-b1f8-4da8-86e9-6c84a66ecb4e tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663475 Oct 24 09:33:18.463167 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3143/6456] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:33:18.474571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f87e6fcc-98d4-49f5-931d-4e2fab47175f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:18.475202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f87e6fcc-98d4-49f5-931d-4e2fab47175f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:18.552871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f87e6fcc-98d4-49f5-931d-4e2fab47175f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:18.560258 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f87e6fcc-98d4-49f5-931d-4e2fab47175f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1214 microversion: 2.1 time: 0.089435 Oct 24 09:33:18.560840 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3314/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:18 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:19.584207 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:19.584944 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:19.592076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:19.592561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:19.592998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:19.593721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:19.594947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:19.595551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:19.691219 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:19.700984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e658db8-067a-4a84-a1cb-fb9b49f2a362 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1274 microversion: 2.1 time: 0.121413 Oct 24 09:33:19.717461 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3144/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:19 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:20.725095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:20.725722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:20.729320 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:20.738123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:20.738850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:20.739370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:20.740003 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:20.740466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:20.740899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:20.745051 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=89 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:20.959659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:20.969084 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d97ba3af-d02c-4e9f-a00b-d3f78253a0b7 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1314 microversion: 2.1 time: 0.248235 Oct 24 09:33:20.969730 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3315/6459] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:20 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:21.082463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1f75529d-1bcf-48f4-87db-2bcb293c5e8a req-c94821e1-7bba-4794-8b23-13915dc6cb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01b4087-7a1a-4cd9-b610-0071129c1617", "tag": "0be08ae7-8221-4de8-892c-59e19d3c717c"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:21.094405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f75529d-1bcf-48f4-87db-2bcb293c5e8a req-c94821e1-7bba-4794-8b23-13915dc6cb10 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:21.095154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f75529d-1bcf-48f4-87db-2bcb293c5e8a req-c94821e1-7bba-4794-8b23-13915dc6cb10 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:21.095583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1f75529d-1bcf-48f4-87db-2bcb293c5e8a req-c94821e1-7bba-4794-8b23-13915dc6cb10 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:21.107073 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1f75529d-1bcf-48f4-87db-2bcb293c5e8a req-c94821e1-7bba-4794-8b23-13915dc6cb10 service nova] Creating event network-changed:0be08ae7-8221-4de8-892c-59e19d3c717c for instance e01b4087-7a1a-4cd9-b610-0071129c1617 on n-h2-master-1 Oct 24 09:33:21.112830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1f75529d-1bcf-48f4-87db-2bcb293c5e8a req-c94821e1-7bba-4794-8b23-13915dc6cb10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033980 Oct 24 09:33:21.113747 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3145/6460] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:21.992504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:21.993573 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:22.002078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:22.002647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:22.003155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:22.003921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:22.004472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:22.005226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:22.143238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:22.151703 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1109656-f33b-40d6-ac59-53158370648f tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1314 microversion: 2.1 time: 0.162976 Oct 24 09:33:22.152106 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3316/6461] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:21 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:23.175587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:23.176391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:23.182690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:23.183174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:23.183609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:23.184300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:23.184753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:23.185181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:23.322736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:23.330999 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a34187b-6294-4aff-9665-9234f184ef10 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1314 microversion: 2.1 time: 0.160591 Oct 24 09:33:23.331587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3146/6462] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:23 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:24.353686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:24.354388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:24.361871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:24.362368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:24.362815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:24.363537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:24.364001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:24.364431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:24.537089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:24.547913 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fb3b403-e4bf-4cac-8783-a95274be3eab tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1314 microversion: 2.1 time: 0.198615 Oct 24 09:33:24.551067 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3317/6463] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:24 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:25.572338 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:25.573033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:25.580789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:25.581374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:25.581809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:25.582494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:25.582939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:25.583363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:25.737079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:25.745555 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5aaa350f-f331-4edf-a590-eacce12ad2fb tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1314 microversion: 2.1 time: 0.177254 Oct 24 09:33:25.746141 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3147/6464] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:25 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:26.494534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-13c340b7-5a7d-439d-9965-745c94416a96 req-2a262641-50db-4955-a03d-1dcc5a921f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01b4087-7a1a-4cd9-b610-0071129c1617", "name": "network-vif-plugged", "status": "completed", "tag": "0be08ae7-8221-4de8-892c-59e19d3c717c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:26.506995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-13c340b7-5a7d-439d-9965-745c94416a96 req-2a262641-50db-4955-a03d-1dcc5a921f98 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:26.508031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-13c340b7-5a7d-439d-9965-745c94416a96 req-2a262641-50db-4955-a03d-1dcc5a921f98 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:26.508765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-13c340b7-5a7d-439d-9965-745c94416a96 req-2a262641-50db-4955-a03d-1dcc5a921f98 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:26.524535 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-13c340b7-5a7d-439d-9965-745c94416a96 req-2a262641-50db-4955-a03d-1dcc5a921f98 service nova] Creating event network-vif-plugged:0be08ae7-8221-4de8-892c-59e19d3c717c for instance e01b4087-7a1a-4cd9-b610-0071129c1617 on n-h2-master-1 Oct 24 09:33:26.530274 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-13c340b7-5a7d-439d-9965-745c94416a96 req-2a262641-50db-4955-a03d-1dcc5a921f98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039762 Oct 24 09:33:26.530863 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3318/6465] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:26.769070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:26.769725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:26.777343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:26.777842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:26.778284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:26.778992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:26.779457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:26.779908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:26.932875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:26.941062 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-952df68f-a070-49a2-ba11-54c36bf0f014 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1314 microversion: 2.1 time: 0.175767 Oct 24 09:33:26.941735 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3148/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:26 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:27.970075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:27.970793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:27.977879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:27.978370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:27.978811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:27.979519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:27.980033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:27.980467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:28.126158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:28.135249 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2769ba10-121d-4e0c-9561-c6edf676acda tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1499 microversion: 2.1 time: 0.170374 Oct 24 09:33:28.135834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3319/6467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:27 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:28.636867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:28.637431 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:28.642498 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:28.643250 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:28.647847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:28.648339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:28.648778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:28.649513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:28.649975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:28.650519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:28.678071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:33:28.756590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aca906f5-328b-478f-87ea-ea827e5cd048 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 204 len: 0 microversion: 2.1 time: 0.123362 Oct 24 09:33:28.757192 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3149/6468] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:33:28 2022] DELETE /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:33:28.765556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:28.766100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:28.768084 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:28.773352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:28.773886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:28.774375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:28.775109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:28.775572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:28.776004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:28.916979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:28.926049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b288282-56a1-45e1-a04f-1f4eeb0df6b4 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1505 microversion: 2.1 time: 0.164561 Oct 24 09:33:28.926757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3320/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:28 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:33:29.954261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:29.955089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:29.962008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:29.962577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:29.963089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:29.963860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:29.964384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:29.964879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:30.098399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:30.107153 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-730d38c9-8f9e-43da-a272-fb62c2219fff tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1505 microversion: 2.1 time: 0.157646 Oct 24 09:33:30.107819 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3150/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:29 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:30.722604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-45d7e563-9c53-4bc2-8861-49f5a468a948 req-6980f0e9-fdc6-40d3-992a-1a1a58cacf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01b4087-7a1a-4cd9-b610-0071129c1617", "name": "network-vif-deleted", "tag": "0be08ae7-8221-4de8-892c-59e19d3c717c"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:30.736435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-45d7e563-9c53-4bc2-8861-49f5a468a948 req-6980f0e9-fdc6-40d3-992a-1a1a58cacf74 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:30.748395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-45d7e563-9c53-4bc2-8861-49f5a468a948 req-6980f0e9-fdc6-40d3-992a-1a1a58cacf74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:30.749180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-45d7e563-9c53-4bc2-8861-49f5a468a948 req-6980f0e9-fdc6-40d3-992a-1a1a58cacf74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:30.768108 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-45d7e563-9c53-4bc2-8861-49f5a468a948 req-6980f0e9-fdc6-40d3-992a-1a1a58cacf74 service nova] Creating event network-vif-deleted:0be08ae7-8221-4de8-892c-59e19d3c717c for instance e01b4087-7a1a-4cd9-b610-0071129c1617 on n-h2-master-1 Oct 24 09:33:30.774310 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-45d7e563-9c53-4bc2-8861-49f5a468a948 req-6980f0e9-fdc6-40d3-992a-1a1a58cacf74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056810 Oct 24 09:33:30.775557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3321/6471] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:31.130139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:31.130792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:31.137712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:31.138191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:31.138635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:31.139891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:31.140350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:31.140779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:31.176131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:31.176612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:31.177048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:31.177526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lazy-loading 'fault' on Instance uuid e01b4087-7a1a-4cd9-b610-0071129c1617 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:33:31.227196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a67ee3d388da46189643fad999dd135c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150cc8e16184031894ee0ff01ba8fd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:31.236948 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a7126462-fa6f-4c93-8959-a81d04e5eaaf tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 200 len: 1304 microversion: 2.1 time: 0.110938 Oct 24 09:33:31.238266 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3151/6472] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:31 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:32.265320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:32.266053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] [instance: e01b4087-7a1a-4cd9-b610-0071129c1617] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:32.272334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:32.272808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:32.273240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:32.273959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:32.274414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:32.278139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:32.289535 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] HTTP exception thrown: Instance e01b4087-7a1a-4cd9-b610-0071129c1617 could not be found. Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Request method failure captured: Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 HTTP/1.1 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlvMCAWYAs8aFJskt6HTJ2jLLVOB4hlGf4lpuikqQQGaP7LMXNQzUv00f36gf7dD2Xbj28L_RxaA3_zSzDrfyg7q0DkO6ddfJyqmJUUITqRcMD6K3QbeA6vv8kuUhXLL_lTZbjonbBG2GlhohOVmG8Bhx7qk3ldSvhW6krxI2HOnqbE Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f150cc8e16184031894ee0ff01ba8fd7 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesActionsTest-67976462 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f150cc8e16184031894ee0ff01ba8fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f150cc8e16184031894ee0ff01ba8fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f150cc8e16184031894ee0ff01ba8fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f150cc8e16184031894ee0ff01ba8fd7"}]}] Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-VolumesActionsTest-67976462 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f150cc8e16184031894ee0ff01ba8fd7 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesActionsTest-67976462 Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-VolumesActionsTest-67976462-project Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: a67ee3d388da46189643fad999dd135c Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-VolumesActionsTest-67976462-project Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: exception: Instance e01b4087-7a1a-4cd9-b610-0071129c1617 could not be found. Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'e01b4087-7a1a-4cd9-b610-0071129c1617'} Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01b4087-7a1a-4cd9-b610-0071129c1617 could not be found. Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01b4087-7a1a-4cd9-b610-0071129c1617 could not be found. Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:33:32.291318 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01b4087-7a1a-4cd9-b610-0071129c1617 could not be found. Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] Returning 404 to user: Instance e01b4087-7a1a-4cd9-b610-0071129c1617 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3def2a93-ccfa-4d65-b0d5-f0ee7da6d211 tempest-VolumesActionsTest-67976462 tempest-VolumesActionsTest-67976462-project] 10.222.0.25 "GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617" status: 404 len: 111 microversion: 2.1 time: 0.032730 Oct 24 09:33:32.303160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3322/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:32 2022] GET /compute/v2.1/servers/e01b4087-7a1a-4cd9-b610-0071129c1617 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:33:44.431417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8cfb8b96-2753-4ce1-938e-09e467ff442f req-8156c159-ae8e-4c9c-a612-d029571a0c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:44.432095 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:44.432529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:44.448973 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:44.449710 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:44.458258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:44.459102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:44.461229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:44.465852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:44.469143 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=15 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:44.469623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:44.471540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:44.474744 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=35 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:44.480963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8cfb8b96-2753-4ce1-938e-09e467ff442f req-8156c159-ae8e-4c9c-a612-d029571a0c56 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:44.483244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8cfb8b96-2753-4ce1-938e-09e467ff442f req-8156c159-ae8e-4c9c-a612-d029571a0c56 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:44.483925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8cfb8b96-2753-4ce1-938e-09e467ff442f req-8156c159-ae8e-4c9c-a612-d029571a0c56 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:44.509456 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8cfb8b96-2753-4ce1-938e-09e467ff442f req-8156c159-ae8e-4c9c-a612-d029571a0c56 service nova] Creating event network-changed:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:33:44.522822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8cfb8b96-2753-4ce1-938e-09e467ff442f req-8156c159-ae8e-4c9c-a612-d029571a0c56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093485 Oct 24 09:33:44.523810 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3323/6474] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:33:45.096804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:33:45.278298 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f102dcd6-ac61-4d77-895d-e22d00f2740a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 204 len: 0 microversion: 2.1 time: 0.854812 Oct 24 09:33:45.314054 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3152/6475] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:33:44 2022] DELETE /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:33:45.320622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:45.321674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:45.343858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:45.344369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:45.344820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:45.345962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:45.347525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:45.349135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:45.570254 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:45.580212 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d466b8d3-169c-4b70-a278-5790033f3262 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1585 microversion: 2.1 time: 0.264936 Oct 24 09:33:45.581576 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3324/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:45 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1585 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:46.612049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:46.613127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:46.621843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:46.622333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:46.623018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:46.623850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:46.624477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:46.624914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:46.816141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:46.826542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afdd8e53-33f3-4375-8e14-f46e1492fb8e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1466 microversion: 2.1 time: 0.220477 Oct 24 09:33:46.828703 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3153/6477] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:46 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1466 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:47.680870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ae82f02e-0209-4fa5-8787-585f5ffe91e9 req-63fe347a-ceda-44bb-9614-5aee46fca027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32c42ff-6d62-4e1b-b03a-5d100cdd8676", "name": "network-vif-deleted", "tag": "2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:33:47.694821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae82f02e-0209-4fa5-8787-585f5ffe91e9 req-63fe347a-ceda-44bb-9614-5aee46fca027 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:47.695554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae82f02e-0209-4fa5-8787-585f5ffe91e9 req-63fe347a-ceda-44bb-9614-5aee46fca027 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:47.697065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae82f02e-0209-4fa5-8787-585f5ffe91e9 req-63fe347a-ceda-44bb-9614-5aee46fca027 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:47.713334 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ae82f02e-0209-4fa5-8787-585f5ffe91e9 req-63fe347a-ceda-44bb-9614-5aee46fca027 service nova] Creating event network-vif-deleted:2457b3e3-59e8-4c90-a8b1-8ad607d1cf3a for instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 on n-h1-master-1 Oct 24 09:33:47.718638 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ae82f02e-0209-4fa5-8787-585f5ffe91e9 req-63fe347a-ceda-44bb-9614-5aee46fca027 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042680 Oct 24 09:33:47.719266 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3325/6478] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:33:47.851344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:47.853118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:47.866680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:47.869406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:47.869857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:47.870588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:47.871097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:47.871479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:47.996761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:48.008605 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7182df44-66e7-4e73-a488-cfe95318a224 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1230 microversion: 2.1 time: 0.161484 Oct 24 09:33:48.009791 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3154/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:47 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1230 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:49.036108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:49.037708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:49.049400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:49.049977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:49.050513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:49.051476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:49.052148 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:49.052773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:49.152879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:49.164740 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6fec9da4-dce8-47db-b971-f6314641eccf tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1230 microversion: 2.1 time: 0.133659 Oct 24 09:33:49.177500 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3326/6480] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:49 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1230 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:50.192509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:50.193168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:50.201799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:50.202733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:50.203613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:50.204861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:50.230507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:50.233332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:50.360138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:50.382614 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6827d1c5-4df9-4f59-abb0-3d5f8bc4af6a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1230 microversion: 2.1 time: 0.190451 Oct 24 09:33:50.388142 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3155/6481] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:50 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1230 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:51.419700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:51.420831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:51.430567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:51.431708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:51.432656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:51.433718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:51.434445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:51.435406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:51.521464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:51.531538 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22d5f333-a016-440e-aa73-689c48d9320a tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1230 microversion: 2.1 time: 0.120614 Oct 24 09:33:51.532205 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3327/6482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:51 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:52.556300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:52.557197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:52.564569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:52.565159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:52.565791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:52.566573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:52.567138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:52.567643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:52.633165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:52.642520 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06e6510d-f220-4829-9160-998898ef9aa6 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1230 microversion: 2.1 time: 0.089953 Oct 24 09:33:52.645486 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3156/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:52 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:53.666162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:53.666829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:53.674786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:53.675501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:53.676141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:53.676854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:53.677336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:53.677939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:53.712540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:53.713135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:53.713675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:53.714136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lazy-loading 'fault' on Instance uuid a32c42ff-6d62-4e1b-b03a-5d100cdd8676 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:33:53.757769 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1731f53174b745b19f6b8529f8681311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3914ae4ecd694d7ead85824e88749b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:33:53.766519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d662b51-902f-4876-8019-3e8c0da8126e tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 200 len: 1235 microversion: 2.1 time: 0.104988 Oct 24 09:33:53.767603 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3328/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:53 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 1235 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:33:54.790697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:54.791429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] [instance: a32c42ff-6d62-4e1b-b03a-5d100cdd8676] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:33:54.800250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:54.805473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:54.806058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:54.806949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:33:54.808214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:33:54.808750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:33:54.823365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] HTTP exception thrown: Instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 could not be found. Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Request method failure captured: Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 HTTP/1.1 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlsh5fkuEjly18Ynwe52_UGIo_GGAFA7eUXXdbIpvP6lmG21Wq3aL667_vdrLcydZee6ewNk5219bCYxAJjdfkM_-ws8o26J-_7yZqbZwKzgNFnskMfc1oZxknXDtsNzy1bL6xAhuH0AkFeLiUufcZU8WGKyBcQ47QqYu80mglg1y9k Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3914ae4ecd694d7ead85824e88749b39 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBackupRestore-2144156050 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3914ae4ecd694d7ead85824e88749b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3914ae4ecd694d7ead85824e88749b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3914ae4ecd694d7ead85824e88749b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3914ae4ecd694d7ead85824e88749b39"}]}] Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBackupRestore-2144156050 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3914ae4ecd694d7ead85824e88749b39 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2144156050 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBackupRestore-2144156050-project Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 1731f53174b745b19f6b8529f8681311 Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBackupRestore-2144156050-project Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 could not be found. Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a32c42ff-6d62-4e1b-b03a-5d100cdd8676'} Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 could not be found. Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 could not be found. Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:33:54.825238 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 could not be found. Oct 24 09:33:54.829568 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:33:54.830055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Returning 404 to user: Instance a32c42ff-6d62-4e1b-b03a-5d100cdd8676 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:33:54.830980 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e33c7772-a649-4c7c-949c-7ef5db72a3e8 tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676" status: 404 len: 111 microversion: 2.1 time: 0.044515 Oct 24 09:33:54.831649 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3157/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:33:54 2022] GET /compute/v2.1/servers/a32c42ff-6d62-4e1b-b03a-5d100cdd8676 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:33:55.010111 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a6a0719-7f42-48c4-bbd1-aba75f6bfefc tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] Calling method '.version_select at 0x7f8da9bf29d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:33:55.036484 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a6a0719-7f42-48c4-bbd1-aba75f6bfefc tempest-TestVolumeBackupRestore-2144156050 tempest-TestVolumeBackupRestore-2144156050-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2131407824" status: 202 len: 0 microversion: 2.1 time: 0.031223 Oct 24 09:33:55.037413 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3329/6486] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2131407824 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:34:27.565544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-196215363", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3c47757d-ec08-4500-8d53-8c80c13042df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:34:27.578040 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:27.578710 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:27.633735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:34:28.056661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:34:28.057571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:34:28.058197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:34:28.058665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:34:28.059212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:34:28.070020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:28.070515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:28.070954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:28.071718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:28.072226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:28.072600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:28.091051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:34:28.097066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:34:28.165769 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:34:28.167869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c47757d-ec08-4500-8d53-8c80c13042df',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:34:28.334881 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f9a43b8-823e-4386-b54c-6e4a6aed6598 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773891 Oct 24 09:34:28.341587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3158/6487] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:34:28.346329 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=30 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:28.347561 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:28.361939 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9a8f943-a86f-4cff-a448-b2f76cea97db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:28.362569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9a8f943-a86f-4cff-a448-b2f76cea97db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:28.430450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9a8f943-a86f-4cff-a448-b2f76cea97db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:28.441020 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9a8f943-a86f-4cff-a448-b2f76cea97db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1056 microversion: 2.1 time: 0.096500 Oct 24 09:34:28.442052 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3330/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:28 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1056 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:29.468289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:29.469694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:29.484669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:29.485517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:29.486164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:29.486790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:29.487414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:29.488087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:29.585679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:29.601890 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab724e93-1b90-4105-8670-ba4174c49dfc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1154 microversion: 2.1 time: 0.138018 Oct 24 09:34:29.613374 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3159/6489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:29 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1154 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:30.631390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:30.631390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:30.647165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:30.647993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:30.648617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:30.650050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:30.650916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:30.651575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:30.777229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:30.793533 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a557dc1-2298-4032-886c-307d212567a9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1172 microversion: 2.1 time: 0.170919 Oct 24 09:34:30.809234 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3331/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:30 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1172 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:31.835988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:31.838752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:31.852479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:31.853216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:31.853824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:31.856554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:31.858244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:31.860501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:32.141890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:32.155797 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d3d9ffc-02c5-4ae8-80ca-cb0e844a461f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1214 microversion: 2.1 time: 0.331110 Oct 24 09:34:32.156102 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3160/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:31 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:32.369026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0884f155-91c6-481f-b2e4-e1c862ad7287 req-ab125d69-73bd-4bff-9ee3-607d645bb732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff43944-ed5e-45e3-9047-ba1f554fee9a", "tag": "67da830f-f8e1-4ce1-ac4a-e8df77b8391e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:34:32.385684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0884f155-91c6-481f-b2e4-e1c862ad7287 req-ab125d69-73bd-4bff-9ee3-607d645bb732 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:32.387115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0884f155-91c6-481f-b2e4-e1c862ad7287 req-ab125d69-73bd-4bff-9ee3-607d645bb732 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:32.387909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0884f155-91c6-481f-b2e4-e1c862ad7287 req-ab125d69-73bd-4bff-9ee3-607d645bb732 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:32.447540 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0884f155-91c6-481f-b2e4-e1c862ad7287 req-ab125d69-73bd-4bff-9ee3-607d645bb732 service nova] Creating event network-changed:67da830f-f8e1-4ce1-ac4a-e8df77b8391e for instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a on n-h1-master-1 Oct 24 09:34:32.457993 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0884f155-91c6-481f-b2e4-e1c862ad7287 req-ab125d69-73bd-4bff-9ee3-607d645bb732 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093539 Oct 24 09:34:32.459126 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3332/6492] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:34:33.194538 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:33.196633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:33.215428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:33.216146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:33.216728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:33.218217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:33.218999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:33.219251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:33.503787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:33.518924 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db9f7359-33ef-4913-bb7c-3ae60691b6ad tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1214 microversion: 2.1 time: 0.334907 Oct 24 09:34:33.520505 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3161/6493] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:33 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1214 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:34.547932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:34.549181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:34.557287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:34.558030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:34.558463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:34.559298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:34.559895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:34.560449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:34.720195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:34.739114 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e21ee3c-9f63-4da9-9ddf-a34a1ffc14a8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1214 microversion: 2.1 time: 0.196511 Oct 24 09:34:34.739994 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3333/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:34 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:35.774316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:35.775040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:35.782973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:35.783627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:35.784189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:35.784900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:35.785389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:35.785824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:35.924005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:35.931728 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b50acc61-1f01-4c0c-852d-c2102d5bc8f7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1214 microversion: 2.1 time: 0.161262 Oct 24 09:34:35.932290 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3162/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:35 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:36.954940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:36.955564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:36.962388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:36.962887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:36.963350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:36.964040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:36.964502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:36.964968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:37.096184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:37.104450 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f6d6dd2-cdd5-46cf-972f-0afe7933f8e5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.154052 Oct 24 09:34:37.105034 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3334/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:36 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:38.127837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:38.128453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:38.131156 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:38.131846 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:38.137994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:38.138477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:38.138915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:38.140243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:38.140702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:38.141129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:38.267180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:38.275471 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-102816be-f618-440f-aa18-a521e0d89887 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.152024 Oct 24 09:34:38.276080 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3163/6497] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:38 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:39.300778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:39.301436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:39.304429 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:39.310348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:39.310845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:39.311284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:39.312706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:39.313168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:39.313623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:39.454516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:39.462320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d6bfa66-41a2-4d3a-8663-29b51082ac27 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.165484 Oct 24 09:34:39.462937 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3335/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:39 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:40.484649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:40.485220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:40.492168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:40.492647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:40.493102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:40.493814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:40.494503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:40.495076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:40.657517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:40.665875 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8d80ac8-f894-4ced-9bcb-517443c3560a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.185145 Oct 24 09:34:40.666466 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3164/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:40 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:41.690763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:41.691376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:41.698159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:41.698640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:41.699165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:41.699858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:41.700311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:41.700751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:41.849747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:41.857753 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04db23a6-a93b-4c50-8fb1-fede76a3533a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.171297 Oct 24 09:34:41.859244 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3336/6500] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:41 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:42.881861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:42.882743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:42.890077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:42.890557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:42.890996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:42.891703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:42.892158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:42.892574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:43.031829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:43.039786 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6ed0197-88a4-4512-8a58-eaa20c236f97 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.161788 Oct 24 09:34:43.053465 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3165/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:42 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:44.064840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:44.066140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:44.073856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:44.074359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:44.074808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:44.075521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:44.075995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:44.076419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:44.218651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:44.228207 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c62fc517-68e8-4841-b28b-3e380c2d2307 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.167883 Oct 24 09:34:44.228993 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3337/6502] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:44 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:45.252177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:45.252900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:45.260081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:45.260567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:45.261120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:45.261847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:45.262328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:45.262761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:45.401285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:45.415335 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dfd63575-4cc2-498b-9284-fdf5d186ba48 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.167614 Oct 24 09:34:45.417474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3166/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:45 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:46.379072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e76bac7a-5e0f-4220-9405-be59e9c57c3c req-4a841f99-1d23-413a-b59b-e2d0400e8e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff43944-ed5e-45e3-9047-ba1f554fee9a", "name": "network-vif-plugged", "status": "completed", "tag": "67da830f-f8e1-4ce1-ac4a-e8df77b8391e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:34:46.392381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e76bac7a-5e0f-4220-9405-be59e9c57c3c req-4a841f99-1d23-413a-b59b-e2d0400e8e45 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:46.393105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e76bac7a-5e0f-4220-9405-be59e9c57c3c req-4a841f99-1d23-413a-b59b-e2d0400e8e45 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:46.393627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e76bac7a-5e0f-4220-9405-be59e9c57c3c req-4a841f99-1d23-413a-b59b-e2d0400e8e45 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:46.407285 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e76bac7a-5e0f-4220-9405-be59e9c57c3c req-4a841f99-1d23-413a-b59b-e2d0400e8e45 service nova] Creating event network-vif-plugged:67da830f-f8e1-4ce1-ac4a-e8df77b8391e for instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a on n-h1-master-1 Oct 24 09:34:46.413402 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e76bac7a-5e0f-4220-9405-be59e9c57c3c req-4a841f99-1d23-413a-b59b-e2d0400e8e45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043756 Oct 24 09:34:46.414549 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3338/6504] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:34:46.440939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:46.442188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:46.450131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:46.450699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:46.451371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:46.464360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:46.465131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:46.465570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:46.698414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:46.706668 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4737879f-fd39-4ffc-9a91-6aa8787c9f95 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1202 microversion: 2.1 time: 0.270501 Oct 24 09:34:46.722725 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3167/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:46 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1202 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:47.731223 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:47.731928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:47.739271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:47.739673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:47.740089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:47.740792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:47.741247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:47.741694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:47.881495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:47.889723 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fc24e76a-2041-4a09-8d1f-cb150d30a2c0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1389 microversion: 2.1 time: 0.163539 Oct 24 09:34:47.890306 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3339/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:47 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:47.912344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:47.912962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:47.920738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:47.921841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:47.922279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:47.922978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:47.923433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:47.923859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.061650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:48.067346 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e2b1c13-f197-4c52-882c-e7af221a1464 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1389 microversion: 2.1 time: 0.159150 Oct 24 09:34:48.067935 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3168/6507] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:47 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:48.088992 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:48.089632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:48.096236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:48.096717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:48.097150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.097999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:48.098419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:48.098854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.231950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:48.239921 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1671998c-7717-451b-a1b6-6c64030cb9c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1389 microversion: 2.1 time: 0.154794 Oct 24 09:34:48.240505 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3340/6508] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:48 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:48.262712 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:48.263147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:48.270552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:48.271053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:48.271494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.272209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:48.272674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:48.273106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.300420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:34:48.387275 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7645e5a3-d3fd-4207-b8a0-8f1d0f6f7517 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 204 len: 0 microversion: 2.1 time: 0.128345 Oct 24 09:34:48.388408 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3169/6509] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:34:48 2022] DELETE /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:34:48.399837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:48.400669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:48.407565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:48.408144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:48.408665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.409391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:48.409852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:48.410279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:48.551663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:48.561320 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f7ab335-04f5-40ae-85cb-08ba81652cb0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1395 microversion: 2.1 time: 0.167909 Oct 24 09:34:48.562612 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3341/6510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:48 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1395 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:49.585951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:49.586574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:49.594152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:49.594583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:49.595023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:49.595718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:49.596176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:49.596602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:49.729015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:49.737487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23519a3e-ecae-42ae-8adc-d666f094f544 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1395 microversion: 2.1 time: 0.155913 Oct 24 09:34:49.738065 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3170/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:49 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:50.483271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-961bfafc-818b-49b9-a342-e093310f390f req-2862656f-6c22-4071-8ebf-840dac34975f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff43944-ed5e-45e3-9047-ba1f554fee9a", "name": "network-vif-deleted", "tag": "67da830f-f8e1-4ce1-ac4a-e8df77b8391e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:34:50.501196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-961bfafc-818b-49b9-a342-e093310f390f req-2862656f-6c22-4071-8ebf-840dac34975f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:50.501877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-961bfafc-818b-49b9-a342-e093310f390f req-2862656f-6c22-4071-8ebf-840dac34975f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:50.502386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-961bfafc-818b-49b9-a342-e093310f390f req-2862656f-6c22-4071-8ebf-840dac34975f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:50.522342 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-961bfafc-818b-49b9-a342-e093310f390f req-2862656f-6c22-4071-8ebf-840dac34975f service nova] Creating event network-vif-deleted:67da830f-f8e1-4ce1-ac4a-e8df77b8391e for instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a on n-h1-master-1 Oct 24 09:34:50.527862 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-961bfafc-818b-49b9-a342-e093310f390f req-2862656f-6c22-4071-8ebf-840dac34975f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049684 Oct 24 09:34:50.528469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3342/6512] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:34:50.760609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:50.761346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:50.769169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:50.769777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:50.770216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:50.771146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:50.771606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:50.772044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:50.846626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:50.860743 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e52557ad-6ea0-4804-abda-3639e9c0e3ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1187 microversion: 2.1 time: 0.104464 Oct 24 09:34:50.861630 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3171/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:50 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:51.884068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:51.885035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:51.893263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:51.893917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:51.894457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:51.895421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:51.896000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:51.896527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:51.971697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:51.981083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-616aee01-d397-4636-a142-a76ae19045c6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1187 microversion: 2.1 time: 0.101387 Oct 24 09:34:51.994518 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3343/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:51 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:53.007408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:53.008409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:53.011479 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:34:53.011851 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:34:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a (ip 10.222.0.25) !!! Oct 24 09:34:53.024525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:53.025021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:53.025499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:53.026454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:53.026786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:53.027221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:53.095212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:53.103364 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8de685b3-f6ba-4c65-8aba-d5cb901f6971 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1187 microversion: 2.1 time: 0.101084 Oct 24 09:34:53.103999 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3172/6515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:53 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:54.128047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:54.129277 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:54.139154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:54.140626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:54.141236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:54.142573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:54.143195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:54.143771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:54.219576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:34:54.229001 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfc1c0c6-3404-470b-8dd6-0845b40d98cb tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 200 len: 1187 microversion: 2.1 time: 0.106281 Oct 24 09:34:54.239182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3344/6516] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:54 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 1187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:34:55.252230 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:34:55.252855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 3ff43944-ed5e-45e3-9047-ba1f554fee9a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:34:55.260811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:55.261331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:55.262118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:55.262598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:34:55.263266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:34:55.263512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:34:55.278487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a could not be found. Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a HTTP/1.1 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a could not be found. Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '3ff43944-ed5e-45e3-9047-ba1f554fee9a'} Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a could not be found. Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a could not be found. Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:34:55.280063 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a could not be found. Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 3ff43944-ed5e-45e3-9047-ba1f554fee9a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7822b87c-0a13-48a4-a459-7b4e04884080 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a" status: 404 len: 111 microversion: 2.1 time: 0.033877 Oct 24 09:34:55.288421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3173/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:34:55 2022] GET /compute/v2.1/servers/3ff43944-ed5e-45e3-9047-ba1f554fee9a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:35:00.459834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-609900938", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7ce06a62-f653-42af-b22b-2cb608b1f9f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:00.471039 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=33 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:00.524309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:35:00.903205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:35:00.903638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:35:00.904115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:35:00.904683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:35:00.905102 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:35:00.915728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:00.916258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:00.916709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:00.917485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:00.917954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:00.918390 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:00.926295 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=73 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:00.938281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:35:00.944019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:35:01.005469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:35:01.007507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ce06a62-f653-42af-b22b-2cb608b1f9f4',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:35:01.145246 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb088ad8-865b-46e9-9eff-75e2c31318a1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689664 Oct 24 09:35:01.153287 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3345/6518] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:35:01.159256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d265771a-7018-4b68-9773-190722e44792 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:01.160335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d265771a-7018-4b68-9773-190722e44792 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:01.163368 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:01.221867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d265771a-7018-4b68-9773-190722e44792 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:01.230523 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d265771a-7018-4b68-9773-190722e44792 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1056 microversion: 2.1 time: 0.076292 Oct 24 09:35:01.231888 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3174/6519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:01 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1056 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:35:02.253842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:02.254461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:02.262549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:02.263051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:02.263487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:02.264370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:02.265051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:02.265656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:02.330824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:02.340693 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4fae9c42-fc03-41c9-8b31-de30080d412b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1154 microversion: 2.1 time: 0.091620 Oct 24 09:35:02.341762 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3346/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:02 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1154 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:03.368442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:03.369984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:03.378718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:03.379955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:03.380501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:03.381465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:03.382108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:03.382726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:03.390318 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:03.671838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:03.684985 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-db5e652d-efa2-4978-a38f-db6c19f00972 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1214 microversion: 2.1 time: 0.320461 Oct 24 09:35:03.686421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3175/6521] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:03 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1214 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:04.012262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-da2b2efa-793c-4ec0-90af-a06123f9ccf7 req-fbf3be5c-7e9b-4629-bfd8-47999b7fc122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f0fbc5-3088-4bf1-ba84-be7869bfe9ed", "tag": "4518f6ff-dc8b-4ee4-b6e5-0b40b4bc35ed"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:04.024947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da2b2efa-793c-4ec0-90af-a06123f9ccf7 req-fbf3be5c-7e9b-4629-bfd8-47999b7fc122 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:04.025845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da2b2efa-793c-4ec0-90af-a06123f9ccf7 req-fbf3be5c-7e9b-4629-bfd8-47999b7fc122 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:04.026718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da2b2efa-793c-4ec0-90af-a06123f9ccf7 req-fbf3be5c-7e9b-4629-bfd8-47999b7fc122 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:04.041172 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-da2b2efa-793c-4ec0-90af-a06123f9ccf7 req-fbf3be5c-7e9b-4629-bfd8-47999b7fc122 service nova] Creating event network-changed:4518f6ff-dc8b-4ee4-b6e5-0b40b4bc35ed for instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed on n-h1-master-1 Oct 24 09:35:04.047486 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-da2b2efa-793c-4ec0-90af-a06123f9ccf7 req-fbf3be5c-7e9b-4629-bfd8-47999b7fc122 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039351 Oct 24 09:35:04.054091 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3347/6522] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:35:04.709494 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:04.710692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:04.719004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:04.719981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:04.720866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:04.722048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:04.722671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:04.723313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:04.905600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:04.914276 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a648571a-aa4c-4e4f-acdd-61fda46cf2b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1214 microversion: 2.1 time: 0.209417 Oct 24 09:35:04.930864 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3176/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:04 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:05.940070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:05.940820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:05.948898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:05.949420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:05.949868 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:05.950571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:05.951036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:05.951464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:06.092370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:06.104561 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c310ee66-dce7-4fe0-9321-9b11081cfe2a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1214 microversion: 2.1 time: 0.169090 Oct 24 09:35:06.105379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3348/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:05 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:07.128433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:07.129114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:07.136362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:07.136845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:07.137279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:07.137998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:07.138449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:07.138870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:07.292326 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:07.301214 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a922a281-0c81-4163-bc27-1b28f6ddb30d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1214 microversion: 2.1 time: 0.177172 Oct 24 09:35:07.302065 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3177/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:07 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:08.324197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:08.324812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:08.331635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:08.332129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:08.332570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:08.333277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:08.333762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:08.334464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:08.473530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:08.481370 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2be2ff25-0dc0-4f01-83b9-402f2eee4978 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.161098 Oct 24 09:35:08.481956 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3349/6526] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:08 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:09.506315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:09.506954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:09.514239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:09.514722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:09.515718 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:09.516419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:09.516871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:09.517310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:09.654600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:09.663103 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cbf01b33-4f04-4461-91a6-78ee7838ab14 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.162636 Oct 24 09:35:09.663680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3178/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:09 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:10.686916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:10.688159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:10.695068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:10.695500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:10.695933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:10.696623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:10.697073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:10.697532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:10.828064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:10.836843 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44600ee5-d60a-47a9-b813-6c04624d546d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.153777 Oct 24 09:35:10.837467 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3350/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:10 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:11.860989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:11.861625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:11.864333 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:11.870055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:11.870535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:11.870971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:11.871659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:11.872113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:11.872532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:12.026606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:12.034701 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1514180-6422-4e23-a73a-90cd00ac6e7c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.177600 Oct 24 09:35:12.035284 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3179/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:11 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:13.057644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:13.058918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:13.061957 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:13.062958 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:13.070519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:13.071182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:13.071684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:13.072608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:13.073136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:13.073646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:13.211012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:13.218878 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-17ae8a44-b18c-4a09-b514-f7fbbe722002 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.165275 Oct 24 09:35:13.219547 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3351/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:13 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:14.241914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:14.242528 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:14.249240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:14.249745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:14.250761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:14.251436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:14.251885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:14.252302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:14.409500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:14.418989 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ef05d996-3472-4a95-8d97-b548a493e3e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.180993 Oct 24 09:35:14.420078 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3180/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:14 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:15.443605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:15.444246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:15.451096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:15.451581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:15.452020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:15.452720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:15.453172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:15.453625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:15.593786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:15.603858 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d773a88e-941f-4769-82b1-38ebf99b1c86 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.164055 Oct 24 09:35:15.604704 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3352/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:15 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:16.627347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:16.627995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:16.635383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:16.635944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:16.636390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:16.637086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:16.637565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:16.637995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:16.768837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:16.776534 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-62eaa63e-6ee2-4e68-a714-d56920b428c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.153223 Oct 24 09:35:16.777108 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3181/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:16 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:17.800006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:17.800694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:17.807375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:17.807862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:17.808305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:17.809060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:17.809555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:17.810033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:17.935821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:17.944366 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a6382849-8f54-4e5c-aa59-6db737ed6f03 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.148874 Oct 24 09:35:17.944950 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3353/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:17 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:18.627357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1a89b2d8-abd4-4daa-83b4-463f172a92e1 req-a3f472ea-6961-4d32-bbb0-5baad899293a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f0fbc5-3088-4bf1-ba84-be7869bfe9ed", "name": "network-vif-plugged", "status": "completed", "tag": "4518f6ff-dc8b-4ee4-b6e5-0b40b4bc35ed"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:18.641261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a89b2d8-abd4-4daa-83b4-463f172a92e1 req-a3f472ea-6961-4d32-bbb0-5baad899293a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:18.641743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a89b2d8-abd4-4daa-83b4-463f172a92e1 req-a3f472ea-6961-4d32-bbb0-5baad899293a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:18.642173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a89b2d8-abd4-4daa-83b4-463f172a92e1 req-a3f472ea-6961-4d32-bbb0-5baad899293a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:18.653521 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1a89b2d8-abd4-4daa-83b4-463f172a92e1 req-a3f472ea-6961-4d32-bbb0-5baad899293a service nova] Creating event network-vif-plugged:4518f6ff-dc8b-4ee4-b6e5-0b40b4bc35ed for instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed on n-h1-master-1 Oct 24 09:35:18.658642 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1a89b2d8-abd4-4daa-83b4-463f172a92e1 req-a3f472ea-6961-4d32-bbb0-5baad899293a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036483 Oct 24 09:35:18.659246 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3182/6535] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:35:18.968303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:18.969542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:18.976510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:18.977002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:18.977475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:18.978193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:18.978649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:18.979077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:19.122510 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:19.130375 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a216b8b0-8718-464e-a965-7cefbf6cc18f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1202 microversion: 2.1 time: 0.165961 Oct 24 09:35:19.130955 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3354/6536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:18 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:20.155028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:20.155731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:20.161928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.162414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.162853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.163543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.163998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.164428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.296896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:20.305915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc6e78df-aaad-4777-8b5b-f14d8a8b2e0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1389 microversion: 2.1 time: 0.156043 Oct 24 09:35:20.306496 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3183/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:20 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:20.328801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:20.329466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:20.336410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.336902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.337391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.338090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.338556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.338987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.467420 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:20.475816 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86a33f0f-3c6c-4a8d-b9ed-9b6dd11ac665 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1389 microversion: 2.1 time: 0.151002 Oct 24 09:35:20.476395 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3355/6538] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:20 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:20.497226 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:20.497866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:20.504277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.504763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.505206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.505920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.506378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.506807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.640420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:20.649355 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c563f11-3514-4335-9af1-85909a139b18 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1389 microversion: 2.1 time: 0.155817 Oct 24 09:35:20.649959 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3184/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:20 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:20.675306 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:20.675813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:20.681869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.682359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.682800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.683505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.683961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.684571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.710278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:35:20.787676 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ebb9b77a-4046-48c8-ad6a-2a1b71318d9b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 204 len: 0 microversion: 2.1 time: 0.116769 Oct 24 09:35:20.788352 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3356/6540] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:35:20 2022] DELETE /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:35:20.796743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:20.797948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:20.804325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.804857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.805353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.806038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:20.806506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:20.806974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:20.942030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:20.949902 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f9b04be7-2b4d-4d3f-a49d-6af2e82eec41 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1395 microversion: 2.1 time: 0.157235 Oct 24 09:35:20.950677 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3185/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:20 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:35:21.975194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:21.975926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:21.986694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:21.987186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:21.987625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:21.988316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:21.988772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:21.989198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:22.124249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:22.132576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4593698-3d3e-493c-9c00-03d953209dab tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1395 microversion: 2.1 time: 0.161367 Oct 24 09:35:22.133009 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3357/6542] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:21 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:22.841726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c7254c21-affa-4789-bc98-876463772ccd req-7d4bbc1e-2440-4164-b7b3-99609fde09eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f0fbc5-3088-4bf1-ba84-be7869bfe9ed", "name": "network-vif-deleted", "tag": "4518f6ff-dc8b-4ee4-b6e5-0b40b4bc35ed"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:22.859347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7254c21-affa-4789-bc98-876463772ccd req-7d4bbc1e-2440-4164-b7b3-99609fde09eb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:22.859789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7254c21-affa-4789-bc98-876463772ccd req-7d4bbc1e-2440-4164-b7b3-99609fde09eb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:22.860220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c7254c21-affa-4789-bc98-876463772ccd req-7d4bbc1e-2440-4164-b7b3-99609fde09eb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:22.880786 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c7254c21-affa-4789-bc98-876463772ccd req-7d4bbc1e-2440-4164-b7b3-99609fde09eb service nova] Creating event network-vif-deleted:4518f6ff-dc8b-4ee4-b6e5-0b40b4bc35ed for instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed on n-h1-master-1 Oct 24 09:35:22.886138 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c7254c21-affa-4789-bc98-876463772ccd req-7d4bbc1e-2440-4164-b7b3-99609fde09eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048967 Oct 24 09:35:22.886957 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3186/6543] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:35:23.155628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:23.156455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:23.163654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:23.164239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:23.164782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:23.165595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:23.166133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:23.166760 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:23.244437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:23.254621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3e0f724-1aea-4ba0-b751-7853d6a85334 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1187 microversion: 2.1 time: 0.103029 Oct 24 09:35:23.255313 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3358/6544] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:23 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:24.278656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:24.279379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:24.286831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:24.287330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:24.287772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:24.288484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:24.288948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:24.289405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:24.383403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:24.393684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b4ed8dc-aff6-498a-9a0e-1aa693860625 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1187 microversion: 2.1 time: 0.119155 Oct 24 09:35:24.394712 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3187/6545] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:24 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:25.416187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:25.417251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:25.424573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:25.425140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:25.425620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:25.426371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:25.427189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:25.427804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:25.501655 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:25.509844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f1d1456-c05d-4dbb-bc77-f96788dc42f1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1187 microversion: 2.1 time: 0.097651 Oct 24 09:35:25.510421 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3359/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:25 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:26.532105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:26.544726 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:26.560562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:26.561066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:26.561550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:26.562264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:26.562731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:26.563157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:26.630884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:26.640665 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af680760-9d0e-4502-a91e-079046c97752 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 200 len: 1187 microversion: 2.1 time: 0.112403 Oct 24 09:35:26.641926 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3188/6547] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:26 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:27.668257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:27.668984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:27.676454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:27.677017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:27.677611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:27.678377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:27.678910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:27.679405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:27.694044 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed could not be found. Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed HTTP/1.1 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed could not be found. Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '66f0fbc5-3088-4bf1-ba84-be7869bfe9ed'} Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed could not be found. Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed could not be found. Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:35:27.695716 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed could not be found. Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 66f0fbc5-3088-4bf1-ba84-be7869bfe9ed could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70d7d7e1-28b4-419e-a9b2-26af3d3052a3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed" status: 404 len: 111 microversion: 2.1 time: 0.033060 Oct 24 09:35:27.703076 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3360/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:27 2022] GET /compute/v2.1/servers/66f0fbc5-3088-4bf1-ba84-be7869bfe9ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:35:45.382600 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=31 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:45.383349 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=75 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:45.573421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-178dbb38-d7c7-4991-9a9f-eac513109dd7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Action: 'create', calling method: .version_select at 0x7f8daaf75040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-989604168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjE5PcQP+/wH1q9gdjEmlrFzzO2ZvFn7envf+Etb81iXmwCwEfVWql9ndUqUGPqUFj6j2qOiWsCrrnZEYxUtJnnj0G4u9VwH2cbowahv/rW7lFEPY6rJJVkOOr1Lq7aUQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:45.589693 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-178dbb38-d7c7-4991-9a9f-eac513109dd7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Getting quotas for project 92300bfd91834591a263b1080a2dbe0d. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:35:45.595614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-178dbb38-d7c7-4991-9a9f-eac513109dd7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Getting quotas for user e46ce6c65db64efaa07525abce5420c1 and project 92300bfd91834591a263b1080a2dbe0d. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:35:45.643924 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-178dbb38-d7c7-4991-9a9f-eac513109dd7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.267227 Oct 24 09:35:45.652289 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3189/6549] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:35:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:35:51.394594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-716510250", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e197487f-8551-4499-b0b2-f977a359e3c4", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:51.421799 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:51.423682 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:51.528722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:35:51.756110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-18472421-access_point-1210237632", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "e5fb285b-ec98-4e84-93ef-0e4c815b36de"}], "key_name": "tempest-TestSecurityGroupsBasicOps-989604168", "security_groups": [{"name": "tempest-secgroup_access--205476751"}, {"name": "tempest-secgroup_general--189020659"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:51.914795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] validate_networks() for [('e5fb285b-ec98-4e84-93ef-0e4c815b36de', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:35:51.958422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:35:51.958852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:35:51.959507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:35:51.959931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:35:51.960349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:35:51.970581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:51.971123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:51.971745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:51.972493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:51.972961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:51.973595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:51.994672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:35:52.000565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:35:52.015594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:35:52.018024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e197487f-8551-4499-b0b2-f977a359e3c4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:35:52.100182 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4665dff5-3d72-4924-8c0c-d4248262aad9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710625 Oct 24 09:35:52.101499 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3361/6550] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:35:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:35:52.113806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44dedd07-5149-44a0-85fe-aee4adf2ad87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:52.114714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44dedd07-5149-44a0-85fe-aee4adf2ad87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:52.175253 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44dedd07-5149-44a0-85fe-aee4adf2ad87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:52.183547 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44dedd07-5149-44a0-85fe-aee4adf2ad87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1056 microversion: 2.1 time: 0.074814 Oct 24 09:35:52.199778 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3362/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:52 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1056 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:35:52.363651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:35:52.364705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:35:52.365189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:35:52.366038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:35:52.366526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:35:52.376530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:52.377160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:52.377508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:52.378244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:52.379072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:52.379514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:52.399485 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Getting quotas for project 92300bfd91834591a263b1080a2dbe0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:35:52.405466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Getting quotas for user e46ce6c65db64efaa07525abce5420c1 and project 92300bfd91834591a263b1080a2dbe0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:35:52.419216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:35:52.421257 n-d-master-1 devstack@n-api.service[126919]: WARNING nova.utils [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-18472421-access_point-1210237632 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-18472421-acce Oct 24 09:35:52.422307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:35:52.478258 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44920a3c-1f7c-472e-bc66-9a01a4a676df tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.728268 Oct 24 09:35:52.479241 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3190/6552] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:35:51 2022] POST /compute/v2.1/servers => generated 456 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:35:52.491327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb4b4810-0555-4468-a8dc-d266af663c36 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:52.492608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb4b4810-0555-4468-a8dc-d266af663c36 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:52.576820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb4b4810-0555-4468-a8dc-d266af663c36 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:52.585211 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb4b4810-0555-4468-a8dc-d266af663c36 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1292 microversion: 2.1 time: 0.098289 Oct 24 09:35:52.587450 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3363/6553] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:52 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:53.219792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:53.222217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:53.238260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:53.238881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:53.239545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:53.240386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:53.240850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:53.241406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:53.327938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:53.337862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-764ab72b-084a-4039-91a7-625689192905 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1108 microversion: 2.1 time: 0.127080 Oct 24 09:35:53.338638 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3191/6554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:53 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1108 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:53.619154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:53.620599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:53.640915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:53.642753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:53.645854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:53.646958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:53.650025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:53.650508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:53.726408 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:53.735359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3738a571-ae4d-4540-8f2f-18a8dbcbbf56 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1344 microversion: 2.1 time: 0.128954 Oct 24 09:35:53.736557 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3364/6555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:53 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:54.362192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:54.362817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:54.400936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:54.405984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:54.406407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:54.409236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:54.409892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:54.412104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:54.762100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:54.762615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:54.770068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:54.775986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:54.776484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:54.776916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:54.777832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:54.779571 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a77e1a41-769c-4b38-a378-0847adfb7ef4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.421319 Oct 24 09:35:54.780705 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3192/6556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:54 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:54.781994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:54.783541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:54.904050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:54.916246 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f65909c8-3371-4042-996f-92d0f7bbb1ae tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1350 microversion: 2.1 time: 0.158243 Oct 24 09:35:54.930547 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3365/6557] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:54 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:55.754567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-908d24f4-56d8-4a33-adb1-c18de34aac59 req-af78ed24-4aff-4e87-ac44-c27d2f3d1d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39af215e-60a7-4d1e-b696-7ad8c6576f81", "tag": "b3938251-b5fa-44c6-938d-b5a7e1e8c8de"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:55.779509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-908d24f4-56d8-4a33-adb1-c18de34aac59 req-af78ed24-4aff-4e87-ac44-c27d2f3d1d27 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:55.780692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-908d24f4-56d8-4a33-adb1-c18de34aac59 req-af78ed24-4aff-4e87-ac44-c27d2f3d1d27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:55.781602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-908d24f4-56d8-4a33-adb1-c18de34aac59 req-af78ed24-4aff-4e87-ac44-c27d2f3d1d27 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:55.793717 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-908d24f4-56d8-4a33-adb1-c18de34aac59 req-af78ed24-4aff-4e87-ac44-c27d2f3d1d27 service nova] Creating event network-changed:b3938251-b5fa-44c6-938d-b5a7e1e8c8de for instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 on n-h1-master-1 Oct 24 09:35:55.804235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:55.804898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:55.812044 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-908d24f4-56d8-4a33-adb1-c18de34aac59 req-af78ed24-4aff-4e87-ac44-c27d2f3d1d27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062413 Oct 24 09:35:55.816534 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3193/6558] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:35:55.817155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:55.818016 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:55.818660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:55.820293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:55.820971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:55.821448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:55.945462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:55.947730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:55.955568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:55.956352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:55.957447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:55.958509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:55.959169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:55.959797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:56.065743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:56.074157 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7ee0e83-2b84-4fc7-8545-dfd363379c12 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.274073 Oct 24 09:35:56.090460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3366/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:55 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:35:56.216918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-35f8562a-f83a-48a5-9106-485c7fafe043 req-594e327e-da55-4a48-b659-62d89046b374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaeb0db9-cace-411f-821f-9a6503521773", "tag": "1b413b0c-0ea6-4867-89db-8c03c7dd385f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:35:56.228784 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:56.231432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-35f8562a-f83a-48a5-9106-485c7fafe043 req-594e327e-da55-4a48-b659-62d89046b374 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:56.231987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-35f8562a-f83a-48a5-9106-485c7fafe043 req-594e327e-da55-4a48-b659-62d89046b374 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:56.232433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-35f8562a-f83a-48a5-9106-485c7fafe043 req-594e327e-da55-4a48-b659-62d89046b374 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:56.253031 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-35f8562a-f83a-48a5-9106-485c7fafe043 req-594e327e-da55-4a48-b659-62d89046b374 service nova] Creating event network-changed:1b413b0c-0ea6-4867-89db-8c03c7dd385f for instance aaeb0db9-cace-411f-821f-9a6503521773 on n-h1-master-1 Oct 24 09:35:56.259826 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed86f0a3-e30c-4c81-bbc9-a5de0840c8c2 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.315111 Oct 24 09:35:56.264341 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-35f8562a-f83a-48a5-9106-485c7fafe043 req-594e327e-da55-4a48-b659-62d89046b374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051876 Oct 24 09:35:56.265230 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3367/6560] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:35:56.270071 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3194/6561] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:55 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:57.100113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:57.100736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:57.107753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:57.108234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:57.108676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:57.109384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:57.109840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:57.110260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:57.244863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:57.252702 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcf5b3bf-c92e-4894-95ad-6a4a460cf580 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.157694 Oct 24 09:35:57.253272 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3368/6562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:57 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:57.284397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:57.285039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:57.291932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:57.292413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:57.292847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:57.293569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:57.294023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:57.294452 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:57.452846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:57.475542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a4ec3bc-e0ce-4671-ac35-eb8105658010 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.192580 Oct 24 09:35:57.477046 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3195/6563] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:57 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:58.276810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:58.277572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:58.285271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:58.285795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:58.286241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:58.286945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:58.288174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:58.288174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:58.451712 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:58.461399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-699c5097-2c27-4627-859c-b7abbc52f158 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.188456 Oct 24 09:35:58.462387 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3369/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:58 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:58.506774 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:58.509147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:58.525177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:58.526466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:58.527260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:58.529139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:58.530205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:58.530883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:58.746869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:58.756105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c316e734-0ae0-48cc-ac30-2d5917e24065 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.259150 Oct 24 09:35:58.756691 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3196/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:58 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:59.490313 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:59.491570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:59.502063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:59.502556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:59.502991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:59.503696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:59.504167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:59.504579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:59.674795 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:59.686224 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-440254f6-213f-4808-927c-3a817b3582b2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.203333 Oct 24 09:35:59.687603 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3370/6566] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:59 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:35:59.781688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:35:59.782311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:35:59.789644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:59.790477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:59.790917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:59.791758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:35:59.792459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:35:59.793243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:35:59.953684 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:35:59.969627 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5013a88-d214-4c5e-8b5e-8f91d461d9d6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.189895 Oct 24 09:35:59.971069 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3197/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:35:59 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:00.712630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:00.714225 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:00.725234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:00.725234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:00.725234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:00.725234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:00.725234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:00.728779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:00.866727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:00.874947 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe73d3ac-25da-42bf-9654-6bc20168f837 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.166163 Oct 24 09:36:00.875522 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3371/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:00 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:00.995012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:00.995777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:01.004251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:01.004906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:01.005616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:01.006555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:01.007731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:01.007731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:01.186816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:01.195320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c981178-af49-4aa0-af32-57692d2758e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.204221 Oct 24 09:36:01.196077 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3198/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:00 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:01.899605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:01.900262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:01.907124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:01.908201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:01.908663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:01.909404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:01.909982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:01.910414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:01.983473 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:02.048278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:02.056580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b246edc3-b20a-4dcf-8d25-27d2dcac3cd3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.160916 Oct 24 09:36:02.057487 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3372/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:01 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:02.218581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:02.219202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:02.226117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:02.226600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:02.227040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:02.227735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:02.228193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:02.228624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:02.366634 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:02.374377 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e58ea8a7-bc86-4f19-b575-4d20262b4050 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.159721 Oct 24 09:36:02.374952 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3199/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:02 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:02.658943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a547ad6c-22ea-4286-865b-0a9e413b1566 req-0d953cd6-0a91-4764-b7e7-f3f1a29f4742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaeb0db9-cace-411f-821f-9a6503521773", "name": "network-vif-plugged", "status": "completed", "tag": "1b413b0c-0ea6-4867-89db-8c03c7dd385f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:02.663804 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:02.670771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a547ad6c-22ea-4286-865b-0a9e413b1566 req-0d953cd6-0a91-4764-b7e7-f3f1a29f4742 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:02.671379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a547ad6c-22ea-4286-865b-0a9e413b1566 req-0d953cd6-0a91-4764-b7e7-f3f1a29f4742 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:02.671818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a547ad6c-22ea-4286-865b-0a9e413b1566 req-0d953cd6-0a91-4764-b7e7-f3f1a29f4742 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:02.683873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a547ad6c-22ea-4286-865b-0a9e413b1566 req-0d953cd6-0a91-4764-b7e7-f3f1a29f4742 service nova] Creating event network-vif-plugged:1b413b0c-0ea6-4867-89db-8c03c7dd385f for instance aaeb0db9-cace-411f-821f-9a6503521773 on n-h1-master-1 Oct 24 09:36:02.689520 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a547ad6c-22ea-4286-865b-0a9e413b1566 req-0d953cd6-0a91-4764-b7e7-f3f1a29f4742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Oct 24 09:36:02.690156 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3373/6572] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:03.080492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:03.081392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:03.083387 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:03.084061 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:03.090198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:03.090684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:03.091123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:03.091845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:03.092306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:03.092736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:03.228071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:03.235656 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5b285a8-f200-4831-8455-fb1daa040407 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.159773 Oct 24 09:36:03.236242 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3200/6573] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:03 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:03.399792 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:03.400508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:03.406690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:03.407177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:03.407656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:03.408881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:03.409372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:03.409808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:03.550178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:03.557877 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-febcb192-62d7-4a5c-bf59-0b5619b837fa tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1468 microversion: 2.1 time: 0.163235 Oct 24 09:36:03.558446 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3374/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:03 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:04.258950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:04.259561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:04.266683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.267164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.267596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.268283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.268735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.269157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.401345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:04.409628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ff70c1a0-ec45-4243-aac0-00364e836930 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.154695 Oct 24 09:36:04.410296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3201/6575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:04 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:04.580352 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:04.581141 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:04.588321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.589702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.590142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.590842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.591304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.591737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.733800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:04.741984 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c090e65-c518-4938-a226-0ae897dc7e87 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1639 microversion: 2.1 time: 0.165406 Oct 24 09:36:04.742585 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3375/6576] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:04 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1639 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:04.764799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:04.765481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:04.772131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.772624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.773060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.773994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.774453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.774881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.916089 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:04.924118 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76fb8f79-6e4c-4330-b191-68f04e0871ad tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1639 microversion: 2.1 time: 0.163550 Oct 24 09:36:04.924646 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3202/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:04 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1639 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:04.946148 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:04.946773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:04.952806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.953308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.953764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:04.954958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:04.955439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:04.955872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:05.192665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-546e8b68-26b4-45c9-9669-01eb2b4c40ca tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1790 microversion: 2.1 time: 0.250149 Oct 24 09:36:05.193333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3376/6578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:04 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1790 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:05.432992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:05.434097 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:05.441505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:05.442121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:05.442660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:05.443632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:05.444293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:05.444823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:05.666937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:05.675646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5dc56ae-d621-4fc4-8fdb-6a038299bde1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.246608 Oct 24 09:36:05.676236 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3203/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:05 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:06.699190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:06.700028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:06.707589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:06.708178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:06.708692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:06.709535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:06.710111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:06.710671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:06.843056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:06.851326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4bfac022-7598-49a7-bbfc-6cc7d6df86d7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.156085 Oct 24 09:36:06.852069 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3377/6580] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:06 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:06.939591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4760c58c-0fb4-4fb8-a999-fce99d6ad8d5 req-b5b82f92-ab5e-45b7-b746-9fc2422fe790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaeb0db9-cace-411f-821f-9a6503521773", "tag": "1b413b0c-0ea6-4867-89db-8c03c7dd385f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:06.950163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4760c58c-0fb4-4fb8-a999-fce99d6ad8d5 req-b5b82f92-ab5e-45b7-b746-9fc2422fe790 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:06.950911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4760c58c-0fb4-4fb8-a999-fce99d6ad8d5 req-b5b82f92-ab5e-45b7-b746-9fc2422fe790 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:06.951499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4760c58c-0fb4-4fb8-a999-fce99d6ad8d5 req-b5b82f92-ab5e-45b7-b746-9fc2422fe790 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:06.970679 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4760c58c-0fb4-4fb8-a999-fce99d6ad8d5 req-b5b82f92-ab5e-45b7-b746-9fc2422fe790 service nova] Creating event network-changed:1b413b0c-0ea6-4867-89db-8c03c7dd385f for instance aaeb0db9-cace-411f-821f-9a6503521773 on n-h1-master-1 Oct 24 09:36:06.976002 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4760c58c-0fb4-4fb8-a999-fce99d6ad8d5 req-b5b82f92-ab5e-45b7-b746-9fc2422fe790 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040706 Oct 24 09:36:06.980569 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3204/6581] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:07.873946 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:07.875151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:07.892553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:07.896594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:07.904015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:07.909524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:07.910217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:07.910677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:08.093518 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:08.104560 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d5f7f37-3a3b-485b-a6e7-d0d34cdaf10c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1168 microversion: 2.1 time: 0.234813 Oct 24 09:36:08.105821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3378/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:07 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:09.134530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:09.135116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:09.142612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:09.143109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:09.143544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:09.144258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:09.144715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:09.145140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:09.278863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:09.286638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-348f0796-26cd-4883-af8f-6996c059b228 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1214 microversion: 2.1 time: 0.157717 Oct 24 09:36:09.287208 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3205/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:09 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:10.309796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:10.310417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:10.317169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:10.317689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:10.318133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:10.318822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:10.319279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:10.319707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:10.452074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:10.459738 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f0f627f-0926-4197-a5aa-d9b7f0afe818 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.153779 Oct 24 09:36:10.460329 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3379/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:10 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:11.482796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:11.483427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:11.490895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:11.491384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:11.491825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:11.492522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:11.492981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:11.493476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:11.619281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:11.626889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a1628c8-ce63-458c-8f71-d354fe3d5485 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.148134 Oct 24 09:36:11.627465 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3206/6585] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:11 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:12.650407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:12.651020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:12.657889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:12.658370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:12.658802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:12.659483 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:12.659935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:12.660354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:12.789726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:12.797965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd8ac3e7-5640-43a2-8434-72a4169fad39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.151236 Oct 24 09:36:12.798843 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3380/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:12 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:13.822152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:13.822761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:13.829975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:13.830454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:13.830883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:13.831573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:13.832026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:13.832449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:13.962445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:13.970230 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0cf611cd-d3b6-4945-a0d6-846db3aa533b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.152586 Oct 24 09:36:13.970798 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3207/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:13 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:14.993158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:14.993829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:15.000609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:15.001092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:15.001624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:15.002310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:15.002763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:15.003191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:15.022511 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:15.138476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:15.146243 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4c04988-78b0-4b09-8ab4-de5ab668d646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.156882 Oct 24 09:36:15.146819 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3381/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:14 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:16.168503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:16.169123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:16.172005 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:16.177157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:16.177678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:16.178117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:16.179461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:16.179921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:16.180351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:16.183663 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:16.312332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:16.320027 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1202d529-792c-46a4-9b80-f0d25a3e4ee7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.155459 Oct 24 09:36:16.320636 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3208/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:16 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:17.342780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:17.343393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:17.350850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:17.351331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:17.351770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:17.352458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:17.352918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:17.353371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:17.480378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:17.488054 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21095002-6fc6-4c33-81d1-92477ce0bc73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.149079 Oct 24 09:36:17.488651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3382/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:17 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:18.511637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:18.512147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:18.518930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:18.519407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:18.519841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:18.520523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:18.520971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:18.521486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:18.654895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:18.663319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-583f1d69-70e4-45ed-87cb-b44495a65aca tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.155408 Oct 24 09:36:18.664104 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3209/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:18 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:19.685937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:19.686584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:19.693439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:19.694420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:19.694862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:19.695556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:19.696013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:19.696442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:19.822436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:19.830180 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7caa483-448f-46e6-b535-6c4a9f213aff tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.148152 Oct 24 09:36:19.830750 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3383/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:19 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:20.772735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ff362f70-52b5-45c5-bdef-e91c7945b711 req-4b62cf63-46da-45ba-a875-a267a8a04ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39af215e-60a7-4d1e-b696-7ad8c6576f81", "name": "network-vif-plugged", "status": "completed", "tag": "b3938251-b5fa-44c6-938d-b5a7e1e8c8de"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:20.783043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ff362f70-52b5-45c5-bdef-e91c7945b711 req-4b62cf63-46da-45ba-a875-a267a8a04ce3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:20.783533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ff362f70-52b5-45c5-bdef-e91c7945b711 req-4b62cf63-46da-45ba-a875-a267a8a04ce3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:20.784048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ff362f70-52b5-45c5-bdef-e91c7945b711 req-4b62cf63-46da-45ba-a875-a267a8a04ce3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:20.795152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ff362f70-52b5-45c5-bdef-e91c7945b711 req-4b62cf63-46da-45ba-a875-a267a8a04ce3 service nova] Creating event network-vif-plugged:b3938251-b5fa-44c6-938d-b5a7e1e8c8de for instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 on n-h1-master-1 Oct 24 09:36:20.800115 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ff362f70-52b5-45c5-bdef-e91c7945b711 req-4b62cf63-46da-45ba-a875-a267a8a04ce3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031181 Oct 24 09:36:20.800772 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3210/6593] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:20.855200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:20.856214 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:20.863033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:20.863518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:20.863961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:20.865396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:20.866815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:20.867231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:21.057799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:21.065730 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2e8a9f8-04a4-4e71-90a4-4ad92680de0b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1202 microversion: 2.1 time: 0.217146 Oct 24 09:36:21.066307 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3384/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:20 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1202 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:22.089987 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:22.090691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:22.096841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.097346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.097789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.098477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.098931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.099356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.231934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:22.239923 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4f2d147f-d887-4304-bab4-642888a40413 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1390 microversion: 2.1 time: 0.155008 Oct 24 09:36:22.240509 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3211/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:22 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:22.263247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:22.263797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:22.266518 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:22.271802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.272794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.273231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.273952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.274413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.274844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.470675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:22.479106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1f6f8c4-c073-4f91-91f7-49598ff92bcd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1390 microversion: 2.1 time: 0.220173 Oct 24 09:36:22.479700 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3385/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:22 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:22.500940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:22.501581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:22.507518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.507997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.508436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.509123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.509610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.510037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.636971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:22.644705 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba3d44e2-75b0-40d4-a221-401d807d4e1a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1390 microversion: 2.1 time: 0.147873 Oct 24 09:36:22.645278 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3212/6597] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:22 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1390 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:22.723810 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:22.724318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:22.730500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.730990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.731433 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.732125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.732586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.733017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.757561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:36:22.831114 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9bc8c620-4fef-48cd-bf14-99b4fec333e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 204 len: 0 microversion: 2.1 time: 0.110807 Oct 24 09:36:22.831797 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3386/6598] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:36:22 2022] DELETE /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:36:22.840583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:22.841136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:22.847200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.847688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.848130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:22.848826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:22.849287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:22.849750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:23.287640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:23.295439 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cf320e4-72b1-45e9-8f7d-876d7b78f211 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1396 microversion: 2.1 time: 0.458806 Oct 24 09:36:23.296010 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3213/6599] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:22 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1396 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:24.320373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:24.321076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:24.323915 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:36:24.324044 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 (ip 10.222.0.25) !!! Oct 24 09:36:24.330790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:24.331273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:24.331712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:24.332417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:24.332859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:24.333285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:24.463796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:24.471502 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3dffd6b-c836-47f7-ab29-eb86419e8afe tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1396 microversion: 2.1 time: 0.155894 Oct 24 09:36:24.472079 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3387/6600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:24 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1396 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:36:25.054757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cb1e632b-6125-4699-adb3-51139036b6ab req-3c8baf21-8f67-4f74-a14c-04b48e58f398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39af215e-60a7-4d1e-b696-7ad8c6576f81", "name": "network-vif-deleted", "tag": "b3938251-b5fa-44c6-938d-b5a7e1e8c8de"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:25.066930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb1e632b-6125-4699-adb3-51139036b6ab req-3c8baf21-8f67-4f74-a14c-04b48e58f398 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:25.067486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb1e632b-6125-4699-adb3-51139036b6ab req-3c8baf21-8f67-4f74-a14c-04b48e58f398 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:25.067914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb1e632b-6125-4699-adb3-51139036b6ab req-3c8baf21-8f67-4f74-a14c-04b48e58f398 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:25.080920 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cb1e632b-6125-4699-adb3-51139036b6ab req-3c8baf21-8f67-4f74-a14c-04b48e58f398 service nova] Creating event network-vif-deleted:b3938251-b5fa-44c6-938d-b5a7e1e8c8de for instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 on n-h1-master-1 Oct 24 09:36:25.086206 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cb1e632b-6125-4699-adb3-51139036b6ab req-3c8baf21-8f67-4f74-a14c-04b48e58f398 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035618 Oct 24 09:36:25.087212 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3214/6601] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:25.494513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:25.495126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:25.501958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:25.502438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:25.502871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:25.503554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:25.504005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:25.504427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:25.567505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:25.575398 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a69b010-274e-4257-8d6d-bd0fa0042e21 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1187 microversion: 2.1 time: 0.084789 Oct 24 09:36:25.575976 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3388/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:25 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:26.599083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:26.599872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:26.608161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:26.608535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:26.608981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:26.609706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:26.610174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:26.610601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:26.680776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:26.689269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3df1b835-9b68-4bbf-84c4-ac15eb38d779 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1187 microversion: 2.1 time: 0.094733 Oct 24 09:36:26.689906 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3215/6603] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:26 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:27.711509 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:27.712129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:27.719116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:27.719608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:27.720051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:27.720795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:27.721217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:27.721674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:27.783447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:27.791155 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0146157d-73f8-45aa-813a-522bd3c2c316 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1187 microversion: 2.1 time: 0.083568 Oct 24 09:36:27.791723 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3389/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:27 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:28.814408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:28.815029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:28.822092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:28.822588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:28.823025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:28.823727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:28.824187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:28.824621 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:28.889937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:28.897864 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46da43d9-b787-441e-957d-baf3c67720d9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 200 len: 1187 microversion: 2.1 time: 0.087429 Oct 24 09:36:28.898459 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3216/6605] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:28 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:29.920819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:29.921480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:29.929178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:29.929706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:29.930165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:29.930871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:29.931341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:29.931776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:29.947043 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 HTTP/1.1 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '39af215e-60a7-4d1e-b696-7ad8c6576f81'} Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:36:29.948744 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b92874bf-444f-46b4-b9b9-f6cc531b4d94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 404 len: 111 microversion: 2.1 time: 0.033550 Oct 24 09:36:29.952638 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3390/6606] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:29 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:36:32.094348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:32.095018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:32.103948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:32.104428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:32.104859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:32.105577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:32.106029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:32.106450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:32.119920 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 HTTP/1.1 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '39af215e-60a7-4d1e-b696-7ad8c6576f81'} Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:36:32.121758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b5a8aed6-7116-479d-8c52-c878735ceccc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 404 len: 111 microversion: 2.1 time: 0.033013 Oct 24 09:36:32.125363 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3217/6607] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:36:32 2022] DELETE /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:36:32.131884 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:32.132501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 39af215e-60a7-4d1e-b696-7ad8c6576f81] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:32.139333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:32.139813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:32.140246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:32.141129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:32.141679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:32.147928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:32.161672 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 HTTP/1.1 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '39af215e-60a7-4d1e-b696-7ad8c6576f81'} Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:36:32.163835 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 39af215e-60a7-4d1e-b696-7ad8c6576f81 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7df413f-8bf8-4a4d-b326-0a9b34323e24 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81" status: 404 len: 111 microversion: 2.1 time: 0.037208 Oct 24 09:36:32.168070 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3391/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:32 2022] GET /compute/v2.1/servers/39af215e-60a7-4d1e-b696-7ad8c6576f81 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:36:47.386736 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=19 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:47.387758 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=47 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:47.392163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1917675991", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "c1ca3b55-84aa-4a56-9af2-0c5e21a81fdc"}], "key_name": "tempest-TestSecurityGroupsBasicOps-989604168", "security_groups": []}, "os:scheduler_hints": {"different_host": ["aaeb0db9-cace-411f-821f-9a6503521773"]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:47.615879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] validate_networks() for [('c1ca3b55-84aa-4a56-9af2-0c5e21a81fdc', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:36:48.124853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:36:48.125609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:36:48.126232 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:36:48.126751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:36:48.127427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:36:48.141576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:48.145805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:48.145805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:48.146563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:48.147045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:48.147486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:48.168196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Getting quotas for project 92300bfd91834591a263b1080a2dbe0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:36:48.173611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Getting quotas for user e46ce6c65db64efaa07525abce5420c1 and project 92300bfd91834591a263b1080a2dbe0d. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:36:48.198013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:36:48.200595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:36:48.251601 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38487c50-54c8-40d1-aa01-cbf15b0868ee tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.868208 Oct 24 09:36:48.252891 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3218/6609] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:36:47 2022] POST /compute/v2.1/servers => generated 361 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:36:48.264616 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ccf95f19-ba4d-4252-8680-fcb695163617 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:48.265889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ccf95f19-ba4d-4252-8680-fcb695163617 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:48.273330 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:48.276220 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:48.345606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccf95f19-ba4d-4252-8680-fcb695163617 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:48.357996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ccf95f19-ba4d-4252-8680-fcb695163617 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1241 microversion: 2.1 time: 0.097569 Oct 24 09:36:48.359179 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3392/6610] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:48 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:49.382527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:49.384625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:49.393722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:49.394385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:49.395172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:49.396454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:49.397071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:49.397865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:49.518979 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:49.540887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-313fd2ca-dedf-4733-a5c5-717692154e15 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1293 microversion: 2.1 time: 0.162090 Oct 24 09:36:49.541693 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3219/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:49 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:50.566041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:50.566851 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:50.576833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:50.577445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:50.578211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:50.579137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:50.579765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:50.580346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:51.043637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:51.059600 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-038897ee-bf11-4e7f-bfb4-10f41c06e265 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1299 microversion: 2.1 time: 0.497381 Oct 24 09:36:51.060852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3393/6612] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:50 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1299 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:51.265088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-12a9fd0b-d538-4802-8d51-9054dc1c2cdf req-7055a1e7-8076-416e-8a79-4650e34aa95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba", "tag": "7f7c1e1c-6d9b-4067-9e3c-1adabec987d7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:51.285453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-12a9fd0b-d538-4802-8d51-9054dc1c2cdf req-7055a1e7-8076-416e-8a79-4650e34aa95b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:51.285942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-12a9fd0b-d538-4802-8d51-9054dc1c2cdf req-7055a1e7-8076-416e-8a79-4650e34aa95b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:51.286539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-12a9fd0b-d538-4802-8d51-9054dc1c2cdf req-7055a1e7-8076-416e-8a79-4650e34aa95b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:51.300724 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-12a9fd0b-d538-4802-8d51-9054dc1c2cdf req-7055a1e7-8076-416e-8a79-4650e34aa95b service nova] Creating event network-changed:7f7c1e1c-6d9b-4067-9e3c-1adabec987d7 for instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba on n-h2-master-1 Oct 24 09:36:51.307616 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-12a9fd0b-d538-4802-8d51-9054dc1c2cdf req-7055a1e7-8076-416e-8a79-4650e34aa95b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047003 Oct 24 09:36:51.309042 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3220/6613] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:52.086071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:52.087703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:52.095458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:52.096081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:52.096780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:52.097956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:52.098681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:52.099146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:52.190217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:52.198818 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9c59805-3aee-43d5-9138-003186236976 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1299 microversion: 2.1 time: 0.118690 Oct 24 09:36:52.199379 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3394/6614] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:52 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:53.224060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:53.224741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:53.240924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:53.241443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:53.242086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:53.243231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:53.243682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:53.244270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:53.331457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:53.340419 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e37d5987-7da7-4f96-a2a9-023779982ca1 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1299 microversion: 2.1 time: 0.121580 Oct 24 09:36:53.341149 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3221/6615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:53 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:54.363125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:54.363859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:54.370780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:54.371265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:54.371699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:54.372396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:54.372857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:54.373282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:54.445509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1072154091", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c54a28bd-8c72-45d6-b514-5b1e7076ae7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:54.460231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:54.468666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f94c56d-5520-483d-8ec3-131bfdf4df1c tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1299 microversion: 2.1 time: 0.109584 Oct 24 09:36:54.469236 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3395/6616] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:54 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:54.513118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:36:54.876267 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:36:54.876691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:36:54.877200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:36:54.877633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:36:54.878047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:36:54.887656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:54.888141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:54.888579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:54.889320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:54.889790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:54.890219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:54.907238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:36:54.912459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:36:54.969695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:36:54.971852 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c54a28bd-8c72-45d6-b514-5b1e7076ae7c',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:36:55.099660 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3a718d3-0bdd-44f6-b690-23fe2a5d904c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659714 Oct 24 09:36:55.100301 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3222/6617] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 09:36:55.112129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dec9c801-4c5f-4c9a-b47a-1717a1ed2f65 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:55.112844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dec9c801-4c5f-4c9a-b47a-1717a1ed2f65 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:55.167720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dec9c801-4c5f-4c9a-b47a-1717a1ed2f65 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:55.175897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dec9c801-4c5f-4c9a-b47a-1717a1ed2f65 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1071 microversion: 2.1 time: 0.068010 Oct 24 09:36:55.176676 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3396/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:55 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1071 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:55.332500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-257839aa-81db-48ad-adb1-47cccdefd411 req-b1f8d65d-2859-4eae-9d13-3ddcae65666b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba", "name": "network-vif-plugged", "status": "completed", "tag": "7f7c1e1c-6d9b-4067-9e3c-1adabec987d7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:55.342516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-257839aa-81db-48ad-adb1-47cccdefd411 req-b1f8d65d-2859-4eae-9d13-3ddcae65666b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:55.342995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-257839aa-81db-48ad-adb1-47cccdefd411 req-b1f8d65d-2859-4eae-9d13-3ddcae65666b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:55.343683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-257839aa-81db-48ad-adb1-47cccdefd411 req-b1f8d65d-2859-4eae-9d13-3ddcae65666b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:55.356100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-257839aa-81db-48ad-adb1-47cccdefd411 req-b1f8d65d-2859-4eae-9d13-3ddcae65666b service nova] Creating event network-vif-plugged:7f7c1e1c-6d9b-4067-9e3c-1adabec987d7 for instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba on n-h2-master-1 Oct 24 09:36:55.361216 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-257839aa-81db-48ad-adb1-47cccdefd411 req-b1f8d65d-2859-4eae-9d13-3ddcae65666b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Oct 24 09:36:55.362084 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3223/6619] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:55.492430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:55.493463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:55.501874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:55.502596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:55.503194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:55.504093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:55.504653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:55.505091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:55.587614 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:55.595585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f65e740-f593-47ad-9442-870e333139a7 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1299 microversion: 2.1 time: 0.107303 Oct 24 09:36:55.596160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3397/6620] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:55 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:56.200501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:56.201194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:56.208659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:56.209377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:56.209965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:56.210958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:56.211420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:56.211841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:56.283879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:56.292162 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-32e919f8-0f7e-4108-9f0c-01749adea937 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1177 microversion: 2.1 time: 0.096821 Oct 24 09:36:56.292754 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3224/6621] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:56 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1177 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:56.619547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:56.625794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:56.638455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:56.639066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:56.639616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:56.640431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:56.640998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:56.641584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:56.753173 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:56.761967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c056ed64-bcad-4cf4-9987-e8de701b3550 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1299 microversion: 2.1 time: 0.146314 Oct 24 09:36:56.763162 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3398/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:56 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:57.316260 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:57.317479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:57.324683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.325261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.325805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:57.326692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.327221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.327722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:57.477586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:57.487225 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ecf9dd0-bb7a-4161-ab3b-2f623c24a543 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1229 microversion: 2.1 time: 0.175181 Oct 24 09:36:57.488354 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3225/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:57 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1229 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:57.630827 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-08e4a1e7-a2e0-41f9-8293-a9a121bc3c88 req-1fef6735-5a21-466e-b3a4-128d48ebbd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d6b9c8-105e-47c0-abbb-b420133589fc", "tag": "c628bc9e-6636-4d37-a718-1f4b6704ba64"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:36:57.642196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-08e4a1e7-a2e0-41f9-8293-a9a121bc3c88 req-1fef6735-5a21-466e-b3a4-128d48ebbd59 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.643045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-08e4a1e7-a2e0-41f9-8293-a9a121bc3c88 req-1fef6735-5a21-466e-b3a4-128d48ebbd59 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.643788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-08e4a1e7-a2e0-41f9-8293-a9a121bc3c88 req-1fef6735-5a21-466e-b3a4-128d48ebbd59 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:57.656841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-08e4a1e7-a2e0-41f9-8293-a9a121bc3c88 req-1fef6735-5a21-466e-b3a4-128d48ebbd59 service nova] Creating event network-changed:c628bc9e-6636-4d37-a718-1f4b6704ba64 for instance a6d6b9c8-105e-47c0-abbb-b420133589fc on n-h1-master-1 Oct 24 09:36:57.683291 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-08e4a1e7-a2e0-41f9-8293-a9a121bc3c88 req-1fef6735-5a21-466e-b3a4-128d48ebbd59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056418 Oct 24 09:36:57.683922 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3399/6624] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:36:57.786460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:57.787282 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:57.794304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.794804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.795250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:57.795962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.796649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.797087 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:57.885451 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:57.894369 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5656e4c9-538b-4468-aaa7-92e68b5bbb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1472 microversion: 2.1 time: 0.112292 Oct 24 09:36:57.895031 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3226/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:57 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1472 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:57.917850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:57.918997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:57.925998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.926768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.927431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:57.928480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:57.929318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:57.929822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.070975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:58.080999 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-216b6c8f-d37f-4579-a397-32ffb7baf12d tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1472 microversion: 2.1 time: 0.167662 Oct 24 09:36:58.081805 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3400/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:57 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:58.104465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:58.105023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:58.113201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.114181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.114793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.115660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.116462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.116881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.204600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a79be3d-dda5-4620-9f1a-d8912196de8a tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1623 microversion: 2.1 time: 0.104245 Oct 24 09:36:58.205528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3227/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:58 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1623 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:58.226987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:58.227843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:58.233901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.234419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.234864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.235570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.236034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.236467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.511152 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:58.512119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:58.519909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.520395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.520829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.521903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.522366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.522791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.688760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:58.703176 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9f356aa-ddef-4764-887e-560dd996bf7d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1229 microversion: 2.1 time: 0.196364 Oct 24 09:36:58.703727 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3228/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:58 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1229 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:36:58.757516 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd1a7434-b552-4c50-b85f-14ef0f710bac tempest-TestSecurityGroupsBasicOps-1614222042 tempest-TestSecurityGroupsBasicOps-1614222042-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1908 microversion: 2.1 time: 0.534448 Oct 24 09:36:58.758403 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3401/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:58 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1908 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:58.826137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:58.826855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:58.833127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.833652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.834093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.834803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.835467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.835704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.862614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:36:58.947643 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a52df8b-6f1b-4f3d-b212-ae8b357f5d84 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 204 len: 0 microversion: 2.1 time: 0.124958 Oct 24 09:36:58.951412 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3229/6630] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:36:58 2022] DELETE /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:36:58.956825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:58.957723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:58.964512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.965381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.965857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:58.966910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:58.967594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:58.968107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:59.080829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:59.089922 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c10be60-f051-49b4-b4ea-d069232901ab tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1478 microversion: 2.1 time: 0.137100 Oct 24 09:36:59.090516 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3402/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:58 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1478 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:36:59.725835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:36:59.726440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:36:59.733478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:59.733971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:59.734414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:59.735113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:36:59.735573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:36:59.736004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:36:59.868654 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:36:59.877084 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e487ee14-e65b-41ec-b490-fbdee9082cb1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1229 microversion: 2.1 time: 0.155782 Oct 24 09:36:59.877691 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3230/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:36:59 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1229 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:00.113039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:00.113777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:00.121389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:00.121880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:00.122322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:00.123055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:00.123520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:00.123951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:00.213063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:00.221876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e0603f5e-dc9e-4847-9b70-800e4d50248e tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1478 microversion: 2.1 time: 0.112705 Oct 24 09:37:00.222595 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3403/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:00 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1478 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:00.795512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-155cfe99-b71c-4183-be1f-62f5073b8b44 req-871cd8dc-e25f-4bfd-86d5-7525c9af150f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba", "name": "network-vif-deleted", "tag": "7f7c1e1c-6d9b-4067-9e3c-1adabec987d7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:00.809827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-155cfe99-b71c-4183-be1f-62f5073b8b44 req-871cd8dc-e25f-4bfd-86d5-7525c9af150f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:00.810803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-155cfe99-b71c-4183-be1f-62f5073b8b44 req-871cd8dc-e25f-4bfd-86d5-7525c9af150f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:00.811395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-155cfe99-b71c-4183-be1f-62f5073b8b44 req-871cd8dc-e25f-4bfd-86d5-7525c9af150f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:00.830639 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-155cfe99-b71c-4183-be1f-62f5073b8b44 req-871cd8dc-e25f-4bfd-86d5-7525c9af150f service nova] Creating event network-vif-deleted:7f7c1e1c-6d9b-4067-9e3c-1adabec987d7 for instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba on n-h2-master-1 Oct 24 09:37:00.836652 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-155cfe99-b71c-4183-be1f-62f5073b8b44 req-871cd8dc-e25f-4bfd-86d5-7525c9af150f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046874 Oct 24 09:37:00.842009 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3231/6634] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:00.903516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:00.904506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:00.911378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:00.912823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:00.914176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:00.915042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:00.916642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:00.917250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:01.068347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:01.077063 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a97d559b-810f-4568-87f9-cfa9c5452aee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1229 microversion: 2.1 time: 0.180535 Oct 24 09:37:01.077687 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3404/6635] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:00 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1229 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:01.247876 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:01.248582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:01.255793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:01.256279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:01.256720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:01.257442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:01.257901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:01.258323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:01.291052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:01.291437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:01.291922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:01.292415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lazy-loading 'fault' on Instance uuid 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:37:01.345457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:01.354061 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a2b4dea-c269-4000-89ea-b6c829ed97e6 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 200 len: 1331 microversion: 2.1 time: 0.112411 Oct 24 09:37:01.354625 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3232/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:01 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:02.100251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:02.100863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:02.107538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:02.108026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:02.108464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:02.109155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:02.109649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:02.110079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:02.237607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:02.245862 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90d8be60-77ca-4fc1-a1a4-8e0853f5b394 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.149685 Oct 24 09:37:02.246442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3405/6637] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:02 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:02.376583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:02.377212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:02.384353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:02.384869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:02.385395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:02.386139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:02.386591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:02.387014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:02.400887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] HTTP exception thrown: Instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba could not be found. Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Request method failure captured: Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba HTTP/1.1 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlxw-NAG3Mc4clOAIDTFFs8S46nKs0VZrdHLY3cM4LM4DjADIlDZTHUbT9WIH9VBkZtzYHLd1M1hHtHaQSd5CiA3XrksNKqQ9u6MSXuR1505wrPCLVzHvly7EatRD-abj3v3TmRrzxywKACrMSEe3d0M22k8ltdSsDfmeDf9dfT05ys Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 92300bfd91834591a263b1080a2dbe0d Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-18472421 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92300bfd91834591a263b1080a2dbe0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92300bfd91834591a263b1080a2dbe0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92300bfd91834591a263b1080a2dbe0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92300bfd91834591a263b1080a2dbe0d"}]}] Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestSecurityGroupsBasicOps-18472421 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 92300bfd91834591a263b1080a2dbe0d Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-18472421 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestSecurityGroupsBasicOps-18472421-project Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e46ce6c65db64efaa07525abce5420c1 Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestSecurityGroupsBasicOps-18472421-project Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba could not be found. Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba'} Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba could not be found. Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba could not be found. Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:37:02.402571 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba could not be found. Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Returning 404 to user: Instance 7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44b39ca5-8bd0-4bb2-a50b-e451804c86d8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba" status: 404 len: 111 microversion: 2.1 time: 0.031379 Oct 24 09:37:02.407279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3233/6638] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:02 2022] GET /compute/v2.1/servers/7de3b5eb-0a92-49bb-afcf-86b9f4b6cfba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:37:03.269871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:03.270660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:03.277358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:03.277847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:03.278289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:03.278983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:03.279440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:03.279873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:03.424751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:03.433636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-119268d5-e655-457b-8cc1-05b2ace96c45 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.167564 Oct 24 09:37:03.434221 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3406/6639] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:03 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:04.456068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:04.456699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:04.465917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:04.467545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:04.468229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:04.469156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:04.469834 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:04.470460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:04.716565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:04.733528 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08e176d1-a04c-4984-9c89-9ee78169bf4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.278855 Oct 24 09:37:04.733528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3234/6640] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:04 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:05.756348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:05.756897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:05.760969 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:05.767410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:05.767955 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:05.768411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:05.769137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:05.769630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:05.770216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:05.905695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:05.913241 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-273fd75b-56f8-456b-8d9e-53ea341b7c61 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.160918 Oct 24 09:37:05.913831 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3407/6641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:05 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:06.543756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:06.544530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:06.546698 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:06.547959 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d30d1eaf-67cf-4925-938f-eb22823f4e75 req-bc58e61e-ee1e-4a55-b382-1c0c9d5a4f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaeb0db9-cace-411f-821f-9a6503521773", "tag": "1b413b0c-0ea6-4867-89db-8c03c7dd385f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:06.548202 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:06.555373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.556013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.556554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:06.557568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.558339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.558968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:06.560592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d30d1eaf-67cf-4925-938f-eb22823f4e75 req-bc58e61e-ee1e-4a55-b382-1c0c9d5a4f0b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.561072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d30d1eaf-67cf-4925-938f-eb22823f4e75 req-bc58e61e-ee1e-4a55-b382-1c0c9d5a4f0b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.561806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d30d1eaf-67cf-4925-938f-eb22823f4e75 req-bc58e61e-ee1e-4a55-b382-1c0c9d5a4f0b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:06.574675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d30d1eaf-67cf-4925-938f-eb22823f4e75 req-bc58e61e-ee1e-4a55-b382-1c0c9d5a4f0b service nova] Creating event network-changed:1b413b0c-0ea6-4867-89db-8c03c7dd385f for instance aaeb0db9-cace-411f-821f-9a6503521773 on n-h1-master-1 Oct 24 09:37:06.580598 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d30d1eaf-67cf-4925-938f-eb22823f4e75 req-bc58e61e-ee1e-4a55-b382-1c0c9d5a4f0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038978 Oct 24 09:37:06.581197 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3408/6642] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:06.587262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:37:06.615829 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:06.690588 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aff32fcd-7e4d-43bb-8c8d-5378f668f7e8 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 204 len: 0 microversion: 2.1 time: 0.150937 Oct 24 09:37:06.691840 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3235/6643] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:37:06 2022] DELETE /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:37:06.702305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:06.702650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:06.709588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.710155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.710606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:06.711314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.711771 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.712201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:06.864653 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:06.872570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43b2b4b9-a940-49e9-a2d1-4c2a0a20cb78 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1763 microversion: 2.1 time: 0.176071 Oct 24 09:37:06.873167 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3409/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:06 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1763 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:06.936722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:06.937365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:06.943437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.943922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.944357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:06.945039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:06.945522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:06.945945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:07.083731 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:07.091573 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e473e3d-d8cf-4c3f-ac06-b390bc0b2f78 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.159316 Oct 24 09:37:07.092140 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3236/6645] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:06 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:07.897245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:07.897830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:07.906162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:07.906661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:07.907108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:07.907816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:07.908281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:07.908717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:08.117210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:08.118141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:08.126060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:08.127104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:08.127589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:08.128018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:08.128886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:08.129366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:08.129798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:08.133877 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8c363dd6-94fc-43d7-86ad-134de21c8074 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1763 microversion: 2.1 time: 0.240787 Oct 24 09:37:08.134515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3410/6646] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:07 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1763 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:08.262570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:08.270516 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58ae7443-7914-4cdc-acee-28195a406854 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.159024 Oct 24 09:37:08.271087 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3237/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:08 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:08.935260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-6a84839c-4aea-4880-9a23-756c7bb449ba req-b6575a77-6385-4da5-bd44-9f1ae9d1b7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaeb0db9-cace-411f-821f-9a6503521773", "name": "network-vif-deleted", "tag": "1b413b0c-0ea6-4867-89db-8c03c7dd385f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:08.945492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6a84839c-4aea-4880-9a23-756c7bb449ba req-b6575a77-6385-4da5-bd44-9f1ae9d1b7d5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:08.945979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6a84839c-4aea-4880-9a23-756c7bb449ba req-b6575a77-6385-4da5-bd44-9f1ae9d1b7d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:08.946420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6a84839c-4aea-4880-9a23-756c7bb449ba req-b6575a77-6385-4da5-bd44-9f1ae9d1b7d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:08.958322 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-6a84839c-4aea-4880-9a23-756c7bb449ba req-b6575a77-6385-4da5-bd44-9f1ae9d1b7d5 service nova] Creating event network-vif-deleted:1b413b0c-0ea6-4867-89db-8c03c7dd385f for instance aaeb0db9-cace-411f-821f-9a6503521773 on n-h1-master-1 Oct 24 09:37:08.963365 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-6a84839c-4aea-4880-9a23-756c7bb449ba req-b6575a77-6385-4da5-bd44-9f1ae9d1b7d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Oct 24 09:37:08.964839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3411/6648] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:09.159235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:09.162022 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:09.170301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:09.170880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:09.172136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:09.172976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:09.173603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:09.174430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:09.213756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:09.214267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:09.214709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:09.215167 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lazy-loading 'fault' on Instance uuid aaeb0db9-cace-411f-821f-9a6503521773 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:37:09.264871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46ce6c65db64efaa07525abce5420c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92300bfd91834591a263b1080a2dbe0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:09.277748 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ce67db77-1c70-4e06-859a-4870f59128fd tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 200 len: 1382 microversion: 2.1 time: 0.122443 Oct 24 09:37:09.278352 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3238/6649] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:09 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 1382 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:09.293385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:09.294096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:09.300410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:09.300901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:09.301379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:09.302486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:09.302951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:09.303383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:09.322997 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:09.449759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:09.462269 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5279a609-4d2e-42c3-98fa-ae79810dddea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.173320 Oct 24 09:37:09.463062 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3412/6650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:09 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:10.301614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:10.302150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] [instance: aaeb0db9-cace-411f-821f-9a6503521773] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:10.308919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:10.309441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:10.309883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:10.310576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:10.311032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:10.311461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:10.324579 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] HTTP exception thrown: Instance aaeb0db9-cace-411f-821f-9a6503521773 could not be found. Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Request method failure captured: Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 HTTP/1.1 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlxw-NAG3Mc4clOAIDTFFs8S46nKs0VZrdHLY3cM4LM4DjADIlDZTHUbT9WIH9VBkZtzYHLd1M1hHtHaQSd5CiA3XrksNKqQ9u6MSXuR1505wrPCLVzHvly7EatRD-abj3v3TmRrzxywKACrMSEe3d0M22k8ltdSsDfmeDf9dfT05ys Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 92300bfd91834591a263b1080a2dbe0d Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-18472421 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92300bfd91834591a263b1080a2dbe0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92300bfd91834591a263b1080a2dbe0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92300bfd91834591a263b1080a2dbe0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92300bfd91834591a263b1080a2dbe0d"}]}] Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestSecurityGroupsBasicOps-18472421 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 92300bfd91834591a263b1080a2dbe0d Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-18472421 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestSecurityGroupsBasicOps-18472421-project Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: e46ce6c65db64efaa07525abce5420c1 Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestSecurityGroupsBasicOps-18472421-project Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: exception: Instance aaeb0db9-cace-411f-821f-9a6503521773 could not be found. Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'aaeb0db9-cace-411f-821f-9a6503521773'} Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaeb0db9-cace-411f-821f-9a6503521773 could not be found. Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaeb0db9-cace-411f-821f-9a6503521773 could not be found. Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:37:10.326243 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaeb0db9-cace-411f-821f-9a6503521773 could not be found. Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Returning 404 to user: Instance aaeb0db9-cace-411f-821f-9a6503521773 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7745e1b7-60f3-4f77-9304-da8aa2b3bb1a tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773" status: 404 len: 111 microversion: 2.1 time: 0.030151 Oct 24 09:37:10.330724 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3239/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:10 2022] GET /compute/v2.1/servers/aaeb0db9-cace-411f-821f-9a6503521773 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 09:37:10.486581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:10.487339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:10.494506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:10.494991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:10.495933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:10.496628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:10.497084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:10.497534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:10.682228 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:10.691081 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f703b8f1-3132-4829-80c8-014e715623fd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.209473 Oct 24 09:37:10.691661 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3413/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:10 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:11.718320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:11.719611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:11.726920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:11.727416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:11.727857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:11.728564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:11.729017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:11.730247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:11.873917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:11.881858 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-452bffad-2973-4eb5-9335-8a752475fbe5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.167859 Oct 24 09:37:11.882541 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3240/6653] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:11 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:12.914950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:12.915689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:12.923590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:12.928352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:12.928993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:12.929838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:12.930395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:12.931143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:13.247702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ac775a97-e75f-40d4-afde-bb197bf24fad req-3b661d17-6c3b-4975-acb0-65bb6a66ec0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d6b9c8-105e-47c0-abbb-b420133589fc", "name": "network-vif-plugged", "status": "completed", "tag": "c628bc9e-6636-4d37-a718-1f4b6704ba64"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:13.274651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ac775a97-e75f-40d4-afde-bb197bf24fad req-3b661d17-6c3b-4975-acb0-65bb6a66ec0e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:13.275176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ac775a97-e75f-40d4-afde-bb197bf24fad req-3b661d17-6c3b-4975-acb0-65bb6a66ec0e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:13.278879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ac775a97-e75f-40d4-afde-bb197bf24fad req-3b661d17-6c3b-4975-acb0-65bb6a66ec0e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:13.300064 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ac775a97-e75f-40d4-afde-bb197bf24fad req-3b661d17-6c3b-4975-acb0-65bb6a66ec0e service nova] Creating event network-vif-plugged:c628bc9e-6636-4d37-a718-1f4b6704ba64 for instance a6d6b9c8-105e-47c0-abbb-b420133589fc on n-h1-master-1 Oct 24 09:37:13.310110 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ac775a97-e75f-40d4-afde-bb197bf24fad req-3b661d17-6c3b-4975-acb0-65bb6a66ec0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064671 Oct 24 09:37:13.311937 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3241/6654] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:37:13.471355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:13.480375 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d3a4261-207e-4d5b-8088-ede3a660a2f8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.577995 Oct 24 09:37:13.480963 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3414/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:12 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:13.687584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4d7a9ae-0001-44f5-8484-587233681b28 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] Calling method '.version_select at 0x7f8da9983820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:13.710318 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4d7a9ae-0001-44f5-8484-587233681b28 tempest-TestSecurityGroupsBasicOps-18472421 tempest-TestSecurityGroupsBasicOps-18472421-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-989604168" status: 202 len: 0 microversion: 2.1 time: 0.030735 Oct 24 09:37:13.710990 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3242/6656] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:37:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-989604168 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:37:14.507382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:14.508032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:14.515891 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:14.516567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:14.517161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:14.518043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:14.518508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:14.518941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:14.727203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:14.736046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-818f6e17-2933-42d9-b941-aa1e8eff00be tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1217 microversion: 2.1 time: 0.232396 Oct 24 09:37:14.736879 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3415/6657] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:14 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:15.760691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:15.761453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:15.765174 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:15.770595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:15.771085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:15.771520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:15.772217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:15.772673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:15.773098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:15.913776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:15.921660 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10a41169-3b43-4725-9308-30a7ce2dcd9a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1405 microversion: 2.1 time: 0.165619 Oct 24 09:37:15.922450 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3243/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:15 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:15.943771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:15.944416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:15.952126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:15.952621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:15.953063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:15.954034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:15.954575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:15.955011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:16.087896 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:16.095658 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9ebc430-6610-46a9-94db-efde98d2ea0d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1405 microversion: 2.1 time: 0.155659 Oct 24 09:37:16.096233 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3416/6659] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:15 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:16.119343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1608535365"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:16.122477 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:16.131232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:16.131716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:16.132149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:16.132873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:16.133344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:16.133996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:16.230900 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Attempting to quiesce instance before volume snapshot. Oct 24 09:37:16.293653 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 24 09:37:16.369311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Creating snapshot from volume c54a28bd-8c72-45d6-b514-5b1e7076ae7c. {{(pid=126919) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 24 09:37:17.437832 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f4bce02-dc2c-4241-ada0-29f232bdfe93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc/action" status: 202 len: 0 microversion: 2.1 time: 1.323043 Oct 24 09:37:17.439965 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3244/6660] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:37:16 2022] POST /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc/action => generated 0 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 09:37:18.702454 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-510697549", "imageRef": "6e897f98-6ab6-4dc3-9adf-c1192d7a5b98", "flavorRef": "452", "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:18.711076 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=55 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:18.813168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:37:19.354911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:37:19.355355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:37:19.356392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:37:19.356863 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:37:19.357320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:37:19.366940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:19.367448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:19.367900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:19.368782 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:19.369340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:19.369780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:19.401202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:37:19.409331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:37:19.426371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:37:19.429486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9570000b-b0ee-467e-a9ee-89af40acb4dd',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:37:19.537936 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf84c27e-fb00-43bb-bfcf-0398275385a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840975 Oct 24 09:37:19.538952 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3417/6661] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:37:19.551360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a43274c-f321-4e3c-8d5b-eb59cc577f39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:19.552256 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a43274c-f321-4e3c-8d5b-eb59cc577f39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:19.645966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a43274c-f321-4e3c-8d5b-eb59cc577f39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:19.654046 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a43274c-f321-4e3c-8d5b-eb59cc577f39 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1229 microversion: 2.1 time: 0.107748 Oct 24 09:37:19.655193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3245/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:19 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:20.682552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:20.683371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:20.693178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:20.693816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:20.694511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:20.695898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:20.696970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:20.709739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:20.820048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:20.829972 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ec75d9a-6c73-4861-8bdd-3e92687d1589 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1281 microversion: 2.1 time: 0.154777 Oct 24 09:37:20.830608 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3418/6663] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:20 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:21.853508 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:21.854149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:21.869403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:21.869935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:21.870403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:21.871696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:21.878788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:21.879426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:22.447495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:22.461397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8de9039a-15df-40f9-af8d-93aba75dd3fc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.611753 Oct 24 09:37:22.489347 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3246/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:21 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:23.008966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f27e7713-175a-4450-ba4a-d833ae0ca9b5 req-21a019e8-7691-4e65-99b6-af3943f857d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2", "tag": "c810737d-c335-45ea-b9c4-b4cf98db3d47"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:23.037620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f27e7713-175a-4450-ba4a-d833ae0ca9b5 req-21a019e8-7691-4e65-99b6-af3943f857d7 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:23.038472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f27e7713-175a-4450-ba4a-d833ae0ca9b5 req-21a019e8-7691-4e65-99b6-af3943f857d7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:23.039165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f27e7713-175a-4450-ba4a-d833ae0ca9b5 req-21a019e8-7691-4e65-99b6-af3943f857d7 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:23.054651 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f27e7713-175a-4450-ba4a-d833ae0ca9b5 req-21a019e8-7691-4e65-99b6-af3943f857d7 service nova] Creating event network-changed:c810737d-c335-45ea-b9c4-b4cf98db3d47 for instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 on n-h2-master-1 Oct 24 09:37:23.064867 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f27e7713-175a-4450-ba4a-d833ae0ca9b5 req-21a019e8-7691-4e65-99b6-af3943f857d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066310 Oct 24 09:37:23.068710 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3419/6665] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:23.504268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:23.504978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:23.514831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:23.516210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:23.517709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:23.519426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:23.520774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:23.523012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:23.759933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:23.781700 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ca591d4-3c07-45f7-8fd1-9c80fbf5e425 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.280750 Oct 24 09:37:23.793815 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3247/6666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:23 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:24.811423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:24.812345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:24.822544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:24.824585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:24.825199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:24.828774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:24.829350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:24.832135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:25.400565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:25.426344 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b73d8f93-425f-4732-8c24-a238816bfc44 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.621974 Oct 24 09:37:25.427208 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3420/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:24 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:26.461931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:26.462562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:26.478817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:26.479765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:26.480391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:26.481359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:26.481964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:26.482886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:26.794104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:26.804039 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-521eb92d-70e8-4c8b-ba3b-2832460ae777 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.352792 Oct 24 09:37:26.809778 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3248/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:26 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:27.839747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:27.843925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:27.854119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:27.854835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:27.855450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:27.856994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:27.857634 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:27.858224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:28.099907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:28.111102 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d9d77eb-91fa-4dc3-971c-66a64a637a3b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.277430 Oct 24 09:37:28.113839 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3421/6669] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:27 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:29.148918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:29.151099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:29.164925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:29.165714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:29.166333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:29.167200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:29.167815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:29.168771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:29.380813 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:29.397462 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:29.407384 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34a1148a-879a-4595-9d2c-b8e2c9fd7f4c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.263942 Oct 24 09:37:29.409816 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3249/6670] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:29 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:29.422180 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:29.604631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c98ecbf-a9c5-4245-8fa9-8e89dfc91480 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Action: 'create', calling method: .version_select at 0x7f8da9c9e700>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1022353876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWQMkPzYZVYK/+2JtEvdk3bk4iuMSPx7CFSPt/18AXTXhgPin0LOz0FMxc+VEwb0i04taFFIBCvGD60BzyPxVDHqjLmBqMHcyL07sVilLfxV0+fRWGnesT/WoXuOmSrhQ=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:29.623585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-0c98ecbf-a9c5-4245-8fa9-8e89dfc91480 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Getting quotas for project 4ddfb35413e745a9b82e8716819bc513. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:37:29.630077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-0c98ecbf-a9c5-4245-8fa9-8e89dfc91480 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Getting quotas for user f81e5d2ba9fc40398712a5d0531db7c2 and project 4ddfb35413e745a9b82e8716819bc513. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:37:29.670104 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c98ecbf-a9c5-4245-8fa9-8e89dfc91480 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331323 Oct 24 09:37:29.673375 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3422/6671] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:37:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:37:30.434491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:30.435400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:30.437171 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:30.445775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:30.446274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:30.446970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:30.448465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:30.449076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:30.450264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:30.685044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:30.696050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76fbf1e6-e83b-4e5c-8651-407a266fb9ce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.265951 Oct 24 09:37:30.711916 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3250/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:30 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:30.975582 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2131509524", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1022353876", "security_groups": [{"name": "tempest-secgroup-smoke-1925204709"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "fa037106-f99d-4554-8d9a-4285406149ce"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:31.113391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] validate_networks() for [('fa037106-f99d-4554-8d9a-4285406149ce', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:37:31.581693 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Getting quotas for project 4ddfb35413e745a9b82e8716819bc513. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:37:31.587370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Getting quotas for user f81e5d2ba9fc40398712a5d0531db7c2 and project 4ddfb35413e745a9b82e8716819bc513. Resources: dict_keys(['metadata_items']) {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:37:31.605563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:37:31.606331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:37:31.607878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:37:31.608523 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:37:31.610331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:37:31.620922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:31.622699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:31.622699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:31.622699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:31.623945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:31.623945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:31.646602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Getting quotas for project 4ddfb35413e745a9b82e8716819bc513. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:37:31.654161 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Getting quotas for user f81e5d2ba9fc40398712a5d0531db7c2 and project 4ddfb35413e745a9b82e8716819bc513. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:37:31.668433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:37:31.671068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:37:31.724721 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:31.726122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:31.734874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:31.735656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:31.736494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:31.737564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:31.738113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:31.738964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:31.775435 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f03e778d-6e2f-4cb8-8047-e8caa544c84b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808329 Oct 24 09:37:31.785726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3423/6673] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:37:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:37:31.794898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0772a133-9155-4875-b9d8-c4123705e113 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:31.796213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0772a133-9155-4875-b9d8-c4123705e113 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:31.885165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0772a133-9155-4875-b9d8-c4123705e113 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:31.899943 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0772a133-9155-4875-b9d8-c4123705e113 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1303 microversion: 2.1 time: 0.110962 Oct 24 09:37:31.901631 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3424/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:31 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:32.029250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:32.045888 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88c855a9-5a44-4912-9601-fe08a239fde6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.327389 Oct 24 09:37:32.047330 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3251/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:31 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:32.943367 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:32.944121 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:32.951990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:32.952493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:32.952940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:32.953708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:32.954266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:32.954716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:33.022426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:33.032311 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f270edf-805e-47d7-b4bb-b7ab2ab0af81 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1355 microversion: 2.1 time: 0.093366 Oct 24 09:37:33.033338 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3425/6676] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:32 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1355 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:33.069680 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:33.070481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:33.078540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:33.079192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:33.079891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:33.080715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:33.081332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:33.081875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:33.099261 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:33.318583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:33.327022 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99c0819e-9e49-4364-8b27-de75ffb7da4a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.261265 Oct 24 09:37:33.327609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3252/6677] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:33 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:34.056697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:34.057383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:34.069696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:34.073163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:34.074606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:34.076703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:34.077253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:34.079362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:34.279155 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:34.288040 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9580ef1-52b8-4df8-a4c1-4cb39ff476e9 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.235614 Oct 24 09:37:34.289256 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3426/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:34 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:34.350958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:34.351739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:34.359471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:34.360211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:34.360669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:34.361413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:34.362073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:34.362515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:34.595705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:34.607840 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29d4cfde-a2dc-4325-bda2-daf704d62d59 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.260493 Oct 24 09:37:34.618449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3253/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:34 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:34.872291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-bb6579d2-9f5a-44aa-a6d7-1a4863c21115 req-a1c1ff44-f062-4715-a4a2-96c50fc19d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69d6968-901b-46da-8552-18fd0d647896", "tag": "22215c64-0260-4e30-9f02-8885525102ef"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:34.892157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bb6579d2-9f5a-44aa-a6d7-1a4863c21115 req-a1c1ff44-f062-4715-a4a2-96c50fc19d5a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:34.892157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bb6579d2-9f5a-44aa-a6d7-1a4863c21115 req-a1c1ff44-f062-4715-a4a2-96c50fc19d5a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:34.892616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bb6579d2-9f5a-44aa-a6d7-1a4863c21115 req-a1c1ff44-f062-4715-a4a2-96c50fc19d5a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:34.912573 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-bb6579d2-9f5a-44aa-a6d7-1a4863c21115 req-a1c1ff44-f062-4715-a4a2-96c50fc19d5a service nova] Creating event network-changed:22215c64-0260-4e30-9f02-8885525102ef for instance a69d6968-901b-46da-8552-18fd0d647896 on n-h1-master-1 Oct 24 09:37:34.920607 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-bb6579d2-9f5a-44aa-a6d7-1a4863c21115 req-a1c1ff44-f062-4715-a4a2-96c50fc19d5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052501 Oct 24 09:37:34.921231 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3427/6680] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:35.318470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:35.319495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:35.326009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:35.326722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:35.327337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:35.328534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:35.329047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:35.329690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:35.475755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:35.484806 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e136e93-9a42-4be3-9169-9c89751cd007 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.170797 Oct 24 09:37:35.485353 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3254/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:35 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:35.636146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:35.637209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:35.646201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:35.646722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:35.647575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:35.648585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:35.649056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:35.650092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:35.804461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:35.813138 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dbce3c05-0015-4632-b3c5-95f322113e90 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.183744 Oct 24 09:37:35.813848 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3428/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:35 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:36.510552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:36.511250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:36.521269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:36.522053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:36.522513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:36.523247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:36.523717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:36.524160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:36.783406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:36.795831 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-196319c1-438f-49ac-aa2a-3717973d68ad tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.291078 Oct 24 09:37:36.796753 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3255/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:36 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:36.836224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:36.837486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:36.844945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:36.845804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:36.846468 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:36.847355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:36.847970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:36.848675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:37.080594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:37.089174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e2e7e1e7-d88e-4697-aa15-f3cee1f702bc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.257020 Oct 24 09:37:37.090010 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3429/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:36 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:37.820085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:37.820714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:37.827699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:37.828193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:37.828645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:37.829448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:37.829854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:37.830310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:37.993740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:38.003181 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12395f42-7077-4060-894a-2e63635bcb7e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.186986 Oct 24 09:37:38.003974 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3256/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:37 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:38.115222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:38.115901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:38.124027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:38.124556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:38.125014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:38.125799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:38.126297 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:38.126747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:38.288319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:38.298638 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34637164-c626-4a3a-9125-3ce6296f665b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1341 microversion: 2.1 time: 0.190187 Oct 24 09:37:38.299431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3430/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:38 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:39.029368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:39.030088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:39.038646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:39.039155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:39.039611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:39.040359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:39.040951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:39.041326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:39.221780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:39.229848 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0420f50b-d641-4d35-a4ca-1df9bd361b4e tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.204647 Oct 24 09:37:39.230458 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3257/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:39 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:39.326339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:39.327023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:39.335035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:39.335551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:39.336042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:39.336788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:39.337278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:39.337741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:39.342789 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=83 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:39.489765 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:39.498846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77589f0f-df37-4f55-b54b-54fd399af003 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1387 microversion: 2.1 time: 0.177135 Oct 24 09:37:39.499735 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3431/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:39 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1387 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:40.254684 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:40.255247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:40.262610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:40.263111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:40.263565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:40.264526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:40.264999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:40.265480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:40.399982 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:40.408531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-072f2d97-2292-45a8-b1a4-fa41b0a32433 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.157859 Oct 24 09:37:40.409118 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3258/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:40 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:40.523158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:40.523698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:40.531191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:40.531676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:40.532116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:40.532802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:40.533261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:40.533711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:40.674021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:40.681863 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-30f6079e-ea22-43ba-8d6a-3a47f5ca64aa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.162650 Oct 24 09:37:40.682445 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3432/6690] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:40 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:41.139418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-183aad72-137c-44f8-94fc-dc058644438a req-cfdf6fb0-2cd9-4f4f-b095-540b4888a580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69d6968-901b-46da-8552-18fd0d647896", "name": "network-vif-plugged", "status": "completed", "tag": "22215c64-0260-4e30-9f02-8885525102ef"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:41.150488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-183aad72-137c-44f8-94fc-dc058644438a req-cfdf6fb0-2cd9-4f4f-b095-540b4888a580 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:41.151358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-183aad72-137c-44f8-94fc-dc058644438a req-cfdf6fb0-2cd9-4f4f-b095-540b4888a580 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:41.151811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-183aad72-137c-44f8-94fc-dc058644438a req-cfdf6fb0-2cd9-4f4f-b095-540b4888a580 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:41.163326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-183aad72-137c-44f8-94fc-dc058644438a req-cfdf6fb0-2cd9-4f4f-b095-540b4888a580 service nova] Creating event network-vif-plugged:22215c64-0260-4e30-9f02-8885525102ef for instance a69d6968-901b-46da-8552-18fd0d647896 on n-h1-master-1 Oct 24 09:37:41.168844 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-183aad72-137c-44f8-94fc-dc058644438a req-cfdf6fb0-2cd9-4f4f-b095-540b4888a580 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Oct 24 09:37:41.169683 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3259/6691] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:41.431312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:41.431969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:41.438186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:41.438681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:41.439129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:41.439830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:41.440298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:41.440744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:41.573474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:41.581615 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07fedcab-8687-4db5-82d9-8a8cfe77754a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1429 microversion: 2.1 time: 0.153946 Oct 24 09:37:41.582569 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3433/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:41 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:41.707347 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:41.708065 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:41.714231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:41.714725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:41.715175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:41.715878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:41.716964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:41.717437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:41.848349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:41.856282 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68d8d1d8-9af2-4ed7-81fb-5cddca2f4f1d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.153992 Oct 24 09:37:41.856862 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3260/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:41 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:42.606349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:42.607007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:42.609332 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:42.610026 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:42.617520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:42.618202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:42.618805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:42.619540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:42.620070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:42.620696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:42.767238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:42.775879 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86350dcb-1d9a-4c16-b1b5-555bbd012c96 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1609 microversion: 2.1 time: 0.173748 Oct 24 09:37:42.776499 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3434/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:42 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1609 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:42.799946 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:42.800621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:42.808457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:42.809027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:42.809587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:42.811001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:42.811443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:42.811949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:42.880609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:42.881244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:42.888883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:42.890319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:42.890889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:42.891491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:42.891996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:42.892513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:42.958829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:42.968715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e26b18c-f1ad-424d-85c1-bbd5877d373d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1609 microversion: 2.1 time: 0.172665 Oct 24 09:37:42.971991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3261/6695] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:42 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1609 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:42.995537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:42.996436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:43.003746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:43.004249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:43.004734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:43.005529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:43.005998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:43.006603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:43.045405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:43.053939 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e88c16f0-4860-4104-a97f-bb5593d1b15f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.177498 Oct 24 09:37:43.058301 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3435/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:42 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:43.168454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:43.179116 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3372642-2f96-4bdc-b3ba-62b2d0b9e1d0 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1609 microversion: 2.1 time: 0.187900 Oct 24 09:37:43.179947 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3262/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:42 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1609 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:44.079583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:44.080270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:44.087701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:44.088306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:44.089096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:44.089403 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:44.089874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:44.090356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:44.243432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:44.251682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8e21050-2ffe-464b-b9d9-816c7d5d9acc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.176997 Oct 24 09:37:44.252292 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3436/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:44 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:45.276729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:45.277675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:45.285437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:45.286021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:45.286423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:45.287141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:45.287617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:45.288220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:45.335229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8529d528-730a-4d95-bed0-45e4adb86e37 req-d3ee36ad-8d16-4370-885f-882df04dbb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69d6968-901b-46da-8552-18fd0d647896", "tag": "22215c64-0260-4e30-9f02-8885525102ef"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:45.346470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8529d528-730a-4d95-bed0-45e4adb86e37 req-d3ee36ad-8d16-4370-885f-882df04dbb6c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:45.347301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8529d528-730a-4d95-bed0-45e4adb86e37 req-d3ee36ad-8d16-4370-885f-882df04dbb6c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:45.347983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8529d528-730a-4d95-bed0-45e4adb86e37 req-d3ee36ad-8d16-4370-885f-882df04dbb6c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:45.360480 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8529d528-730a-4d95-bed0-45e4adb86e37 req-d3ee36ad-8d16-4370-885f-882df04dbb6c service nova] Creating event network-changed:22215c64-0260-4e30-9f02-8885525102ef for instance a69d6968-901b-46da-8552-18fd0d647896 on n-h1-master-1 Oct 24 09:37:45.366125 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8529d528-730a-4d95-bed0-45e4adb86e37 req-d3ee36ad-8d16-4370-885f-882df04dbb6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Oct 24 09:37:45.366763 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3437/6699] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:37:45.440029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:45.449676 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d8686deb-26c4-4a47-99ac-dd1e06e4e888 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.177363 Oct 24 09:37:45.451111 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3263/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:45 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:46.476901 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:46.477932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:46.486244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:46.487047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:46.487604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:46.488459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:46.489114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:46.489752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:46.661044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:46.674131 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28a9c999-5499-4673-a113-143b5e4e3438 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.203032 Oct 24 09:37:46.674834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3438/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:46 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:47.700866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:47.701501 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:47.704931 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=43 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:47.710590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:47.711103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:47.711565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:47.712287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:47.712790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:47.713238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:47.851723 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:47.859681 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b47ff434-c74e-4b1a-b13a-33ce33365c4d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.162858 Oct 24 09:37:47.860309 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3264/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:47 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:48.881586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:48.882213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:48.885058 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:48.890688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:48.891183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:48.891629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:48.892331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:48.892794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:48.893227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:49.034312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:49.041963 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cfb2cdd-0b11-4988-8feb-8a2a510590a7 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.164293 Oct 24 09:37:49.042526 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3439/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:48 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:49.585629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8650fcc9-8b89-43c8-8f67-622b08ba3848 req-43195643-91a0-438f-a2c2-c3bbb97611e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2", "name": "network-vif-plugged", "status": "completed", "tag": "c810737d-c335-45ea-b9c4-b4cf98db3d47"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:49.597792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8650fcc9-8b89-43c8-8f67-622b08ba3848 req-43195643-91a0-438f-a2c2-c3bbb97611e8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:49.598292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8650fcc9-8b89-43c8-8f67-622b08ba3848 req-43195643-91a0-438f-a2c2-c3bbb97611e8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:49.598740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8650fcc9-8b89-43c8-8f67-622b08ba3848 req-43195643-91a0-438f-a2c2-c3bbb97611e8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:49.611077 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8650fcc9-8b89-43c8-8f67-622b08ba3848 req-43195643-91a0-438f-a2c2-c3bbb97611e8 service nova] Creating event network-vif-plugged:c810737d-c335-45ea-b9c4-b4cf98db3d47 for instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 on n-h2-master-1 Oct 24 09:37:49.616349 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8650fcc9-8b89-43c8-8f67-622b08ba3848 req-43195643-91a0-438f-a2c2-c3bbb97611e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034891 Oct 24 09:37:49.616991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3265/6704] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:50.065131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:50.065828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:50.075487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:50.075978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:50.076521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:50.077769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:50.078232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:50.078658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:50.526839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:50.535303 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f6c113d-2971-488c-9a64-f17ac985b35b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1375 microversion: 2.1 time: 0.474772 Oct 24 09:37:50.535904 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3440/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:50 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1375 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:51.564322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:51.565038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:51.571270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:51.571766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:51.572221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:51.572922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:51.573420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:51.573883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:51.710377 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:51.719069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36cfdc40-ac0a-42b4-8c18-70e7b8856a7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1562 microversion: 2.1 time: 0.159931 Oct 24 09:37:51.719639 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3266/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:51 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:51.741665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:51.742226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:51.749564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:51.750056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:51.750498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:51.751195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:51.751660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:51.752095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:51.879826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:51.888068 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3959e178-f687-4235-a0d9-6f52a58369db tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1562 microversion: 2.1 time: 0.150341 Oct 24 09:37:51.888648 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3441/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:51 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:51.967183 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:51.968177 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:51.974932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:51.975428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:51.975873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:51.976574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:51.977040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:51.977507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:52.003430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:37:52.079532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4baf6918-1b9a-494d-8470-dd06490d3f67 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 204 len: 0 microversion: 2.1 time: 0.115817 Oct 24 09:37:52.080221 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3267/6708] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:37:51 2022] DELETE /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:37:52.088330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:52.088958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:52.095516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:52.096013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:52.096460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:52.097161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:52.097661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:52.098103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:52.233190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:52.241023 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5c4e855-5516-4aeb-bb8e-972e3dc45c36 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1568 microversion: 2.1 time: 0.156584 Oct 24 09:37:52.241646 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3442/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:52 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:53.266556 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:53.267266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:53.273616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:53.274102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:53.274548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:53.275250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:53.275711 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:53.276457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:53.413510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:53.415851 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:53.424453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36a01b0b-801f-49ad-8228-918060d476a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1568 microversion: 2.1 time: 0.163297 Oct 24 09:37:53.425200 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3268/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:53 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:54.154500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-68282871-f549-44cf-aab1-ea0edc9a9f82 req-f9d252b4-c7d1-493c-a287-23ad703a879e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2", "name": "network-vif-deleted", "tag": "c810737d-c335-45ea-b9c4-b4cf98db3d47"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:37:54.165170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68282871-f549-44cf-aab1-ea0edc9a9f82 req-f9d252b4-c7d1-493c-a287-23ad703a879e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:54.165943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68282871-f549-44cf-aab1-ea0edc9a9f82 req-f9d252b4-c7d1-493c-a287-23ad703a879e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:54.166647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-68282871-f549-44cf-aab1-ea0edc9a9f82 req-f9d252b4-c7d1-493c-a287-23ad703a879e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:54.179813 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-68282871-f549-44cf-aab1-ea0edc9a9f82 req-f9d252b4-c7d1-493c-a287-23ad703a879e service nova] Creating event network-vif-deleted:c810737d-c335-45ea-b9c4-b4cf98db3d47 for instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 on n-h2-master-1 Oct 24 09:37:54.188758 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-68282871-f549-44cf-aab1-ea0edc9a9f82 req-f9d252b4-c7d1-493c-a287-23ad703a879e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038145 Oct 24 09:37:54.189740 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3443/6711] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:37:54.448724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:54.449348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:54.457882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:54.458390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:54.458845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:54.459569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:54.460038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:54.460471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:54.534178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:54.543079 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25c526bb-4cb9-4341-b08a-5e4e34356b73 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1360 microversion: 2.1 time: 0.098792 Oct 24 09:37:54.544065 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3269/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:54 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1360 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:55.571172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:55.571952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:55.581095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:55.582262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:55.582794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:55.583873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:55.584673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:55.585565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:55.658318 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:55.666811 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8bec6d80-1cf9-4b4c-935c-58e6dad29d84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1360 microversion: 2.1 time: 0.100913 Oct 24 09:37:55.667419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3444/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:55 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1360 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:56.691091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:56.691757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:56.698886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:56.699388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:56.699842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:56.700553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:56.701022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:56.701492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:56.768314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:56.776206 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8bca2bcc-140a-484b-98bb-4351c01da545 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1360 microversion: 2.1 time: 0.089646 Oct 24 09:37:56.776787 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3270/6714] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:56 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:37:57.799428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:57.800054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:57.807142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:57.807644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:57.808093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:57.808828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:57.809313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:57.809753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:57.874057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:37:57.882081 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b41b403e-8661-423d-81d7-616b37c58a53 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 200 len: 1360 microversion: 2.1 time: 0.086667 Oct 24 09:37:57.882646 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3445/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:57 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 1360 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:37:58.906884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:37:58.907648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:37:58.914747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:58.915277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:58.915705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:58.916558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:37:58.917237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:37:58.917730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:37:58.932320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 HTTP/1.1 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: exception: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2'} Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:37:58.934208 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46d88038-2b10-47ce-b146-c8c84cb4d119 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 404 len: 111 microversion: 2.1 time: 0.033604 Oct 24 09:37:58.942660 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3271/6716] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:37:58 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:04.275756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:04.276647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:04.282944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:04.283435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:04.283878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:04.284596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:04.285041 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:04.285509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:04.310316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:38:04.385213 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8f0b9a2-247e-42c6-a504-5fd753762daa tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 204 len: 0 microversion: 2.1 time: 0.113256 Oct 24 09:38:04.385825 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3446/6717] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:38:04 2022] DELETE /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:38:04.396875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:04.399108 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:04.406977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:04.407471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:04.407920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:04.408624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:04.409092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:04.409563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:04.539750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:04.548507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-399c549e-c315-449c-90d3-ec6a2617c5b6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1411 microversion: 2.1 time: 0.158124 Oct 24 09:38:04.549116 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3272/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:04 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:05.573639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:05.574278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:05.581750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:05.582248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:05.582694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:05.583405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:05.583871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:05.584324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:05.599896 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:05.718288 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:05.726160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf54cbb0-abb9-4283-bdcb-2c6dd12ee807 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1411 microversion: 2.1 time: 0.156942 Oct 24 09:38:05.726745 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3447/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:05 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:06.698005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-54c1afcd-ecea-4394-9524-f00427c93316 req-c2d325dd-e69e-4ec9-b6f7-ce28fc8735ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d6b9c8-105e-47c0-abbb-b420133589fc", "name": "network-vif-deleted", "tag": "c628bc9e-6636-4d37-a718-1f4b6704ba64"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:06.710185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-54c1afcd-ecea-4394-9524-f00427c93316 req-c2d325dd-e69e-4ec9-b6f7-ce28fc8735ee service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:06.710714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-54c1afcd-ecea-4394-9524-f00427c93316 req-c2d325dd-e69e-4ec9-b6f7-ce28fc8735ee service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:06.711178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-54c1afcd-ecea-4394-9524-f00427c93316 req-c2d325dd-e69e-4ec9-b6f7-ce28fc8735ee service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:06.724034 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-54c1afcd-ecea-4394-9524-f00427c93316 req-c2d325dd-e69e-4ec9-b6f7-ce28fc8735ee service nova] Creating event network-vif-deleted:c628bc9e-6636-4d37-a718-1f4b6704ba64 for instance a6d6b9c8-105e-47c0-abbb-b420133589fc on n-h1-master-1 Oct 24 09:38:06.729514 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-54c1afcd-ecea-4394-9524-f00427c93316 req-c2d325dd-e69e-4ec9-b6f7-ce28fc8735ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035366 Oct 24 09:38:06.730137 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3273/6720] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:38:06.749601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:06.750251 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:06.757716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:06.758207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:06.758648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:06.759345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:06.759804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:06.760235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:06.826464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:06.835234 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5016f72-f85e-49e2-b54f-500704bfc02e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1202 microversion: 2.1 time: 0.089588 Oct 24 09:38:06.835825 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3448/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:06 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:07.859903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:07.861284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:07.867635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:07.868144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:07.868599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:07.869321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:07.869822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:07.870260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:07.933999 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:07.942704 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20f523f7-b4b4-424c-a546-bc44941d65dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1202 microversion: 2.1 time: 0.087919 Oct 24 09:38:07.943279 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3274/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:07 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:08.966218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:08.966853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:08.974831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:08.975329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:08.975778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:08.976490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:08.976952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:08.977438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:09.042919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:09.051621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-086b4836-39df-4c16-b4cf-da11a15aa83f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1202 microversion: 2.1 time: 0.089233 Oct 24 09:38:09.052235 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3449/6723] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:08 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:10.075062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:10.075720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:10.083383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:10.083886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:10.084341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:10.085059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:10.085561 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:10.086011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:10.154780 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:10.163310 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30bbff24-8f8b-4fe9-8989-572c8c1a1949 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1202 microversion: 2.1 time: 0.092176 Oct 24 09:38:10.163887 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3275/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:10 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:11.185451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:11.186066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:11.193677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:11.195276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:11.195276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:11.195527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:11.195966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:11.196392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:11.232378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:11.232870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:11.233320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:11.233780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lazy-loading 'fault' on Instance uuid a6d6b9c8-105e-47c0-abbb-b420133589fc {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:38:11.286961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:11.295308 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-edd5401d-7935-471a-be28-af29919bfee1 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 200 len: 1207 microversion: 2.1 time: 0.113717 Oct 24 09:38:11.295918 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3450/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:11 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 1207 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:12.319231 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:12.319872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:12.327339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:12.327872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:12.328322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:12.329073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:12.330137 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:12.330645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:12.344540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc HTTP/1.1 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a6d6b9c8-105e-47c0-abbb-b420133589fc'} Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:12.346823 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67ab55c6-874b-4da4-9422-3c5c5d8f99a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 404 len: 111 microversion: 2.1 time: 0.033116 Oct 24 09:38:12.351033 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3276/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:12 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:14.497843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:14.498370 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:14.507322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:14.507915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:14.508475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:14.509329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:14.509923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:14.510449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:14.528441 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 HTTP/1.1 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: exception: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2'} Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:38:14.530643 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:38:14.535151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe24f93a-b155-4b56-8634-5d9a5e1efc17 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 404 len: 111 microversion: 2.1 time: 0.039203 Oct 24 09:38:14.536376 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3451/6727] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:38:14 2022] DELETE /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:14.542178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:14.542888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:14.549897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:14.550614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:14.551069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:14.551778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:14.552250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:14.552690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:14.566884 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 HTTP/1.1 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: exception: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2'} Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:14.568636 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-198fcd63-e7dc-4dcd-a756-7670229c55a6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2" status: 404 len: 111 microversion: 2.1 time: 0.031891 Oct 24 09:38:14.572750 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3277/6728] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:14 2022] GET /compute/v2.1/servers/fcc31db9-ed3c-4b2a-9eab-f14d9ee6cbb2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:15.069019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:15.069576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:15.075790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:15.076318 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:15.076790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:15.077549 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:15.078015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:15.078446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:15.091837 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc HTTP/1.1 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a6d6b9c8-105e-47c0-abbb-b420133589fc'} Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:38:15.093551 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8d177bd-b002-436b-8976-141dbf403093 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 404 len: 111 microversion: 2.1 time: 0.029970 Oct 24 09:38:15.098628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3452/6729] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:38:15 2022] DELETE /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:15.104218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:15.104913 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: a6d6b9c8-105e-47c0-abbb-b420133589fc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:15.112088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:15.112588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:15.113067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:15.113809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:15.114307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:15.114751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:15.131531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc HTTP/1.1 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a6d6b9c8-105e-47c0-abbb-b420133589fc'} Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:15.133077 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance a6d6b9c8-105e-47c0-abbb-b420133589fc could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a398801-6ca3-4060-bda1-9dde6c951364 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc" status: 404 len: 111 microversion: 2.1 time: 0.034341 Oct 24 09:38:15.137640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3278/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:15 2022] GET /compute/v2.1/servers/a6d6b9c8-105e-47c0-abbb-b420133589fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:15.209043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-10daff17-54ec-4891-8b01-f69abdc36ee3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: .version_select at 0x7f8da9c9e820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1714232235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOW2vtOEJqgSOqgZnV7WbWUYrEp5qsP4v46c5F7lkFjl6YjBtIB2suUJrYxrqIcPlnwpZG/viPsNS6ULWbFMZn29L1MOoPNELsFWhjUGnPtlv7OPjWmBo5olxPvTsdMPA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:15.225273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-10daff17-54ec-4891-8b01-f69abdc36ee3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:38:15.230531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-10daff17-54ec-4891-8b01-f69abdc36ee3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:38:15.254286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-10daff17-54ec-4891-8b01-f69abdc36ee3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049134 Oct 24 09:38:15.254874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3453/6731] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:38:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:38:21.556777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:21.557332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:21.560635 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:21.574337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:21.575210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:21.575843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:21.576577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:21.577047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:21.577680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:21.608461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:38:21.647649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b64c4c21-664c-4e96-9a24-024442b0e954 req-d9e6c5be-c241-4fe4-a046-c35d9fd5f43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69d6968-901b-46da-8552-18fd0d647896", "tag": "22215c64-0260-4e30-9f02-8885525102ef"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:21.653362 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:21.660570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b64c4c21-664c-4e96-9a24-024442b0e954 req-d9e6c5be-c241-4fe4-a046-c35d9fd5f43d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:21.661040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b64c4c21-664c-4e96-9a24-024442b0e954 req-d9e6c5be-c241-4fe4-a046-c35d9fd5f43d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:21.661688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b64c4c21-664c-4e96-9a24-024442b0e954 req-d9e6c5be-c241-4fe4-a046-c35d9fd5f43d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:21.676877 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b64c4c21-664c-4e96-9a24-024442b0e954 req-d9e6c5be-c241-4fe4-a046-c35d9fd5f43d service nova] Creating event network-changed:22215c64-0260-4e30-9f02-8885525102ef for instance a69d6968-901b-46da-8552-18fd0d647896 on n-h1-master-1 Oct 24 09:38:21.682302 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b64c4c21-664c-4e96-9a24-024442b0e954 req-d9e6c5be-c241-4fe4-a046-c35d9fd5f43d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132703 Oct 24 09:38:21.683430 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3454/6732] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:38:21.713052 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb1b79a9-6186-45dd-b997-b8dc5998dde4 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 204 len: 0 microversion: 2.1 time: 0.166723 Oct 24 09:38:21.713692 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3279/6733] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:38:21 2022] DELETE /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:38:21.723193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:21.724181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:21.730954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:21.731708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:21.732312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:21.733194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:21.733840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:21.734430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:21.947831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:21.956725 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7bf066a6-4fcd-431a-a37f-512d53339f6a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1734 microversion: 2.1 time: 0.238364 Oct 24 09:38:21.957327 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3455/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:21 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:22.982633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:22.983357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:22.990216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:22.990951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:22.991413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:22.993803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:22.993803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:22.993803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:23.145229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:23.153565 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-497e390a-5e7d-4c5d-a052-abb3f8fb592d tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1734 microversion: 2.1 time: 0.175635 Oct 24 09:38:23.154156 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3280/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:22 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:23.706807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7ce5c009-c713-46eb-9694-a08591a7669d req-9f6ffdeb-f65c-4f82-a541-4094dd581117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69d6968-901b-46da-8552-18fd0d647896", "name": "network-vif-deleted", "tag": "22215c64-0260-4e30-9f02-8885525102ef"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:23.719515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7ce5c009-c713-46eb-9694-a08591a7669d req-9f6ffdeb-f65c-4f82-a541-4094dd581117 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:23.720118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7ce5c009-c713-46eb-9694-a08591a7669d req-9f6ffdeb-f65c-4f82-a541-4094dd581117 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:23.720623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7ce5c009-c713-46eb-9694-a08591a7669d req-9f6ffdeb-f65c-4f82-a541-4094dd581117 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:23.732381 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7ce5c009-c713-46eb-9694-a08591a7669d req-9f6ffdeb-f65c-4f82-a541-4094dd581117 service nova] Creating event network-vif-deleted:22215c64-0260-4e30-9f02-8885525102ef for instance a69d6968-901b-46da-8552-18fd0d647896 on n-h1-master-1 Oct 24 09:38:23.738282 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7ce5c009-c713-46eb-9694-a08591a7669d req-9f6ffdeb-f65c-4f82-a541-4094dd581117 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Oct 24 09:38:23.738893 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3456/6736] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:38:24.176719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:24.178055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:24.185720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:24.186264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:24.186717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:24.187648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:24.188222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:24.189196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:24.223816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:24.224577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:24.225246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:24.225911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lazy-loading 'fault' on Instance uuid a69d6968-901b-46da-8552-18fd0d647896 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:38:24.276747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81e5d2ba9fc40398712a5d0531db7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddfb35413e745a9b82e8716819bc513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:24.287315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-993b7d33-7d62-4d7a-bdbe-4ad68077376b tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 200 len: 1389 microversion: 2.1 time: 0.114364 Oct 24 09:38:24.288363 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3281/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:24 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 1389 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:25.310272 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:25.315160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:25.315883 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] [instance: a69d6968-901b-46da-8552-18fd0d647896] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:25.322828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:25.323322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:25.323769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:25.324476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:25.324941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:25.325411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:25.339619 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] HTTP exception thrown: Instance a69d6968-901b-46da-8552-18fd0d647896 could not be found. Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Request method failure captured: Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 HTTP/1.1 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlzQPUgwmsXY9C_1ZwGT67lnghXCbDyh4mdbLPWFqUURsXqA-1zfFKRMVZYlGzYP8O-4y-hAUh2QSDtwg6y6mYDDwBcOnEDMdpD7Ga6bORxYg_OlMEBe_oFjLA1TBqrMPbupZLh7mLhieEQaJZ4q4SRS01CmJicyr0Jwm4kT15dhUTM Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 4ddfb35413e745a9b82e8716819bc513 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestServerBasicOps-276811177 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4ddfb35413e745a9b82e8716819bc513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4ddfb35413e745a9b82e8716819bc513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4ddfb35413e745a9b82e8716819bc513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4ddfb35413e745a9b82e8716819bc513"}]}] Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestServerBasicOps-276811177 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 4ddfb35413e745a9b82e8716819bc513 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestServerBasicOps-276811177 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestServerBasicOps-276811177-project Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: f81e5d2ba9fc40398712a5d0531db7c2 Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestServerBasicOps-276811177-project Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a69d6968-901b-46da-8552-18fd0d647896 could not be found. Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a69d6968-901b-46da-8552-18fd0d647896'} Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a69d6968-901b-46da-8552-18fd0d647896 could not be found. Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a69d6968-901b-46da-8552-18fd0d647896 could not be found. Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:38:25.341345 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a69d6968-901b-46da-8552-18fd0d647896 could not be found. Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Returning 404 to user: Instance a69d6968-901b-46da-8552-18fd0d647896 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2d82461-c374-4a2a-872d-e77e3574ad4a tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896" status: 404 len: 111 microversion: 2.1 time: 0.034545 Oct 24 09:38:25.346762 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3457/6738] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:25 2022] GET /compute/v2.1/servers/a69d6968-901b-46da-8552-18fd0d647896 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:25.514269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b73b6042-4d14-49f3-8c98-6cd5ae378264 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] Calling method '.version_select at 0x7f8dab93fca0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:25.541024 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b73b6042-4d14-49f3-8c98-6cd5ae378264 tempest-TestServerBasicOps-276811177 tempest-TestServerBasicOps-276811177-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1022353876" status: 202 len: 0 microversion: 2.1 time: 0.030056 Oct 24 09:38:25.546419 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3282/6739] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1022353876 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:38:32.691272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1525815677", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1714232235", "security_groups": [{"name": "tempest-secgroup-smoke-1804052703"}], "block_device_mapping_v2": [{"uuid": "1ed25279-5a9e-4d6b-8a36-e98a270aa7ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:32.870342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:38:33.411785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:38:33.412221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:38:33.412734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:38:33.413229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:38:33.413751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:38:33.422539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:33.423605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:33.424055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:33.424791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:33.425258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:33.425748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:33.442637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:38:33.447903 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:38:33.509240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:38:33.511430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ed25279-5a9e-4d6b-8a36-e98a270aa7ff',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:38:33.649635 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2600c1fd-56ce-4cc5-bc76-c4db82dac303 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.971146 Oct 24 09:38:33.650501 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3458/6740] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:38:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:38:33.661861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eccb9e77-6409-44b8-9c5c-04527dd4e8de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:33.662495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eccb9e77-6409-44b8-9c5c-04527dd4e8de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:33.739314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eccb9e77-6409-44b8-9c5c-04527dd4e8de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:33.748970 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eccb9e77-6409-44b8-9c5c-04527dd4e8de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1095 microversion: 2.1 time: 0.091213 Oct 24 09:38:33.764453 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3283/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:33 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:34.772377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:34.773009 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:34.779986 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:34.780813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:34.781257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:34.781980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:34.782949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:34.783388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:34.847128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:34.855517 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c20268f4-8a04-4b66-a6cc-155db2eaed84 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1193 microversion: 2.1 time: 0.087090 Oct 24 09:38:34.856128 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3459/6742] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:34 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:35.879786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:35.880320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:35.882346 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:35.902148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:35.902655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:35.903154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:35.903905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:35.904377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:35.904811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:36.114656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:36.122943 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-be648e10-5d90-451f-b3f5-69f0b9157406 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1279 microversion: 2.1 time: 0.247515 Oct 24 09:38:36.123655 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3284/6743] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:35 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:36.452246 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-18240f24-71fe-47bd-a44f-6ffb1ddf707d req-82fdb8c7-bece-42b4-8a91-75f981a8a5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971ee186-a92b-4771-b7ef-a2728b76d79a", "tag": "8d84ecf5-32df-4bce-a997-1368150174ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:36.465681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-18240f24-71fe-47bd-a44f-6ffb1ddf707d req-82fdb8c7-bece-42b4-8a91-75f981a8a5fd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:36.466661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-18240f24-71fe-47bd-a44f-6ffb1ddf707d req-82fdb8c7-bece-42b4-8a91-75f981a8a5fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:36.467414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-18240f24-71fe-47bd-a44f-6ffb1ddf707d req-82fdb8c7-bece-42b4-8a91-75f981a8a5fd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:36.471400 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=48 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:36.483010 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-18240f24-71fe-47bd-a44f-6ffb1ddf707d req-82fdb8c7-bece-42b4-8a91-75f981a8a5fd service nova] Creating event network-changed:8d84ecf5-32df-4bce-a997-1368150174ea for instance 971ee186-a92b-4771-b7ef-a2728b76d79a on n-h1-master-1 Oct 24 09:38:36.488382 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-18240f24-71fe-47bd-a44f-6ffb1ddf707d req-82fdb8c7-bece-42b4-8a91-75f981a8a5fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040234 Oct 24 09:38:36.489012 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3460/6744] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:38:37.146518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:37.147832 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:37.155357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:37.155889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:37.156341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:37.157054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:37.157673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:37.158415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:37.394433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:37.402393 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46ef13bb-1730-482f-b3c5-d5175365fb1c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1279 microversion: 2.1 time: 0.259851 Oct 24 09:38:37.413362 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3285/6745] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:37 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:38.428505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:38.429151 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:38.435462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:38.435958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:38.436407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:38.437108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:38.437619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:38.438057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:38.570790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:38.578551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-552137aa-2c5e-47de-b0ae-361fe72e74b8 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1279 microversion: 2.1 time: 0.155380 Oct 24 09:38:38.579131 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3461/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:38 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:39.601372 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:39.602078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:39.609236 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:39.609770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:39.610227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:39.611463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:39.611938 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:39.612380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:39.751601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:39.759454 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4613e193-3912-4746-ab43-df44de601c8b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1279 microversion: 2.1 time: 0.162051 Oct 24 09:38:39.760057 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3286/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:39 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:40.783444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:40.784020 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:40.790966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:40.791455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:40.791895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:40.792591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:40.793052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:40.793525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:40.925800 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:40.933453 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0994d059-21f2-464e-88c4-fb25db3d9970 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.154045 Oct 24 09:38:40.934025 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3462/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:40 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:41.957366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:41.957991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:41.965003 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:41.965537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:41.965990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:41.966693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:41.967159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:41.967596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:42.097571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:42.105186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e9cd1b6-c9ff-4cdc-b10e-33193419ce00 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.152372 Oct 24 09:38:42.105851 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3287/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:41 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:43.128125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:43.128750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:43.135787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:43.136281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:43.136725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:43.137467 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:43.137935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:43.138372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:43.268467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:43.276190 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f18367d8-7167-46de-bbbd-09a08611d3c5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.152041 Oct 24 09:38:43.276775 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3463/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:43 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:44.299953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:44.300570 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:44.303415 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:44.308771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:44.309264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:44.309739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:44.310436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:44.310903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:44.311340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:44.445211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:44.452920 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-969a7fd9-baa0-4e33-92b6-8ca2d1877283 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.156933 Oct 24 09:38:44.453503 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3288/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:44 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:45.478011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:45.478818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:45.480804 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:45.481728 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:45.489028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:45.489552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:45.490000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:45.490722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:45.491190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:45.491626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:45.631077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:45.638796 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e75bd9f-7fc4-464b-aeac-e4eebe0e6fed tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.164773 Oct 24 09:38:45.639368 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3464/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:45 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:46.661463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:46.662101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:46.668930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:46.669479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:46.669937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:46.670640 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:46.671109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:46.671552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:46.802989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:46.810769 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8485d219-d04b-4e4f-a3be-4231b6b91e9e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.153753 Oct 24 09:38:46.811344 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3289/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:46 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:47.833938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:47.834470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:47.841308 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:47.841805 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:47.842251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:47.842948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:47.843407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:47.843837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:47.979310 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:47.988068 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7a1f972-74b7-4c4f-b523-d272e444e19d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.158639 Oct 24 09:38:47.988651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3465/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:47 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:49.010724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:49.011388 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:49.018642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:49.019145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:49.019602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:49.020313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:49.020787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:49.021233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:49.156266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:49.164878 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9076531f-343e-4aad-9da1-39b65aa34f92 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.158069 Oct 24 09:38:49.165488 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3290/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:49 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:50.187722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:50.188378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:50.195819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:50.196310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:50.196753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:50.197492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:50.197958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:50.198392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:50.331263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:50.339150 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19b8033c-95eb-4179-806b-2e6270dd2fa2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.155380 Oct 24 09:38:50.339739 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3466/6756] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:50 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:51.361772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:51.362403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:51.369185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:51.369715 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:51.370169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:51.370874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:51.371345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:51.371790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:51.506800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:51.514761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2aa3ac3e-a83e-40ee-b417-3f1dd3d633e6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.157504 Oct 24 09:38:51.515349 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3291/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:51 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:51.695044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a17fe2b3-2092-4305-8245-7096a1ee2f47 req-008d81c1-a305-4ef4-a454-8dfd9d3b4867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ee186-a92b-4771-b7ef-a2728b76d79a", "name": "network-vif-plugged", "status": "completed", "tag": "8d84ecf5-32df-4bce-a997-1368150174ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:51.699981 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:51.705730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a17fe2b3-2092-4305-8245-7096a1ee2f47 req-008d81c1-a305-4ef4-a454-8dfd9d3b4867 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:51.706219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a17fe2b3-2092-4305-8245-7096a1ee2f47 req-008d81c1-a305-4ef4-a454-8dfd9d3b4867 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:51.706660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a17fe2b3-2092-4305-8245-7096a1ee2f47 req-008d81c1-a305-4ef4-a454-8dfd9d3b4867 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:51.717941 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a17fe2b3-2092-4305-8245-7096a1ee2f47 req-008d81c1-a305-4ef4-a454-8dfd9d3b4867 service nova] Creating event network-vif-plugged:8d84ecf5-32df-4bce-a997-1368150174ea for instance 971ee186-a92b-4771-b7ef-a2728b76d79a on n-h1-master-1 Oct 24 09:38:51.723434 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a17fe2b3-2092-4305-8245-7096a1ee2f47 req-008d81c1-a305-4ef4-a454-8dfd9d3b4867 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160031 Oct 24 09:38:51.724026 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3467/6758] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:38:52.539957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:52.540590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:52.542556 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:52.548913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:52.549001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:52.549498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:52.550199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:52.550673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:52.551123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:52.684315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:52.692212 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6e0af7e-2c16-489a-976c-2a845e15a646 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1267 microversion: 2.1 time: 0.156606 Oct 24 09:38:52.692797 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3292/6759] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:52 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:53.715815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:53.716519 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:53.722664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:53.723144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:53.723581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:53.724262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:53.724717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:53.725140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:53.861667 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:53.869389 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0df87058-0fbe-45d5-b328-5426121705d3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1455 microversion: 2.1 time: 0.158784 Oct 24 09:38:53.869957 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3468/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:53 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:53.892284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:38:53.892919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:38:53.899650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:53.900142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:53.900591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:53.901288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:53.901777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:53.902213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:54.032163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:38:54.039944 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56aefa09-44d8-4903-9e23-4c59ab894ac5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1455 microversion: 2.1 time: 0.152019 Oct 24 09:38:54.040528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3293/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:38:53 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:38:55.902895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ae80d6dc-3242-416c-9c4f-b6e64c918183 req-59a8a6f3-17bc-46f5-b8db-492b725bfeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971ee186-a92b-4771-b7ef-a2728b76d79a", "tag": "8d84ecf5-32df-4bce-a997-1368150174ea"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:38:55.913393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae80d6dc-3242-416c-9c4f-b6e64c918183 req-59a8a6f3-17bc-46f5-b8db-492b725bfeb1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:38:55.913967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae80d6dc-3242-416c-9c4f-b6e64c918183 req-59a8a6f3-17bc-46f5-b8db-492b725bfeb1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:38:55.914482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae80d6dc-3242-416c-9c4f-b6e64c918183 req-59a8a6f3-17bc-46f5-b8db-492b725bfeb1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:38:55.926485 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ae80d6dc-3242-416c-9c4f-b6e64c918183 req-59a8a6f3-17bc-46f5-b8db-492b725bfeb1 service nova] Creating event network-changed:8d84ecf5-32df-4bce-a997-1368150174ea for instance 971ee186-a92b-4771-b7ef-a2728b76d79a on n-h1-master-1 Oct 24 09:38:55.938576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ae80d6dc-3242-416c-9c4f-b6e64c918183 req-59a8a6f3-17bc-46f5-b8db-492b725bfeb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035078 Oct 24 09:38:55.941174 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3469/6762] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:40:50.186178 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:40:50.187019 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=60 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:40:50.188115 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:40:50.188427 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a (ip 10.222.0.25) !!! Oct 24 09:40:50.189885 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 24 09:40:50.190667 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 24 09:40:50.310844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:50.311430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:50.317408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:50.317901 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:50.318347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:50.319041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:50.319510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:50.319949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:50.346918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:40:50.423254 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bd363eb-223e-4fa2-b45f-fe69dbde0b0a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 204 len: 0 microversion: 2.1 time: 0.238695 Oct 24 09:40:50.423931 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3294/6763] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:40:50 2022] DELETE /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:40:50.431652 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:40:50.433134 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:40:50.433912 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=47 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:40:50.435937 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 09:40:50.436082 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a (ip 10.222.0.25) !!! Oct 24 09:40:50.448312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:50.449026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:50.456969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:50.457511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:50.457960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:50.459239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:50.459239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:50.459581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:50.590940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:50.598928 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-015e91b8-3907-4da7-acf1-e13ec528b156 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1578 microversion: 2.1 time: 0.169337 Oct 24 09:40:50.599511 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3470/6764] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:50 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:51.623344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:51.624054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:51.631542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:51.632036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:51.632491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:51.633185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:51.633674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:51.634114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:51.765472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:51.773695 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5d5c3fc-def2-4d4d-91de-c23e0770673d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1578 microversion: 2.1 time: 0.155162 Oct 24 09:40:51.774277 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3295/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:51 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:52.796957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:52.797638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:52.805228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:52.805746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:52.806191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:52.806897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:52.807360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:52.807792 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:52.814031 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58104. Oct 24 09:40:52.877052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:52.885902 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c43c5cc-7f5e-4957-8a97-dc30da7a0fd9 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1510 microversion: 2.1 time: 0.093787 Oct 24 09:40:52.886987 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3471/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:52 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:52.946160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-92f51ce5-a672-40b6-8564-db92fa0b4d84 req-c74267b0-ebe7-4e17-823d-754079c0a8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ee186-a92b-4771-b7ef-a2728b76d79a", "name": "network-vif-deleted", "tag": "8d84ecf5-32df-4bce-a997-1368150174ea"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:40:52.956186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-92f51ce5-a672-40b6-8564-db92fa0b4d84 req-c74267b0-ebe7-4e17-823d-754079c0a8be service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:52.956682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-92f51ce5-a672-40b6-8564-db92fa0b4d84 req-c74267b0-ebe7-4e17-823d-754079c0a8be service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:52.957132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-92f51ce5-a672-40b6-8564-db92fa0b4d84 req-c74267b0-ebe7-4e17-823d-754079c0a8be service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:52.969622 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-92f51ce5-a672-40b6-8564-db92fa0b4d84 req-c74267b0-ebe7-4e17-823d-754079c0a8be service nova] Creating event network-vif-deleted:8d84ecf5-32df-4bce-a997-1368150174ea for instance 971ee186-a92b-4771-b7ef-a2728b76d79a on n-h1-master-1 Oct 24 09:40:52.975292 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-92f51ce5-a672-40b6-8564-db92fa0b4d84 req-c74267b0-ebe7-4e17-823d-754079c0a8be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Oct 24 09:40:52.976347 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3296/6767] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:40:53.909532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:53.910154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:53.917188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:53.917710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:53.918155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:53.918863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:53.919889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:53.920506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:53.988927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:54.003893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5744def2-8d2f-42b0-9c22-9a0647809b2f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1226 microversion: 2.1 time: 0.098215 Oct 24 09:40:54.004711 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3472/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:53 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:55.029269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:55.029937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:55.036191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:55.036692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:55.037147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:55.037880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:55.038352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:55.038796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:55.103019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:55.110984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ba70b6c3-839f-440e-a220-8f848cd968b5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1226 microversion: 2.1 time: 0.087313 Oct 24 09:40:55.111562 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3297/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:55 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:56.133207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:56.133888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:56.140920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:56.141453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:56.141902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:56.142632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:56.143098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:56.143533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:56.209873 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:56.219162 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df288a66-9981-4f41-9109-fd89e6e1a883 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1226 microversion: 2.1 time: 0.089792 Oct 24 09:40:56.219760 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3473/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:56 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:57.242001 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:57.242635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:57.249689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:57.250194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:57.250646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:57.251355 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:57.251824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:57.252268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:57.287139 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:57.287554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:57.288007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:57.288461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lazy-loading 'fault' on Instance uuid 971ee186-a92b-4771-b7ef-a2728b76d79a {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:40:57.333074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:57.340890 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bee78635-4935-4254-a776-67e6cc3c3b2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 200 len: 1231 microversion: 2.1 time: 0.102774 Oct 24 09:40:57.342013 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3298/6771] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:57 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:40:58.364270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:58.364894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:58.371816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:58.372830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:58.373277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:58.374067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:58.374534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:58.374968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:58.388609 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a HTTP/1.1 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '971ee186-a92b-4771-b7ef-a2728b76d79a'} Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:40:58.390295 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-38dbfad0-c33d-4b95-bd99-736e17630e83 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 404 len: 111 microversion: 2.1 time: 0.031424 Oct 24 09:40:58.395160 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3474/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:58 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:40:58.442147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1506107029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1714232235", "security_groups": [{"name": "tempest-secgroup-smoke-1804052703"}], "block_device_mapping_v2": [{"uuid": "1ed25279-5a9e-4d6b-8a36-e98a270aa7ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:40:58.563686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:40:59.110967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:40:59.111419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:40:59.111996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:40:59.112459 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:40:59.112954 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:40:59.122048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:59.122541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:59.122990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:59.123753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:40:59.124217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:40:59.124665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:40:59.142498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:40:59.148016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:40:59.207903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:40:59.210043 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ed25279-5a9e-4d6b-8a36-e98a270aa7ff',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:40:59.336901 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f761451-6dce-42f3-a92d-51ac7099de93 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.898534 Oct 24 09:40:59.337585 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3299/6773] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:40:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:40:59.349035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-177fddf7-275d-4e7c-b56d-b9b6cd46d91c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:40:59.349700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-177fddf7-275d-4e7c-b56d-b9b6cd46d91c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:40:59.405229 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-177fddf7-275d-4e7c-b56d-b9b6cd46d91c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:40:59.412723 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-177fddf7-275d-4e7c-b56d-b9b6cd46d91c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1095 microversion: 2.1 time: 0.067622 Oct 24 09:40:59.413619 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3475/6774] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:40:59 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:00.437647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:00.438308 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:00.444435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:00.444921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:00.445445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:00.446165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:00.446635 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:00.447085 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:00.548785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:00.556768 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06cf3968-826a-4ac9-8f08-314b5566bb7e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1201 microversion: 2.1 time: 0.124878 Oct 24 09:41:00.557363 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3300/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:00 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1201 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:01.580986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:01.581753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:01.588670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:01.589246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:01.589836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:01.590762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:01.591802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:01.592312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:01.740604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:01.749117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1470e75-1439-4ced-adc5-2536d908ddba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1279 microversion: 2.1 time: 0.172204 Oct 24 09:41:01.749812 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3476/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:01 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:01.910814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ead0e6d1-48cb-4b08-8c14-4479a985ce20 req-355befa6-a19e-4a14-b169-f373870b09c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7645074e-5bb2-4199-8fb2-03ad1592debc", "tag": "711f3dba-7506-4939-af56-7d2ab67354d2"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:41:01.923747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ead0e6d1-48cb-4b08-8c14-4479a985ce20 req-355befa6-a19e-4a14-b169-f373870b09c8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:01.924256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ead0e6d1-48cb-4b08-8c14-4479a985ce20 req-355befa6-a19e-4a14-b169-f373870b09c8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:01.924709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ead0e6d1-48cb-4b08-8c14-4479a985ce20 req-355befa6-a19e-4a14-b169-f373870b09c8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:01.937449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ead0e6d1-48cb-4b08-8c14-4479a985ce20 req-355befa6-a19e-4a14-b169-f373870b09c8 service nova] Creating event network-changed:711f3dba-7506-4939-af56-7d2ab67354d2 for instance 7645074e-5bb2-4199-8fb2-03ad1592debc on n-h1-master-1 Oct 24 09:41:01.942593 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ead0e6d1-48cb-4b08-8c14-4479a985ce20 req-355befa6-a19e-4a14-b169-f373870b09c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035505 Oct 24 09:41:01.943427 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3301/6777] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:41:02.772493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:02.773602 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:02.782329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:02.782827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:02.783606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:02.784332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:02.784982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:02.785439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:02.941652 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:02.954426 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64425df1-ec92-464f-9ee3-c62984778858 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1279 microversion: 2.1 time: 0.185903 Oct 24 09:41:02.955391 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3477/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:02 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:03.980463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:03.981069 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:03.988340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:03.989094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:03.989819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:03.990803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:03.991279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:03.991724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:04.123964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:04.131803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc69f98a-52d6-40bd-ad07-e3b790c28a72 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1279 microversion: 2.1 time: 0.157156 Oct 24 09:41:04.132373 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3302/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:03 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:05.155899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:05.156567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:05.163714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:05.164218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:05.164668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:05.165413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:05.165883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:05.166333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:05.307218 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:05.315691 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3f47d16-a78d-422c-8b95-16be94a66996 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1279 microversion: 2.1 time: 0.164285 Oct 24 09:41:05.316286 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3478/6780] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:05 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:06.338950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:06.339576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:06.347105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:06.347603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:06.348062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:06.348764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:06.349232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:06.349694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:06.477827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:06.486247 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d62ada84-e297-4d59-81e5-ecd6409cfd2b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.151251 Oct 24 09:41:06.486821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3303/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:06 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:07.509947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:07.510488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:07.517446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:07.517933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:07.518369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:07.519059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:07.519779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:07.520207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:07.654816 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:07.662686 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e2f12b4-6eda-4b32-9033-e5e7677df34a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.156720 Oct 24 09:41:07.663290 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3479/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:07 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:08.686226 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:08.686854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:08.693674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:08.694173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:08.694625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:08.695321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:08.695785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:08.696221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:08.833711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:08.842096 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19a191e2-99b9-4681-ba27-da04c19e3623 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.160380 Oct 24 09:41:08.842680 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3304/6783] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:08 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:09.865766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:09.866386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:09.869032 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:41:09.874444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:09.874938 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:09.875383 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:09.876075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:09.876533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:09.876965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:10.007130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:10.015451 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32e70402-465b-432e-b195-a9313a419734 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.153639 Oct 24 09:41:10.016018 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3480/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:09 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:11.038637 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:11.039220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:11.041186 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:41:11.041995 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:41:11.049381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:11.049882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:11.050336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:11.051042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:11.051511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:11.051953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:11.183203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:11.191618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b528571-8e42-47e9-8d2f-4413e46fc2d4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.156974 Oct 24 09:41:11.192202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3305/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:11 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:12.214487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:12.215103 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:12.221953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:12.222441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:12.222879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:12.223567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:12.224022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:12.224448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:12.357195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:12.364847 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0dbb4401-815d-4b44-b16e-ececc60bd93b tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.154311 Oct 24 09:41:12.365449 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3481/6786] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:12 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:13.388683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:13.389425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:13.396593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:13.397095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:13.397572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:13.398336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:13.398757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:13.399206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:13.532714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:13.540395 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a7bdc62e-6088-42b4-a428-deb341b4d78d tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.156204 Oct 24 09:41:13.540961 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3306/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:13 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:14.563821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:14.564498 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:14.571730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:14.572225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:14.572673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:14.573443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:14.573983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:14.574826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:14.711859 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:14.721672 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db43cdb0-b3ab-4d12-aa90-b230715da39e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.162208 Oct 24 09:41:14.722476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3482/6788] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:14 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:15.744530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:15.745079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:15.752459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:15.752958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:15.753444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:15.754148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:15.754618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:15.755058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:15.884113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:15.892494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b5273e0b-ba39-4986-a608-15ae02d332b3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.151989 Oct 24 09:41:15.893070 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3307/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:15 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:16.203195 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ab1cbb6a-b326-4bff-9ea6-7244314c7af4 req-943e2d25-a084-41dd-8f73-dfc78ae48845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7645074e-5bb2-4199-8fb2-03ad1592debc", "name": "network-vif-plugged", "status": "completed", "tag": "711f3dba-7506-4939-af56-7d2ab67354d2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:41:16.213862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ab1cbb6a-b326-4bff-9ea6-7244314c7af4 req-943e2d25-a084-41dd-8f73-dfc78ae48845 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:16.214351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ab1cbb6a-b326-4bff-9ea6-7244314c7af4 req-943e2d25-a084-41dd-8f73-dfc78ae48845 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:16.214790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ab1cbb6a-b326-4bff-9ea6-7244314c7af4 req-943e2d25-a084-41dd-8f73-dfc78ae48845 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:16.225854 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ab1cbb6a-b326-4bff-9ea6-7244314c7af4 req-943e2d25-a084-41dd-8f73-dfc78ae48845 service nova] Creating event network-vif-plugged:711f3dba-7506-4939-af56-7d2ab67354d2 for instance 7645074e-5bb2-4199-8fb2-03ad1592debc on n-h1-master-1 Oct 24 09:41:16.230820 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ab1cbb6a-b326-4bff-9ea6-7244314c7af4 req-943e2d25-a084-41dd-8f73-dfc78ae48845 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Oct 24 09:41:16.231920 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3483/6790] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:41:16.915455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:16.916091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:16.923154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:16.923655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:16.924111 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:16.924819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:16.925289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:16.925758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:17.056704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:17.065143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7615d31c-3a4e-422e-9b65-eb50d43b5f43 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1267 microversion: 2.1 time: 0.153669 Oct 24 09:41:17.065749 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3308/6791] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:16 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:18.089727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:18.090441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:18.096605 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:18.097092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:18.097560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:18.098253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:18.098714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:18.099142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:18.233490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:18.241756 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f53ace35-00e1-4f2d-9ffd-b14f00c3de38 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1454 microversion: 2.1 time: 0.157116 Oct 24 09:41:18.242339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3484/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:18 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:18.264122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:41:18.264791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:41:18.271920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:18.272414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:18.272855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:18.273585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:18.274052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:18.274489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:18.407395 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:41:18.415211 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eafbddac-09c9-4d2b-be0b-0cbbd92abb6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1454 microversion: 2.1 time: 0.154976 Oct 24 09:41:18.415790 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3309/6793] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:41:18 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:41:20.078029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e0d8fb0c-445f-4559-aa96-c88df076cd9b req-566dff53-7615-43c4-801c-1c364370fddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7645074e-5bb2-4199-8fb2-03ad1592debc", "tag": "711f3dba-7506-4939-af56-7d2ab67354d2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:41:20.088374 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e0d8fb0c-445f-4559-aa96-c88df076cd9b req-566dff53-7615-43c4-801c-1c364370fddd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:41:20.088858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e0d8fb0c-445f-4559-aa96-c88df076cd9b req-566dff53-7615-43c4-801c-1c364370fddd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:41:20.089289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e0d8fb0c-445f-4559-aa96-c88df076cd9b req-566dff53-7615-43c4-801c-1c364370fddd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:41:20.100517 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e0d8fb0c-445f-4559-aa96-c88df076cd9b req-566dff53-7615-43c4-801c-1c364370fddd service nova] Creating event network-changed:711f3dba-7506-4939-af56-7d2ab67354d2 for instance 7645074e-5bb2-4199-8fb2-03ad1592debc on n-h1-master-1 Oct 24 09:41:20.105580 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e0d8fb0c-445f-4559-aa96-c88df076cd9b req-566dff53-7615-43c4-801c-1c364370fddd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Oct 24 09:41:20.106196 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3485/6794] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:42:58.389414 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 09:42:58.390378 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17ac0623-892c-4f4d-af69-1915864327ee] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 09:42:58.390969 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:42:58.391756 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:42:58.393226 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 09:42:58.393434 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 24 09:42:58.398222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-260853397", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1714232235", "security_groups": [{"name": "tempest-secgroup-smoke-1804052703"}], "block_device_mapping_v2": [{"uuid": "ecfa4c89-a764-4f2b-adb4-1a67030ebcbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d98fef7-e3d8-4063-8323-e30a2e29da1d"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:42:58.659291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] validate_networks() for [('4d98fef7-e3d8-4063-8323-e30a2e29da1d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:42:59.020415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:42:59.020860 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:42:59.021407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:42:59.022105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:42:59.022534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:42:59.031906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:42:59.032404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:42:59.032858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:42:59.033712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:42:59.034188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:42:59.034633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:42:59.051928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:42:59.057314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Getting quotas for user db0afba834c04bdc92565bf8e9a57ee9 and project ec0e7acf72144b558f1ba2f863244f89. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:42:59.114673 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:42:59.116818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecfa4c89-a764-4f2b-adb4-1a67030ebcbf',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:42:59.254464 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e71a32de-46dc-4da7-b3bd-d72266de48ee tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.867517 Oct 24 09:42:59.255137 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3310/6795] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:42:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:42:59.264497 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:42:59.266974 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 24 09:42:59.267719 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=34 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:42:59.268644 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=78 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:42:59.270621 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:42:59.271191 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 (ip 10.222.0.25) !!! Oct 24 09:42:59.280457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95173e3a-9ca8-4954-856a-a8c8e9f848a2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:42:59.281600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95173e3a-9ca8-4954-856a-a8c8e9f848a2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:42:59.434194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95173e3a-9ca8-4954-856a-a8c8e9f848a2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:42:59.441153 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95173e3a-9ca8-4954-856a-a8c8e9f848a2 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1094 microversion: 2.1 time: 0.178355 Oct 24 09:42:59.441716 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3486/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:42:59 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1094 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:00.468121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:00.468819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:00.478124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:00.478796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:00.479312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:00.480182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:00.480652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:00.481192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:00.500220 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [17ac0623-892c-4f4d-af69-1915864327ee] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58328. Oct 24 09:43:00.501119 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58326. Oct 24 09:43:00.551042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:00.559672 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36fc6827-bddc-4f7a-ad77-a1a63cb05a8e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1210 microversion: 2.1 time: 0.098212 Oct 24 09:43:00.560446 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3311/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:00 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:01.582068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:01.582788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:01.591423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:01.592169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:01.592814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:01.593653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:01.594554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:01.595065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:01.615537 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58334. Oct 24 09:43:01.619898 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58336. Oct 24 09:43:01.821389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:01.830430 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e581619-c2dd-4ad4-b8e2-05afdde90fce tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1278 microversion: 2.1 time: 0.252198 Oct 24 09:43:01.831055 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3487/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:01 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:43:02.099154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e96dc6b4-84b5-4c97-a965-2a714fde9da7 req-c722d236-1aca-4f46-a242-de14dab03d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d00387-9e4a-45ea-be92-3a0a3daff021", "tag": "fd84c9b3-2d5e-4433-ad81-d5f4e392fc53"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:43:02.111221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e96dc6b4-84b5-4c97-a965-2a714fde9da7 req-c722d236-1aca-4f46-a242-de14dab03d96 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:02.111725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e96dc6b4-84b5-4c97-a965-2a714fde9da7 req-c722d236-1aca-4f46-a242-de14dab03d96 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:02.112175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e96dc6b4-84b5-4c97-a965-2a714fde9da7 req-c722d236-1aca-4f46-a242-de14dab03d96 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:02.124627 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e96dc6b4-84b5-4c97-a965-2a714fde9da7 req-c722d236-1aca-4f46-a242-de14dab03d96 service nova] Creating event network-changed:fd84c9b3-2d5e-4433-ad81-d5f4e392fc53 for instance 66d00387-9e4a-45ea-be92-3a0a3daff021 on n-h2-master-1 Oct 24 09:43:02.131395 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e96dc6b4-84b5-4c97-a965-2a714fde9da7 req-c722d236-1aca-4f46-a242-de14dab03d96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126558 Oct 24 09:43:02.132661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3312/6799] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:43:02.854406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:02.856287 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:02.863582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:02.864177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:02.864691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:02.865535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:02.866069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:02.866589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:03.077130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:03.085746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8b3ef2b-a762-4114-999c-8a7174194174 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1278 microversion: 2.1 time: 0.235421 Oct 24 09:43:03.086486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3488/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:02 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:04.110242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:04.111155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:04.117488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:04.117993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:04.118448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:04.119153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:04.119627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:04.120072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:04.257363 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:04.265656 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd2cbb32-3e79-43a0-aa5e-b0480a0114de tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1278 microversion: 2.1 time: 0.161135 Oct 24 09:43:04.266234 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3313/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:04 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:05.289571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:05.290198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:05.297279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:05.297839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:05.298288 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:05.299013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:05.299477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:05.299912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:05.437486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:05.445761 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-717ffc20-cf60-4224-a439-f53c69fa062e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1278 microversion: 2.1 time: 0.160116 Oct 24 09:43:05.446358 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3489/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:05 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:06.469931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:06.470464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:06.477967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:06.478481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:06.479002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:06.479717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:06.480250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:06.480759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:06.645639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:06.655411 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a74b5ce9-da3a-48d9-aa26-458e6c44dea6 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.189308 Oct 24 09:43:06.656340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3314/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:06 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:07.686274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:07.687125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:07.694780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:07.695431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:07.695876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:07.696590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:07.697102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:07.697565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:08.142297 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:08.150436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8d031cc-f44b-43e0-b37d-4c2dc882ceea tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.468850 Oct 24 09:43:08.151017 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3490/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:07 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:09.174198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:09.174833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:09.177718 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:43:09.178407 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:43:09.184148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:09.184642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:09.185107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:09.185870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:09.186347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:09.186795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:09.320137 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:09.328392 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8567f0d7-4cf9-449e-8c85-3f568c5cf8a4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.158218 Oct 24 09:43:09.328988 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3315/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:09 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:10.351791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:10.352415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:10.355681 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:43:10.361072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:10.361586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:10.362028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:10.362721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:10.363183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:10.363612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:10.492260 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:10.501215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-600784d1-6203-42db-8941-6ff47ef00f55 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.153267 Oct 24 09:43:10.501834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3491/6806] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:10 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:11.523810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:11.524360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:11.531324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:11.531814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:11.532261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:11.532956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:11.533454 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:11.533893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:11.668234 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:11.675946 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38e883e6-601f-4e26-90cd-3bb2af2d25dd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.156476 Oct 24 09:43:11.676510 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3316/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:11 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:12.698555 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:12.699753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:12.706590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:12.707071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:12.707507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:12.708192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:12.708647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:12.709070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:12.839332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:12.847579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7be2e56e-c68f-4d59-8109-07ec0846ffb3 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.152903 Oct 24 09:43:12.848173 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3492/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:12 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:13.871249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:13.871885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:13.878707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:13.879215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:13.879673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:13.880385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:13.880862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:13.881343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:14.013665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:14.021430 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a075de3b-ef8c-48f5-bef1-8d2bdbe6fe88 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.154618 Oct 24 09:43:14.022270 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3317/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:13 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:15.044022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:15.044649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:15.051702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:15.052195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:15.052637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:15.053380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:15.053847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:15.054286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:15.194011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:15.202931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-29961057-4c55-4bb5-ae81-d6ef8bcc14f1 req-cde0874d-ca87-4427-a84d-c07315fb0306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d00387-9e4a-45ea-be92-3a0a3daff021", "name": "network-vif-plugged", "status": "completed", "tag": "fd84c9b3-2d5e-4433-ad81-d5f4e392fc53"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:43:15.203510 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfe200d9-2574-4f3f-981c-bb283d8d4f94 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.162777 Oct 24 09:43:15.215511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-29961057-4c55-4bb5-ae81-d6ef8bcc14f1 req-cde0874d-ca87-4427-a84d-c07315fb0306 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:15.216306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-29961057-4c55-4bb5-ae81-d6ef8bcc14f1 req-cde0874d-ca87-4427-a84d-c07315fb0306 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:15.216823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-29961057-4c55-4bb5-ae81-d6ef8bcc14f1 req-cde0874d-ca87-4427-a84d-c07315fb0306 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:15.217750 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3493/6810] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:15 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:15.228320 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-29961057-4c55-4bb5-ae81-d6ef8bcc14f1 req-cde0874d-ca87-4427-a84d-c07315fb0306 service nova] Creating event network-vif-plugged:fd84c9b3-2d5e-4433-ad81-d5f4e392fc53 for instance 66d00387-9e4a-45ea-be92-3a0a3daff021 on n-h2-master-1 Oct 24 09:43:15.234358 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-29961057-4c55-4bb5-ae81-d6ef8bcc14f1 req-cde0874d-ca87-4427-a84d-c07315fb0306 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036700 Oct 24 09:43:15.234966 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3318/6811] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:43:16.226492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:16.227107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:16.234451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:16.234933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:16.235367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:16.236052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:16.236507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:16.236930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:16.371464 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:16.379537 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ff41297-1ec0-42eb-9e07-9fe7e6a00995 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1266 microversion: 2.1 time: 0.156964 Oct 24 09:43:16.380104 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3494/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:16 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:17.404766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:17.405423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:17.411581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:17.412072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:17.412516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:17.413206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:17.413697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:17.414481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:17.549783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:17.557548 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-789a060c-2203-4618-b689-5dfc130752a5 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1454 microversion: 2.1 time: 0.158421 Oct 24 09:43:17.558135 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3319/6813] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:17 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:17.579780 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:43:17.580397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:43:17.587112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:17.587591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:17.588029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:17.588720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:17.589177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:17.589728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:17.718296 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:43:17.726096 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f75f37e-27df-4a50-9f0d-bedf985ec29c tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1454 microversion: 2.1 time: 0.150123 Oct 24 09:43:17.726674 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3495/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:43:17 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:43:19.624980 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-aaff2c3c-aeec-4d32-9a1e-66bce9b3a420 req-371d159b-0add-40fd-aaed-31ea2897b618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d00387-9e4a-45ea-be92-3a0a3daff021", "tag": "fd84c9b3-2d5e-4433-ad81-d5f4e392fc53"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:43:19.635055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aaff2c3c-aeec-4d32-9a1e-66bce9b3a420 req-371d159b-0add-40fd-aaed-31ea2897b618 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:43:19.635840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aaff2c3c-aeec-4d32-9a1e-66bce9b3a420 req-371d159b-0add-40fd-aaed-31ea2897b618 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:43:19.636863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-aaff2c3c-aeec-4d32-9a1e-66bce9b3a420 req-371d159b-0add-40fd-aaed-31ea2897b618 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:43:19.650490 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-aaff2c3c-aeec-4d32-9a1e-66bce9b3a420 req-371d159b-0add-40fd-aaed-31ea2897b618 service nova] Creating event network-changed:fd84c9b3-2d5e-4433-ad81-d5f4e392fc53 for instance 66d00387-9e4a-45ea-be92-3a0a3daff021 on n-h2-master-1 Oct 24 09:43:19.655833 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-aaff2c3c-aeec-4d32-9a1e-66bce9b3a420 req-371d159b-0add-40fd-aaed-31ea2897b618 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035334 Oct 24 09:43:19.656570 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3320/6815] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:44:59.574210 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=22 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:44:59.576140 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=54 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:44:59.576865 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:44:59.577452 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:44:59.577867 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 (ip 10.222.0.25) !!! Oct 24 09:44:59.577975 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=50 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:44:59.580160 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:44:59.580300 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 (ip 10.222.0.25) !!! Oct 24 09:44:59.591003 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:44:59.591730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:44:59.603279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:44:59.603763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:44:59.604397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:44:59.605099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:44:59.605740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:44:59.606167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:44:59.636824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:44:59.658894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b675e4c2-cf15-4659-9fe7-629f4fc48a27 req-ae5a7fba-4e73-417c-b97d-9a711d74de51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d00387-9e4a-45ea-be92-3a0a3daff021", "tag": "fd84c9b3-2d5e-4433-ad81-d5f4e392fc53"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:44:59.670823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b675e4c2-cf15-4659-9fe7-629f4fc48a27 req-ae5a7fba-4e73-417c-b97d-9a711d74de51 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:44:59.671423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b675e4c2-cf15-4659-9fe7-629f4fc48a27 req-ae5a7fba-4e73-417c-b97d-9a711d74de51 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:44:59.672127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b675e4c2-cf15-4659-9fe7-629f4fc48a27 req-ae5a7fba-4e73-417c-b97d-9a711d74de51 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:44:59.684617 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b675e4c2-cf15-4659-9fe7-629f4fc48a27 req-ae5a7fba-4e73-417c-b97d-9a711d74de51 service nova] Creating event network-changed:fd84c9b3-2d5e-4433-ad81-d5f4e392fc53 for instance 66d00387-9e4a-45ea-be92-3a0a3daff021 on n-h2-master-1 Oct 24 09:44:59.690158 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b675e4c2-cf15-4659-9fe7-629f4fc48a27 req-ae5a7fba-4e73-417c-b97d-9a711d74de51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115933 Oct 24 09:44:59.691438 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3321/6816] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:44:59.729132 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd36ddd8-6473-4515-9716-3c04d806f352 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 204 len: 0 microversion: 2.1 time: 0.157340 Oct 24 09:44:59.732006 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3496/6817] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:44:59 2022] DELETE /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:44:59.741733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:44:59.742611 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:44:59.749067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:44:59.749793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:44:59.750349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:44:59.751297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:44:59.751888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:44:59.752442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:44:59.890526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:44:59.898496 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ee92634-67a3-4dca-920d-5e324fb9f5e4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1579 microversion: 2.1 time: 0.162040 Oct 24 09:44:59.899340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3322/6818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:44:59 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:00.923033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:00.923745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:00.931067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:00.931565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:00.932007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:00.932739 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:00.933354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:00.933791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:01.115377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:01.124387 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0bf48792-56f0-4525-a4f6-f223b3f1718a tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1579 microversion: 2.1 time: 0.205655 Oct 24 09:45:01.124982 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3497/6819] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:00 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1579 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:01.967802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a343d2c2-6260-4c00-8cf0-743f1dea559f req-35351fc3-bc5b-4cd3-b8e5-140b79e93aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d00387-9e4a-45ea-be92-3a0a3daff021", "name": "network-vif-deleted", "tag": "fd84c9b3-2d5e-4433-ad81-d5f4e392fc53"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:01.979714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a343d2c2-6260-4c00-8cf0-743f1dea559f req-35351fc3-bc5b-4cd3-b8e5-140b79e93aa6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:01.980211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a343d2c2-6260-4c00-8cf0-743f1dea559f req-35351fc3-bc5b-4cd3-b8e5-140b79e93aa6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:01.980655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a343d2c2-6260-4c00-8cf0-743f1dea559f req-35351fc3-bc5b-4cd3-b8e5-140b79e93aa6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:01.992172 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a343d2c2-6260-4c00-8cf0-743f1dea559f req-35351fc3-bc5b-4cd3-b8e5-140b79e93aa6 service nova] Creating event network-vif-deleted:fd84c9b3-2d5e-4433-ad81-d5f4e392fc53 for instance 66d00387-9e4a-45ea-be92-3a0a3daff021 on n-h2-master-1 Oct 24 09:45:01.997715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a343d2c2-6260-4c00-8cf0-743f1dea559f req-35351fc3-bc5b-4cd3-b8e5-140b79e93aa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Oct 24 09:45:01.998327 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3323/6820] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:02.150132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:02.150778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:02.156821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:02.157332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:02.157778 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:02.158500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:02.158957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:02.159518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:02.226449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:02.234575 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a338c48c-0feb-42e6-96a2-0c236112d71e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1225 microversion: 2.1 time: 0.090255 Oct 24 09:45:02.235419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3498/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:02 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:03.260382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:03.261127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:03.267404 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:03.267898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:03.268347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:03.269044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:03.269539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:03.269978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:03.334163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:03.341961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e5a5e1b-1a23-4301-811e-f1e24f324c13 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1225 microversion: 2.1 time: 0.086817 Oct 24 09:45:03.342531 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3324/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:03 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:04.365204 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:04.365664 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:04.372644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:04.373152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:04.373631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:04.374349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:04.374817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:04.375252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:04.443178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:04.451065 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57af7d11-dd52-4258-8d87-29a0411e5dc0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1225 microversion: 2.1 time: 0.090521 Oct 24 09:45:04.451644 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3499/6823] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:04 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:05.475080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:05.475635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:05.482242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:05.482741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:05.483192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:05.483899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:05.484372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:05.484814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:05.549848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:05.557646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0c9b662-bfe0-490c-8f26-1a4153a5d1f4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 200 len: 1225 microversion: 2.1 time: 0.086671 Oct 24 09:45:05.558219 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3325/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:05 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:06.580857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:06.581525 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 66d00387-9e4a-45ea-be92-3a0a3daff021] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:06.589863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:06.590572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:06.591024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:06.591750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:06.592194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:06.592624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:06.606494 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 66d00387-9e4a-45ea-be92-3a0a3daff021 could not be found. Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 HTTP/1.1 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 66d00387-9e4a-45ea-be92-3a0a3daff021 could not be found. Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '66d00387-9e4a-45ea-be92-3a0a3daff021'} Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d00387-9e4a-45ea-be92-3a0a3daff021 could not be found. Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d00387-9e4a-45ea-be92-3a0a3daff021 could not be found. Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:06.608174 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d00387-9e4a-45ea-be92-3a0a3daff021 could not be found. Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 66d00387-9e4a-45ea-be92-3a0a3daff021 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8e9ae91-dabb-4b5a-8f80-4767c2b6226e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021" status: 404 len: 111 microversion: 2.1 time: 0.032900 Oct 24 09:45:06.612961 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3500/6825] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:06 2022] GET /compute/v2.1/servers/66d00387-9e4a-45ea-be92-3a0a3daff021 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:45:13.127034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:13.128113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:13.130136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-eaf3712e-2cb3-4033-8bdb-52e719bcac27 req-64192aa8-155b-401e-88bb-4cf66545e084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7645074e-5bb2-4199-8fb2-03ad1592debc", "tag": "711f3dba-7506-4939-af56-7d2ab67354d2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:13.135474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:13.135981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:13.136471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:13.137156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:13.137898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:13.138420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:13.141665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eaf3712e-2cb3-4033-8bdb-52e719bcac27 req-64192aa8-155b-401e-88bb-4cf66545e084 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:13.151380 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eaf3712e-2cb3-4033-8bdb-52e719bcac27 req-64192aa8-155b-401e-88bb-4cf66545e084 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:13.151845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eaf3712e-2cb3-4033-8bdb-52e719bcac27 req-64192aa8-155b-401e-88bb-4cf66545e084 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:13.164821 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-eaf3712e-2cb3-4033-8bdb-52e719bcac27 req-64192aa8-155b-401e-88bb-4cf66545e084 service nova] Creating event network-changed:711f3dba-7506-4939-af56-7d2ab67354d2 for instance 7645074e-5bb2-4199-8fb2-03ad1592debc on n-h1-master-1 Oct 24 09:45:13.167653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:45:13.170111 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-eaf3712e-2cb3-4033-8bdb-52e719bcac27 req-64192aa8-155b-401e-88bb-4cf66545e084 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043771 Oct 24 09:45:13.170724 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3501/6826] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:45:13.257742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a2f590f-4d89-4daf-8ee2-840581c2c9dc tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 204 len: 0 microversion: 2.1 time: 0.133695 Oct 24 09:45:13.258641 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3326/6827] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:45:13 2022] DELETE /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:45:13.267505 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:13.268226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:13.275268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:13.275769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:13.276216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:13.276919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:13.277411 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:13.277852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:13.409278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:13.417700 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f3eb834-3791-456f-b205-af5fea1782d0 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1578 microversion: 2.1 time: 0.154443 Oct 24 09:45:13.418278 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3502/6828] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:13 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:14.442051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:14.442799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:14.449548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:14.450046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:14.450498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:14.451202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:14.451696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:14.452136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:14.584887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:14.593577 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8bf61fcd-10f1-4ccd-81cb-86b3df69adaf tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1578 microversion: 2.1 time: 0.155768 Oct 24 09:45:14.594377 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3327/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:14 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:15.453803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-6461a5f4-4dfd-47b4-a3de-fdd9812a5191 req-a2d0a233-2022-45dc-9de4-d266ae7df23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7645074e-5bb2-4199-8fb2-03ad1592debc", "name": "network-vif-deleted", "tag": "711f3dba-7506-4939-af56-7d2ab67354d2"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:15.464675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6461a5f4-4dfd-47b4-a3de-fdd9812a5191 req-a2d0a233-2022-45dc-9de4-d266ae7df23b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:15.465099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6461a5f4-4dfd-47b4-a3de-fdd9812a5191 req-a2d0a233-2022-45dc-9de4-d266ae7df23b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:15.465564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6461a5f4-4dfd-47b4-a3de-fdd9812a5191 req-a2d0a233-2022-45dc-9de4-d266ae7df23b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:15.477640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-6461a5f4-4dfd-47b4-a3de-fdd9812a5191 req-a2d0a233-2022-45dc-9de4-d266ae7df23b service nova] Creating event network-vif-deleted:711f3dba-7506-4939-af56-7d2ab67354d2 for instance 7645074e-5bb2-4199-8fb2-03ad1592debc on n-h1-master-1 Oct 24 09:45:15.482988 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-6461a5f4-4dfd-47b4-a3de-fdd9812a5191 req-a2d0a233-2022-45dc-9de4-d266ae7df23b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Oct 24 09:45:15.483591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3503/6830] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:15.616710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:15.617360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:15.624319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:15.624872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:15.625351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:15.626057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:15.626527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:15.626970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:15.689555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:15.697590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-591790e8-b194-4a9d-a5fa-8055157bea6e tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1226 microversion: 2.1 time: 0.084792 Oct 24 09:45:15.698171 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3328/6831] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:15 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:16.721828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:16.722465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:16.729282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:16.729804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:16.730254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:16.730945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:16.731406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:16.731839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:16.795073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:16.803640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-731c5a8e-edbe-40e5-aeeb-f9ec645ae276 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1226 microversion: 2.1 time: 0.086378 Oct 24 09:45:16.804221 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3504/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:16 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:17.826620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:17.827172 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:17.834774 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:17.835271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:17.835726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:17.836444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:17.836911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:17.837374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:17.905429 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:17.913852 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4bc6a24-3ec5-46df-94d9-f68b2f9e7f68 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1226 microversion: 2.1 time: 0.091418 Oct 24 09:45:17.914421 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3329/6833] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:17 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:18.936088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:18.936615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:18.943664 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:18.944155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:18.944598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:18.945322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:18.945785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:18.946214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:19.007721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0afba834c04bdc92565bf8e9a57ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0e7acf72144b558f1ba2f863244f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:19.018094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e6351ce-f1b7-43d1-a5d6-2f8360a1c03f tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 200 len: 1226 microversion: 2.1 time: 0.085971 Oct 24 09:45:19.018887 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3505/6834] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:18 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:20.040718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:20.041516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 7645074e-5bb2-4199-8fb2-03ad1592debc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:20.048411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:20.048905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:20.049740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:20.050453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:20.050921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:20.051360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:20.065803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 7645074e-5bb2-4199-8fb2-03ad1592debc could not be found. Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc HTTP/1.1 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 7645074e-5bb2-4199-8fb2-03ad1592debc could not be found. Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '7645074e-5bb2-4199-8fb2-03ad1592debc'} Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7645074e-5bb2-4199-8fb2-03ad1592debc could not be found. Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7645074e-5bb2-4199-8fb2-03ad1592debc could not be found. Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:20.067975 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7645074e-5bb2-4199-8fb2-03ad1592debc could not be found. Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 7645074e-5bb2-4199-8fb2-03ad1592debc could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-45596ddb-67ef-4c6d-8936-f6612652c9ba tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc" status: 404 len: 111 microversion: 2.1 time: 0.033578 Oct 24 09:45:20.072691 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3330/6835] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:20 2022] GET /compute/v2.1/servers/7645074e-5bb2-4199-8fb2-03ad1592debc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:45:20.511342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:20.511836 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:20.518942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:20.519445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:20.519894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:20.520601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:20.521065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:20.521586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:20.538643 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a HTTP/1.1 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '971ee186-a92b-4771-b7ef-a2728b76d79a'} Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:45:20.540338 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85ce6a84-387f-4531-b56a-eaf581aec8bd tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 404 len: 111 microversion: 2.1 time: 0.034371 Oct 24 09:45:20.544865 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3506/6836] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:45:20 2022] DELETE /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:45:20.550442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:20.551077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] [instance: 971ee186-a92b-4771-b7ef-a2728b76d79a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:20.557552 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:20.558057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:20.558512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:20.559214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:20.559686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:20.560128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:20.576955 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] HTTP exception thrown: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Request method failure captured: Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a HTTP/1.1 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVlwajkO3H33auOQPtHU1UgeYN1IXjwBwLXQUzNShX3KvPbJgs81ccxvhz_Xr1gl51BOUCiWU3wdjlMh9I5hFbF8QghECQ9yk97LX9rok31rT8UvI2sxcVuHyZQSU9hDwF-fWKGLdmtvbGtWFXVLwKAaz5GEfvaSUlzFVWsxPLIu7PY4 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec0e7acf72144b558f1ba2f863244f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec0e7acf72144b558f1ba2f863244f89"}]}] Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: ec0e7acf72144b558f1ba2f863244f89 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-2083654904 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: db0afba834c04bdc92565bf8e9a57ee9 Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-2083654904-project Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '971ee186-a92b-4771-b7ef-a2728b76d79a'} Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:20.578540 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Returning 404 to user: Instance 971ee186-a92b-4771-b7ef-a2728b76d79a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0619b399-367a-47aa-8d95-efdf9297db87 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a" status: 404 len: 111 microversion: 2.1 time: 0.033393 Oct 24 09:45:20.583444 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3331/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:20 2022] GET /compute/v2.1/servers/971ee186-a92b-4771-b7ef-a2728b76d79a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:45:24.234924 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e0e19dd-52aa-490d-b886-16818a0e68c4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] Calling method '.version_select at 0x7f8dab029820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:24.260755 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e0e19dd-52aa-490d-b886-16818a0e68c4 tempest-TestVolumeBootPattern-2083654904 tempest-TestVolumeBootPattern-2083654904-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1714232235" status: 202 len: 0 microversion: 2.1 time: 0.029547 Oct 24 09:45:24.273806 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3507/6838] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1714232235 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:45:43.019409 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:43.020102 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:43.131786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2146245347", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:43.185959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:45:43.374849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:45:43.375284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:45:43.375768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:45:43.376209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:45:43.376640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:45:43.386005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:43.386504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:43.387002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:43.387728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:43.388199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:43.388641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:43.407571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Getting quotas for project 09dab1ca22de47f6bcf5adb5e0356ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:45:43.412694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Getting quotas for user 7b3312417ce54a57b8baec38c65338f0 and project 09dab1ca22de47f6bcf5adb5e0356ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:45:43.424858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:45:43.427147 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:45:43.470240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85afb559-1d22-4960-8222-30102343c209 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455983 Oct 24 09:45:43.470912 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3332/6839] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:45:43.481513 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:43.482452 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:43.486536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e1b319b-35e3-4f1c-9ddf-50d9db4658ec tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:43.488166 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e1b319b-35e3-4f1c-9ddf-50d9db4658ec tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:43.548942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e1b319b-35e3-4f1c-9ddf-50d9db4658ec tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:43.556572 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e1b319b-35e3-4f1c-9ddf-50d9db4658ec tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1222 microversion: 2.1 time: 0.076905 Oct 24 09:45:43.557141 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3508/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:43 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:44.581277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:44.581934 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:44.589827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:44.590858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:44.591769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:44.592690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:44.593337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:44.593823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:44.678316 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:44.688980 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ddb79e04-12d1-4471-ac90-f88f295365af tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1282 microversion: 2.1 time: 0.112534 Oct 24 09:45:44.690171 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3333/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:44 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:45.712648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:45.713570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:45.720786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:45.721469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:45.722015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:45.722896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:45.723626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:45.724699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:45.945323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:45.953061 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec10dbf7-332e-42dd-880c-7ec3f93f2bb1 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.244465 Oct 24 09:45:45.953680 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3509/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:45 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:46.139757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1baa7e7d-24e5-4901-9404-07754452eb22 req-36523ca4-4cf0-4417-9ab1-08abffd62e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca58eec2-c3cb-4869-9d1c-6f0378916652", "tag": "c6f728b0-4cf8-4f23-a37c-f54789a65471"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:46.158647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1baa7e7d-24e5-4901-9404-07754452eb22 req-36523ca4-4cf0-4417-9ab1-08abffd62e13 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:46.159286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1baa7e7d-24e5-4901-9404-07754452eb22 req-36523ca4-4cf0-4417-9ab1-08abffd62e13 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:46.159837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1baa7e7d-24e5-4901-9404-07754452eb22 req-36523ca4-4cf0-4417-9ab1-08abffd62e13 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:46.174539 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1baa7e7d-24e5-4901-9404-07754452eb22 req-36523ca4-4cf0-4417-9ab1-08abffd62e13 service nova] Creating event network-changed:c6f728b0-4cf8-4f23-a37c-f54789a65471 for instance ca58eec2-c3cb-4869-9d1c-6f0378916652 on n-h1-master-1 Oct 24 09:45:46.181689 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1baa7e7d-24e5-4901-9404-07754452eb22 req-36523ca4-4cf0-4417-9ab1-08abffd62e13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046779 Oct 24 09:45:46.182526 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3334/6843] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:45:46.976069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:46.976625 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:46.983404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:46.983892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:46.984330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:46.985014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:46.985507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:46.985942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:47.116066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:47.123699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bcefef70-4d36-4a93-9bf4-96be51370c03 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.151587 Oct 24 09:45:47.124273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3510/6844] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:46 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:48.147968 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:48.148878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:48.156214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:48.156716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:48.157181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:48.157910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:48.158385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:48.158858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:48.286058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:48.294372 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af5697ad-4b93-4ce3-8346-07dd1958cfd3 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.151151 Oct 24 09:45:48.294952 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3335/6845] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:48 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:49.317126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:49.317794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:49.324619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:49.325113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:49.325587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:49.326289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:49.326756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:49.327196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:49.455473 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:49.463135 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08f2c8e4-f4cb-4e6e-887a-e4d0710106bd tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.149920 Oct 24 09:45:49.463715 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3511/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:49 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:50.487049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:50.487593 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:50.494920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:50.495411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:50.495862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:50.496559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:50.497020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:50.497492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:50.629692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:50.637889 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe96d0c2-291e-419f-8243-41465784eb63 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.154915 Oct 24 09:45:50.638455 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3336/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:50 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:51.620998 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c14ee46f-bfe8-4e04-be68-030e13a92ed9 req-5e5ad1cb-9dd5-48e9-bb97-183286b79c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca58eec2-c3cb-4869-9d1c-6f0378916652", "name": "network-vif-plugged", "status": "completed", "tag": "c6f728b0-4cf8-4f23-a37c-f54789a65471"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:51.630863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c14ee46f-bfe8-4e04-be68-030e13a92ed9 req-5e5ad1cb-9dd5-48e9-bb97-183286b79c6d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:51.631340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c14ee46f-bfe8-4e04-be68-030e13a92ed9 req-5e5ad1cb-9dd5-48e9-bb97-183286b79c6d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:51.631780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c14ee46f-bfe8-4e04-be68-030e13a92ed9 req-5e5ad1cb-9dd5-48e9-bb97-183286b79c6d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:51.642624 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c14ee46f-bfe8-4e04-be68-030e13a92ed9 req-5e5ad1cb-9dd5-48e9-bb97-183286b79c6d service nova] Creating event network-vif-plugged:c6f728b0-4cf8-4f23-a37c-f54789a65471 for instance ca58eec2-c3cb-4869-9d1c-6f0378916652 on n-h1-master-1 Oct 24 09:45:51.648381 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c14ee46f-bfe8-4e04-be68-030e13a92ed9 req-5e5ad1cb-9dd5-48e9-bb97-183286b79c6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101273 Oct 24 09:45:51.648914 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3512/6848] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:51.660131 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:51.660757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:51.667639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:51.668141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:51.668592 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:51.669315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:51.669781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:51.670222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:51.803957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:51.811544 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-929d3c88-9b4f-4268-a819-0cbc10b561cc tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.155297 Oct 24 09:45:51.812120 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3337/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:51 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:52.836888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:52.837624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:52.844225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:52.844713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:52.845155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:52.845884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:52.846340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:52.846795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:52.982848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:52.990665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-011d367a-a187-4974-8502-618bb58694c8 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1322 microversion: 2.1 time: 0.159539 Oct 24 09:45:52.991241 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3513/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:52 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:54.013698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:54.014324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:54.017156 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:54.017857 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:54.024148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.024897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.025385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.026096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.026566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.027007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.160677 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:54.168952 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ab2d59d-f61d-4062-871a-19b52a462f95 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1472 microversion: 2.1 time: 0.159229 Oct 24 09:45:54.169575 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3338/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:54 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:54.194301 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:54.243235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a76ec83f-9672-4e6f-9cea-d7d77ea6fcf6 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Calling method '.version_select at 0x7f8dab02a430>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:54.308597 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a76ec83f-9672-4e6f-9cea-d7d77ea6fcf6 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/2137dc40db0f410491537f42103e4fee" status: 200 len: 371 microversion: 2.1 time: 0.118862 Oct 24 09:45:54.309200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3514/6852] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:45:54 2022] GET /compute/v2.1/os-quota-sets/2137dc40db0f410491537f42103e4fee => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:54.321206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27c56b12-4386-44df-b59a-77c292a2bdfa tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1195217371", "id": 867923217, "os-flavor-access:is_public": "True"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:54.338907 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27c56b12-4386-44df-b59a-77c292a2bdfa tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021451 Oct 24 09:45:54.339480 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3339/6853] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:45:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:54.352622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "867923217"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:54.354990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:54.360948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.361476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.361971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.362616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.363077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.363508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.548123 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd742f2251653497b89e918066d35fa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dc40db0f410491537f42103e4fee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:54.554328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1195217371 {{(pid=126920) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:45:54.561036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.561545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.561988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.562715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.563174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.563600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.587438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Getting quotas for project 09dab1ca22de47f6bcf5adb5e0356ae5. Resources: {'ram', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:45:54.592449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Getting quotas for user 7b3312417ce54a57b8baec38c65338f0 and project 09dab1ca22de47f6bcf5adb5e0356ae5. Resources: {'ram', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:45:54.605703 n-d-master-1 devstack@n-api.service[126920]: INFO nova.compute.api [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] ram quota exceeded for 2137dc40db0f410491537f42103e4fee, tried to resize instance. Oct 24 09:45:54.606244 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Request method failure captured: Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652/action HTTP/1.1 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 38 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl7GehDskxNl2eHf11WJFjXtSY220MLfT_uukfma0F4ZBJlr-SA6qyWQKMqkHm7zMiZ-es4HSQANoO1CYw1jJ_ewKT-ePQdJsOB7M1cUtM2dNvo5fwiM6YbLNmB8816KTGTbMblDd2xPs1SPP0hUe2ZLY2O3PXupsXAZGjrIdWDpvKQ Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 2137dc40db0f410491537f42103e4fee Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-451551917 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Role: admin,member,reader Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Roles: admin,member,reader Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2137dc40db0f410491537f42103e4fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2137dc40db0f410491537f42103e4fee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2137dc40db0f410491537f42103e4fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2137dc40db0f410491537f42103e4fee"}]}] Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersAdminNegativeTestJSON-451551917 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 2137dc40db0f410491537f42103e4fee Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-451551917 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersAdminNegativeTestJSON-451551917-project-admin Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: d742f2251653497b89e918066d35fa38 Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersAdminNegativeTestJSON-451551917-project-admin Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: {"resize": {"flavorRef": "867923217"}} Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ca58eec2-c3cb-4869-9d1c-6f0378916652', 'body': {'resize': {'flavorRef': '867923217'}}} Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:45:54.608314 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03f40f9c-8286-4681-abc7-d3d42a65f909 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652/action" status: 403 len: 118 microversion: 2.1 time: 0.261574 Oct 24 09:45:54.613078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3515/6854] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:45:54 2022] POST /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:45:54.621729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-caf718b9-5ee6-4e3e-ba36-1cf05e17af82 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:54.638801 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-caf718b9-5ee6-4e3e-ba36-1cf05e17af82 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/867923217" status: 202 len: 0 microversion: 2.1 time: 0.020663 Oct 24 09:45:54.639578 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3340/6855] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 09:45:54 2022] DELETE /compute/v2.1/flavors/867923217 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:45:54.648308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bfabf811-9cdc-4390-85af-570b0ec21fdf tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:54.668228 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bfabf811-9cdc-4390-85af-570b0ec21fdf tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024196 Oct 24 09:45:54.668809 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3516/6856] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:45:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:54.688829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-532a06b8-8a70-4d65-9b55-d0af45e52d7b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Calling method '.version_select at 0x7f8daf22d9d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:54.759581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-532a06b8-8a70-4d65-9b55-d0af45e52d7b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/2137dc40db0f410491537f42103e4fee" status: 200 len: 371 microversion: 2.1 time: 0.074343 Oct 24 09:45:54.760314 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3341/6857] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:45:54 2022] GET /compute/v2.1/os-quota-sets/2137dc40db0f410491537f42103e4fee => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:54.772309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e60f9d08-f1d3-4eca-86ba-4d1479a75cb2 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-92050036", "id": 1213934173, "os-flavor-access:is_public": "True"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:54.790866 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e60f9d08-f1d3-4eca-86ba-4d1479a75cb2 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022709 Oct 24 09:45:54.791448 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3517/6858] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:45:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:54.804024 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1213934173"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:54.806450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:54.812504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.812995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.813488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.814189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.814655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.815092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.900464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd742f2251653497b89e918066d35fa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2137dc40db0f410491537f42103e4fee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:54.906599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-92050036 {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:45:54.913131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.913672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.914117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.914848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:54.915307 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:54.915741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:54.936101 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Getting quotas for project 09dab1ca22de47f6bcf5adb5e0356ae5. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:45:54.941046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Getting quotas for user 7b3312417ce54a57b8baec38c65338f0 and project 09dab1ca22de47f6bcf5adb5e0356ae5. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:45:54.953673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] cores quota exceeded for 2137dc40db0f410491537f42103e4fee, tried to resize instance. Oct 24 09:45:54.954505 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Request method failure captured: Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652/action HTTP/1.1 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 39 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl7GehDskxNl2eHf11WJFjXtSY220MLfT_uukfma0F4ZBJlr-SA6qyWQKMqkHm7zMiZ-es4HSQANoO1CYw1jJ_ewKT-ePQdJsOB7M1cUtM2dNvo5fwiM6YbLNmB8816KTGTbMblDd2xPs1SPP0hUe2ZLY2O3PXupsXAZGjrIdWDpvKQ Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 2137dc40db0f410491537f42103e4fee Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-451551917 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Role: admin,member,reader Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Roles: admin,member,reader Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2137dc40db0f410491537f42103e4fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2137dc40db0f410491537f42103e4fee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2137dc40db0f410491537f42103e4fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2137dc40db0f410491537f42103e4fee"}]}] Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersAdminNegativeTestJSON-451551917 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 2137dc40db0f410491537f42103e4fee Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-451551917 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersAdminNegativeTestJSON-451551917-project-admin Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: d742f2251653497b89e918066d35fa38 Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersAdminNegativeTestJSON-451551917-project-admin Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: {"resize": {"flavorRef": "1213934173"}} Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ca58eec2-c3cb-4869-9d1c-6f0378916652', 'body': {'resize': {'flavorRef': '1213934173'}}} Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:45:54.968585 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a993fab6-d295-4805-a314-72e1d14372ed tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652/action" status: 403 len: 113 microversion: 2.1 time: 0.170507 Oct 24 09:45:54.973375 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3342/6859] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:45:54 2022] POST /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652/action => generated 113 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:45:54.978832 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7f915a8-1557-4ffc-89bb-8e48f009b636 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:54.996826 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7f915a8-1557-4ffc-89bb-8e48f009b636 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1213934173" status: 202 len: 0 microversion: 2.1 time: 0.021678 Oct 24 09:45:54.997441 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3518/6860] 10.222.0.25 () {58 vars in 1161 bytes} [Mon Oct 24 09:45:54 2022] DELETE /compute/v2.1/flavors/1213934173 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:45:55.005136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eea99ca8-7cf1-49d8-807c-4bf9e91e4acf tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:55.027618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eea99ca8-7cf1-49d8-807c-4bf9e91e4acf tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026103 Oct 24 09:45:55.028474 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3343/6861] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:45:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:45:55.048922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:55.049791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:55.056244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:55.056730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:55.057171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:55.057897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:55.058354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:55.058787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:55.083862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:45:55.158380 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bbaccab0-067a-4905-adde-237d5f0fe3a4 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 204 len: 0 microversion: 2.1 time: 0.113030 Oct 24 09:45:55.159001 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3519/6862] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:45:55 2022] DELETE /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:45:55.167886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:55.168518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:55.174555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:55.175055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:55.175523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:55.176232 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:55.176709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:55.177845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:55.306073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:55.313761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af8a19c2-4fb3-482a-9227-4d12863aa473 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1478 microversion: 2.1 time: 0.149871 Oct 24 09:45:55.314325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3344/6863] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:55 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1478 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:56.337274 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:56.338019 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:56.344970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:56.345522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:56.345979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:56.346683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:56.347146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:56.347581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:56.486515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:56.495443 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-168fadbb-c1a8-4250-b08e-476e1447d8e2 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1478 microversion: 2.1 time: 0.162225 Oct 24 09:45:56.496462 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3520/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:56 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1478 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:45:57.070755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-76972ed6-0580-42b6-baeb-2193af2f65bd req-924bdb98-3a67-4dfa-b58f-934994d01a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca58eec2-c3cb-4869-9d1c-6f0378916652", "name": "network-vif-deleted", "tag": "c6f728b0-4cf8-4f23-a37c-f54789a65471"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:45:57.081324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76972ed6-0580-42b6-baeb-2193af2f65bd req-924bdb98-3a67-4dfa-b58f-934994d01a74 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:57.081851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76972ed6-0580-42b6-baeb-2193af2f65bd req-924bdb98-3a67-4dfa-b58f-934994d01a74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:57.082294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-76972ed6-0580-42b6-baeb-2193af2f65bd req-924bdb98-3a67-4dfa-b58f-934994d01a74 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:57.094292 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-76972ed6-0580-42b6-baeb-2193af2f65bd req-924bdb98-3a67-4dfa-b58f-934994d01a74 service nova] Creating event network-vif-deleted:c6f728b0-4cf8-4f23-a37c-f54789a65471 for instance ca58eec2-c3cb-4869-9d1c-6f0378916652 on n-h1-master-1 Oct 24 09:45:57.100000 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-76972ed6-0580-42b6-baeb-2193af2f65bd req-924bdb98-3a67-4dfa-b58f-934994d01a74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 Oct 24 09:45:57.100612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3345/6865] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:45:57.518688 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:57.519373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:57.527146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:57.527639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:57.528084 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:57.528816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:57.529281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:57.529735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:57.567375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:57.568392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:57.568841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:57.569317 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lazy-loading 'fault' on Instance uuid ca58eec2-c3cb-4869-9d1c-6f0378916652 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:45:57.611785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3312417ce54a57b8baec38c65338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dab1ca22de47f6bcf5adb5e0356ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:45:57.620513 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-653a2444-9a11-427d-8cfe-c736b563c095 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 200 len: 1312 microversion: 2.1 time: 0.105817 Oct 24 09:45:57.621094 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3521/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:57 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:45:58.646314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:45:58.647035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] [instance: ca58eec2-c3cb-4869-9d1c-6f0378916652] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:45:58.653465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:58.653961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:58.654414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:58.655114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:45:58.655584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:45:58.656024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:45:58.669114 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] HTTP exception thrown: Instance ca58eec2-c3cb-4869-9d1c-6f0378916652 could not be found. Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Request method failure captured: Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 HTTP/1.1 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl7GWSIBWrd5RhdK9s-ChD886d0LKoOmLFH3yANdWe9WXFL5iaStbJMU6qe4BpCnZd_95s8nD1Sc3vGjybdPgy72T_a4ZJ_qkPDfNlasKDwCJPB-eDCrwYSgaoLFbNOxfdw0b0jEUCQ1Mc_ooiHZznkA1NrfwfompQx5UVAdR2f17-Y Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 09dab1ca22de47f6bcf5adb5e0356ae5 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1438193783 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09dab1ca22de47f6bcf5adb5e0356ae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09dab1ca22de47f6bcf5adb5e0356ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09dab1ca22de47f6bcf5adb5e0356ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09dab1ca22de47f6bcf5adb5e0356ae5"}]}] Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1438193783 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 09dab1ca22de47f6bcf5adb5e0356ae5 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1438193783 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersAdminNegativeTestJSON-1438193783-project Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7b3312417ce54a57b8baec38c65338f0 Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1438193783-project Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ca58eec2-c3cb-4869-9d1c-6f0378916652 could not be found. Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ca58eec2-c3cb-4869-9d1c-6f0378916652'} Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca58eec2-c3cb-4869-9d1c-6f0378916652 could not be found. Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca58eec2-c3cb-4869-9d1c-6f0378916652 could not be found. Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:58.670767 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca58eec2-c3cb-4869-9d1c-6f0378916652 could not be found. Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] Returning 404 to user: Instance ca58eec2-c3cb-4869-9d1c-6f0378916652 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7fc18240-a264-467a-9fed-63b2548de195 tempest-ServersAdminNegativeTestJSON-1438193783 tempest-ServersAdminNegativeTestJSON-1438193783-project] 10.222.0.25 "GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652" status: 404 len: 111 microversion: 2.1 time: 0.031103 Oct 24 09:45:58.675153 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3346/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:45:58 2022] GET /compute/v2.1/servers/ca58eec2-c3cb-4869-9d1c-6f0378916652 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:46:04.953259 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:04.954625 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:05.078632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-864123510", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "c73aef6f-65c8-4e64-95a4-699e5c6a4655"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:05.134460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] validate_networks() for [('c73aef6f-65c8-4e64-95a4-699e5c6a4655', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:46:05.506438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:46:05.507508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:46:05.507985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:46:05.508401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:46:05.508814 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:46:05.517672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:05.518155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:05.518594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:05.519328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:05.519790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:05.520222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:05.538232 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Getting quotas for project 996a4beed0bd44c49c163fbac68e9687. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:46:05.544605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Getting quotas for user 516efdf9d07843a4a5605f94145c293d and project 996a4beed0bd44c49c163fbac68e9687. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:46:05.557752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:46:05.560237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:46:05.604143 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:46:06.612476 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58760. Oct 24 09:46:06.617605 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c562631-dee0-44e7-8d71-bae8632251af tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669172 Oct 24 09:46:06.618423 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3522/6868] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:46:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:46:06.630175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2a06654-3f55-4e36-917c-071de4b85e5e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:06.630959 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f2a06654-3f55-4e36-917c-071de4b85e5e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:06.633422 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:06.635104 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:06.699590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f2a06654-3f55-4e36-917c-071de4b85e5e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:06.706894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2a06654-3f55-4e36-917c-071de4b85e5e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1214 microversion: 2.1 time: 0.081111 Oct 24 09:46:06.707653 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3347/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:06 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:07.731739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:07.732314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:07.739364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:07.739864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:07.740314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:07.741073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:07.742088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:07.742531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:07.867861 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:07.889678 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64e55ac9-ce01-435f-828d-f1f01a19d574 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1274 microversion: 2.1 time: 0.162704 Oct 24 09:46:07.890919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3523/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:07 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:08.914472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:08.915678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:08.919627 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=57 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:08.927169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:08.927586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:08.928021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:08.929449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:08.929793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:08.930239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:09.080070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:09.088838 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d5d2c52-85cb-4dd2-9b63-3d93440f53e7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1314 microversion: 2.1 time: 0.178241 Oct 24 09:46:09.101503 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3348/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:08 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:09.237945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-8096c107-3665-4620-b807-2ac85a5c7686 req-4d2bc854-a39f-4d50-867f-cdd089246208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fecd0591-71ce-4687-9f77-9f6b4dde7f92", "tag": "6cae600c-b5af-4f96-b03a-c024862be1dd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:09.250555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8096c107-3665-4620-b807-2ac85a5c7686 req-4d2bc854-a39f-4d50-867f-cdd089246208 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:09.251141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8096c107-3665-4620-b807-2ac85a5c7686 req-4d2bc854-a39f-4d50-867f-cdd089246208 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:09.251656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-8096c107-3665-4620-b807-2ac85a5c7686 req-4d2bc854-a39f-4d50-867f-cdd089246208 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:09.263122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-8096c107-3665-4620-b807-2ac85a5c7686 req-4d2bc854-a39f-4d50-867f-cdd089246208 service nova] Creating event network-changed:6cae600c-b5af-4f96-b03a-c024862be1dd for instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 on n-h1-master-1 Oct 24 09:46:09.268408 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-8096c107-3665-4620-b807-2ac85a5c7686 req-4d2bc854-a39f-4d50-867f-cdd089246208 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035062 Oct 24 09:46:09.269019 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3524/6872] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:46:10.114495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:10.115123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:10.122117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:10.122611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:10.123059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:10.123778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:10.124225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:10.124666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:10.259179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:10.266776 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6707e6e3-c845-45d4-8690-63360f25c95f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1314 microversion: 2.1 time: 0.156358 Oct 24 09:46:10.267337 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3349/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:10 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:11.292988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:11.293737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:11.300207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:11.300705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:11.301150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:11.301893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:11.302357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:11.302824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:11.439022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:11.447228 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7000b679-3e4f-4a14-a0d4-c53aed4463bb tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1314 microversion: 2.1 time: 0.160327 Oct 24 09:46:11.447803 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3525/6874] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:11 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:12.470941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:12.471497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:12.478917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:12.479412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:12.479861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:12.480597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:12.481065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:12.481534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:12.608127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:12.615755 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df19ccfd-42e7-43f8-a505-8acbe2a96a6b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1314 microversion: 2.1 time: 0.148818 Oct 24 09:46:12.616325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3350/6875] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:12 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:13.638664 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:13.639322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:13.642162 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:13.647712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:13.648208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:13.648652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:13.649385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:13.650120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:13.650555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:13.654215 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:13.671373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b568cec6-5327-421b-85d7-acc4c0965695 req-834a57ed-6dfa-49ed-bc98-ad65730d4711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecd0591-71ce-4687-9f77-9f6b4dde7f92", "name": "network-vif-plugged", "status": "completed", "tag": "6cae600c-b5af-4f96-b03a-c024862be1dd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:13.683973 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:13.685905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b568cec6-5327-421b-85d7-acc4c0965695 req-834a57ed-6dfa-49ed-bc98-ad65730d4711 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:13.686617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b568cec6-5327-421b-85d7-acc4c0965695 req-834a57ed-6dfa-49ed-bc98-ad65730d4711 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:13.687303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b568cec6-5327-421b-85d7-acc4c0965695 req-834a57ed-6dfa-49ed-bc98-ad65730d4711 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:13.700365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b568cec6-5327-421b-85d7-acc4c0965695 req-834a57ed-6dfa-49ed-bc98-ad65730d4711 service nova] Creating event network-vif-plugged:6cae600c-b5af-4f96-b03a-c024862be1dd for instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 on n-h1-master-1 Oct 24 09:46:13.705711 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b568cec6-5327-421b-85d7-acc4c0965695 req-834a57ed-6dfa-49ed-bc98-ad65730d4711 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039559 Oct 24 09:46:13.706492 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3351/6876] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:46:13.800413 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:13.809058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73601b75-a604-41c1-ac7c-9056e62ed97e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1314 microversion: 2.1 time: 0.174303 Oct 24 09:46:13.809664 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3526/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:13 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:14.833869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:14.835080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:14.841230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:14.841768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:14.842221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:14.843060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:14.843564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:14.844115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:14.987058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:14.994919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99523ecf-1dd1-448b-a088-a73e0b5a11dc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1314 microversion: 2.1 time: 0.166522 Oct 24 09:46:14.995500 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3352/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:14 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:16.018154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:16.018788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:16.021520 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:16.022201 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:16.028795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:16.029311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:16.029762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:16.030466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:16.030934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:16.031370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:16.161988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:16.170347 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64e78317-460e-4eb5-b1e6-b3757218c797 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1500 microversion: 2.1 time: 0.156482 Oct 24 09:46:16.170939 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3527/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:16 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:46:16.192967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:16.195210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:16.201855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:16.202340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:16.202780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:16.203474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:16.203937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:16.204372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:16.232197 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:16.237399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Old instance type m1.heat2, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:46:16.243764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:46:16.244191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:46:16.244701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:46:16.245119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:46:16.245559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:46:16.306390 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-822ecfc6-8f37-4fbe-aee4-d5cc2349343c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "POST /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92/action" status: 202 len: 0 microversion: 2.1 time: 0.117262 Oct 24 09:46:16.306924 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3353/6880] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:46:16 2022] POST /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:46:16.315012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:16.315622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:16.321498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:16.321987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:16.322424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:16.323121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:16.323583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:16.324013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:16.461631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:16.470070 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60fa341b-f4c1-4a9f-8c4e-8b88216dbcd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1509 microversion: 2.1 time: 0.158896 Oct 24 09:46:16.470673 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3528/6881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:16 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:17.493217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:17.493902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:17.496654 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:17.504663 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:17.505256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:17.505785 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:17.506497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:17.506967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:17.507405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:17.655672 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:17.664115 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df16c22b-bc1f-488b-8c0a-507469549c20 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1509 microversion: 2.1 time: 0.174912 Oct 24 09:46:17.664698 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3354/6882] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:17 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:18.686234 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:18.686877 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:18.693840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:18.694334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:18.694781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:18.695480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:18.695943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:18.696378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:18.823672 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:18.831381 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80f93254-d2f0-4ffb-a084-c88657cd050a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.149027 Oct 24 09:46:18.831955 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3529/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:18 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:19.855455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:19.856076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:19.862828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:19.863315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:19.863761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:19.864453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:19.864914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:19.865378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:19.992692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:20.000429 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f9e82c6c-744e-4d09-815b-ebf603ee4122 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.148911 Oct 24 09:46:20.001013 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3355/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:19 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:21.024563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:21.025379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:21.032119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:21.032608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:21.033047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:21.033763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:21.034221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:21.034652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:21.166677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:21.174479 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f7f286a-b5db-4c0d-a3c6-83c407345f6c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.154462 Oct 24 09:46:21.175062 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3530/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:21 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:22.198488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:22.199115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:22.205904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:22.206399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:22.206847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:22.207540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:22.207999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:22.208435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:22.335530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:22.343064 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1527d47-9f76-41d3-93b0-d68f47a58cd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.148911 Oct 24 09:46:22.343636 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3356/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:22 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:23.366559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:23.367190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:23.374110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:23.374604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:23.375050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:23.375748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:23.376212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:23.376645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:23.503579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:23.511928 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e8040f2f-ea01-48b9-866c-7dd3750f8e90 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.149731 Oct 24 09:46:23.512514 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3531/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:23 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:24.535360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:24.535938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:24.542764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:24.543263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:24.543713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:24.544417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:24.544887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:24.545357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:24.680606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:24.688532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a6297c1-16fb-4148-ac05-d0bf9037186d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.157133 Oct 24 09:46:24.689149 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3357/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:24 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:25.711995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:25.712612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:25.719524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:25.720010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:25.720444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:25.721131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:25.721623 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:25.722048 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:25.848326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:25.856038 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-362d00ef-0512-4706-97bb-3f1de2111ed4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.147963 Oct 24 09:46:25.856614 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3532/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:25 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:26.879947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:26.880588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:26.887478 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:26.887961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:26.888412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:26.889105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:26.889593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:26.890035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:27.019557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:27.028017 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c40f7c7-0046-402c-ab76-7b7690f8d992 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.151943 Oct 24 09:46:27.028587 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3358/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:26 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:28.051207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:28.051774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:28.059324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:28.059810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:28.060245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:28.060939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:28.061423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:28.061851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:28.490085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:28.498266 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f66e130-001e-4c82-9ca1-05a897bc8532 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.451054 Oct 24 09:46:28.498841 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3533/6891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:28 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:46:29.521196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:29.522342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:29.529533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:29.530025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:29.530469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:29.531161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:29.531624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:29.532059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:29.664894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:29.673936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0199fd49-db4c-485d-b0ff-327a88671db7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.156586 Oct 24 09:46:29.674544 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3359/6892] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:29 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:30.696556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:30.697174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:30.704396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:30.704879 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:30.705330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:30.706052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:30.706506 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:30.706928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:30.835592 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:30.843508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a477d4a-ae24-4669-969b-d3b3c8d3f4d7 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.151427 Oct 24 09:46:30.844105 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3534/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:30 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:31.867898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:31.868532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:31.874934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:31.875435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:31.875892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:31.876601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:31.877072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:31.877544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:32.006750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:32.014564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5cfdcdf6-2427-40da-aa23-4d4ece02fbd4 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.151186 Oct 24 09:46:32.015147 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3360/6894] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:31 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:33.038857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:33.039487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:33.045754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:33.046248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:33.046698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:33.047394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:33.047864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:33.048304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:33.180136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:33.187012 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b0341e1a-1813-4f23-a2ed-82a5b6c16b47 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.152245 Oct 24 09:46:33.187591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3535/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:33 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:34.210568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:34.211189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:34.218770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:34.219271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:34.219720 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:34.220428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:34.220896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:34.221362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:34.353251 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:34.360874 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac98d563-1d75-4a87-9241-0773c70dc83f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.154759 Oct 24 09:46:34.361747 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3361/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:34 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:35.384543 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:35.385170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:35.392078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:35.392554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:35.392996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:35.393720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:35.394181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:35.394613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:35.520804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:35.529277 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f3d2b045-26b8-4f9d-b3aa-d50dbbf5e5ab tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.149192 Oct 24 09:46:35.529873 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3536/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:35 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:36.552509 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:36.553574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:36.560340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:36.560830 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:36.561276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:36.561992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:36.562453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:36.562889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:36.690224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:36.698501 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0919878e-e3e4-4071-902d-1ca18635ae76 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.149977 Oct 24 09:46:36.699078 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3362/6898] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:36 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:37.721611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:37.722219 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:37.731152 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:37.731992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:37.732679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:37.733434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:37.733913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:37.734354 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:37.865122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:37.873530 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-af0087f7-497f-451c-b2ea-281dce9ff86a tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.155778 Oct 24 09:46:37.874095 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3537/6899] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:37 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:38.896633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:38.897261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:38.904423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:38.904918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:38.905462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:38.906166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:38.906636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:38.907077 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:39.035461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:39.037683 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:39.044605 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20e47cd0-d10c-411e-ab7b-7f28b138fd3c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.151874 Oct 24 09:46:39.045174 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3363/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:38 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:40.067999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:40.069124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:40.077779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:40.078266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:40.078701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:40.079394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:40.079853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:40.080281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:40.207811 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:40.216027 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2316c0df-774b-4f4f-817e-33880b41701c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.151955 Oct 24 09:46:40.216611 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3538/6901] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:40 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:41.239460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:41.240018 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:41.242447 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:46:41.242588 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:46:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 (ip 10.222.0.25) !!! Oct 24 09:46:41.252249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:41.252740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:41.253196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:41.253918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:41.254382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:41.254819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:41.388254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:41.396090 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c79fe43-113d-4155-852c-c623fbd0a23c tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.160903 Oct 24 09:46:41.396662 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3364/6902] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:41 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:42.420410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:42.420980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:42.427758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:42.428251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:42.428690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:42.430017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:42.430476 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:42.430909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:42.557567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:42.565147 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-627fc828-6734-402b-b02c-0118dcb4a4c3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.148755 Oct 24 09:46:42.565749 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3539/6903] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:42 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:43.587966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:43.588617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:43.595444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:43.595933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:43.596377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:43.597074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:43.597586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:43.598023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:43.724778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:43.732871 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94eb0b74-3543-456d-bc99-13eb9ae7751f tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.148803 Oct 24 09:46:43.733465 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3365/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:43 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:44.756220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:44.756744 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:44.759999 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=28 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:44.765394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:44.765876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:44.766312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:44.766993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:44.767449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:44.767874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:44.771795 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=84 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:44.900481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:44.908145 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32643727-8c0c-48cc-80a2-21d4af5ae6f2 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.155908 Oct 24 09:46:44.908716 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3540/6905] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:44 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:45.931359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:45.931991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:45.934718 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:45.939965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:45.940457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:45.940906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:45.941661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:45.942133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:45.942572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:46.087288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:46.095264 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5268b180-b17d-4757-9221-f63d160ede6d tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.167830 Oct 24 09:46:46.095863 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3366/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:45 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:47.118485 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:47.119101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:47.125958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:47.126438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:47.126914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:47.127554 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:47.128011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:47.128438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:47.263733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:47.271484 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c5ec9dc3-9de5-41ba-aa24-0801c3a7fbbe tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.156886 Oct 24 09:46:47.272066 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3541/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:47 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:48.295383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:48.296010 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:48.303123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:48.303320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:48.303773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:48.305284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:48.305916 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:48.306365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:48.435941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:48.443766 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69754bb0-cdb8-41f9-8e34-f7063939c945 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.152324 Oct 24 09:46:48.444337 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3367/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:48 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:49.467191 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:49.467837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:49.474698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:49.475123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:49.475560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:49.476874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:49.477364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:49.477796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:49.611466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:49.619061 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e877f36f-c186-443f-b477-c5e7e327106b tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1514 microversion: 2.1 time: 0.155780 Oct 24 09:46:49.619660 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3542/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:49 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:50.643555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:50.644181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:50.651941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:50.652436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:50.652886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:50.653613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:50.654079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:50.654518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:50.864703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:50.873123 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-276196ad-366a-4b81-8586-e37daab18fd3 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1513 microversion: 2.1 time: 0.233735 Oct 24 09:46:50.873861 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3368/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:50 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:51.131788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecd0591-71ce-4687-9f77-9f6b4dde7f92", "name": "network-vif-unplugged", "status": "completed", "tag": "6cae600c-b5af-4f96-b03a-c024862be1dd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:51.142622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:51.143305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:51.143744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:51.156281 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] Creating event network-vif-unplugged:6cae600c-b5af-4f96-b03a-c024862be1dd for instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 on n-h2-master-1 Oct 24 09:46:51.161622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:46:51.173438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-050a610c-c73f-455f-83fa-2af69abe8bcf req-79901cbc-b1b8-4e8b-af17-f07622807680 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045351 Oct 24 09:46:51.174056 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3543/6911] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:46:51.898366 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:51.899107 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:51.906481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:51.906982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:51.907433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:51.908138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:51.908602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:51.909037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:52.047560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:52.055860 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fdb72abd-6853-4ffc-a0ae-8b2a1720afd5 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1513 microversion: 2.1 time: 0.161998 Oct 24 09:46:52.056426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3369/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:51 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:53.080784 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:53.081584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:53.087930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:53.088422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:53.088869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:53.089607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:53.090066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:53.090495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:53.200971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fecd0591-71ce-4687-9f77-9f6b4dde7f92", "tag": "6cae600c-b5af-4f96-b03a-c024862be1dd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:53.211356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:53.211926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:53.212376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:53.220457 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:53.223960 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] Creating event network-changed:6cae600c-b5af-4f96-b03a-c024862be1dd for instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 on n-h2-master-1 Oct 24 09:46:53.228348 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8af0b3d8-4c94-42ed-9586-f9f5e065e417 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1511 microversion: 2.1 time: 0.152599 Oct 24 09:46:53.228934 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3544/6913] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:53 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:53.229279 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:46:53.249210 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a8862134-b0b4-438b-830b-bc81e4a087b1 req-c3d8a340-16bc-46db-a9ce-17b2320719b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051825 Oct 24 09:46:53.249899 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3370/6914] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:46:54.252778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:54.253520 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:54.260978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:54.261518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:54.261967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:54.262673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:54.263138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:54.263566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:54.394159 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:54.402850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59d5f0e5-8fef-47ee-922f-e37f12d6e6f0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1508 microversion: 2.1 time: 0.154389 Oct 24 09:46:54.403430 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3545/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:54 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:54.426615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:54.427213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:54.434098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:54.434591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:54.435048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:54.435777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:54.436240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:54.436677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:54.462695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:46:54.511270 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Found an unconfirmed migration during delete, id: 16, status: finished Oct 24 09:46:56.083362 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7c5e209-bdbe-40fd-a230-89aebbc24763 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 204 len: 0 microversion: 2.1 time: 1.661837 Oct 24 09:46:56.084078 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3371/6916] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:46:54 2022] DELETE /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 0 bytes in 1664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:46:56.093597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:56.094222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:56.101322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:56.102046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:56.102492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:56.103201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:56.103665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:56.104097 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:56.235278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:56.243943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3d505183-4704-4e64-9464-516edc3522d4 req-8e084949-bcf6-434a-98a0-b3575edda744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecd0591-71ce-4687-9f77-9f6b4dde7f92", "name": "network-vif-plugged", "status": "completed", "tag": "6cae600c-b5af-4f96-b03a-c024862be1dd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:56.244212 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3137bf77-a2ae-41af-831e-54b79f2bfc4e tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1500 microversion: 2.1 time: 0.155293 Oct 24 09:46:56.245046 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3546/6917] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:56 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:56.255620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d505183-4704-4e64-9464-516edc3522d4 req-8e084949-bcf6-434a-98a0-b3575edda744 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:56.256238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d505183-4704-4e64-9464-516edc3522d4 req-8e084949-bcf6-434a-98a0-b3575edda744 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:56.256548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3d505183-4704-4e64-9464-516edc3522d4 req-8e084949-bcf6-434a-98a0-b3575edda744 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:56.272244 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3d505183-4704-4e64-9464-516edc3522d4 req-8e084949-bcf6-434a-98a0-b3575edda744 service nova] Creating event network-vif-plugged:6cae600c-b5af-4f96-b03a-c024862be1dd for instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 on n-h2-master-1 Oct 24 09:46:56.277680 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3d505183-4704-4e64-9464-516edc3522d4 req-8e084949-bcf6-434a-98a0-b3575edda744 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038527 Oct 24 09:46:56.278338 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3372/6918] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:46:57.268083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:57.268772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:57.277356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:57.277853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:57.278319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:57.278998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:57.279461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:57.279893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:57.417072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516efdf9d07843a4a5605f94145c293d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996a4beed0bd44c49c163fbac68e9687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:46:57.424770 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad4a6cc1-0ee1-476f-bc99-6a824e710a05 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 200 len: 1500 microversion: 2.1 time: 0.160654 Oct 24 09:46:57.425787 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3547/6919] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:57 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:46:58.030738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2c5587a1-a80a-4cbf-9d2f-9c7ac7e41a0e req-9b3210a0-9d56-420b-9851-c1deb4244d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecd0591-71ce-4687-9f77-9f6b4dde7f92", "name": "network-vif-deleted", "tag": "6cae600c-b5af-4f96-b03a-c024862be1dd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:46:58.043398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2c5587a1-a80a-4cbf-9d2f-9c7ac7e41a0e req-9b3210a0-9d56-420b-9851-c1deb4244d1b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.044173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2c5587a1-a80a-4cbf-9d2f-9c7ac7e41a0e req-9b3210a0-9d56-420b-9851-c1deb4244d1b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.044616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2c5587a1-a80a-4cbf-9d2f-9c7ac7e41a0e req-9b3210a0-9d56-420b-9851-c1deb4244d1b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.057222 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2c5587a1-a80a-4cbf-9d2f-9c7ac7e41a0e req-9b3210a0-9d56-420b-9851-c1deb4244d1b service nova] Creating event network-vif-deleted:6cae600c-b5af-4f96-b03a-c024862be1dd for instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 on n-h2-master-1 Oct 24 09:46:58.064574 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2c5587a1-a80a-4cbf-9d2f-9c7ac7e41a0e req-9b3210a0-9d56-420b-9851-c1deb4244d1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Oct 24 09:46:58.065905 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3373/6920] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:46:58.449469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:58.450018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:58.456799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.457285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.457756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.458451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.458940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.459362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.473341 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] HTTP exception thrown: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Request method failure captured: Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 HTTP/1.1 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl7cjES8etE-qgzVHjYYOU18Zbcifp9LmxKDoD4hlXSJOZAXE2ALly6P52BPmCmL5hcMfeegm-6U0hdpOCvvH2E0ODS2bXodU6WBZVcm3PMq-eB0U7KnultzecIuQvzWaY_b-TMx9Na_JySswW3_iK9X3zDzBddqVPr3Gg6sXdQyTpA Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 996a4beed0bd44c49c163fbac68e9687 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/996a4beed0bd44c49c163fbac68e9687"}]}] Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 996a4beed0bd44c49c163fbac68e9687 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-978006383-project Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 516efdf9d07843a4a5605f94145c293d Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-978006383-project Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: exception: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'fecd0591-71ce-4687-9f77-9f6b4dde7f92'} Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:46:58.475220 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Returning 404 to user: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbc4210c-5b17-4489-b249-322aafe3c9bc tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 404 len: 111 microversion: 2.1 time: 0.031812 Oct 24 09:46:58.480685 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3548/6921] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:58 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:46:58.494828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:58.495418 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:58.502310 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.503027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.503483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.504188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.504722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.505157 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.518817 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] HTTP exception thrown: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Request method failure captured: Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 HTTP/1.1 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl7cjES8etE-qgzVHjYYOU18Zbcifp9LmxKDoD4hlXSJOZAXE2ALly6P52BPmCmL5hcMfeegm-6U0hdpOCvvH2E0ODS2bXodU6WBZVcm3PMq-eB0U7KnultzecIuQvzWaY_b-TMx9Na_JySswW3_iK9X3zDzBddqVPr3Gg6sXdQyTpA Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 996a4beed0bd44c49c163fbac68e9687 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/996a4beed0bd44c49c163fbac68e9687"}]}] Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 996a4beed0bd44c49c163fbac68e9687 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-978006383-project Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 516efdf9d07843a4a5605f94145c293d Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-978006383-project Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: exception: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'fecd0591-71ce-4687-9f77-9f6b4dde7f92'} Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:46:58.520492 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Returning 404 to user: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-822c5ab7-79ed-4df8-9e11-7c9ca1b918b0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 404 len: 111 microversion: 2.1 time: 0.031795 Oct 24 09:46:58.525215 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3374/6922] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:46:58 2022] DELETE /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:46:58.531422 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:46:58.532034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] [instance: fecd0591-71ce-4687-9f77-9f6b4dde7f92] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:46:58.537999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.539046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.539484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.540166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:46:58.540622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:46:58.541044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:46:58.554292 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] HTTP exception thrown: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Request method failure captured: Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 HTTP/1.1 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl7cjES8etE-qgzVHjYYOU18Zbcifp9LmxKDoD4hlXSJOZAXE2ALly6P52BPmCmL5hcMfeegm-6U0hdpOCvvH2E0ODS2bXodU6WBZVcm3PMq-eB0U7KnultzecIuQvzWaY_b-TMx9Na_JySswW3_iK9X3zDzBddqVPr3Gg6sXdQyTpA Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 996a4beed0bd44c49c163fbac68e9687 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/996a4beed0bd44c49c163fbac68e9687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/996a4beed0bd44c49c163fbac68e9687"}]}] Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 996a4beed0bd44c49c163fbac68e9687 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-978006383 Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-978006383-project Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 516efdf9d07843a4a5605f94145c293d Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-978006383-project Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: exception: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'fecd0591-71ce-4687-9f77-9f6b4dde7f92'} Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:46:58.555818 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] Returning 404 to user: Instance fecd0591-71ce-4687-9f77-9f6b4dde7f92 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1044763a-7254-460d-9989-599a51b321e0 tempest-DeleteServersTestJSON-978006383 tempest-DeleteServersTestJSON-978006383-project] 10.222.0.25 "GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92" status: 404 len: 111 microversion: 2.1 time: 0.029764 Oct 24 09:46:58.560490 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3549/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:46:58 2022] GET /compute/v2.1/servers/fecd0591-71ce-4687-9f77-9f6b4dde7f92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:47:06.888653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1485916657", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "26c1c923-8f0a-4065-a6cf-b69e0e0fce7d"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:06.946958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] validate_networks() for [('26c1c923-8f0a-4065-a6cf-b69e0e0fce7d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:47:07.431925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:47:07.432357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:47:07.432835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:47:07.433250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:47:07.433687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:47:07.442930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:07.443421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:07.443864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:07.444797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:07.445263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:07.445721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:07.472438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Getting quotas for project f426d2cfe5ba47c1b1fd9d625177e682. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:47:07.478581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Getting quotas for user cafa00717a9c418ca48edeb2bfbf12dd and project f426d2cfe5ba47c1b1fd9d625177e682. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:47:07.491284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:47:07.493652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:47:07.541827 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f1730bf1-8f92-475b-b898-cee13773097e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822878 Oct 24 09:47:07.542663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3375/6924] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:47:07.553610 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2945dcb5-f67c-4b42-9f97-777d647e4a3c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:07.554943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2945dcb5-f67c-4b42-9f97-777d647e4a3c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:07.614870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2945dcb5-f67c-4b42-9f97-777d647e4a3c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:07.624674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2945dcb5-f67c-4b42-9f97-777d647e4a3c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1218 microversion: 2.1 time: 0.074809 Oct 24 09:47:07.625235 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3550/6925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:07 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:08.648918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:08.649566 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:08.657124 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:08.657666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:08.658126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:08.658844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:08.659317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:08.659763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:08.783175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:08.791507 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53c1f306-9676-451e-8ac1-939414b9b58a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1278 microversion: 2.1 time: 0.147258 Oct 24 09:47:08.792455 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3376/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:08 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:09.820882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:09.822463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:09.828635 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=49 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:09.832389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:09.833184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:09.833888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:09.835548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:09.836271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:09.836895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:09.998834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:10.007603 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-545991f0-9fba-4228-a3fb-47a0fb375d89 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.194934 Oct 24 09:47:10.008627 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3551/6927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:09 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:10.473276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2bba2877-ef2a-46a9-b2eb-e2c8eaf91408 req-c91e878d-0f7e-4516-a416-a44afafa03aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4b6da4-6c03-4553-9636-6bf111ce097a", "tag": "b7cab58a-3160-459b-926b-fc87994d17a8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:10.497749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bba2877-ef2a-46a9-b2eb-e2c8eaf91408 req-c91e878d-0f7e-4516-a416-a44afafa03aa service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:10.498336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bba2877-ef2a-46a9-b2eb-e2c8eaf91408 req-c91e878d-0f7e-4516-a416-a44afafa03aa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:10.498850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2bba2877-ef2a-46a9-b2eb-e2c8eaf91408 req-c91e878d-0f7e-4516-a416-a44afafa03aa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:10.512828 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2bba2877-ef2a-46a9-b2eb-e2c8eaf91408 req-c91e878d-0f7e-4516-a416-a44afafa03aa service nova] Creating event network-changed:b7cab58a-3160-459b-926b-fc87994d17a8 for instance bf4b6da4-6c03-4553-9636-6bf111ce097a on n-h2-master-1 Oct 24 09:47:10.518226 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2bba2877-ef2a-46a9-b2eb-e2c8eaf91408 req-c91e878d-0f7e-4516-a416-a44afafa03aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048877 Oct 24 09:47:10.519308 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3377/6928] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:47:11.038898 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:11.039526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:11.046626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:11.047185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:11.047685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:11.048472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:11.048970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:11.049427 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:11.202492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:11.210329 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7df5905-e2cd-440a-8d05-cdb9846c5428 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.176780 Oct 24 09:47:11.210911 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3552/6929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:11 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:12.233753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:12.234504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:12.241796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:12.242336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:12.242815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:12.243459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:12.243985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:12.244458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:12.249829 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:12.448671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:12.456369 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c3e8410-331b-4bdb-9941-c48fb87a1dfc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.226902 Oct 24 09:47:12.456939 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3378/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:12 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:13.479018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:13.479636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:13.486437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:13.486952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:13.487391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:13.488077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:13.488533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:13.488959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:13.615387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:13.623523 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bc52aab2-d6d5-48c0-9355-e116b55db5c6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.148417 Oct 24 09:47:13.624098 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3553/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:13 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:14.646349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:14.646976 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:14.655057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:14.655559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:14.656011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:14.656807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:14.657382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:14.657952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:14.798650 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:14.807205 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20bed5a3-1c24-4658-a95b-b6a71cfa5b62 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.164762 Oct 24 09:47:14.807781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3379/6932] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:14 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:15.829919 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:15.830548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:15.833277 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=30 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:15.839382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:15.839876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:15.840322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:15.841054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:15.841543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:15.841981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:15.972205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:15.980388 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95107178-62fc-4440-b7a3-ef8745b90b67 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.154411 Oct 24 09:47:15.980968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3554/6933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:15 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:16.315415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b052151a-ff47-4277-b0c0-29ef382fa82c req-f7236e76-1fc2-44ba-9e0a-b79a4293de3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b6da4-6c03-4553-9636-6bf111ce097a", "name": "network-vif-plugged", "status": "completed", "tag": "b7cab58a-3160-459b-926b-fc87994d17a8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:16.321215 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:16.327112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b052151a-ff47-4277-b0c0-29ef382fa82c req-f7236e76-1fc2-44ba-9e0a-b79a4293de3f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:16.327613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b052151a-ff47-4277-b0c0-29ef382fa82c req-f7236e76-1fc2-44ba-9e0a-b79a4293de3f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:16.328123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b052151a-ff47-4277-b0c0-29ef382fa82c req-f7236e76-1fc2-44ba-9e0a-b79a4293de3f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:16.340915 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b052151a-ff47-4277-b0c0-29ef382fa82c req-f7236e76-1fc2-44ba-9e0a-b79a4293de3f service nova] Creating event network-vif-plugged:b7cab58a-3160-459b-926b-fc87994d17a8 for instance bf4b6da4-6c03-4553-9636-6bf111ce097a on n-h2-master-1 Oct 24 09:47:16.346328 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b052151a-ff47-4277-b0c0-29ef382fa82c req-f7236e76-1fc2-44ba-9e0a-b79a4293de3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034809 Oct 24 09:47:16.347113 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3380/6934] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:47:17.003831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:17.004456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:17.011355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:17.011851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:17.012296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:17.012990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:17.013489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:17.013923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:17.144826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:17.153474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-71a5bc07-5835-4cd9-a84b-007c729bdaee tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1318 microversion: 2.1 time: 0.153479 Oct 24 09:47:17.154052 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3555/6935] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:16 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:18.174116 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:18.174893 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:18.179032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:18.179734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:18.186751 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.187240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.187683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.188372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.188832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.189267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.326329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:18.334456 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-011703b4-80fa-42be-8205-96edd67ed372 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1508 microversion: 2.1 time: 0.162131 Oct 24 09:47:18.335645 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3381/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:18 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:18.357849 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:18.358476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:18.360443 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:18.366624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.367118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.367565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.368260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.368723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.369157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.500294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:18.508705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c74a811-e567-4ba2-8e1d-a8492babe68d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1508 microversion: 2.1 time: 0.154806 Oct 24 09:47:18.509289 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3556/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:18 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:18.531046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:18.533420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:18.539348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.539844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.540295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.540995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.541494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.541940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.604071 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36769c89-db5e-4d2a-af3a-d8a81f4b1e72 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "PUT /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1080 microversion: 2.1 time: 0.076939 Oct 24 09:47:18.604860 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3382/6938] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:47:18 2022] PUT /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1080 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:18.623064 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:18.623678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:18.629901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.630428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.630870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:18.631608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:18.632070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:18.632522 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.057714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:19.065557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cac1a70f-8b7f-422c-9e71-15b9daae2be6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1506 microversion: 2.1 time: 0.446309 Oct 24 09:47:19.066141 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3557/6939] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:18 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:19.088344 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:19.088964 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:19.094934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:19.095429 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:19.095874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.096569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:19.097032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:19.097492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.229229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:19.237340 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37f9e147-1574-4ab1-8700-7971de3d400e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1506 microversion: 2.1 time: 0.153368 Oct 24 09:47:19.237920 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3383/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:19 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:19.259411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:19.261772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:19.267765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:19.268254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:19.268699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.269423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:19.269888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:19.270320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.345146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:19.351194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Old instance type m1.heat2, new instance type m1.heat {{(pid=126920) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:47:19.357681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:47:19.358108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:47:19.358648 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:47:19.359011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:47:19.359426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:47:19.468401 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7a168fe-bb40-43a6-84b7-92d21dd387d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a/action" status: 202 len: 0 microversion: 2.1 time: 0.212986 Oct 24 09:47:19.469045 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3558/6941] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:47:19 2022] POST /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:47:19.477749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:19.478315 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:19.484259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:19.484762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:19.485214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.485944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:19.486411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:19.487020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:19.651617 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:19.659606 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0298cac-088e-4578-a400-f3e454c46d38 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1517 microversion: 2.1 time: 0.186405 Oct 24 09:47:19.660177 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3384/6942] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:19 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:20.684043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:20.684580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:20.691553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:20.692040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:20.692487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:20.693184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:20.693669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:20.694692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:20.826502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:20.835578 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-395dc2a6-12e5-460a-b235-0d49cbdda082 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1517 microversion: 2.1 time: 0.156353 Oct 24 09:47:20.836157 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3559/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:20 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:21.859012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:21.859638 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:21.867110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:21.867602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:21.868055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:21.868753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:21.869219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:21.869684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:21.997906 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:22.005526 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf41eff9-6134-416e-958c-7813bb9a2a2c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.150458 Oct 24 09:47:22.006101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3385/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:21 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:23.028213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:23.028825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:23.035622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:23.036100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:23.036539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:23.037218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:23.037694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:23.038119 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:23.168258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:23.175859 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70868844-d82e-4d64-b1fe-6462e25b702e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.151748 Oct 24 09:47:23.176431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3560/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:23 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:24.199414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:24.200040 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:24.206839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:24.207328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:24.207773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:24.208467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:24.208929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:24.209393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:24.341073 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:24.348894 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8cfd14b3-0855-4562-a665-9790fbd696ac tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.153342 Oct 24 09:47:24.349506 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3386/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:24 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:25.374645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:25.375266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:25.382177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:25.382662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:25.383102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:25.383790 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:25.384246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:25.384678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:25.511186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:25.518899 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3688e41-a34a-4736-b9fb-e1c2d3afb677 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.148160 Oct 24 09:47:25.519584 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3561/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:25 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:26.543085 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:26.543643 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:26.550435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:26.550930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:26.551379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:26.552083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:26.552547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:26.552987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:26.685340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:26.693232 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9dd2f37-7f92-4ffd-8b95-b3700ae82fe0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.154219 Oct 24 09:47:26.694374 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3387/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:26 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:27.716844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:27.717488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:27.724283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:27.724764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:27.725848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:27.726543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:27.727000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:27.727426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:27.856316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:27.863911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42e1f435-75ee-4a50-9901-031dfafee69a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.150963 Oct 24 09:47:27.864502 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3562/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:27 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:28.887504 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:28.888083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:28.895082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:28.895570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:28.896014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:28.896708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:28.897795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:28.898235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:29.026163 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:29.033829 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c2a26a36-2150-4f77-b955-2b8b76abdb5e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.150258 Oct 24 09:47:29.034403 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3388/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:28 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:30.057319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:30.057980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:30.065034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:30.065590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:30.066031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:30.066727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:30.067187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:30.067616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:30.195144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:30.202850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7b83eaca-7993-4b92-99ca-1bef423e4ca7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.150063 Oct 24 09:47:30.203435 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3563/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:30 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:31.226707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:31.227274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:31.233831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:31.234345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:31.234838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:31.235557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:31.236409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:31.236878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:31.369325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:31.377168 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d0bfccf-2000-4cb3-ae62-745a697a962b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.155177 Oct 24 09:47:31.377806 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3389/6952] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:31 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:32.400493 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:32.401336 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:32.407269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:32.407754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:32.408192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:32.408881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:32.409364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:32.409800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:32.544927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:32.553745 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c872e280-5a69-4d00-bf37-8e58443c5628 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.156969 Oct 24 09:47:32.554327 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3564/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:32 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:33.577063 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:33.577621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:33.584989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:33.585522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:33.585976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:33.586684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:33.587152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:33.587602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:33.716140 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:33.723860 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c753aec-9317-4c50-9dd5-f827c8b5b7b1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.150753 Oct 24 09:47:33.724437 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3390/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:33 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:34.747198 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:34.747815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:34.754499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:34.754981 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:34.755418 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:34.756102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:34.756551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:34.756974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:34.883366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:34.891288 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-359f9fb3-ebcf-4796-82f2-da32cd41a13b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.147897 Oct 24 09:47:34.891872 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3565/6955] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:34 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:35.915305 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:35.915955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:35.922738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:35.923231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:35.923686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:35.924384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:35.924843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:35.925279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:36.056580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:36.064453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d50ca02-4eef-41c4-9750-249874f6a1d6 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.153607 Oct 24 09:47:36.065029 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3391/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:35 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:37.088314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:37.088941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:37.095768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:37.096259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:37.096701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:37.097415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:37.097876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:37.098307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:37.102703 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:37.228770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:37.236519 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e327f9d2-8e72-4ec1-b563-f06c36b9679d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.152072 Oct 24 09:47:37.237106 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3566/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:37 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:38.260236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:38.260937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:38.267826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:38.268317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:38.268763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:38.269486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:38.269950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:38.270382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:38.402285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:38.409931 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad414ff1-ff9d-4e57-ad9e-cb562aac7490 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.154044 Oct 24 09:47:38.410495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3392/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:38 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:39.433808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:39.434424 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:39.440995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:39.441513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:39.441951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:39.442641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:39.443122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:39.443551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:39.573730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:39.581378 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-88119192-3869-4927-90b5-9f4ec834d005 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.151377 Oct 24 09:47:39.581958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3567/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:39 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:40.604238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:40.604861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:40.611811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:40.612305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:40.612747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:40.613496 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:40.613941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:40.614378 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:40.827531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:40.836189 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fda3d0c1-4f20-408c-a0fe-102e968b76c1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.236027 Oct 24 09:47:40.837267 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3393/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:40 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:41.859301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:41.859916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:41.867336 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:41.867816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:41.868251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:41.868936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:41.869422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:41.869852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:41.997558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:42.005192 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad6569ad-ccbb-4d3f-b1fb-9452181d4c31 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.149781 Oct 24 09:47:42.005791 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3568/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:41 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:43.029635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:43.030292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:43.037047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:43.037569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:43.038015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:43.038707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:43.039173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:43.039603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:43.042135 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:43.173729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:43.181954 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15d07528-20e5-42f3-bc11-5dfae2833313 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.156537 Oct 24 09:47:43.182525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3394/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:43 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:44.205926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:44.206551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:44.213440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:44.213929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:44.214369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:44.215066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:44.215525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:44.215954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:44.349255 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:44.357675 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-341d940d-1780-4513-818d-396831fd99d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.155979 Oct 24 09:47:44.358250 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3569/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:44 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:45.381182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:45.381836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:45.388610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:45.389102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:45.389586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:45.390287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:45.390756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:45.391197 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:45.529030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:45.536720 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-057e029c-84c3-47b6-8f64-0bf88199516a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.159487 Oct 24 09:47:45.537385 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3395/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:45 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:46.561122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:46.561756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:46.564397 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=36 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:46.570151 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:46.570629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:46.571059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:46.571745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:46.572201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:46.573130 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:46.711548 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:46.719265 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ac14cd6-fbda-4f3a-800c-3b9eabf7503f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.162077 Oct 24 09:47:46.719848 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3570/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:46 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:47.742665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:47.743289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:47.746041 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=32 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:47.751613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:47.752110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:47.752574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:47.753270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:47.753762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:47.754203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:47.886359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:47.894020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ef6b996-94aa-461a-bd23-e29d9eb45b01 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1522 microversion: 2.1 time: 0.155312 Oct 24 09:47:47.894592 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3396/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:47 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:48.918761 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:48.919402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:48.926126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:48.926606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:48.927037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:48.928340 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:48.928777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:48.929197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:48.996971 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b6da4-6c03-4553-9636-6bf111ce097a", "name": "network-vif-unplugged", "status": "completed", "tag": "b7cab58a-3160-459b-926b-fc87994d17a8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:49.007136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:49.007630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:49.008075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:49.020352 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] Creating event network-vif-unplugged:b7cab58a-3160-459b-926b-fc87994d17a8 for instance bf4b6da4-6c03-4553-9636-6bf111ce097a on n-h1-master-1 Oct 24 09:47:49.026322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] Instance bf4b6da4-6c03-4553-9636-6bf111ce097a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:47:49.038732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7ccfb2d2-76f8-4ad0-b85e-d43cb8ef6835 req-44fe9eb4-7c73-41cb-8a2d-3c2f3c7c74b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045588 Oct 24 09:47:49.039666 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3397/6967] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:47:49.179282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:49.187083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73628b5d-4570-4972-a1fd-67bea61742ab tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1521 microversion: 2.1 time: 0.272157 Oct 24 09:47:49.187652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3571/6968] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:48 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:50.212220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:50.212931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:50.219152 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:50.219651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:50.220128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:50.220832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:50.221326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:50.221764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:50.353766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:50.361491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-103b5dac-5410-4eb1-bf4d-4d96f4bb62dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1519 microversion: 2.1 time: 0.154368 Oct 24 09:47:50.362064 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3398/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:50 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:51.054067 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4b6da4-6c03-4553-9636-6bf111ce097a", "tag": "b7cab58a-3160-459b-926b-fc87994d17a8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:51.065234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:51.065747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:51.066177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:51.077786 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] Creating event network-changed:b7cab58a-3160-459b-926b-fc87994d17a8 for instance bf4b6da4-6c03-4553-9636-6bf111ce097a on n-h1-master-1 Oct 24 09:47:51.082990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] Instance bf4b6da4-6c03-4553-9636-6bf111ce097a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:47:51.094448 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-555699a2-9d34-4d4f-9ed1-b595b4a70079 req-410bfe3c-f90e-4601-b8ed-859a73c4f460 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044083 Oct 24 09:47:51.095061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3572/6970] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:47:51.385577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:51.386262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:51.394889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:51.395396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:51.395851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:51.397164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:51.397670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:51.398319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:51.631956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:51.640343 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c31910ce-cc48-4bd8-9b03-4ade55d15769 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1519 microversion: 2.1 time: 0.259222 Oct 24 09:47:51.640994 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3399/6971] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:51 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:52.667623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:52.668331 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:52.674409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:52.674894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:52.675332 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:52.676036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:52.676472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:52.676900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:52.804182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:52.811873 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec333f56-a28d-492e-8457-136e2b562027 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1516 microversion: 2.1 time: 0.149517 Oct 24 09:47:52.812451 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3573/6972] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:52 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:52.834754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:52.835307 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:52.842223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:52.842723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:52.843180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:52.843886 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:52.844358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:52.844804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:52.904978 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ba1ad00-71a0-4d4d-9439-fce9051a04dc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a/action" status: 204 len: 0 microversion: 2.1 time: 0.073948 Oct 24 09:47:52.905677 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3400/6973] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:47:52 2022] POST /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:47:52.914221 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:52.914841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:52.920864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:52.921339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:52.921754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:52.922450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:52.922909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:52.923347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:53.062821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:53.070772 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2b64daf-1b4f-4125-be4a-e2a30797fe32 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1516 microversion: 2.1 time: 0.160859 Oct 24 09:47:53.071354 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3574/6974] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:52 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:54.096671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:54.097518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:54.104456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:54.105605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:54.106066 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:54.106882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:54.107362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:54.107817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:54.225371 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3a22c645-fe0f-409e-9f11-a360ecdce142 req-dd1ab689-54cc-4848-815a-18749f64635a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b6da4-6c03-4553-9636-6bf111ce097a", "name": "network-vif-plugged", "status": "completed", "tag": "b7cab58a-3160-459b-926b-fc87994d17a8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:54.238018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3a22c645-fe0f-409e-9f11-a360ecdce142 req-dd1ab689-54cc-4848-815a-18749f64635a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:54.238448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3a22c645-fe0f-409e-9f11-a360ecdce142 req-dd1ab689-54cc-4848-815a-18749f64635a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:54.239056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3a22c645-fe0f-409e-9f11-a360ecdce142 req-dd1ab689-54cc-4848-815a-18749f64635a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:54.254985 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3a22c645-fe0f-409e-9f11-a360ecdce142 req-dd1ab689-54cc-4848-815a-18749f64635a service nova] Creating event network-vif-plugged:b7cab58a-3160-459b-926b-fc87994d17a8 for instance bf4b6da4-6c03-4553-9636-6bf111ce097a on n-h1-master-1 Oct 24 09:47:54.261507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3a22c645-fe0f-409e-9f11-a360ecdce142 req-dd1ab689-54cc-4848-815a-18749f64635a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040447 Oct 24 09:47:54.262507 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3575/6975] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:47:54.262621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:54.271293 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c5cfeb8-7686-4aec-8e70-5b44b466aeb9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1516 microversion: 2.1 time: 0.179978 Oct 24 09:47:54.272045 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3401/6976] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:54 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:55.296623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:55.297263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:55.303500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:55.303992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:55.304439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:55.305133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:55.305624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:55.306061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:55.432124 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:55.439812 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50937ea4-549f-4380-a791-12349087fd63 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1508 microversion: 2.1 time: 0.148376 Oct 24 09:47:55.440386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3576/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:55 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:55.462295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:55.462918 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:55.469724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:55.470211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:55.470657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:55.471363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:55.471827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:55.472261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:55.598054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:55.605932 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b606c91d-1cd7-4f61-92ac-c2ddf1d2d945 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1508 microversion: 2.1 time: 0.147944 Oct 24 09:47:55.606515 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3402/6978] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:55 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:55.631446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df820954-b18a-4c63-802e-910689fc25d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'create', calling method: .version_select at 0x7f8daa582790>, body: {"keypair": {"name": "tempest-keypair-514920315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0tzvcTXpHHTgjrEndalMan7DDMICronY9H6ftFspTgS02lvdo1vO0Mgi8EfihXDEhc/thGYl0OBbGxJ6GIsUr/jXDTgtsDfeLIuvDXBIReIZn6QTEzmU7Wz452edAWcA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:55.647203 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-df820954-b18a-4c63-802e-910689fc25d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Getting quotas for project f426d2cfe5ba47c1b1fd9d625177e682. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:47:55.652453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-df820954-b18a-4c63-802e-910689fc25d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Getting quotas for user cafa00717a9c418ca48edeb2bfbf12dd and project f426d2cfe5ba47c1b1fd9d625177e682. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:47:55.676634 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df820954-b18a-4c63-802e-910689fc25d1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049448 Oct 24 09:47:55.677230 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3577/6979] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:47:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:47:57.154766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:57.155422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:57.162947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:57.163442 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:57.163895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:57.164591 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:57.165057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:57.165533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:57.295709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:57.303429 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10c4b42f-14ef-490c-ac64-4a74bc57d744 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 200 len: 1508 microversion: 2.1 time: 0.155041 Oct 24 09:47:57.304009 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3403/6980] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:57 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:57.326617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:57.327134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:57.335112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:57.335595 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:57.336036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:57.336716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:57.337167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:57.337625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:57.361368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:47:57.439444 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32414076-ca99-4fc8-ac3c-37f3ed28c584 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 204 len: 0 microversion: 2.1 time: 0.116410 Oct 24 09:47:57.440045 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3578/6981] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:47:57 2022] DELETE /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:47:57.497886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-791166253", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "26c1c923-8f0a-4065-a6cf-b69e0e0fce7d"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:57.549800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] validate_networks() for [('26c1c923-8f0a-4065-a6cf-b69e0e0fce7d', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:47:57.914141 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:47:57.914925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:47:57.915792 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:47:57.916576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:47:57.917027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:47:57.926647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:57.927150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:57.928205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:57.928957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:57.929468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:57.929915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:57.949649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Getting quotas for project f426d2cfe5ba47c1b1fd9d625177e682. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:47:57.954915 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Getting quotas for user cafa00717a9c418ca48edeb2bfbf12dd and project f426d2cfe5ba47c1b1fd9d625177e682. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:47:57.969931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:47:57.972259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:47:58.022261 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2f674b44-73ac-41a3-a8d0-e1900b7c7bbd tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528269 Oct 24 09:47:58.022925 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3404/6982] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:47:58.035129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9a4fdeb-a326-4aac-9ef9-72168c626d65 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:58.035843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9a4fdeb-a326-4aac-9ef9-72168c626d65 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:58.093207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9a4fdeb-a326-4aac-9ef9-72168c626d65 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:58.101876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9a4fdeb-a326-4aac-9ef9-72168c626d65 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1217 microversion: 2.1 time: 0.071071 Oct 24 09:47:58.102469 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3579/6983] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:58 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:47:59.126466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:47:59.127093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:47:59.134664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:59.135169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:59.135626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:59.136341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:59.136809 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:59.137246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:59.354475 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e64d7d1f-b5f2-4ebd-b5e2-88a82aad0e94 req-1c7bf1d0-eded-4009-a600-8b49b0dd1936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4b6da4-6c03-4553-9636-6bf111ce097a", "name": "network-vif-deleted", "tag": "b7cab58a-3160-459b-926b-fc87994d17a8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:47:59.367477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e64d7d1f-b5f2-4ebd-b5e2-88a82aad0e94 req-1c7bf1d0-eded-4009-a600-8b49b0dd1936 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:47:59.374365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e64d7d1f-b5f2-4ebd-b5e2-88a82aad0e94 req-1c7bf1d0-eded-4009-a600-8b49b0dd1936 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:47:59.375479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e64d7d1f-b5f2-4ebd-b5e2-88a82aad0e94 req-1c7bf1d0-eded-4009-a600-8b49b0dd1936 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:47:59.392323 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e64d7d1f-b5f2-4ebd-b5e2-88a82aad0e94 req-1c7bf1d0-eded-4009-a600-8b49b0dd1936 service nova] Creating event network-vif-deleted:b7cab58a-3160-459b-926b-fc87994d17a8 for instance bf4b6da4-6c03-4553-9636-6bf111ce097a on n-h1-master-1 Oct 24 09:47:59.394937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:47:59.398660 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e64d7d1f-b5f2-4ebd-b5e2-88a82aad0e94 req-1c7bf1d0-eded-4009-a600-8b49b0dd1936 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048878 Oct 24 09:47:59.399726 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3580/6984] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:47:59.406484 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ed2c912-3c64-4f9b-802b-48e3d3e23c61 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1277 microversion: 2.1 time: 0.284879 Oct 24 09:47:59.407073 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3405/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:47:59 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:00.434624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:00.435355 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:00.442114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:00.442607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:00.443073 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:00.444524 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:00.444994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:00.445453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:00.656710 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1c478a54-b6f0-411d-8086-cb06f0ee772d req-e7e6e339-4fde-43fa-b4cf-251353f20d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9665b9f6-ff34-42ea-8c3e-c7064f73d19b", "tag": "0d4cded2-8e3d-43fc-a91d-9cd940f30a06"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:00.661353 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:00.667679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1c478a54-b6f0-411d-8086-cb06f0ee772d req-e7e6e339-4fde-43fa-b4cf-251353f20d5d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:00.668181 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1c478a54-b6f0-411d-8086-cb06f0ee772d req-e7e6e339-4fde-43fa-b4cf-251353f20d5d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:00.668628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1c478a54-b6f0-411d-8086-cb06f0ee772d req-e7e6e339-4fde-43fa-b4cf-251353f20d5d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:00.680922 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1c478a54-b6f0-411d-8086-cb06f0ee772d req-e7e6e339-4fde-43fa-b4cf-251353f20d5d service nova] Creating event network-changed:0d4cded2-8e3d-43fc-a91d-9cd940f30a06 for instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b on n-h2-master-1 Oct 24 09:48:00.685641 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1c478a54-b6f0-411d-8086-cb06f0ee772d req-e7e6e339-4fde-43fa-b4cf-251353f20d5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032848 Oct 24 09:48:00.686307 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3406/6986] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:48:00.687209 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1477faeb-cae8-4f43-8f1d-c90df09e1e6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1317 microversion: 2.1 time: 0.258229 Oct 24 09:48:00.687916 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3581/6987] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:00 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:01.712640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:01.713397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:01.719690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:01.720190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:01.720650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:01.721422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:01.721897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:01.722368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:01.855759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:01.863803 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f2309d7-5c7b-47ed-af89-5c62205642f3 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1317 microversion: 2.1 time: 0.156879 Oct 24 09:48:01.864411 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3407/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:01 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:02.888926 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:02.889581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:02.896082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:02.897013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:02.897498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:02.898191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:02.898657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:02.899120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:03.033542 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:03.041978 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db8db12e-442c-4913-a819-2b9a2dd17c66 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1317 microversion: 2.1 time: 0.156949 Oct 24 09:48:03.042569 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3582/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:02 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:04.065016 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:04.065661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:04.072508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:04.072997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:04.073475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:04.074172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:04.074631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:04.075065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:04.204824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:04.212923 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e739f8e-e400-4a46-a012-307c4c5f8f6a tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1317 microversion: 2.1 time: 0.151870 Oct 24 09:48:04.213509 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3408/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:04 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:04.537325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-46ae69b4-44cb-4bf2-8216-21b2809d96a7 req-721b6354-7105-4abb-94fa-95ae4d49d298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9665b9f6-ff34-42ea-8c3e-c7064f73d19b", "name": "network-vif-plugged", "status": "completed", "tag": "0d4cded2-8e3d-43fc-a91d-9cd940f30a06"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:04.550847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-46ae69b4-44cb-4bf2-8216-21b2809d96a7 req-721b6354-7105-4abb-94fa-95ae4d49d298 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:04.551330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-46ae69b4-44cb-4bf2-8216-21b2809d96a7 req-721b6354-7105-4abb-94fa-95ae4d49d298 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:04.551767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-46ae69b4-44cb-4bf2-8216-21b2809d96a7 req-721b6354-7105-4abb-94fa-95ae4d49d298 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:04.563454 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-46ae69b4-44cb-4bf2-8216-21b2809d96a7 req-721b6354-7105-4abb-94fa-95ae4d49d298 service nova] Creating event network-vif-plugged:0d4cded2-8e3d-43fc-a91d-9cd940f30a06 for instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b on n-h2-master-1 Oct 24 09:48:04.568630 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-46ae69b4-44cb-4bf2-8216-21b2809d96a7 req-721b6354-7105-4abb-94fa-95ae4d49d298 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035442 Oct 24 09:48:04.569697 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3583/6991] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:48:05.236523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:05.237083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:05.244115 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:05.244610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:05.245058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:05.245820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:05.246290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:05.246729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:05.373481 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:05.381645 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05667b00-8dd5-4de1-bc2d-fd2742db53bf tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1317 microversion: 2.1 time: 0.149038 Oct 24 09:48:05.382229 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3409/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:05 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:06.405969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:06.406580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:06.414136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.414614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.415044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.415726 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.416176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.416598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.547717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:06.555276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f4845dd-e061-4e61-a693-e7e1bc86a7a7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1506 microversion: 2.1 time: 0.153887 Oct 24 09:48:06.555852 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3584/6993] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:06 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:06.577249 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:06.577910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:06.585179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.585701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.586156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.586880 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.587353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.587795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.718373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:06.726653 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-76329e6d-6667-40f8-ae71-86f797d5b8fc tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1506 microversion: 2.1 time: 0.153242 Oct 24 09:48:06.727225 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3410/6994] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:06 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:06.748280 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:06.750576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:06.756401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.756880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.757329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.758013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.758464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.758886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.778262 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:06.788860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:06.794192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Old instance type m1.heat2, new instance type m1.heat {{(pid=126920) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:48:06.801646 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:48:06.802059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:48:06.802552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:48:06.802956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:48:06.803360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:48:06.864215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b6efc23-853c-4578-9580-79d77376b296 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b/action" status: 202 len: 0 microversion: 2.1 time: 0.119633 Oct 24 09:48:06.864829 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3585/6995] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:48:06 2022] POST /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:48:06.873216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:06.874235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:06.880130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.881235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.881777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.882543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:06.883075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:06.883741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:06.888612 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:07.043917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:07.052086 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22bf1ceb-602e-4766-bedc-a338c9a24cf2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1513 microversion: 2.1 time: 0.183104 Oct 24 09:48:07.052788 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3411/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:06 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:08.077728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:08.078996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:08.088051 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:08.088562 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:08.089062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:08.089799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:08.090871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:08.091303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:08.097581 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:08.227101 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:08.234844 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16607321-4c75-415d-9b4f-39cc40d7ded2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1513 microversion: 2.1 time: 0.161857 Oct 24 09:48:08.235418 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3586/6997] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:08 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:09.259060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:09.259620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:09.262293 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:09.262993 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:09.269484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:09.269974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:09.270420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:09.271724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:09.272198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:09.272652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:09.408496 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:09.416139 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52e77cc3-5126-412e-a8c7-259ae0dd2cec tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.161526 Oct 24 09:48:09.416715 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3412/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:09 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:10.439879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:10.440499 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:10.447377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:10.447870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:10.448312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:10.449007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:10.449510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:10.449944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:10.584639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:10.592361 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65ce0054-895a-4ad8-aad2-bccf3fa21262 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.156407 Oct 24 09:48:10.592938 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3587/6999] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:10 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:11.615556 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:11.616181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:11.623400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:11.623905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:11.624363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:11.625105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:11.625610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:11.626057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:11.758668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:11.766439 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37029f89-1e51-45a8-9e25-d4844064ac0c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.154814 Oct 24 09:48:11.767017 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3413/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:11 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:12.790500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:12.791157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:12.798196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:12.798691 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:12.799141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:12.799839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:12.800304 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:12.800743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:12.928286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:12.935988 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37a7fdd1-994f-457f-b07a-baca01b057bb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.150020 Oct 24 09:48:12.936570 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3588/7001] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:12 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:13.960179 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:13.960800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:13.968014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:13.968449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:13.968895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:13.969617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:13.970083 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:13.970518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:14.102879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:14.110556 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7fcbf5a8-be3a-4aea-8f6d-60a59849f0db tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.154821 Oct 24 09:48:14.111124 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3414/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:13 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:15.133645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:15.134262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:15.141092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:15.141610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:15.142068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:15.142754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:15.143211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:15.143639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:15.269882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:15.277914 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d60dd3b-84b3-4ff2-9749-66ebac7b9c69 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.148195 Oct 24 09:48:15.278484 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3589/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:15 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:16.301720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:16.302855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:16.309789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:16.310288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:16.310738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:16.311440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:16.311904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:16.312386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:16.439337 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:16.447712 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eff6e5a6-cde4-4f4a-b23a-9f74b051912f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.150059 Oct 24 09:48:16.448281 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3415/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:16 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:17.471079 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:17.471695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:17.474688 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:17.480226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:17.480817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:17.481250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:17.481978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:17.482426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:17.482851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:17.616589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:17.624451 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddc7fe77-bb35-4124-888e-a7a9950f4517 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.157225 Oct 24 09:48:17.625029 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3590/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:17 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:18.648379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:18.649007 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:18.652021 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:18.657280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:18.657796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:18.658239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:18.658937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:18.659402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:18.659847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:18.789318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:18.796942 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f51c4abb-479a-4f29-a14b-392510eebcd9 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.153022 Oct 24 09:48:18.797537 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3416/7006] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:18 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:19.820714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:19.821365 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:19.828187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:19.828670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:19.829107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:19.829820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:19.830281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:19.830711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:19.957720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:19.965413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b08c85d6-1b87-4fbf-8dfe-edbe4d1c2389 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.149076 Oct 24 09:48:19.965989 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3591/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:19 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:20.988164 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:20.988798 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:20.995779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:20.996272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:20.996726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:20.997472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:20.997949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:20.998392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:21.130714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:21.138517 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b4fc3bf7-fc65-4ee0-9532-3b74306c53d2 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.154301 Oct 24 09:48:21.139107 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3417/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:20 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:22.163245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:22.163844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:22.171081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:22.171544 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:22.171983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:22.172667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:22.173117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:22.173564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:22.309056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:22.316712 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9dcf946b-db18-46fb-9691-e1e87a749c9e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.157840 Oct 24 09:48:22.317313 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3592/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:22 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:23.340457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:23.341020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:23.348455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:23.349448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:23.349903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:23.350596 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:23.351057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:23.351493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:23.479091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:23.486839 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7cdfa44-22bd-4b14-a731-e3ca784b8f03 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.150355 Oct 24 09:48:23.487417 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3418/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:23 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:24.510031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:24.510659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:24.517655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:24.518137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:24.518570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:24.519250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:24.519702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:24.520124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:24.646262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:24.654083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ea3f64d5-6b5f-4689-80cd-799bc4433e80 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.148506 Oct 24 09:48:24.654687 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3593/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:24 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:48:25.677278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:25.677924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:25.684761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:25.685259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:25.685740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:25.686468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:25.686970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:25.687413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:25.821270 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:25.828993 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-072d5482-0d79-483d-9c47-78b01edc814f tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.155652 Oct 24 09:48:25.829612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3419/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:25 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:26.852637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:26.853262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:26.860147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:26.860633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:26.861074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:26.861800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:26.862255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:26.862685 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:26.990440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:26.998183 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad83f896-a61c-41b0-b02b-effaed37a321 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.149534 Oct 24 09:48:26.998758 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3594/7013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:26 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:28.022472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:28.023276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:28.030213 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:28.030707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:28.031159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:28.031865 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:28.032332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:28.032778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:28.162070 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:28.169796 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-30c99401-8083-4cd1-a18e-097585e5fd4c tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.151835 Oct 24 09:48:28.170405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3420/7014] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:28 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:29.194477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:29.195089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:29.202013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:29.202503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:29.202943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:29.203706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:29.204197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:29.204624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:29.334953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:29.342498 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a393ad0-6c63-448d-a456-ec396d02731b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.152251 Oct 24 09:48:29.343074 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3595/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:29 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:30.365640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:30.366268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:30.373029 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:30.373557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:30.374012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:30.374737 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:30.375204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:30.375645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:30.503768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:30.512104 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad3c92d7-8be7-441a-9880-10ed49edf874 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.150504 Oct 24 09:48:30.512686 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3421/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:30 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:31.535423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:31.536041 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:31.543518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:31.544000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:31.544437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:31.545127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:31.545681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:31.546111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:31.671977 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:31.679644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a342bd5-0af6-412e-8a81-c156737508e7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.148058 Oct 24 09:48:31.680216 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3596/7017] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:31 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:32.703770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:32.704436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:32.711493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:32.711996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:32.712458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:32.713164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:32.713676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:32.714122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:32.844995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:32.853374 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5db43221-2d11-4629-a3c9-d66783205941 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.153537 Oct 24 09:48:32.853952 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3422/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:32 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:33.876403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:33.877022 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:33.883936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:33.884424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:33.884865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:33.885586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:33.886049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:33.886481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:34.017400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:34.025999 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a439dc44-97ef-4180-bc18-d9387ff55be0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.153437 Oct 24 09:48:34.026842 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3597/7019] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:33 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:35.049839 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:35.050468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:35.058015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:35.058517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:35.058968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:35.059674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:35.060142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:35.060610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:35.189038 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:35.196830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d59eda84-08a5-488b-af12-6c9c33181cd5 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1518 microversion: 2.1 time: 0.150927 Oct 24 09:48:35.197425 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3423/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:35 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:36.220059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:36.220681 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:36.227783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:36.228278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:36.228728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:36.229466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:36.229931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:36.230358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:36.339869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9665b9f6-ff34-42ea-8c3e-c7064f73d19b", "name": "network-vif-unplugged", "status": "completed", "tag": "0d4cded2-8e3d-43fc-a91d-9cd940f30a06"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:36.349721 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:36.350208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:36.350645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:36.362640 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] Creating event network-vif-unplugged:0d4cded2-8e3d-43fc-a91d-9cd940f30a06 for instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b on n-h1-master-1 Oct 24 09:48:36.368568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:48:36.382569 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fdf5bb80-d1bd-475e-ac4e-a0ffd6e1489b req-80496cc9-3e0b-4f72-bba8-fb2b55887b35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111204 Oct 24 09:48:36.383183 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3424/7021] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:48:36.486617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:36.495731 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b13f156d-a23c-4dd0-a32a-f6bc0f6bea12 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1517 microversion: 2.1 time: 0.279584 Oct 24 09:48:36.496316 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3598/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:36 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:37.521695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:37.522333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:37.528734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:37.529263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:37.529804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:37.530537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:37.531007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:37.531449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:37.534125 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=81 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:37.665493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:37.673175 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee702929-90c6-4d64-87ef-d3965bd67834 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1515 microversion: 2.1 time: 0.157248 Oct 24 09:48:37.673782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3425/7023] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:37 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:38.402002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9665b9f6-ff34-42ea-8c3e-c7064f73d19b", "tag": "0d4cded2-8e3d-43fc-a91d-9cd940f30a06"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:38.412088 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:38.412574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:38.413010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:38.416647 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:38.425056 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] Creating event network-changed:0d4cded2-8e3d-43fc-a91d-9cd940f30a06 for instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b on n-h1-master-1 Oct 24 09:48:38.432868 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:48:38.444472 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-da7769d7-5ce2-4a7d-a7fa-9ee56dc34411 req-21389503-8c09-4e86-a23a-54694adfdb19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046406 Oct 24 09:48:38.445069 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3599/7024] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:48:38.697568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:38.698790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:38.707538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:38.708357 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:38.709034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:38.709961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:38.710590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:38.711252 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:38.941676 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:38.950402 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b32296a-eb3c-4a24-9084-1d2bd5393bf7 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1515 microversion: 2.1 time: 0.257475 Oct 24 09:48:38.951213 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3426/7025] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:38 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:39.975889 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:39.976603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:39.984339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:39.984827 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:39.985268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:39.985984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:39.986439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:39.986878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:40.121395 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:40.128986 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4dd9cbb-b3fd-4492-9ae7-64a1b6896890 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1512 microversion: 2.1 time: 0.157973 Oct 24 09:48:40.129584 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3600/7026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:39 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:40.152027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:40.152567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:40.159384 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:40.159871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:40.160317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:40.161014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:40.162074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:40.162511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:40.219265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a967c412-9295-4d42-a593-362f7f6996c4 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "POST /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b/action" status: 204 len: 0 microversion: 2.1 time: 0.071147 Oct 24 09:48:40.219918 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3427/7027] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:48:40 2022] POST /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:48:40.228083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:40.228634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:40.234746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:40.235234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:40.235750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:40.236453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:40.236908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:40.237558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:40.375303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:40.384346 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1582184b-1f17-4cf5-8352-9d33ff089249 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1512 microversion: 2.1 time: 0.160141 Oct 24 09:48:40.385047 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3601/7028] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:40 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:41.411019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:41.412324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:41.419264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:41.419811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:41.420266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:41.420986 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:41.421485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:41.421925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:41.559994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:41.568286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8782238e-3203-4ff0-958a-8bd279c7aad1 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1512 microversion: 2.1 time: 0.162092 Oct 24 09:48:41.569156 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3428/7029] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:41 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:48:42.398269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ca1b3dc7-d4ed-4e57-ab9d-75d45bc5d4cf req-6baffa4f-20be-4e84-b01f-5aee86546ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9665b9f6-ff34-42ea-8c3e-c7064f73d19b", "name": "network-vif-plugged", "status": "completed", "tag": "0d4cded2-8e3d-43fc-a91d-9cd940f30a06"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:42.410750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ca1b3dc7-d4ed-4e57-ab9d-75d45bc5d4cf req-6baffa4f-20be-4e84-b01f-5aee86546ba3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.411880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ca1b3dc7-d4ed-4e57-ab9d-75d45bc5d4cf req-6baffa4f-20be-4e84-b01f-5aee86546ba3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.412419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ca1b3dc7-d4ed-4e57-ab9d-75d45bc5d4cf req-6baffa4f-20be-4e84-b01f-5aee86546ba3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:42.423839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ca1b3dc7-d4ed-4e57-ab9d-75d45bc5d4cf req-6baffa4f-20be-4e84-b01f-5aee86546ba3 service nova] Creating event network-vif-plugged:0d4cded2-8e3d-43fc-a91d-9cd940f30a06 for instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b on n-h1-master-1 Oct 24 09:48:42.428758 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ca1b3dc7-d4ed-4e57-ab9d-75d45bc5d4cf req-6baffa4f-20be-4e84-b01f-5aee86546ba3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034785 Oct 24 09:48:42.429427 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3602/7030] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:48:42.592110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:42.592735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:42.599577 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.600074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.600527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:42.601230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.601731 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.602175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:42.731894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:42.739620 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-609d61a6-7af7-45f1-a3e4-b000a20c4f30 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1504 microversion: 2.1 time: 0.151406 Oct 24 09:48:42.740189 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3429/7031] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:42 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:42.762529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:42.763230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:42.769460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.769948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.770389 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:42.771676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.772134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.772565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:42.902844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:42.910468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-69f0b696-c144-4314-96f4-87ba99f1d9eb tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1504 microversion: 2.1 time: 0.152133 Oct 24 09:48:42.911042 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3603/7032] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:42 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:42.932901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:42.933482 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:42.939479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.939966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.940411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:42.941100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:42.941587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:42.942021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.073180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:43.080967 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2a070ff-2ae3-4287-b422-07198634c68e tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1504 microversion: 2.1 time: 0.151992 Oct 24 09:48:43.081557 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3430/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:42 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:43.102918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:43.103419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:43.109329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:43.109823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:43.110261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.110950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:43.111404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:43.111833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.136845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:48:43.212017 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b582d1ae-0d8b-4b8b-adf5-ecfd0b3b56a0 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 204 len: 0 microversion: 2.1 time: 0.112275 Oct 24 09:48:43.212654 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3604/7034] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:48:43 2022] DELETE /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:48:43.226044 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:43.226552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:43.232414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:43.232905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:43.233376 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.234072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:43.234534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:43.234975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.259702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:48:43.304784 n-d-master-1 devstack@n-api.service[126919]: INFO nova.compute.api [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Instance is already in deleting state, ignoring this request Oct 24 09:48:43.305673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b4e8ca5-1455-4a7c-8259-6d62bf33627d tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 204 len: 0 microversion: 2.1 time: 0.083603 Oct 24 09:48:43.306251 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3431/7035] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:48:43 2022] DELETE /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:48:43.314828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:43.315531 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:43.322031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:43.322509 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:43.323036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.323765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:43.324217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:43.324642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:43.452771 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:43.461133 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12177f5b-5d5d-49db-8986-6e5d2dcca0d8 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1510 microversion: 2.1 time: 0.150586 Oct 24 09:48:43.461737 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3605/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:43 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:44.483949 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:44.484479 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:44.491817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:44.492327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:44.492773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:44.493514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:44.493979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:44.494415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:44.623473 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:44.631665 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-145777ea-aef5-4b1b-87e0-e48d53172343 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1510 microversion: 2.1 time: 0.151639 Oct 24 09:48:44.632245 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3432/7037] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:44 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:45.120256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a883ab7e-fa90-4e57-9473-e3c00e808fd9 req-3721e258-afd6-4a7c-bd20-aa9af316b864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9665b9f6-ff34-42ea-8c3e-c7064f73d19b", "name": "network-vif-deleted", "tag": "0d4cded2-8e3d-43fc-a91d-9cd940f30a06"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:45.131584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a883ab7e-fa90-4e57-9473-e3c00e808fd9 req-3721e258-afd6-4a7c-bd20-aa9af316b864 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:45.132075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a883ab7e-fa90-4e57-9473-e3c00e808fd9 req-3721e258-afd6-4a7c-bd20-aa9af316b864 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:45.132510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a883ab7e-fa90-4e57-9473-e3c00e808fd9 req-3721e258-afd6-4a7c-bd20-aa9af316b864 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:45.156927 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a883ab7e-fa90-4e57-9473-e3c00e808fd9 req-3721e258-afd6-4a7c-bd20-aa9af316b864 service nova] Creating event network-vif-deleted:0d4cded2-8e3d-43fc-a91d-9cd940f30a06 for instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b on n-h1-master-1 Oct 24 09:48:45.162557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a883ab7e-fa90-4e57-9473-e3c00e808fd9 req-3721e258-afd6-4a7c-bd20-aa9af316b864 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046002 Oct 24 09:48:45.163233 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3606/7038] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:48:45.655060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:45.655763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:45.662854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:45.663426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:45.663944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:45.664712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:45.665243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:45.665709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:45.700353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:45.700763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:45.701207 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:45.701692 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lazy-loading 'fault' on Instance uuid 9665b9f6-ff34-42ea-8c3e-c7064f73d19b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:48:45.750375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafa00717a9c418ca48edeb2bfbf12dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f426d2cfe5ba47c1b1fd9d625177e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:45.758780 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3985b1d0-9389-47f2-87bd-95925e9a2f97 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 200 len: 1305 microversion: 2.1 time: 0.108000 Oct 24 09:48:45.759848 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3433/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:45 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:48:46.783952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:46.784686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: 9665b9f6-ff34-42ea-8c3e-c7064f73d19b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:46.790978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:46.791494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:46.791935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:46.792645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:46.793103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:46.793556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:46.807216 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] HTTP exception thrown: Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b could not be found. Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Request method failure captured: Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b HTTP/1.1 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl8aPBpGfjzckGKR6nydFdLhyHr-_xX7T8qZaaa3269pmUgcMrOCk1IiJvLtRPNZ5V_QOmQsTGEhZfdU7tSZssODb4SQwESqieIAGopO42SkqJsjnOlrVZk1Gm-PZIZD5d6nKzF0I907q-zalQNcyWQ4_4nJqhmPi1bRPrM9tyjLb1k Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f426d2cfe5ba47c1b1fd9d625177e682 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f426d2cfe5ba47c1b1fd9d625177e682"}]}] Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f426d2cfe5ba47c1b1fd9d625177e682 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerDiskConfigTestJSON-1948780236-project Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: cafa00717a9c418ca48edeb2bfbf12dd Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerDiskConfigTestJSON-1948780236-project Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b could not be found. Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '9665b9f6-ff34-42ea-8c3e-c7064f73d19b'} Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b could not be found. Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b could not be found. Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:48:46.808826 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b could not be found. Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Returning 404 to user: Instance 9665b9f6-ff34-42ea-8c3e-c7064f73d19b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97e56406-66a6-43aa-9211-646c9d40f73b tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b" status: 404 len: 111 microversion: 2.1 time: 0.031469 Oct 24 09:48:46.813606 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3607/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:46 2022] GET /compute/v2.1/servers/9665b9f6-ff34-42ea-8c3e-c7064f73d19b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:48:46.819378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-794003af-048e-48d3-846b-e090d3933a35 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '.version_select at 0x7f8daf22d310>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:46.842540 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-794003af-048e-48d3-846b-e090d3933a35 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514920315" status: 202 len: 0 microversion: 2.1 time: 0.027469 Oct 24 09:48:46.843115 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3434/7041] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:48:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514920315 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:48:47.443935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:47.444434 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:47.450458 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:47.450946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:47.451391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:47.452074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:47.452530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:47.452956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:47.466581 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] HTTP exception thrown: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Request method failure captured: Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a HTTP/1.1 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl8aPBpGfjzckGKR6nydFdLhyHr-_xX7T8qZaaa3269pmUgcMrOCk1IiJvLtRPNZ5V_QOmQsTGEhZfdU7tSZssODb4SQwESqieIAGopO42SkqJsjnOlrVZk1Gm-PZIZD5d6nKzF0I907q-zalQNcyWQ4_4nJqhmPi1bRPrM9tyjLb1k Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f426d2cfe5ba47c1b1fd9d625177e682 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f426d2cfe5ba47c1b1fd9d625177e682"}]}] Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f426d2cfe5ba47c1b1fd9d625177e682 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerDiskConfigTestJSON-1948780236-project Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: cafa00717a9c418ca48edeb2bfbf12dd Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerDiskConfigTestJSON-1948780236-project Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: exception: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'bf4b6da4-6c03-4553-9636-6bf111ce097a'} Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:48:47.468110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Returning 404 to user: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4124685-64fe-40df-9c53-217919485190 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 404 len: 111 microversion: 2.1 time: 0.029428 Oct 24 09:48:47.472326 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3608/7042] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:48:47 2022] DELETE /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:48:47.478827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:47.479450 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] [instance: bf4b6da4-6c03-4553-9636-6bf111ce097a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:47.486082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:47.486568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:47.487012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:47.487702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:47.488163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:47.488599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:47.501561 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] HTTP exception thrown: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Request method failure captured: Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a HTTP/1.1 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl8aPBpGfjzckGKR6nydFdLhyHr-_xX7T8qZaaa3269pmUgcMrOCk1IiJvLtRPNZ5V_QOmQsTGEhZfdU7tSZssODb4SQwESqieIAGopO42SkqJsjnOlrVZk1Gm-PZIZD5d6nKzF0I907q-zalQNcyWQ4_4nJqhmPi1bRPrM9tyjLb1k Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: f426d2cfe5ba47c1b1fd9d625177e682 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f426d2cfe5ba47c1b1fd9d625177e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f426d2cfe5ba47c1b1fd9d625177e682"}]}] Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: f426d2cfe5ba47c1b1fd9d625177e682 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1948780236 Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerDiskConfigTestJSON-1948780236-project Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: cafa00717a9c418ca48edeb2bfbf12dd Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerDiskConfigTestJSON-1948780236-project Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: exception: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'bf4b6da4-6c03-4553-9636-6bf111ce097a'} Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:48:47.503216 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] Returning 404 to user: Instance bf4b6da4-6c03-4553-9636-6bf111ce097a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e32fa09c-4874-428b-805e-3072d70f3b82 tempest-ServerDiskConfigTestJSON-1948780236 tempest-ServerDiskConfigTestJSON-1948780236-project] 10.222.0.25 "GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a" status: 404 len: 111 microversion: 2.1 time: 0.029735 Oct 24 09:48:47.507905 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3435/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:47 2022] GET /compute/v2.1/servers/bf4b6da4-6c03-4553-9636-6bf111ce097a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:48:56.176205 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4621728d-37d1-4c2b-b067-9485856634d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'create', calling method: .version_select at 0x7f8daa3e19d0>, body: {"keypair": {"name": "tempest-keypair-454579110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRV6imRdbdC5ZciDChSq1OvgDuEgsHrTbx1er9O7IHVMjpdp8RzkmxA6vqxUQA3PSaR+cPbr+N9iiBaxCBerMKBqMASBUrG0zKH/S6f4O/i50DLQHRCjGvT0vF3vJ2s0Q=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:56.182475 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:56.195303 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4621728d-37d1-4c2b-b067-9485856634d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:48:56.200554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-4621728d-37d1-4c2b-b067-9485856634d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:48:56.226708 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4621728d-37d1-4c2b-b067-9485856634d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.230468 Oct 24 09:48:56.227310 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3609/7044] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:48:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:48:57.471984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2054262076", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fa15dc2-ca41-4467-8f2e-7062f271892b"}], "security_groups": [{"name": "tempest-securitygroup--1900023493"}], "key_name": "tempest-keypair-454579110", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:48:57.482406 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:57.494766 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:57.834790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] validate_networks() for [('5fa15dc2-ca41-4467-8f2e-7062f271892b', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:48:58.210693 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:48:58.211133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:48:58.211616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:48:58.212068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:48:58.212487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:48:58.221563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:58.222070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:58.222518 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:58.223763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:58.224409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:58.224852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:58.244605 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:48:58.250764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:48:58.263296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:48:58.265636 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:48:58.312615 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c2fc838-14d9-41fb-a2ec-0383711871bc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.845147 Oct 24 09:48:58.313742 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3436/7045] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:48:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:48:58.324359 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:58.346819 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ec9510b-fbe1-4e49-85e8-69cfd40e8f32 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:58.348125 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ec9510b-fbe1-4e49-85e8-69cfd40e8f32 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:58.515467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ec9510b-fbe1-4e49-85e8-69cfd40e8f32 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:58.523773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ec9510b-fbe1-4e49-85e8-69cfd40e8f32 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1238 microversion: 2.1 time: 0.202317 Oct 24 09:48:58.524486 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3610/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:58 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1238 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:48:59.548181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:48:59.548823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:48:59.556055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:59.556560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:59.557014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:59.557764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:48:59.558237 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:48:59.558678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:48:59.629602 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:48:59.638518 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61aa87d0-362e-455f-80fb-3ceb1ba0d03f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1290 microversion: 2.1 time: 0.095171 Oct 24 09:48:59.638963 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3437/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:48:59 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:00.662755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:00.663271 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:00.670913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:00.671400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:00.671837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:00.672592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:00.673045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:00.673513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:00.884382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:00.892028 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b09f5f67-8d77-4c75-9ff8-453583973045 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1364 microversion: 2.1 time: 0.233336 Oct 24 09:49:00.892603 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3611/7048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:00 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:01.227310 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6e9c1fc2-395a-4929-9b20-00f10f92f332 req-c1195822-43b6-4105-9921-767446ec89a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:49:01.240511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e9c1fc2-395a-4929-9b20-00f10f92f332 req-c1195822-43b6-4105-9921-767446ec89a3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:01.241104 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e9c1fc2-395a-4929-9b20-00f10f92f332 req-c1195822-43b6-4105-9921-767446ec89a3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:01.241627 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6e9c1fc2-395a-4929-9b20-00f10f92f332 req-c1195822-43b6-4105-9921-767446ec89a3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:01.252523 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6e9c1fc2-395a-4929-9b20-00f10f92f332 req-c1195822-43b6-4105-9921-767446ec89a3 service nova] Creating event network-changed:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h1-master-1 Oct 24 09:49:01.259227 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6e9c1fc2-395a-4929-9b20-00f10f92f332 req-c1195822-43b6-4105-9921-767446ec89a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038153 Oct 24 09:49:01.260023 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3438/7049] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:49:01.916494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:01.917113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:01.923360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:01.923853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:01.924298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:01.925009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:01.925501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:01.925937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:02.118238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:02.126100 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6dcab5f4-475c-4ff5-a624-4b6693d949de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1364 microversion: 2.1 time: 0.213858 Oct 24 09:49:02.126677 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3612/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:01 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:03.150758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:03.151474 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:03.158902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:03.159395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:03.159987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:03.161410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:03.161878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:03.162351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:03.297288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:03.305989 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44bc4954-4e28-4fda-a166-10a067c5e585 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1364 microversion: 2.1 time: 0.159639 Oct 24 09:49:03.306735 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3439/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:03 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:04.328097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:04.328713 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:04.336145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:04.336636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:04.337078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:04.337795 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:04.338255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:04.338686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:04.468421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:04.476222 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2440da18-e213-4673-8096-10141dab403b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1364 microversion: 2.1 time: 0.152060 Oct 24 09:49:04.476802 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3613/7052] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:04 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:05.499012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:05.499629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:05.506515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:05.506998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:05.507445 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:05.508136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:05.508594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:05.509025 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:05.637928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:05.646011 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b21fe382-3c67-419d-abd2-0e34490c556b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1364 microversion: 2.1 time: 0.150912 Oct 24 09:49:05.646581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3440/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:05 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:06.511442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0d50a682-cc1f-4f4a-be2a-c20827fe63ea req-a620a04c-9b72-4a76-a233-003c43a6d2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "name": "network-vif-plugged", "status": "completed", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:49:06.523932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0d50a682-cc1f-4f4a-be2a-c20827fe63ea req-a620a04c-9b72-4a76-a233-003c43a6d2aa service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:06.524615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0d50a682-cc1f-4f4a-be2a-c20827fe63ea req-a620a04c-9b72-4a76-a233-003c43a6d2aa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:06.525099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0d50a682-cc1f-4f4a-be2a-c20827fe63ea req-a620a04c-9b72-4a76-a233-003c43a6d2aa service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:06.537091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0d50a682-cc1f-4f4a-be2a-c20827fe63ea req-a620a04c-9b72-4a76-a233-003c43a6d2aa service nova] Creating event network-vif-plugged:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h1-master-1 Oct 24 09:49:06.542251 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0d50a682-cc1f-4f4a-be2a-c20827fe63ea req-a620a04c-9b72-4a76-a233-003c43a6d2aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034544 Oct 24 09:49:06.543202 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3614/7054] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:49:06.669669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:06.670304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:06.677840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:06.678409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:06.679208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:06.679825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:06.680391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:06.680842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:06.809423 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:06.817184 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f10b0afb-45ab-4e6f-9682-2b404aa03a20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1364 microversion: 2.1 time: 0.151417 Oct 24 09:49:06.817782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3441/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:06 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:07.840845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:07.841591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:07.848762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:07.849254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:07.849732 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:07.850444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:07.850916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:07.851345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:07.980060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:07.987782 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-772d9bb9-4e77-4d86-95db-e3a6f5070037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1550 microversion: 2.1 time: 0.151258 Oct 24 09:49:07.988357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3615/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:07 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:08.010919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:08.011410 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:08.018244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:08.018682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:08.019132 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:08.019831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:08.020301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:08.020743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:08.101642 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b821a30-5ec2-4d96-bf5b-056a949322e7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094512 Oct 24 09:49:08.102249 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3442/7057] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:49:08 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:49:09.391328 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:09.443278 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a37e2a7d-2588-4607-9eff-5863acb32950 req-2c592dc4-35b5-417c-b6ea-9d5d383f2a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:49:09.452723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a37e2a7d-2588-4607-9eff-5863acb32950 req-2c592dc4-35b5-417c-b6ea-9d5d383f2a12 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:09.453201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a37e2a7d-2588-4607-9eff-5863acb32950 req-2c592dc4-35b5-417c-b6ea-9d5d383f2a12 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:09.453665 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a37e2a7d-2588-4607-9eff-5863acb32950 req-2c592dc4-35b5-417c-b6ea-9d5d383f2a12 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:09.467094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a37e2a7d-2588-4607-9eff-5863acb32950 req-2c592dc4-35b5-417c-b6ea-9d5d383f2a12 service nova] Creating event network-changed:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h1-master-1 Oct 24 09:49:09.471936 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a37e2a7d-2588-4607-9eff-5863acb32950 req-2c592dc4-35b5-417c-b6ea-9d5d383f2a12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085150 Oct 24 09:49:09.472538 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3616/7058] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:49:43.525992 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:43.526808 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:43.529684 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:43.530326 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=32 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:43.534464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:43.535328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:43.544344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:43.544900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:43.545374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:43.546080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:43.546543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:43.546978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:43.678436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:43.686084 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b52910f2-96ff-4551-94aa-cf3b2a0a6c87 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1669 microversion: 2.1 time: 0.160970 Oct 24 09:49:43.686648 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3443/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:43 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:43.707261 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:43.708019 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=28 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:43.712130 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:43.712871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:43.720123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:43.720613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:43.721055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:43.721776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:43.722241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:43.722676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:43.854764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:43.862526 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1b366d5-6df0-4b9b-a7b6-c776b5a00962 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1669 microversion: 2.1 time: 0.157619 Oct 24 09:49:43.863095 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3617/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:43 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:43.885587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:43.886210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:43.892133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:43.892625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:43.893073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:43.893793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:43.894266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:43.894702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:44.019753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:44.028202 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c551b34b-9797-41ce-8db6-bf7c8b4213cf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1669 microversion: 2.1 time: 0.146552 Oct 24 09:49:44.028903 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3444/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:43 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1669 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:49:44.051339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:49:44.054126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:44.060211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:44.060635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:44.061069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:44.061788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:44.062240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:44.062666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:44.090996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:44.096194 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Old instance type m1.heat2, new instance type m1.heat {{(pid=126920) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:49:44.102872 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:49:44.103295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:49:44.103762 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:49:44.104168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:49:44.104575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:49:44.168219 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c3a2b89-af08-4852-89d3-1b0e6ab75ff6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a/action" status: 202 len: 0 microversion: 2.1 time: 0.121019 Oct 24 09:49:44.168829 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3618/7062] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:49:44 2022] POST /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:49:44.176871 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:44.177532 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:44.183460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:44.183953 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:44.184398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:44.185096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:44.185581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:44.186021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:44.342897 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:44.351105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5995fb2b-ac81-404e-958f-d0f0d4b09008 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1678 microversion: 2.1 time: 0.178048 Oct 24 09:49:44.351940 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3445/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:44 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:45.375142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:45.375779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:45.384093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:45.384582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:45.385025 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:45.385749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:45.386212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:45.386641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:45.732838 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:45.742031 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-118ec59f-623d-4c32-ade7-529be9af6a63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1678 microversion: 2.1 time: 0.370796 Oct 24 09:49:45.742748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3619/7064] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:45 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:46.779719 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:46.780345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:46.787393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:46.787889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:46.788335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:46.789078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:46.789565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:46.790030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:46.923025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:46.931379 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23d2a6fa-cc1c-4c45-9fa0-a882ba9a2316 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.155915 Oct 24 09:49:46.931956 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3446/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:46 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:47.954647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:47.955294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:47.962674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:47.963155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:47.963587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:47.964273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:47.964727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:47.965150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:48.094845 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:48.102504 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-809e764c-5ef2-4665-b176-cf93bb3a9601 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.151824 Oct 24 09:49:48.103081 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3620/7066] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:47 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:49.126314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:49.126943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:49.134358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:49.134851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:49.135299 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:49.136001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:49.136467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:49.136905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:49.268417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:49.276184 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e11e88d-8d57-4980-a239-a8fefdc6d333 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.153808 Oct 24 09:49:49.276794 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3447/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:49 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:50.300028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:50.300645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:50.307979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:50.308466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:50.308904 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:50.309619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:50.310079 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:50.310511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:50.435852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:50.444039 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf889fde-69db-45f8-9b84-8cbdf9032f3e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.147896 Oct 24 09:49:50.444613 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3621/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:50 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:51.466927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:51.467889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:51.476328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:51.476820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:51.477269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:51.478002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:51.478466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:51.478902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:51.613772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:51.621921 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46f3d388-d07a-49dc-a428-7594f7210665 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.158838 Oct 24 09:49:51.622528 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3448/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:51 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:52.645615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:52.646243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:52.653371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:52.653864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:52.654306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:52.655002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:52.655465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:52.655899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:52.790348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:52.798007 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1a60af4-b2da-4093-be1c-d3c10eb8db43 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.156311 Oct 24 09:49:52.798580 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3622/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:52 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:53.822503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:53.823124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:53.830052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:53.830557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:53.830998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:53.831694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:53.832168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:53.832631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:53.963037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:53.970667 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8192c7aa-47d1-4e99-adb2-09e54b2ea26c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.152030 Oct 24 09:49:53.971241 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3449/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:53 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:54.993944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:54.994508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:55.001360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:55.001846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:55.002281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:55.002960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:55.003413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:55.003833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:55.131834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:55.140046 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b40947e-5f63-420c-b317-17cb1127a919 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.149978 Oct 24 09:49:55.140629 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3623/7072] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:54 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:56.164184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:56.164818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:56.171752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:56.172251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:56.172760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:56.173455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:56.173926 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:56.174368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:56.302551 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:56.310383 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38fb3a2f-7359-4794-9767-07ec787c3768 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.150122 Oct 24 09:49:56.310956 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3450/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:56 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:57.334502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:57.335026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:57.341800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:57.342285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:57.342721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:57.343402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:57.343856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:57.344278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:57.472647 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:57.481195 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fff373ad-e4dd-489b-8c47-722d980d990d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1683 microversion: 2.1 time: 0.150597 Oct 24 09:49:57.481791 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3624/7074] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:57 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:58.506027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:58.506572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:58.513472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:58.513969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:58.514420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:58.515122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:58.515590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:58.516040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:58.720034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "name": "network-vif-unplugged", "status": "completed", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:49:58.730093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:58.731047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:58.731531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:58.731994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:58.739749 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e663c02f-dc66-47ba-9658-b6189154b5c2 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1682 microversion: 2.1 time: 0.237677 Oct 24 09:49:58.757079 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3451/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:58 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:49:58.760531 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] Creating event network-vif-unplugged:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h2-master-1 Oct 24 09:49:58.766286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:49:58.778924 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-55a49234-f491-4fbe-be8e-2f9922a0df73 req-f55ab5ec-d6a1-4c2a-8d79-e88cf1124af0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062682 Oct 24 09:49:58.779536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3625/7076] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:49:59.764057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:49:59.764738 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:49:59.772274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:59.772780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:59.773238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:59.773988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:49:59.774460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:49:59.774902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:49:59.913581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:49:59.921365 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e210cc9-87fb-4eef-b08a-14e1feb2a32f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1682 microversion: 2.1 time: 0.161149 Oct 24 09:49:59.921949 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3452/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:49:59 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:00.797979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:00.808830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:00.809597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:00.810029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:00.821154 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] Creating event network-changed:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h2-master-1 Oct 24 09:50:00.826309 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:50:00.837316 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-09399633-caaa-4f7c-8b60-4ef17fdab87d req-156230dc-272e-43c5-9452-75c22e7d7ae2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044175 Oct 24 09:50:00.837924 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3626/7078] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:50:00.944480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:00.945148 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:00.951676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:00.952210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:00.952665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:00.953410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:00.953883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:00.954323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:01.094737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:01.103834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8583fef7-d8fd-4ae8-ba26-9f762b4a6a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1680 microversion: 2.1 time: 0.163664 Oct 24 09:50:01.104434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3453/7079] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:00 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:02.128055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:02.128764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:02.135478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:02.135964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:02.136402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:02.137085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:02.137573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:02.138005 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:02.278230 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:02.286163 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6a1e293e-6575-4da0-ae10-407a7c8471d3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1677 microversion: 2.1 time: 0.163232 Oct 24 09:50:02.286734 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3627/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:02 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:02.309412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:02.309963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:02.316736 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:02.317890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:02.318351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:02.319059 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:02.319537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:02.319980 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:02.381064 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8da854c0-a5f0-47d7-81f5-646146212ee4 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a/action" status: 204 len: 0 microversion: 2.1 time: 0.075262 Oct 24 09:50:02.381843 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3454/7081] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:50:02 2022] POST /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:50:02.394046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:02.395070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:02.404038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:02.404663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:02.405317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:02.406197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:02.406772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:02.407369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:02.617651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:02.625745 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5d7e6fc-e484-4d6e-9974-3b688cc8d43f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1677 microversion: 2.1 time: 0.236375 Oct 24 09:50:02.626326 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3628/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:02 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:03.215683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "name": "network-vif-plugged", "status": "completed", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:03.225873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:03.227116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:03.227914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:03.239818 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] Creating event network-vif-plugged:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h2-master-1 Oct 24 09:50:03.245384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:50:03.255771 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-62c715a8-8611-4241-afe4-532d65f8f812 req-42fdf003-b003-4bcc-a3a4-1bbd76636ecf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100291 Oct 24 09:50:03.256441 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3455/7083] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:50:03.649778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:03.650393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:03.657674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:03.658205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:03.659407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:03.660480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:03.661493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:03.661937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:03.800724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:03.808996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-661fca32-56aa-447e-ae23-7d5ac8c6446e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1677 microversion: 2.1 time: 0.163124 Oct 24 09:50:03.809603 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3629/7084] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:03 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:04.836074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:04.836878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:04.844256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:04.844837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:04.845352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:04.846130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:04.846643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:04.847198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:04.980274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:04.988248 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b4ac01e-6fb9-45e6-a2fe-266010bfd946 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1669 microversion: 2.1 time: 0.159440 Oct 24 09:50:04.988831 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3456/7085] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:04 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:05.011405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:05.012023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:05.018889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.019359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.019809 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.021067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.021564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.021998 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.154431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:05.162089 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-507d1a59-9160-4840-8dc2-71a247a95d56 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1669 microversion: 2.1 time: 0.154553 Oct 24 09:50:05.162857 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3630/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:05 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:05.184413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:05.185041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:05.190909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.191405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.192373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.193054 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.193541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.193985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.323583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:05.331248 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc94c512-7e74-4fdd-9463-e1d7cf1dfbaf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1669 microversion: 2.1 time: 0.150737 Oct 24 09:50:05.331827 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3457/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:05 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:05.353876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:05.354580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:05.360606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.361091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.361575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.362265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.362725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.363155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.388291 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:50:05.422398 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:05.471491 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a71a48ba-3252-4b87-8c07-9a09a07edb0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 204 len: 0 microversion: 2.1 time: 0.121310 Oct 24 09:50:05.472534 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3631/7088] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:50:05 2022] DELETE /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:50:05.480655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:05.481438 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:05.488123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.488632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.490619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.491338 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:05.491819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:05.492265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:05.624195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:05.626600 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:05.634855 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ced5acf-7db8-4c8f-a239-06e7c6ca2029 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1675 microversion: 2.1 time: 0.158065 Oct 24 09:50:05.635440 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3458/7089] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:05 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:06.659630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:06.660389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:06.667688 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:06.668170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:06.668614 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:06.669305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:06.669764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:06.670194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:06.798193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:06.806448 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-878629fe-7d5d-4024-87da-abe383c6e3ce tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1675 microversion: 2.1 time: 0.151383 Oct 24 09:50:06.807020 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3632/7090] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:06 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:07.793276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7c2a08ed-09b9-492a-b5ff-6d791994a303 req-08c2ebe4-c7ee-45b8-be6f-40d0f72ddd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b5b8de-a820-4a3b-854b-d0248c45c96a", "name": "network-vif-deleted", "tag": "18664683-014c-48f4-a1e5-cb8e590d07ad"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:07.805583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7c2a08ed-09b9-492a-b5ff-6d791994a303 req-08c2ebe4-c7ee-45b8-be6f-40d0f72ddd55 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:07.806226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7c2a08ed-09b9-492a-b5ff-6d791994a303 req-08c2ebe4-c7ee-45b8-be6f-40d0f72ddd55 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:07.806706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7c2a08ed-09b9-492a-b5ff-6d791994a303 req-08c2ebe4-c7ee-45b8-be6f-40d0f72ddd55 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:07.823716 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7c2a08ed-09b9-492a-b5ff-6d791994a303 req-08c2ebe4-c7ee-45b8-be6f-40d0f72ddd55 service nova] Creating event network-vif-deleted:18664683-014c-48f4-a1e5-cb8e590d07ad for instance 79b5b8de-a820-4a3b-854b-d0248c45c96a on n-h2-master-1 Oct 24 09:50:07.828962 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7c2a08ed-09b9-492a-b5ff-6d791994a303 req-08c2ebe4-c7ee-45b8-be6f-40d0f72ddd55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039675 Oct 24 09:50:07.829772 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3459/7091] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:50:07.831338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:07.831968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:07.846425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:07.846922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:07.848420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:07.849694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:07.850183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:07.851236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:07.923987 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:07.932622 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76654b41-f053-4537-8479-c4589d6b90b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 200 len: 1323 microversion: 2.1 time: 0.106262 Oct 24 09:50:07.933585 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3633/7092] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:07 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 1323 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:08.956758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:08.957544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:08.963685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:08.964180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:08.964661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:08.965380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:08.965848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:08.966288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:08.980271 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a HTTP/1.1 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '79b5b8de-a820-4a3b-854b-d0248c45c96a'} Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:50:08.981891 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5319ab17-c780-4d59-a7b8-bca0c98b618f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 404 len: 111 microversion: 2.1 time: 0.031693 Oct 24 09:50:08.986834 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3460/7093] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:08 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:50:08.995559 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:08.996184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:09.003085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:09.003583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:09.004028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:09.004766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:09.005235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:09.005701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:09.018830 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a HTTP/1.1 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '79b5b8de-a820-4a3b-854b-d0248c45c96a'} Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:50:09.020507 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-899a1a70-ff47-46ac-acd2-e97e117cd20a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 404 len: 111 microversion: 2.1 time: 0.030267 Oct 24 09:50:09.024794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3634/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:08 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:50:09.071990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-854303904", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "5fa15dc2-ca41-4467-8f2e-7062f271892b"}], "security_groups": [{"name": "tempest-securitygroup--1900023493"}], "key_name": "tempest-keypair-454579110", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:09.177134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] validate_networks() for [('5fa15dc2-ca41-4467-8f2e-7062f271892b', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:50:09.617356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:50:09.617789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:50:09.618298 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:50:09.618730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:50:09.619135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:50:09.631195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:09.631684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:09.632131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:09.632862 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:09.633346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:09.633787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:09.653352 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:50:09.658498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:50:09.670569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:50:09.672836 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:50:09.719961 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-933a92ff-0cf5-4fc0-b51d-8af13a1c3949 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651786 Oct 24 09:50:09.720605 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3461/7095] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:50:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:50:09.731971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad403bc6-2d4f-4095-bb33-59af4e27b227 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:09.732620 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad403bc6-2d4f-4095-bb33-59af4e27b227 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:09.790907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad403bc6-2d4f-4095-bb33-59af4e27b227 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:09.800753 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad403bc6-2d4f-4095-bb33-59af4e27b227 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1237 microversion: 2.1 time: 0.072661 Oct 24 09:50:09.801855 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3635/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:09 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:10.827812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:10.828444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:10.836512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:10.837212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:10.837757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:10.838698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:10.839389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:10.839899 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:10.904695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:10.914449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-886dd8ca-bcd4-4c18-8e4f-83ce075f9fbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1307 microversion: 2.1 time: 0.091119 Oct 24 09:50:10.915025 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3462/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:10 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:50:11.938436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:11.939044 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:11.946859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:11.947348 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:11.947919 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:11.948622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:11.949080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:11.949532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:12.125105 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:12.132822 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b4cf6b99-ff64-4b2a-9295-5e1908c66746 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1363 microversion: 2.1 time: 0.198306 Oct 24 09:50:12.133418 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3636/7098] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:11 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:12.365644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-11e84858-c4f0-4b56-a8e6-9cd482f347eb req-d7356289-a0af-4c45-b5eb-754ea3f756d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:12.375337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-11e84858-c4f0-4b56-a8e6-9cd482f347eb req-d7356289-a0af-4c45-b5eb-754ea3f756d2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:12.375748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-11e84858-c4f0-4b56-a8e6-9cd482f347eb req-d7356289-a0af-4c45-b5eb-754ea3f756d2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:12.376191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-11e84858-c4f0-4b56-a8e6-9cd482f347eb req-d7356289-a0af-4c45-b5eb-754ea3f756d2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:12.390631 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-11e84858-c4f0-4b56-a8e6-9cd482f347eb req-d7356289-a0af-4c45-b5eb-754ea3f756d2 service nova] Creating event network-changed:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h1-master-1 Oct 24 09:50:12.396887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-11e84858-c4f0-4b56-a8e6-9cd482f347eb req-d7356289-a0af-4c45-b5eb-754ea3f756d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089790 Oct 24 09:50:12.397850 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3463/7099] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:50:13.156709 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:13.157373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:13.164716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:13.165204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:13.165671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:13.166364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:13.166820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:13.167250 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:13.297055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:13.305593 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a5e7704-1e4a-42ec-8ea4-8caea5563480 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1363 microversion: 2.1 time: 0.152970 Oct 24 09:50:13.306204 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3637/7100] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:13 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:14.331172 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:14.331904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:14.333966 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:14.339542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:14.340028 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:14.340472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:14.341168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:14.341652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:14.342088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:14.473770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:14.481491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-801c37c3-63ed-4f7f-a5b7-602bfe0dc341 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1363 microversion: 2.1 time: 0.155393 Oct 24 09:50:14.482060 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3464/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:14 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:15.504754 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:15.505327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:15.508727 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:15.514015 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:15.514501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:15.514934 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:15.515650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:15.516102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:15.516525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:15.646175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:15.654555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e2bf62b-af4b-464b-ba64-7548685e952d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1363 microversion: 2.1 time: 0.153797 Oct 24 09:50:15.655124 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3638/7102] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:15 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:16.678145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:16.678761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:16.685622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:16.686114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:16.686584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:16.687276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:16.687740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:16.688177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:16.819586 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:16.827728 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-be27dff4-cbe7-404d-b6a0-f127358a17d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1363 microversion: 2.1 time: 0.153401 Oct 24 09:50:16.828415 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3465/7103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:16 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:16.934605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ed460bc0-6743-4ca3-abbb-e7922d6df1ea req-f9693b61-404a-4e0d-ad31-8d73174d1c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "name": "network-vif-plugged", "status": "completed", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:16.945551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ed460bc0-6743-4ca3-abbb-e7922d6df1ea req-f9693b61-404a-4e0d-ad31-8d73174d1c2c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:16.946136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ed460bc0-6743-4ca3-abbb-e7922d6df1ea req-f9693b61-404a-4e0d-ad31-8d73174d1c2c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:16.946580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ed460bc0-6743-4ca3-abbb-e7922d6df1ea req-f9693b61-404a-4e0d-ad31-8d73174d1c2c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:16.958823 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ed460bc0-6743-4ca3-abbb-e7922d6df1ea req-f9693b61-404a-4e0d-ad31-8d73174d1c2c service nova] Creating event network-vif-plugged:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h1-master-1 Oct 24 09:50:16.964362 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ed460bc0-6743-4ca3-abbb-e7922d6df1ea req-f9693b61-404a-4e0d-ad31-8d73174d1c2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033520 Oct 24 09:50:16.964954 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3639/7104] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:50:17.852541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:17.853161 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:17.860326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:17.860825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:17.861270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:17.862010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:17.862475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:17.862910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:17.998195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:18.006707 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c95cd77-e184-45e6-8d61-196f2e3b243a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1363 microversion: 2.1 time: 0.158575 Oct 24 09:50:18.007286 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3466/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:17 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:19.037536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:19.038250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:19.044922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:19.044922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:19.045315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:19.046001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:19.046455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:19.046876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:19.186890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:19.195467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6bf5495-6fd1-43ad-9a37-02b0c6e9c26a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1549 microversion: 2.1 time: 0.163709 Oct 24 09:50:19.196055 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3640/7106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:19 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:19.218824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:19.219369 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:19.226852 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:19.227352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:19.227805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:19.228519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:19.228989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:19.229467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:19.311074 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-25b7ba13-08c6-4834-9d8b-52e0fbf30584 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096150 Oct 24 09:50:19.311694 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3467/7107] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:50:19 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:50:20.544087 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-56c6484b-7e67-4b72-99f9-fde6aef24fff req-f101b8b0-4681-4eaf-9a78-7175a03a601f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:20.548942 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:20.555897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56c6484b-7e67-4b72-99f9-fde6aef24fff req-f101b8b0-4681-4eaf-9a78-7175a03a601f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:20.555897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56c6484b-7e67-4b72-99f9-fde6aef24fff req-f101b8b0-4681-4eaf-9a78-7175a03a601f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:20.556299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56c6484b-7e67-4b72-99f9-fde6aef24fff req-f101b8b0-4681-4eaf-9a78-7175a03a601f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:20.567071 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-56c6484b-7e67-4b72-99f9-fde6aef24fff req-f101b8b0-4681-4eaf-9a78-7175a03a601f service nova] Creating event network-changed:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h1-master-1 Oct 24 09:50:20.571938 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-56c6484b-7e67-4b72-99f9-fde6aef24fff req-f101b8b0-4681-4eaf-9a78-7175a03a601f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031511 Oct 24 09:50:20.572725 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3641/7108] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:50:53.475967 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:53.476768 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:53.478909 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=7 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:53.479542 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=37 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:53.483888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b70f5d1-9961-4de9-8df1-bfc84a87093a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:50:53.492801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b70f5d1-9961-4de9-8df1-bfc84a87093a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:53.493288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b70f5d1-9961-4de9-8df1-bfc84a87093a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:53.493754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b70f5d1-9961-4de9-8df1-bfc84a87093a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:53.515370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b70f5d1-9961-4de9-8df1-bfc84a87093a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Going to try to stop instance {{(pid=126919) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 09:50:53.557477 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b70f5d1-9961-4de9-8df1-bfc84a87093a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action" status: 202 len: 0 microversion: 2.1 time: 0.082536 Oct 24 09:50:53.558051 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3468/7109] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:50:53 2022] POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:50:53.564864 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:53.565744 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:53.570007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:53.570719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:53.578647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:53.579138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:53.579585 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:53.580280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:53.580742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:53.581169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:53.715793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:53.723566 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7734e728-d016-453d-bc81-3c84619bf576 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.160973 Oct 24 09:50:53.724130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3642/7110] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:53 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:54.748402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:54.749121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:54.758876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:54.759453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:54.759900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:54.760679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:54.761206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:54.761744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:54.890134 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:54.898322 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f86e10cf-1478-40b3-abb5-f11729bca554 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.155197 Oct 24 09:50:54.898900 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3469/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:54 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:55.921344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:55.921966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:55.930951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:55.931440 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:55.931878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:55.932571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:55.933033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:55.933521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:56.064001 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:56.072274 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4cee9847-f110-4c57-bb92-8792ca68ffd6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.154843 Oct 24 09:50:56.072864 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3643/7112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:55 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:57.096269 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:57.096926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:57.104422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:57.104915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:57.105397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:57.106101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:57.106573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:57.107015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:57.238950 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:57.246740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-574aa492-d659-4cf9-9cf9-faf68606bf06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.154400 Oct 24 09:50:57.247325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3470/7113] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:57 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:58.271540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:58.272729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:58.279925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:58.280415 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:58.280861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:58.281591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:58.282054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:58.282485 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:58.412005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:58.419864 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-392f3967-8f2b-45e7-b647-b28ae3abe995 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.152197 Oct 24 09:50:58.420537 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3644/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:58 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:50:59.442401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:50:59.443034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:50:59.450407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:59.450898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:59.451345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:59.452047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:50:59.452514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:50:59.452950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:50:59.584550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:50:59.592314 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9c49ee5-2967-4697-9b16-cfe9857537dc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.153697 Oct 24 09:50:59.592829 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3471/7115] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:50:59 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:00.615110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:00.615730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:00.622601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:00.623093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:00.623539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:00.624225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:00.624681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:00.625109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:00.755708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:00.763862 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2b0c3f3-c862-435e-8f76-1600ce2dd484 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.152635 Oct 24 09:51:00.764425 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3645/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:00 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:01.787128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:01.788331 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:01.794523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:01.795010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:01.795453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:01.796150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:01.796611 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:01.797043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:01.927099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:01.934833 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb340ce9-c320-4274-852e-2ad50ce96966 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.151765 Oct 24 09:51:01.935410 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3472/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:01 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:02.958617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:02.959752 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:02.966052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:02.966535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:02.966973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:02.967654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:02.968108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:02.968531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:03.099426 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:03.107613 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5955ae42-8fab-464d-bc09-3c146efc61df tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.152939 Oct 24 09:51:03.108182 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3646/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:02 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:04.130102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:04.130722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:04.138164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:04.138648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:04.139090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:04.139782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:04.140240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:04.140674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:04.270597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:04.279006 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-baeb78a9-9408-43da-8493-c6b132e93931 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.152778 Oct 24 09:51:04.279572 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3473/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:04 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:05.302516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:05.303080 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:05.310117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:05.310611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:05.311060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:05.311752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:05.312213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:05.312647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:05.439599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:05.447257 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f49869d-9353-4160-9c93-1ee788ed7891 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.148724 Oct 24 09:51:05.447841 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3647/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:05 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:06.470973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:06.471497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:06.479065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:06.479565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:06.480012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:06.480719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:06.481180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:06.481648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:06.608900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:06.620786 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-90af6938-db17-4c85-9132-d7252d473b19 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.153683 Oct 24 09:51:06.621403 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3474/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:06 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:07.644530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:07.645176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:07.652180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:07.652666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:07.653413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:07.654135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:07.654604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:07.655033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:07.786146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:07.793853 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c178b543-151f-459e-8c56-8f866877f092 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.153181 Oct 24 09:51:07.794426 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3648/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:07 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:08.817046 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:08.817646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:08.825345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:08.825837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:08.826281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:08.826973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:08.827433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:08.827867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:08.960874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:08.968794 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83c00d05-2829-46ba-a66a-599494aee76d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.155715 Oct 24 09:51:08.969612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3475/7123] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:08 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:09.992785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:09.993446 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:10.000255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:10.000744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:10.001183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:10.001908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:10.002367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:10.002798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:10.130162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:10.138237 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-022be41d-8d16-498f-b989-44a001572590 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1655 microversion: 2.1 time: 0.149782 Oct 24 09:51:10.138821 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3649/7124] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:09 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:10.161190 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:10.164110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:10.170943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:10.171437 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:10.171887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:10.172585 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:10.173051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:10.173519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:10.203956 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:10.209407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Old instance type m1.heat2, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:51:10.215872 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:51:10.216304 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:51:10.216791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:51:10.217212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:51:10.217656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:51:10.279069 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee3daef6-8cfd-43f8-a93c-cd7d04ce656b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action" status: 202 len: 0 microversion: 2.1 time: 0.121720 Oct 24 09:51:10.279607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3476/7125] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:51:10 2022] POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:51:10.288193 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:10.288817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:10.295116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:10.295615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:10.296054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:10.296819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:10.297278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:10.297914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:10.436529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:10.444507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e593251-c12a-4914-a87c-97bbf9c0b176 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.160694 Oct 24 09:51:10.445086 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3650/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:10 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:11.469333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:11.469885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:11.477551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:11.478056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:11.478510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:11.479548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:11.479691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:11.480116 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:11.615266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:11.623628 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3549a02f-2068-4552-a4fc-bae3a4e5f7a1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1678 microversion: 2.1 time: 0.159280 Oct 24 09:51:11.624206 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3477/7127] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:11 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:12.647645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:12.648477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:12.658486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:12.659104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:12.659451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:12.660154 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:12.660613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:12.661043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:12.792397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:12.800225 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac3a5049-ff66-4482-8db8-7e03ec0f612e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1683 microversion: 2.1 time: 0.157068 Oct 24 09:51:12.800794 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3651/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:12 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:13.823464 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:13.824074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:13.830885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:13.831379 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:13.831823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:13.832514 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:13.832975 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:13.833444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:13.964017 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:13.971879 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f955ac0c-f6c2-4284-89e0-c5b9f4aa3922 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1683 microversion: 2.1 time: 0.152299 Oct 24 09:51:13.972449 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3478/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:13 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:14.500328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "name": "network-vif-unplugged", "status": "completed", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:14.511121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:14.511609 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:14.512026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:14.524051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] Creating event network-vif-unplugged:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h2-master-1 Oct 24 09:51:14.529739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] Instance 87de54ed-4741-4e15-b035-26245621e134 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:51:14.541210 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b9747755-bcd7-455a-8e33-004d24d7ddae req-55657e1f-83f6-41c7-a9f5-cd4de29073f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044527 Oct 24 09:51:14.541862 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3652/7130] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:51:14.996175 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:14.996807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:15.005871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:15.006373 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:15.006827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:15.007542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:15.008068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:15.008529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:15.239277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:15.247061 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-152ec503-56f6-44e2-b50f-e642673d6942 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1682 microversion: 2.1 time: 0.254926 Oct 24 09:51:15.247625 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3479/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:14 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1682 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:16.273702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:16.274404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:16.280800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:16.281334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:16.281780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:16.282471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:16.282931 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:16.283364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:16.412564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:16.420195 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4cda49ad-23f6-477e-8a6f-30545469faf8 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1680 microversion: 2.1 time: 0.152298 Oct 24 09:51:16.420767 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3653/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:16 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:16.581614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:16.591575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:16.592055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:16.592492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:16.603752 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] Creating event network-changed:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h2-master-1 Oct 24 09:51:16.609123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] Instance 87de54ed-4741-4e15-b035-26245621e134 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:51:16.620718 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-36352954-0d64-4b17-9434-3196ff3469e0 req-16caefbc-9ff9-489b-beda-35f586642065 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042539 Oct 24 09:51:16.621356 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3480/7133] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:51:17.443937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:17.444564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:17.451381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:17.451877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:17.452321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:17.453026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:17.453538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:17.453972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:17.588276 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:17.596165 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d650e43-12ad-424f-8d1c-f17363b2666c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1676 microversion: 2.1 time: 0.156011 Oct 24 09:51:17.596735 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3654/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:17 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:17.620856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:17.621512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:17.629925 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:17.630419 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:17.630866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:17.632126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:17.632589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:17.633024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:17.671538 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:17.695834 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-015c32b2-f6ea-435d-b7c8-673fa8268c49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action" status: 204 len: 0 microversion: 2.1 time: 0.079787 Oct 24 09:51:17.696524 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3481/7135] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:51:17 2022] POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:51:17.706110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:17.706741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:17.716360 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:17.716859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:17.717319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:17.718648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:17.719113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:17.719538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:17.936412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:17.944841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fd91f0b-146a-499f-9773-c6e8cac3f313 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1676 microversion: 2.1 time: 0.243101 Oct 24 09:51:17.945475 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3655/7136] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:17 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:18.968678 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:18.969401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:18.977041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:18.977560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:18.978005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:18.978708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:18.979169 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:18.979603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:19.123868 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:19.132602 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-788cc974-efbf-44e3-b32a-b8c0e0239235 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1676 microversion: 2.1 time: 0.168051 Oct 24 09:51:19.133338 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3482/7137] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:18 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:20.156252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:20.156871 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:20.163776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.164263 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.164701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.165422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.165882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.166312 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.297011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:20.305212 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e57fd0a-24bf-4cab-ad0f-c7e9335b861f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1655 microversion: 2.1 time: 0.153168 Oct 24 09:51:20.305814 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3656/7138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:20 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:20.327992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:20.328621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:20.335434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.335934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.336390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.337093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.337601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.338045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.464034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:20.471692 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-075e2b41-f3ab-46a2-a013-0007038ea73f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1655 microversion: 2.1 time: 0.147619 Oct 24 09:51:20.472275 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3483/7139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:20 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:20.494441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f72650b-f2f2-41bf-93a8-fce40d328196 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:20.500428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f72650b-f2f2-41bf-93a8-fce40d328196 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.500916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f72650b-f2f2-41bf-93a8-fce40d328196 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.501386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f72650b-f2f2-41bf-93a8-fce40d328196 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.523368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f72650b-f2f2-41bf-93a8-fce40d328196 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Going to try to start instance {{(pid=126920) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 09:51:20.559062 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:20.568091 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f72650b-f2f2-41bf-93a8-fce40d328196 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action" status: 202 len: 0 microversion: 2.1 time: 0.077886 Oct 24 09:51:20.569444 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3657/7140] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:51:20 2022] POST /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:51:20.577580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:20.578296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:20.584277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.584866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.585421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.586229 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:20.586797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:20.587280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:20.802704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:20.813719 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a8d0dc7-4ed8-4cf7-9ecc-8b29f368d4ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1664 microversion: 2.1 time: 0.239645 Oct 24 09:51:20.814922 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3484/7141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:20 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1664 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:21.377910 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-89e9f118-aae7-426e-ac43-8ea6e268093e req-9a1c4dbc-3378-4c5a-882a-d326c972f915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "name": "network-vif-plugged", "status": "completed", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:21.389419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89e9f118-aae7-426e-ac43-8ea6e268093e req-9a1c4dbc-3378-4c5a-882a-d326c972f915 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:21.389920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89e9f118-aae7-426e-ac43-8ea6e268093e req-9a1c4dbc-3378-4c5a-882a-d326c972f915 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:21.390408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89e9f118-aae7-426e-ac43-8ea6e268093e req-9a1c4dbc-3378-4c5a-882a-d326c972f915 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:21.402436 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-89e9f118-aae7-426e-ac43-8ea6e268093e req-9a1c4dbc-3378-4c5a-882a-d326c972f915 service nova] Creating event network-vif-plugged:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h2-master-1 Oct 24 09:51:21.407682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-89e9f118-aae7-426e-ac43-8ea6e268093e req-9a1c4dbc-3378-4c5a-882a-d326c972f915 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033878 Oct 24 09:51:21.408280 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3658/7142] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:51:21.837550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:21.838469 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:21.845583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:21.846079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:21.846560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:21.847272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:21.847772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:21.848211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:21.976074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:21.983750 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1b8d00f-2081-4502-833f-e5efb6cb9ce1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1668 microversion: 2.1 time: 0.150253 Oct 24 09:51:21.984312 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3485/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:21 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:51:22.008437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:22.009028 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:22.015179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:22.015673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:22.016118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:22.016798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:22.017264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:22.017713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:22.043824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:51:22.118915 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7364622-a23a-4c51-923d-d712c6b0ec15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 204 len: 0 microversion: 2.1 time: 0.114946 Oct 24 09:51:22.119792 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3659/7144] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:51:22 2022] DELETE /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:51:22.127995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:22.128618 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:22.135233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:22.135739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:22.136186 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:22.136889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:22.137414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:22.137855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:22.265460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:22.273763 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a339b562-c076-4fe2-a416-fab53d1bd9e0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1674 microversion: 2.1 time: 0.149573 Oct 24 09:51:22.274340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3486/7145] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:22 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:51:23.298267 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:23.298986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:23.306036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:23.306525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:23.306967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:23.307660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:23.308122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:23.308555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:23.436635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:23.444942 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee692589-3c88-4e80-97b9-8f9fc366ea15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1674 microversion: 2.1 time: 0.151078 Oct 24 09:51:23.445554 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3660/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:23 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:24.307621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-563fe5d8-c20e-4430-9196-a10e0d9599be req-07baa2a5-f092-4d62-83ea-ab492e7a6942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87de54ed-4741-4e15-b035-26245621e134", "name": "network-vif-deleted", "tag": "8165ef89-b3b4-4062-a2e5-040b3c019931"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:24.317636 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=43 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:24.325545 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-563fe5d8-c20e-4430-9196-a10e0d9599be req-07baa2a5-f092-4d62-83ea-ab492e7a6942 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:24.326536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-563fe5d8-c20e-4430-9196-a10e0d9599be req-07baa2a5-f092-4d62-83ea-ab492e7a6942 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:24.327453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-563fe5d8-c20e-4430-9196-a10e0d9599be req-07baa2a5-f092-4d62-83ea-ab492e7a6942 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:24.344209 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-563fe5d8-c20e-4430-9196-a10e0d9599be req-07baa2a5-f092-4d62-83ea-ab492e7a6942 service nova] Creating event network-vif-deleted:8165ef89-b3b4-4062-a2e5-040b3c019931 for instance 87de54ed-4741-4e15-b035-26245621e134 on n-h2-master-1 Oct 24 09:51:24.349266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-563fe5d8-c20e-4430-9196-a10e0d9599be req-07baa2a5-f092-4d62-83ea-ab492e7a6942 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046186 Oct 24 09:51:24.350926 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3487/7147] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:51:24.468719 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:24.469368 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:24.473580 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:24.478428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:24.478924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:24.479359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:24.480463 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:24.480928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:24.481541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:24.518254 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:24.518993 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:24.519508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:24.520015 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lazy-loading 'fault' on Instance uuid 87de54ed-4741-4e15-b035-26245621e134 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:51:24.563302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:24.570988 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57f03f98-7529-4337-8a21-3bb58ca81dca tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 200 len: 1327 microversion: 2.1 time: 0.106711 Oct 24 09:51:24.571563 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3661/7148] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:24 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:25.596368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:25.596997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:25.603143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:25.603664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:25.604126 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:25.604813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:25.605280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:25.605748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:25.619289 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 HTTP/1.1 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '87de54ed-4741-4e15-b035-26245621e134'} Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:51:25.620903 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12a6a583-deca-4e18-9b66-47e605f79b69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 404 len: 111 microversion: 2.1 time: 0.031285 Oct 24 09:51:25.625875 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3488/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:25 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:51:25.639196 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:25.639856 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:25.646680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:25.647171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:25.647615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:25.648310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:25.648784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:25.649217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:25.662530 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 HTTP/1.1 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '87de54ed-4741-4e15-b035-26245621e134'} Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:51:25.664168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa46df29-5f17-4d9b-8be7-6639fd62b933 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 404 len: 111 microversion: 2.1 time: 0.030235 Oct 24 09:51:25.669078 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3662/7150] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:25 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:51:25.738752 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-604852238", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "5fa15dc2-ca41-4467-8f2e-7062f271892b"}], "security_groups": [{"name": "tempest-securitygroup--1900023493"}], "key_name": "tempest-keypair-454579110", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:25.841790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] validate_networks() for [('5fa15dc2-ca41-4467-8f2e-7062f271892b', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:51:26.212651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:51:26.213084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:51:26.213597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:51:26.214011 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:51:26.214432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:51:26.223167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:26.223661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:26.224108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:26.224896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:26.225408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:26.225850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:26.242856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:51:26.248154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:51:26.260866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:51:26.263210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:51:26.308542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1b7db8ca-56e1-4f9d-9265-17959908a681 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.573582 Oct 24 09:51:26.309193 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3489/7151] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:51:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:51:26.321066 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e80e47a0-a53f-4cfc-b0b4-425e045469f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:26.321702 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e80e47a0-a53f-4cfc-b0b4-425e045469f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:26.375372 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e80e47a0-a53f-4cfc-b0b4-425e045469f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:26.382804 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e80e47a0-a53f-4cfc-b0b4-425e045469f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1237 microversion: 2.1 time: 0.066121 Oct 24 09:51:26.383359 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3663/7152] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:26 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:27.407417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:27.408773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:27.415712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:27.416368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:27.416826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:27.417702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:27.418336 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:27.418951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:27.488293 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:27.496635 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd2ea6f1-a0a5-4def-a75c-f62e01f79a23 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1307 microversion: 2.1 time: 0.094198 Oct 24 09:51:27.497221 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3490/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:27 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:28.520867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:28.521626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:28.530373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:28.530859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:28.531294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:28.531984 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:28.532442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:28.532861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:28.721893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:28.729523 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2529a596-2845-46e3-a218-aaf00939f97e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1363 microversion: 2.1 time: 0.212458 Oct 24 09:51:28.730090 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3664/7154] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:28 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:28.847917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b38fff38-90db-4c50-b10e-9576a0785470 req-de8e20e7-9295-45d5-8e73-401e78d87c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82b4723-478a-4507-852f-721687701c45", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:28.861928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b38fff38-90db-4c50-b10e-9576a0785470 req-de8e20e7-9295-45d5-8e73-401e78d87c2e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:28.862510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b38fff38-90db-4c50-b10e-9576a0785470 req-de8e20e7-9295-45d5-8e73-401e78d87c2e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:28.863729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b38fff38-90db-4c50-b10e-9576a0785470 req-de8e20e7-9295-45d5-8e73-401e78d87c2e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:28.878447 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b38fff38-90db-4c50-b10e-9576a0785470 req-de8e20e7-9295-45d5-8e73-401e78d87c2e service nova] Creating event network-changed:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h1-master-1 Oct 24 09:51:28.884597 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b38fff38-90db-4c50-b10e-9576a0785470 req-de8e20e7-9295-45d5-8e73-401e78d87c2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039982 Oct 24 09:51:28.885620 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3491/7155] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:51:29.753860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:29.754511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:29.761272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:29.761789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:29.762232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:29.762945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:29.763408 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:29.763846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:29.891662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:29.899315 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae632a6f-1679-4c71-9ac8-28f9739adff7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1363 microversion: 2.1 time: 0.149400 Oct 24 09:51:29.899899 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3665/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:29 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:30.924500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:30.925243 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:30.932609 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:30.933107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:30.933584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:30.934288 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:30.934758 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:30.935201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:31.067958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:31.076130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f4a1aa9-a9d0-404b-bcd1-3fbae0916abf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1363 microversion: 2.1 time: 0.156175 Oct 24 09:51:31.076706 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3492/7157] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:30 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:32.099579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:32.100131 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:32.106438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:32.106927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:32.107377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:32.108064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:32.108525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:32.108953 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:32.239627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:32.248229 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-743ef096-e7e5-4409-8327-494c1af7eee0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1363 microversion: 2.1 time: 0.152608 Oct 24 09:51:32.248800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3666/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:32 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:33.272463 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:33.273373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:33.280399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:33.280895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:33.281359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:33.282415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:33.282959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:33.283436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:33.419039 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:33.420735 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cc40873f-49a2-46d6-900b-dd5b9ded74d6 req-3b03272c-fdc9-44ed-9255-d568583f74fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82b4723-478a-4507-852f-721687701c45", "name": "network-vif-plugged", "status": "completed", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:33.429617 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2569386e-581b-429c-9159-bd4e26f612ae tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1363 microversion: 2.1 time: 0.161302 Oct 24 09:51:33.432659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cc40873f-49a2-46d6-900b-dd5b9ded74d6 req-3b03272c-fdc9-44ed-9255-d568583f74fc service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:33.433261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cc40873f-49a2-46d6-900b-dd5b9ded74d6 req-3b03272c-fdc9-44ed-9255-d568583f74fc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:33.433806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cc40873f-49a2-46d6-900b-dd5b9ded74d6 req-3b03272c-fdc9-44ed-9255-d568583f74fc service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:33.445312 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cc40873f-49a2-46d6-900b-dd5b9ded74d6 req-3b03272c-fdc9-44ed-9255-d568583f74fc service nova] Creating event network-vif-plugged:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h1-master-1 Oct 24 09:51:33.447096 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3493/7159] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:33 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:33.450464 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cc40873f-49a2-46d6-900b-dd5b9ded74d6 req-3b03272c-fdc9-44ed-9255-d568583f74fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033579 Oct 24 09:51:33.451142 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3667/7160] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:51:34.453527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:34.454110 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:34.461390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:34.461881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:34.462325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:34.463018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:34.463480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:34.463915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:34.595157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:34.604370 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6047dce-3b34-4b1f-acf9-d8311260474b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1363 microversion: 2.1 time: 0.154700 Oct 24 09:51:34.604962 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3494/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:34 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:35.629638 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:35.630346 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:35.636994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:35.637521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:35.637963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:35.638649 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:35.639113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:35.639539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:35.765785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:51:35.774332 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a1e49d98-b857-4892-9084-b24d75c72d20 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1549 microversion: 2.1 time: 0.149436 Oct 24 09:51:35.775046 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3668/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:51:35 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:51:35.797609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:51:35.798112 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:51:35.804973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:35.805500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:35.805948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:35.806641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:35.807102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:35.807533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:35.883406 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f5903c2-c234-4478-bd9b-f93f658995af tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089626 Oct 24 09:51:35.884004 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3495/7163] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:51:35 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:51:37.039377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b3da9188-6765-47eb-b1bd-b8026e34fcfc req-7d310741-5b24-4425-8576-a02ead61e499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82b4723-478a-4507-852f-721687701c45", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:51:37.045116 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:37.053147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b3da9188-6765-47eb-b1bd-b8026e34fcfc req-7d310741-5b24-4425-8576-a02ead61e499 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:51:37.053666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b3da9188-6765-47eb-b1bd-b8026e34fcfc req-7d310741-5b24-4425-8576-a02ead61e499 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:51:37.059166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b3da9188-6765-47eb-b1bd-b8026e34fcfc req-7d310741-5b24-4425-8576-a02ead61e499 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:51:37.071282 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b3da9188-6765-47eb-b1bd-b8026e34fcfc req-7d310741-5b24-4425-8576-a02ead61e499 service nova] Creating event network-changed:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h1-master-1 Oct 24 09:51:37.076191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b3da9188-6765-47eb-b1bd-b8026e34fcfc req-7d310741-5b24-4425-8576-a02ead61e499 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041499 Oct 24 09:51:37.076845 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3669/7164] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:52:09.925625 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:09.926423 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:09.928843 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:52:09.929022 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:52:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/action (ip 10.222.0.25) !!! Oct 24 09:52:09.930073 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:09.930717 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:09.936663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:09.938960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:09.950411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:09.950915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:09.951361 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:09.952061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:09.952523 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:09.952958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:09.981926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:09.987309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Old instance type m1.heat2, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:52:09.993791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:52:09.994822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:52:09.995302 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:52:09.995718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:52:09.996132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:52:10.061020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69c71595-1503-438f-bc90-4ffbab454050 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/action" status: 202 len: 0 microversion: 2.1 time: 0.136141 Oct 24 09:52:10.061669 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3496/7165] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:52:09 2022] POST /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:52:10.068219 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:52:10.068708 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 (ip 10.222.0.25) !!! Oct 24 09:52:10.069532 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:52:10.069650 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 (ip 10.222.0.25) !!! Oct 24 09:52:10.070610 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=21 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:10.071564 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:10.078302 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:10.078823 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:10.089397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:10.089854 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:10.090278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:10.091001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:10.091430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:10.091885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:10.233826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:10.241632 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc8a2d36-290d-4d8a-906e-1ad638bd7f62 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1677 microversion: 2.1 time: 0.175604 Oct 24 09:52:10.242219 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3670/7166] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:10 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:52:11.266529 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:11.267084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:11.273897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:11.274387 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:11.274832 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:11.275525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:11.275992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:11.276461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:11.406268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:11.414216 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c279b5b7-e2fb-4968-9fce-dfac11c9c184 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1677 microversion: 2.1 time: 0.152907 Oct 24 09:52:11.414792 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3497/7167] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:11 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:12.438002 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:12.438540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:12.445317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:12.445810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:12.446249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:12.446936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:12.447391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:12.447818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:12.577308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:12.585014 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb910644-0312-463f-b262-7fbf35ee5243 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.151013 Oct 24 09:52:12.585619 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3671/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:12 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:13.609180 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:13.609853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:13.617156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:13.617689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:13.618143 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:13.619349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:13.619841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:13.620316 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:13.750312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:13.758119 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27b563ce-1825-46f4-b8d0-9aa3bda76204 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.152859 Oct 24 09:52:13.758705 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3498/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:13 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:14.782419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:14.783026 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:14.789847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:14.790321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:14.790755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:14.791431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:14.791881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:14.792303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:14.921513 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:14.929117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f624dd48-107d-4497-b82d-8c755a3806db tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.150771 Oct 24 09:52:14.929669 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3672/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:14 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:15.953510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:15.954135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:15.960902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:15.961490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:15.961944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:15.962669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:15.963133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:15.963571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:16.091960 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:16.099717 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7fb3597d-4404-4554-93ce-8bfada1aadec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.150145 Oct 24 09:52:16.100284 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3499/7171] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:15 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:17.123950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:17.124569 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:17.131328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:17.131812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:17.132251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:17.132936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:17.133421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:17.133851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:17.264466 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:17.272215 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-117d924e-1c84-48bb-a058-01f882f6b5c0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.152133 Oct 24 09:52:17.272800 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3673/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:17 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:18.295924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:18.296549 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:18.303271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:18.303765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:18.304215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:18.304910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:18.305395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:18.305840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:18.437874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:18.445497 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-526ada38-3785-4a38-8d8d-f3af58da2db7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.153433 Oct 24 09:52:18.446067 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3500/7173] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:18 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:19.469732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:19.470286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:19.477020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:19.477558 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:19.478596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:19.479320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:19.479789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:19.480223 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:19.607804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:19.615544 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ceb3e3d-a28f-4bc1-ac98-7e1c78c67295 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.149871 Oct 24 09:52:19.616121 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3674/7174] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:19 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:20.639921 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:20.640730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:20.647637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:20.648129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:20.648580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:20.649302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:20.649781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:20.650769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:20.779422 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:20.787043 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94c5bb1b-ddae-44e7-ab46-ec894d08b34e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.151425 Oct 24 09:52:20.787777 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3501/7175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:20 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:52:21.810547 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:21.811172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:21.818281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:21.818773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:21.819219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:21.819915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:21.820378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:21.820812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:21.954637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:21.962907 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eaffe622-d8e2-42ea-b8fc-4a3f01f614a9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.155807 Oct 24 09:52:21.963483 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3675/7176] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:21 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:22.986455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:22.987106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:22.994628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:22.995117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:22.995560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:22.996412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:22.996876 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:22.997330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:23.129802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:23.137575 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d9fa7c5-bb2d-47b0-8545-551639411e27 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.155014 Oct 24 09:52:23.138155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3502/7177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:22 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:24.162137 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:24.162759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:24.169592 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:24.170085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:24.170536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:24.171235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:24.171698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:24.172133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:24.307666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:24.315418 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f0ea9e6-7381-4eb1-8845-dafb51a07324 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.157238 Oct 24 09:52:24.315995 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3676/7178] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:24 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:25.339512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:25.340135 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:25.346958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:25.347543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:25.348000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:25.348692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:25.349155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:25.349620 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:25.475699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:25.483323 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ffa0cbaf-da3b-427a-8bde-797f3ea96c47 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.148362 Oct 24 09:52:25.483886 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3503/7179] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:25 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:26.507068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:26.507587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:26.514872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:26.515357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:26.515798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:26.516489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:26.516948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:26.517402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:26.649167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:26.657718 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a09f5eb-81fe-479e-9dda-92d394bd4d63 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.154561 Oct 24 09:52:26.658293 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3677/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:26 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:27.681144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:27.681801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:27.688752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:27.689249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:27.689749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:27.690461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:27.690931 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:27.691381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:27.821875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:27.829520 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38ae935a-f0b6-4998-807d-5ec962d54684 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.152328 Oct 24 09:52:27.830101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3504/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:27 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:28.854088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:28.854704 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:28.861701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:28.862184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:28.862626 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:28.863322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:28.863808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:28.864233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:28.993156 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:29.001370 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05251233-1c7c-4c23-8615-9d1443fce036 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1682 microversion: 2.1 time: 0.151734 Oct 24 09:52:29.001958 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3678/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:28 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:29.789984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82b4723-478a-4507-852f-721687701c45", "name": "network-vif-unplugged", "status": "completed", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:29.800217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:29.800684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:29.801168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:29.812995 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] Creating event network-vif-unplugged:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h2-master-1 Oct 24 09:52:29.818465 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] Instance b82b4723-478a-4507-852f-721687701c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:52:29.829885 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e629e3f9-3d20-4f1b-ab62-b8745a7e080a req-e2565fdc-6073-497d-bd1d-a1c04e271b5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043760 Oct 24 09:52:29.830502 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3505/7183] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:30.024074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:30.024643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:30.031737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:30.032225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:30.032659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:30.033402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:30.033859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:30.034307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:30.169844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:30.177662 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-49e7e536-85f3-459b-bd66-ae73d202022b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1681 microversion: 2.1 time: 0.157495 Oct 24 09:52:30.178245 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3679/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:30 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:31.203844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:31.204548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:31.210619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:31.211107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:31.211551 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:31.212825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:31.213287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:31.213743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:31.344745 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:31.352414 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-01c9f194-187c-46ab-821c-31e43324b225 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1679 microversion: 2.1 time: 0.154078 Oct 24 09:52:31.353176 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3506/7185] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:31 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:31.867146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82b4723-478a-4507-852f-721687701c45", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:31.877269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:31.877774 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:31.878206 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:31.889684 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] Creating event network-changed:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h2-master-1 Oct 24 09:52:31.895018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] Instance b82b4723-478a-4507-852f-721687701c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:52:31.906191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a859d5fb-de16-49ae-9f14-296c88b56810 req-de8eb801-a5a3-4715-b724-0a176141e344 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042718 Oct 24 09:52:31.906775 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3680/7186] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:32.376727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:32.377489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:32.383977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:32.384487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:32.384958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:32.385706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:32.386178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:32.386615 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:32.561309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:32.570395 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e3f0cf6-f3d8-49bc-8493-30fd255c2073 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1679 microversion: 2.1 time: 0.198203 Oct 24 09:52:32.570988 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3507/7187] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:32 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:33.596035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:33.596778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:33.603750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.604265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.604707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.605439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.605905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.606335 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.742975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:33.750827 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c36a1d4-ef42-40fd-92df-a866d137d7d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1676 microversion: 2.1 time: 0.159943 Oct 24 09:52:33.751408 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3681/7188] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:33 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:33.773456 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:33.773992 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:33.781589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.782079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.782519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.783209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.783669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.784100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.820689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.821215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.821747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.822576 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.823043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.823483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.844012 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:52:33.849030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:52:33.927401 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:33.951092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1b8ce0a7-624b-4c24-bf36-17b539b5c052 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/action" status: 202 len: 0 microversion: 2.1 time: 0.181338 Oct 24 09:52:33.951702 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3508/7189] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:52:33 2022] POST /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:52:33.967844 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:33.968389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:33.975043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.975654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.976132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:33.976874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:33.977322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:33.978391 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:34.115507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:34.123387 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6d664a5b-b771-4da6-9a98-3684e3430759 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1675 microversion: 2.1 time: 0.167430 Oct 24 09:52:34.123966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3682/7190] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:33 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:35.149943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:35.150720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:35.158108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:35.158610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:35.159063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:35.159770 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:35.160239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:35.160681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:35.294026 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:35.301765 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-18581f22-da2a-4b04-9d69-183d112b8217 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1675 microversion: 2.1 time: 0.157440 Oct 24 09:52:35.302335 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3509/7191] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:35 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:35.619042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82b4723-478a-4507-852f-721687701c45", "name": "network-vif-plugged", "status": "completed", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:35.629639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:35.630166 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:35.630662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:35.644095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] Creating event network-vif-plugged:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h2-master-1 Oct 24 09:52:35.650741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] Instance b82b4723-478a-4507-852f-721687701c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:52:35.661976 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b72c70bf-9d86-4809-b27d-a5e7bfa70649 req-b235ad44-0f7c-4269-b112-f8b84e21cb1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046699 Oct 24 09:52:35.662586 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3683/7192] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:36.325272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:36.325917 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:36.332757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:36.333188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:36.333665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:36.334359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:36.334826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:36.335266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:36.474277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:36.482761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6398fb0-c3b1-429c-9dd3-ebd615e80ab9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1675 microversion: 2.1 time: 0.161352 Oct 24 09:52:36.483446 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3510/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:36 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:37.210231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82b4723-478a-4507-852f-721687701c45", "name": "network-vif-unplugged", "status": "completed", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:37.221388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:37.221950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:37.222395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:37.234421 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] Creating event network-vif-unplugged:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h1-master-1 Oct 24 09:52:37.239723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] Instance b82b4723-478a-4507-852f-721687701c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:52:37.249986 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d1fa9fb8-fe81-41bf-983e-37238d39c18e req-3d0c19c8-4b20-4ad1-bb16-e170054436d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043913 Oct 24 09:52:37.250597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3684/7194] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:37.507902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:37.508537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:37.516048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:37.516555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:37.517011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:37.517757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:37.518234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:37.518678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:37.652220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:37.661652 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22f643c8-d4f8-43e0-8266-1b23d25719c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1675 microversion: 2.1 time: 0.157484 Oct 24 09:52:37.662676 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3511/7195] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:37 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:38.687678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:38.688412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:38.694534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:38.695017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:38.695454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:38.696142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:38.697113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:38.697567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:38.823796 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:38.831444 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8ef1b69-b9ed-4cf6-9aa5-2035981e4f65 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1675 microversion: 2.1 time: 0.148824 Oct 24 09:52:38.832034 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3685/7196] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:38 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:39.277800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82b4723-478a-4507-852f-721687701c45", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:39.288476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:39.288961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:39.289507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:39.301162 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] Creating event network-changed:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h1-master-1 Oct 24 09:52:39.306844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] Instance b82b4723-478a-4507-852f-721687701c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:52:39.318588 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-af0b97e1-ba9d-49f1-9c81-7d5d6e88de6e req-26ea696c-2765-4985-9849-e339240d014e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044497 Oct 24 09:52:39.319422 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3512/7197] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:39.857997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:39.858763 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:39.870876 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:39.871478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:39.871992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:39.872784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:39.873351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:39.873860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.398568 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:40.400881 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=95 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:40.408328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8fe22589-3318-4226-a422-673649b35440 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1668 microversion: 2.1 time: 0.556626 Oct 24 09:52:40.408916 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3686/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:39 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1668 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:40.432121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:40.432767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:40.435574 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:40.440948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.441490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.441942 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.442649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.443120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.443559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.577829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:40.586141 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14056490-f238-48a6-b394-b83d3efb9734 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1668 microversion: 2.1 time: 0.158799 Oct 24 09:52:40.587202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3513/7199] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:40 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:40.609545 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:40.610164 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:40.612048 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=35 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:40.617660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.618663 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.619105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.619798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.620260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.620693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.746417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:40.754205 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a52ea752-35d1-4ca1-8f9a-230fa11ad381 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1668 microversion: 2.1 time: 0.148487 Oct 24 09:52:40.754782 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3687/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:40 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:40.776259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:40.776777 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:40.782939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.783438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.783891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.784598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.785069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.785541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.810703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:52:40.882705 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6df1dd1f-6f02-4fcc-aa14-4be45cd590f1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 204 len: 0 microversion: 2.1 time: 0.109962 Oct 24 09:52:40.883604 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3514/7201] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:52:40 2022] DELETE /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:52:40.892731 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:40.893361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:40.900091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.900572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.901002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:40.901806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:40.902257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:40.902705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:41.032717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:41.041197 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59196189-80ea-4d97-b342-752261bb6807 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1674 microversion: 2.1 time: 0.152615 Oct 24 09:52:41.041924 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3688/7202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:40 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:42.066688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:42.067324 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:42.074198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:42.074695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:42.075150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:42.075860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:42.076330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:42.076772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:42.208760 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:42.217747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f912e6e-6165-4a6e-91c2-0e58de8342c9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1674 microversion: 2.1 time: 0.155550 Oct 24 09:52:42.218325 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3515/7203] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:42 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:43.090730 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-afea355a-573e-4cac-80b6-1b1c8de71112 req-818c000f-bc6d-4b9e-b21d-3f82ca0464a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82b4723-478a-4507-852f-721687701c45", "name": "network-vif-deleted", "tag": "9df8fbb8-fb78-48af-8a8d-94127aa205c0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:43.110471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-afea355a-573e-4cac-80b6-1b1c8de71112 req-818c000f-bc6d-4b9e-b21d-3f82ca0464a6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:43.111093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-afea355a-573e-4cac-80b6-1b1c8de71112 req-818c000f-bc6d-4b9e-b21d-3f82ca0464a6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:43.111730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-afea355a-573e-4cac-80b6-1b1c8de71112 req-818c000f-bc6d-4b9e-b21d-3f82ca0464a6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:43.124615 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-afea355a-573e-4cac-80b6-1b1c8de71112 req-818c000f-bc6d-4b9e-b21d-3f82ca0464a6 service nova] Creating event network-vif-deleted:9df8fbb8-fb78-48af-8a8d-94127aa205c0 for instance b82b4723-478a-4507-852f-721687701c45 on n-h1-master-1 Oct 24 09:52:43.130576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-afea355a-573e-4cac-80b6-1b1c8de71112 req-818c000f-bc6d-4b9e-b21d-3f82ca0464a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045069 Oct 24 09:52:43.131756 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3689/7204] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:43.242185 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:43.242837 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:43.249847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:43.250337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:43.250788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:43.251690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:43.252154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:43.252586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:43.290243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:43.290739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:43.291189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:43.291639 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lazy-loading 'fault' on Instance uuid b82b4723-478a-4507-852f-721687701c45 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:52:43.332714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:43.341269 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f0e5d9f-0f9b-4fd6-aa4a-244251e328de tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 200 len: 1327 microversion: 2.1 time: 0.102882 Oct 24 09:52:43.341870 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3516/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:43 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:44.366453 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:44.367069 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:44.373177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:44.373693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:44.374137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:44.374822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:44.375283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:44.375711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:44.388760 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 HTTP/1.1 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b82b4723-478a-4507-852f-721687701c45'} Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:52:44.390404 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9bcd055-b9f2-4037-b915-6df88d95aa21 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 404 len: 111 microversion: 2.1 time: 0.030578 Oct 24 09:52:44.395170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3690/7206] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:44 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:52:44.409439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:44.410062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:44.412109 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:44.418749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:44.419253 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:44.419701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:44.420399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:44.420866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:44.421318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:44.434862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 HTTP/1.1 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b82b4723-478a-4507-852f-721687701c45'} Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:52:44.436569 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23cb113c-d51c-45ab-9c65-6a4a4a28af5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 404 len: 111 microversion: 2.1 time: 0.032527 Oct 24 09:52:44.441491 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3517/7207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:44 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:52:44.485706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1647590608", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "5fa15dc2-ca41-4467-8f2e-7062f271892b"}], "security_groups": [{"name": "tempest-securitygroup--1900023493"}], "key_name": "tempest-keypair-454579110", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:44.589724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] validate_networks() for [('5fa15dc2-ca41-4467-8f2e-7062f271892b', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:52:45.063282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:52:45.063708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:52:45.064217 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:52:45.064627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:52:45.065040 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:52:45.073917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:45.074405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:45.074845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:45.075574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:45.076033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:45.076462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:45.095938 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:52:45.101215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:52:45.114035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:52:45.116333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:52:45.166146 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b8a9b4b5-b365-4504-b0a2-771858c14de1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683757 Oct 24 09:52:45.166792 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3691/7208] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:52:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:52:45.177972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d9df5c4-dca4-47f2-bcd3-bc6e2a56c446 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:45.178595 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d9df5c4-dca4-47f2-bcd3-bc6e2a56c446 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:45.235162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d9df5c4-dca4-47f2-bcd3-bc6e2a56c446 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:45.242380 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d9df5c4-dca4-47f2-bcd3-bc6e2a56c446 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1238 microversion: 2.1 time: 0.068043 Oct 24 09:52:45.242991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3518/7209] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:45 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:52:46.266006 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:46.266641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:46.274684 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:46.275209 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:46.275855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:46.276574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:46.277036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:46.277501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:46.341463 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:46.349255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64ea1d1d-631b-40aa-9ca7-7798ba846c06 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1290 microversion: 2.1 time: 0.087390 Oct 24 09:52:46.349856 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3692/7210] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:46 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:47.377020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:47.377707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:47.386342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:47.386917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:47.387396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:47.388220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:47.388686 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:47.389325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:47.523222 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:47.531552 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-702d3e5d-c3ae-441d-9732-79f2dd1393bf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.158920 Oct 24 09:52:47.532349 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3519/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:47 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:48.030449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d4d2cca5-ff12-494c-8963-bb39c90b0d8d req-b26c57b2-df82-4828-8946-7114d63bbb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:48.043894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d4d2cca5-ff12-494c-8963-bb39c90b0d8d req-b26c57b2-df82-4828-8946-7114d63bbb78 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:48.045327 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d4d2cca5-ff12-494c-8963-bb39c90b0d8d req-b26c57b2-df82-4828-8946-7114d63bbb78 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:48.045842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d4d2cca5-ff12-494c-8963-bb39c90b0d8d req-b26c57b2-df82-4828-8946-7114d63bbb78 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:48.057083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d4d2cca5-ff12-494c-8963-bb39c90b0d8d req-b26c57b2-df82-4828-8946-7114d63bbb78 service nova] Creating event network-changed:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:52:48.063749 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d4d2cca5-ff12-494c-8963-bb39c90b0d8d req-b26c57b2-df82-4828-8946-7114d63bbb78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039881 Oct 24 09:52:48.064357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3693/7212] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:48.555804 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:48.556364 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:48.563145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:48.563639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:48.564090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:48.564787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:48.565254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:48.565719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:48.692092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:48.700383 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10be6fd0-1e50-41f4-a28d-14198f95a2ef tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.148517 Oct 24 09:52:48.700956 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3520/7213] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:48 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:49.724716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:49.725465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:49.732571 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:49.733059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:49.733529 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:49.734217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:49.734671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:49.735092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:49.863465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:49.871698 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f914efa-6900-488b-bb62-5aef34df937e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.151372 Oct 24 09:52:49.872277 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3694/7214] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:49 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:50.895278 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:50.895904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:50.902798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:50.903286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:50.903994 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:50.904694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:50.905158 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:50.905690 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:51.037265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:51.045084 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d3701c0-bb4f-4c5a-9599-c38e68d74163 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.153683 Oct 24 09:52:51.045686 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3521/7215] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:50 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:52.068052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:52.068597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:52.075947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:52.076431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:52.076874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:52.077598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:52.078057 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:52.078486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:52.217969 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:52.225728 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6a19460-3a27-4edc-a9d8-86cc01ad2c64 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.161617 Oct 24 09:52:52.226333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3695/7216] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:52 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:53.249312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:53.249955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:53.256754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:53.257248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:53.257742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:53.258443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:53.258911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:53.259351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:53.386194 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:53.393743 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f446d78-9c9f-4230-a891-167d33067056 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.148299 Oct 24 09:52:53.394317 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3522/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:53 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:53.844753 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3e68e9fc-1b5f-4c8e-8b21-f6fd39d13497 req-27eb6006-a852-4314-8717-f692d177b6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "name": "network-vif-plugged", "status": "completed", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:53.855751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3e68e9fc-1b5f-4c8e-8b21-f6fd39d13497 req-27eb6006-a852-4314-8717-f692d177b6d4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:53.856319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3e68e9fc-1b5f-4c8e-8b21-f6fd39d13497 req-27eb6006-a852-4314-8717-f692d177b6d4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:53.856856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3e68e9fc-1b5f-4c8e-8b21-f6fd39d13497 req-27eb6006-a852-4314-8717-f692d177b6d4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:53.870191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3e68e9fc-1b5f-4c8e-8b21-f6fd39d13497 req-27eb6006-a852-4314-8717-f692d177b6d4 service nova] Creating event network-vif-plugged:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:52:53.875160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3e68e9fc-1b5f-4c8e-8b21-f6fd39d13497 req-27eb6006-a852-4314-8717-f692d177b6d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Oct 24 09:52:53.875926 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3696/7218] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:54.418314 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:54.418937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:54.425992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:54.426479 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:54.426961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:54.427657 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:54.428121 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:54.428558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:54.562367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:54.570383 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e66d715-f0e6-4e4a-a8dd-8cc8e5111bdc tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1364 microversion: 2.1 time: 0.156427 Oct 24 09:52:54.570975 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3523/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:54 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:55.595476 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:55.596172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:55.599000 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:55.599726 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:55.605942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:55.606422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:55.606858 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:55.607537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:55.607987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:55.608409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:55.739068 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:52:55.747308 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe920ff2-c2b0-45a5-a2fa-3b9f40f2167b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1550 microversion: 2.1 time: 0.156022 Oct 24 09:52:55.747882 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3697/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:52:55 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:52:55.770238 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:52:55.770753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:52:55.772513 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:55.779008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:55.779498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:55.779944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:55.780633 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:55.781096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:55.781558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:55.861170 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56936389-567f-43d4-95c7-10a1b3e2abb1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094746 Oct 24 09:52:55.861818 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3524/7221] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:52:55 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:52:57.007474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1071e4e9-5f8f-424b-8132-0da3b9501ae4 req-399a0b02-4376-449b-8af3-a1b73e2a1a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:52:57.018292 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1071e4e9-5f8f-424b-8132-0da3b9501ae4 req-399a0b02-4376-449b-8af3-a1b73e2a1a44 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:52:57.018773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1071e4e9-5f8f-424b-8132-0da3b9501ae4 req-399a0b02-4376-449b-8af3-a1b73e2a1a44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:52:57.019208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1071e4e9-5f8f-424b-8132-0da3b9501ae4 req-399a0b02-4376-449b-8af3-a1b73e2a1a44 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:52:57.030272 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1071e4e9-5f8f-424b-8132-0da3b9501ae4 req-399a0b02-4376-449b-8af3-a1b73e2a1a44 service nova] Creating event network-changed:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:52:57.035347 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1071e4e9-5f8f-424b-8132-0da3b9501ae4 req-399a0b02-4376-449b-8af3-a1b73e2a1a44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031655 Oct 24 09:52:57.035947 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3698/7222] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:53:31.205072 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:31.205871 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:31.209698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:31.210349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:31.218221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:31.218717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:31.219172 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:31.219875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:31.220348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:31.220792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:31.350966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:31.358638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7644fac7-9eb2-4cef-b394-edab42a6fcad tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1669 microversion: 2.1 time: 0.155697 Oct 24 09:53:31.359212 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3525/7223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:31 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:31.383412 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0758584-9b34-4e7c-8cf6-288dd0c94752"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:53:31.385862 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:31.387993 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:31.388774 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=49 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:31.394029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:31.394523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:31.394959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:31.395653 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:31.396106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:31.396723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:31.652463 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b8e19ec-5958-4e89-92bd-c7ce38b41402 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273990 Oct 24 09:53:31.653071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3699/7224] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:53:31 2022] POST /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:53:42.361541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:53:42.363877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:42.366748 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:42.367937 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:42.373509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:42.374041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:42.374497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:42.375205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:42.375677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:42.376123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:42.403861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:42.409427 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Old instance type m1.heat2, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 09:53:42.416827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:53:42.417264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:53:42.417772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:53:42.418191 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:53:42.418615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:53:42.480376 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb803ef7-d961-4798-b07e-ac55051f77e9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/action" status: 202 len: 0 microversion: 2.1 time: 0.122788 Oct 24 09:53:42.481019 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3526/7225] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:53:42 2022] POST /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:53:42.487927 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:42.488697 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:42.494329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:42.495036 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:42.504158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:42.504651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:42.505115 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:42.505973 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:42.506413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:42.506839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:42.643734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:42.652938 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e2b06d6-fef5-4968-acec-1fcfbc8f557e tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1724 microversion: 2.1 time: 0.167349 Oct 24 09:53:42.653580 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3700/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:42 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:53:43.678396 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:43.679020 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:43.686365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:43.686859 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:43.687315 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:43.688020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:43.688486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:43.688929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:43.825250 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:43.834459 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-24f6facb-4aeb-4673-803c-bf7deeb676d6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1724 microversion: 2.1 time: 0.160833 Oct 24 09:53:43.835275 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3527/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:43 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:44.858065 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:44.858689 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:44.865681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:44.866169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:44.867121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:44.867850 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:44.868299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:44.868752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:44.996356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:45.004530 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9f03f9d-8060-41ad-9aaa-cac821e93d42 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.151135 Oct 24 09:53:45.005108 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3701/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:44 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:46.028192 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:46.028817 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:46.035902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:46.036418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:46.036866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:46.037584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:46.038046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:46.039000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:46.170983 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:46.179895 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-381a07a4-cb23-4687-93fa-6dcd50161ab7 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.155122 Oct 24 09:53:46.180475 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3528/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:46 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:47.203807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:47.204436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:47.211834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:47.212350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:47.212770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:47.213500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:47.213965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:47.214404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:47.346804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:47.355868 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2eae55d-e049-4f98-ac88-2bb0a1471bf3 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.156266 Oct 24 09:53:47.356442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3702/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:47 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:48.378575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:48.379203 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:48.386074 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:48.386575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:48.387027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:48.387732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:48.388205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:48.388646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:48.519443 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:48.527686 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b09c4c6a-d27d-43a6-b789-2bcf120d515f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.153106 Oct 24 09:53:48.528260 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3529/7231] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:48 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:49.551645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:49.552179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:49.559388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:49.559869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:49.560305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:49.560992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:49.561481 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:49.561910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:49.687340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:49.696122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ceb5b654-ec91-4f27-add8-1aa16b284af0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.148423 Oct 24 09:53:49.696701 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3703/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:49 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:50.719057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:50.719697 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:50.727198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:50.727698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:50.728155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:50.728860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:50.729362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:50.729808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:50.861829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:50.872671 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-086e70e6-20ca-4a31-9e01-ef9d53f4ec0b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.157106 Oct 24 09:53:50.873755 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3530/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:50 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:51.898348 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:51.898970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:51.906689 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:51.907167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:51.907607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:51.908307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:51.908765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:51.909196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:52.040100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:52.048482 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21b6668b-9be8-49ad-97b5-be6f0d8644d5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.154570 Oct 24 09:53:52.049063 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3704/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:51 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:53.072370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:53.072988 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:53.079904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:53.080393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:53.080842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:53.081625 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:53.082088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:53.082521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:53.216768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:53.224973 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e09ac9e3-70c5-4718-a322-e9015e20b15c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.156551 Oct 24 09:53:53.225581 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3531/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:53 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:54.248760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:54.249328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:54.256189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:54.256666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:54.257098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:54.257806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:54.258261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:54.258686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:54.394273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:54.402493 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dabb61f9-d235-4517-a4d0-8bd23dda2423 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.157659 Oct 24 09:53:54.403069 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3705/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:54 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:55.481694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:55.482346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:55.488597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:55.489097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:55.489572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:55.490300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:55.490792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:55.491258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:55.623209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:55.631551 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a395f5f-ee9e-4d85-8543-3a0e47fdc1a0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.208580 Oct 24 09:53:55.632661 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3532/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:55 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:56.655929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:56.656546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:56.663781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:56.664269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:56.664712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:56.665479 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:56.665945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:56.666376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:56.793669 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:56.801901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50d44737-f144-4cf9-8db6-ee6ef06c553b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.150120 Oct 24 09:53:56.802478 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3706/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:56 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:57.826432 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:57.827060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:57.833896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:57.834388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:57.834839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:57.835538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:57.836007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:57.836449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:58.009646 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:58.017856 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c88db3c-4752-4bf0-8a31-74d24317bdcb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.195360 Oct 24 09:53:58.018434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3533/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:57 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:53:59.042736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:53:59.043347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:53:59.050632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:59.051111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:59.051543 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:59.052231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:53:59.052683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:53:59.053104 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:53:59.230497 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:53:59.238645 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-991305e4-5642-445f-8d12-40889f22048f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.200340 Oct 24 09:53:59.239226 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3707/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:53:59 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:00.262181 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:00.262843 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:00.269680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:00.270177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:00.270630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:00.271330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:00.271800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:00.272243 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:00.399165 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:00.407500 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19d80ca1-10f7-461a-87a5-2456276ff77f tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.149230 Oct 24 09:54:00.408070 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3534/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:00 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:01.432560 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:01.433322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:01.439978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:01.440460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:01.440895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:01.441620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:01.442077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:01.442627 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:01.572178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:01.580336 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-487be36c-c838-4778-ad90-1ba8fc388bdf tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.152436 Oct 24 09:54:01.580909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3708/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:01 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:02.604144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:02.604925 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:02.611513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:02.612019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:02.612471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:02.613188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:02.613683 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:02.614155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:02.747797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:02.755994 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bb07bc7-b86a-40b9-b42a-126a80aa6233 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1729 microversion: 2.1 time: 0.155759 Oct 24 09:54:02.757344 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3535/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:02 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:03.780980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:03.781556 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:03.788753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:03.789445 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:03.789957 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:03.790728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:03.791261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:03.791756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:03.927488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:03.936459 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f72b6be-4b93-439d-b375-71dd0c715ab0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1728 microversion: 2.1 time: 0.160363 Oct 24 09:54:03.937199 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3709/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:03 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:04.218042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "name": "network-vif-unplugged", "status": "completed", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:04.228583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:04.229073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:04.229558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:04.241450 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] Creating event network-vif-unplugged:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h2-master-1 Oct 24 09:54:04.246870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:54:04.258091 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-153a9d42-6186-4c01-86b5-f37d5db7ae6c req-2bffd7e7-7494-44df-89f5-d77385e40268 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043749 Oct 24 09:54:04.258696 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3536/7245] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:54:04.960031 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:04.960654 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:04.967727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:04.968217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:04.968662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:04.969386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:04.969848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:04.970271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:05.111727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:05.120316 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cca31618-6d49-49c6-a812-e172ca1ce3f0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1728 microversion: 2.1 time: 0.164130 Oct 24 09:54:05.120999 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3710/7246] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:04 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:06.145624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:06.146945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:06.153700 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:06.154441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:06.154893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:06.155598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:06.156064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:06.156498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:06.297899 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:06.299574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:06.308574 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb5b0226-ecee-4eb6-a533-a14ba01909eb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.168133 Oct 24 09:54:06.308756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:06.309164 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3537/7247] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:06 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:06.315643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:06.315643 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:06.321475 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] Creating event network-changed:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h2-master-1 Oct 24 09:54:06.326874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:54:06.337593 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-89b8aefc-9c64-4293-8ec5-72a50b60e07f req-d540cd06-522a-41be-9132-a82fc8b5c417 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043586 Oct 24 09:54:06.338199 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3711/7248] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:54:07.332023 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:07.332653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:07.340154 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:07.340661 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:07.341112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:07.341854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:07.342325 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:07.342769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:07.474284 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:07.482670 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc66beb6-ccec-4d3f-b879-d1b1642c0fde tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.154672 Oct 24 09:54:07.483252 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3538/7249] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:07 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:08.508671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:08.509639 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:08.515885 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:08.516372 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:08.516808 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:08.517537 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:08.517991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:08.518414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:08.651308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:08.659816 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1238eb2-a65a-467c-b2ac-9ec30ec98ef1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.156399 Oct 24 09:54:08.660320 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3712/7250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:08 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:09.684467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:09.685077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:09.691981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:09.692473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:09.692922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:09.693666 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:09.694129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:09.695136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:09.827266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:09.835641 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5cd20023-5605-4bfc-8de5-39c7bfa19283 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.155029 Oct 24 09:54:09.836214 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3539/7251] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:09 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:10.859222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:10.859887 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:10.867693 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:10.868175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:10.868610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:10.869306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:10.869772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:10.870194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:11.006492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:11.015297 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04d000cb-b49f-4b40-8972-9c2191936772 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.159904 Oct 24 09:54:11.015888 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3713/7252] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:10 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:12.040609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:12.041266 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:12.048293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:12.048905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:12.049234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:12.049965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:12.050439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:12.050881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:12.182544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:12.190881 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-70f61480-5d61-4dfb-9e5d-c0a02f2c318b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.154750 Oct 24 09:54:12.191457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3540/7253] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:12 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:13.214686 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:13.215344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:13.218240 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=29 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:13.223622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:13.224114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:13.224557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:13.225255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:13.225744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:13.226176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:13.230320 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=83 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:13.359011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:13.371088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e14d15e0-0eba-4315-ad41-d448ec902378 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.160207 Oct 24 09:54:13.373435 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3714/7254] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:13 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:14.395002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:14.395656 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:14.398644 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=35 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:14.404760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:14.405258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:14.405735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:14.406439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:14.406908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:14.407351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:14.411308 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:14.536580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:14.544829 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-acf5d6bf-8d7f-424c-87ff-0195476c32bd tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.153710 Oct 24 09:54:14.545416 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3541/7255] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:14 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:15.568696 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:15.569333 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:15.576946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:15.577470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:15.577915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:15.578613 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:15.579072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:15.579504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:15.713674 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:15.721942 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7f62ad0e-80ad-4e6e-a04b-2033d86eb043 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.157168 Oct 24 09:54:15.722543 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3715/7256] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:15 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:16.745966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:16.746588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:16.753469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:16.753968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:16.754423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:16.755129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:16.755600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:16.756043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:16.888420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:16.896727 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b683094-1746-404b-b15b-31276a742bf9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1726 microversion: 2.1 time: 0.155248 Oct 24 09:54:16.897322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3542/7257] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:16 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:17.920670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:17.921386 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:17.928129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:17.928621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:17.929064 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:17.929787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:17.930252 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:17.931371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.066127 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:18.075149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d56c0d3a-7b33-463e-a1e5-a4cb393ba613 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1723 microversion: 2.1 time: 0.158393 Oct 24 09:54:18.075702 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3716/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:17 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:18.098475 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:18.099119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:18.107974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:18.108525 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:18.109156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.110069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:18.110538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:18.110978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.152356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:18.152860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:18.153333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.154084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:18.154828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:18.155272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.176989 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:54:18.182259 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Getting quotas for user afe39e1dac7e4a5eb5be30ac83fc748d and project deab71e5559a471cbe856a6360093250. Resources: {'ram', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:54:18.280447 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3151662c-219b-446b-894b-61266a6d2911 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "POST /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/action" status: 202 len: 0 microversion: 2.1 time: 0.186344 Oct 24 09:54:18.281065 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3543/7259] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:54:18 2022] POST /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:54:18.289207 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:18.289852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:18.295926 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:18.296414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:18.296852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.297608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:18.298258 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:18.298928 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:18.438529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:18.446996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48f9ae62-8df5-4d4b-8112-1b0b6ffa5921 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.161561 Oct 24 09:54:18.447591 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3717/7260] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:18 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:19.471948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:19.472667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:19.479314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:19.479807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:19.480257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:19.480959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:19.481466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:19.481898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:19.610211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:19.618575 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c72a0650-8dee-4156-b035-e2fc7fecf6b6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.151739 Oct 24 09:54:19.619152 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3544/7261] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:19 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:20.088469 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "name": "network-vif-plugged", "status": "completed", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:20.098775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:20.099268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:20.099700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:20.112391 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] Creating event network-vif-plugged:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h2-master-1 Oct 24 09:54:20.118634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:54:20.129440 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9631cccb-df1c-426f-bb58-ab16258443c1 req-193f7fe8-9f07-49e3-bd68-96cb6c09ad52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044793 Oct 24 09:54:20.130015 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3718/7262] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:54:20.643121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:20.643753 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:20.650632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:20.651127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:20.651579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:20.652281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:20.652777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:20.653240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:20.785718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:20.793976 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3eaff18-1d10-42ae-b1fd-db0726e6607d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.154772 Oct 24 09:54:20.794908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3545/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:20 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:21.820668 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:21.821912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:21.828373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:21.828872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:21.829328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:21.830045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:21.830507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:21.830942 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:21.969534 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:21.977975 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4840d892-0f99-4dc3-a464-fbf534f1218d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.162685 Oct 24 09:54:21.978559 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3719/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:21 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:23.002050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:23.002562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:23.010048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:23.010436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:23.010877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:23.011570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:23.012043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:23.012468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:23.153560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:23.162919 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2e9ed84-843a-47f1-82ff-42cd9799e758 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.164490 Oct 24 09:54:23.163443 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3546/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:22 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:23.828748 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "name": "network-vif-unplugged", "status": "completed", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:23.839489 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:23.839975 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:23.840455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:23.853522 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] Creating event network-vif-unplugged:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:54:23.859100 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:54:23.870915 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ae609ffa-325e-4763-af45-4a311da5e864 req-30960509-6209-4794-ac47-49a518bf353a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045913 Oct 24 09:54:23.871999 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3720/7266] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:54:24.187300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:24.187961 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:24.194885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:24.195390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:24.195847 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:24.196612 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:24.197275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:24.197777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:24.336252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:24.345364 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71576325-1bd5-48e1-93bc-bbf18a55fc55 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.161769 Oct 24 09:54:24.345880 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3547/7267] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:24 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:25.370529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:25.371252 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:25.378508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:25.378994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:25.379426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:25.380108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:25.380560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:25.380982 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:25.515081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:25.523621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5ae22516-b1e4-4793-ab9c-4d1f38853d15 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.157912 Oct 24 09:54:25.524772 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3721/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:25 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:25.910384 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:25.921499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:25.921991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:25.922435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:25.934316 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] Creating event network-changed:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:54:25.939929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 09:54:25.950688 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4426351e-f601-4b79-9223-67d53d15d35e req-d3027b6a-6a61-425c-a7e4-c3ad4acb444b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043973 Oct 24 09:54:25.951497 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3548/7269] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:54:26.547927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:26.548805 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:26.556320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:26.556807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:26.557239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:26.557954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:26.558404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:26.558977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:26.692891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:26.701665 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-33450b50-a7a8-4c10-8ffe-e197f170453d tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.157568 Oct 24 09:54:26.702239 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3722/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:26 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:27.724755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:27.725497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:27.733665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:27.734171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:27.734624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:27.735347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:27.735816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:27.736257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:27.876866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:27.885418 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33f19fde-7e12-446d-91fe-3c321f243ca9 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.164905 Oct 24 09:54:27.886005 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3549/7271] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:27 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:28.909605 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:28.910250 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:28.917049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:28.917602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:28.918034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:28.918722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:28.919174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:28.919596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:29.053323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:29.062416 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b705294f-f13e-4e63-8d64-3f1dd04d5cf0 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.156669 Oct 24 09:54:29.062992 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3723/7272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:28 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:30.088080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:30.088707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:30.090745 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:30.096670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:30.097164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:30.097642 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:30.098345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:30.098817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:30.099260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:30.226894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:30.235702 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d89fd2a5-f5e5-405c-8bb0-440290295037 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.151522 Oct 24 09:54:30.236275 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3550/7273] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:30 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:31.259489 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:31.260106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:31.266913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:31.267393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:31.267826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:31.268542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:31.269006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:31.269451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:31.395190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:31.403494 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a62e4f1-fb60-4269-a7c7-416090449a49 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.148427 Oct 24 09:54:31.404003 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3724/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:31 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:32.427733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:32.428287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:32.434795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:32.435301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:32.435757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:32.436465 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:32.436939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:32.437414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:32.570236 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:32.579050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3279d43-5e36-4b57-9cf2-cdcf4362b96b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.155639 Oct 24 09:54:32.579629 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3551/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:32 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:33.603375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:33.603986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:33.609930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:33.610409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:33.610847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:33.611528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:33.611985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:33.612459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:33.744025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:33.752157 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24c823fb-2e25-4a28-8e92-91a33dd8e122 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.153620 Oct 24 09:54:33.752727 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3725/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:33 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:34.775543 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:34.776171 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:34.783263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:34.783761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:34.784210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:34.784915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:34.785412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:34.785855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:34.918460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:34.926684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-acad8d7e-dc67-4280-9196-19a5fb0333b5 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.155065 Oct 24 09:54:34.927257 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3552/7277] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:34 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:54:35.951484 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:35.952097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:35.959141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:35.959603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:35.960033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:35.960714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:35.961165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:35.961638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:36.092115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:36.100350 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-507a4b50-1631-4690-ade1-c3ecd9e441ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1722 microversion: 2.1 time: 0.152723 Oct 24 09:54:36.100928 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3726/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:35 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:37.123791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:37.124409 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:37.131274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.131763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.132206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.132896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.133389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.133827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.265571 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:37.274261 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-941b0bcf-2658-40bb-a691-057d058b991a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1715 microversion: 2.1 time: 0.153799 Oct 24 09:54:37.274838 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3553/7279] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:37 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:37.297261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:37.297912 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:37.304743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.305227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.305699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.306382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.306840 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.307267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.437025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:37.445256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e38d8e23-6be7-4825-8bba-0a8b741fb507 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1715 microversion: 2.1 time: 0.151771 Oct 24 09:54:37.445861 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3727/7280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:37 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:37.521967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:37.522587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:37.528567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.529055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.529803 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.530489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.530949 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.531380 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.657037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:37.665703 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f68e1332-6340-414c-a308-ef4f1fac8dbb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1715 microversion: 2.1 time: 0.147594 Oct 24 09:54:37.666268 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3554/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:37 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:37.688445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:37.688945 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:37.694893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.695378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.695817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.696507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.696964 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.697423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.721840 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:54:37.797245 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-147907b0-64a9-49c8-85c7-6d952950b909 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 204 len: 0 microversion: 2.1 time: 0.112243 Oct 24 09:54:37.797868 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3728/7282] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:54:37 2022] DELETE /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:54:37.806939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:37.807562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:37.813947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.814436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.814881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.815574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:37.816035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:37.816471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:37.820382 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:37.950121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:37.958294 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08ffd193-bce3-4015-a7f7-f55f3cdaaea1 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1721 microversion: 2.1 time: 0.155726 Oct 24 09:54:37.958859 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3555/7283] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:37 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:38.267115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a54ac2c1-7369-45f0-916b-0e44b7e92528 req-ced7cf4f-0c9c-402a-affa-ebc0dffda380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "name": "network-vif-plugged", "status": "completed", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:38.276777 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a54ac2c1-7369-45f0-916b-0e44b7e92528 req-ced7cf4f-0c9c-402a-affa-ebc0dffda380 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:38.277243 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a54ac2c1-7369-45f0-916b-0e44b7e92528 req-ced7cf4f-0c9c-402a-affa-ebc0dffda380 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:38.277706 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a54ac2c1-7369-45f0-916b-0e44b7e92528 req-ced7cf4f-0c9c-402a-affa-ebc0dffda380 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:38.292528 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a54ac2c1-7369-45f0-916b-0e44b7e92528 req-ced7cf4f-0c9c-402a-affa-ebc0dffda380 service nova] Creating event network-vif-plugged:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:54:38.297343 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a54ac2c1-7369-45f0-916b-0e44b7e92528 req-ced7cf4f-0c9c-402a-affa-ebc0dffda380 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034332 Oct 24 09:54:38.297964 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3729/7284] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:54:38.982084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:38.982711 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:38.989489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:38.989985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:38.990435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:38.991177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:38.991649 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:38.992092 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:39.125694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:39.135010 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-954e6fff-1e79-4814-a641-281be3e126ed tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1721 microversion: 2.1 time: 0.156498 Oct 24 09:54:39.135745 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3556/7285] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:38 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:40.161170 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:40.161922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:40.169875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:40.170644 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:40.171249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:40.172831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:40.173488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:40.174968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:40.197085 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:40.273502 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:40.282987 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a6e670b5-9f47-40b3-a2df-7c3e412d9626 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1653 microversion: 2.1 time: 0.127019 Oct 24 09:54:40.283594 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3730/7286] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:40 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1653 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:40.333955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cb1c2acd-9d4a-40be-83f4-2fa271cd1734 req-f08094d4-15d0-4c42-9701-105ff73b33e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b7b0-353f-4e81-9c33-ee173361df8b", "name": "network-vif-deleted", "tag": "03db9a9c-bd42-4d1a-9774-50ad80f73273"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:40.344188 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb1c2acd-9d4a-40be-83f4-2fa271cd1734 req-f08094d4-15d0-4c42-9701-105ff73b33e5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:40.344681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb1c2acd-9d4a-40be-83f4-2fa271cd1734 req-f08094d4-15d0-4c42-9701-105ff73b33e5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:40.345153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cb1c2acd-9d4a-40be-83f4-2fa271cd1734 req-f08094d4-15d0-4c42-9701-105ff73b33e5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:40.356569 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cb1c2acd-9d4a-40be-83f4-2fa271cd1734 req-f08094d4-15d0-4c42-9701-105ff73b33e5 service nova] Creating event network-vif-deleted:03db9a9c-bd42-4d1a-9774-50ad80f73273 for instance 1b81b7b0-353f-4e81-9c33-ee173361df8b on n-h1-master-1 Oct 24 09:54:40.361883 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cb1c2acd-9d4a-40be-83f4-2fa271cd1734 req-f08094d4-15d0-4c42-9701-105ff73b33e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Oct 24 09:54:40.362846 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3557/7287] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:54:41.308202 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:41.309496 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:41.317067 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:41.317599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:41.318042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:41.318747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:41.320462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:41.321472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:41.389860 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:41.399115 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cd4a1ec-c540-407b-a90a-242bb65a2110 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1369 microversion: 2.1 time: 0.094815 Oct 24 09:54:41.400097 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3731/7288] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:41 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:42.424248 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:42.424967 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:42.431244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:42.431748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:42.432200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:42.432906 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:42.433410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:42.433856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:42.502216 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:42.510619 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afe7407e-cdbd-4ee7-9b44-3f1974ef3bb6 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1369 microversion: 2.1 time: 0.091849 Oct 24 09:54:42.511199 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3558/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:42 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:43.534979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:43.535538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:43.538260 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:43.544274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:43.544746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:43.545185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:43.545932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:43.546399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:43.546828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:43.612732 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:43.622074 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d78e171-6f7e-4b2c-b990-638fdfa21093 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1369 microversion: 2.1 time: 0.091068 Oct 24 09:54:43.622855 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3732/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:43 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:44.645644 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:44.646211 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:44.649058 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:44.654244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:44.655004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:44.655457 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:44.656160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:44.656632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:44.657076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:44.689339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:44.689850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:44.690309 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:44.690776 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lazy-loading 'fault' on Instance uuid 1b81b7b0-353f-4e81-9c33-ee173361df8b {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:54:44.731268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe39e1dac7e4a5eb5be30ac83fc748d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deab71e5559a471cbe856a6360093250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:44.739553 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58c5bb8a-7eb3-4e4f-ad1f-4a72c1696b58 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 200 len: 1374 microversion: 2.1 time: 0.098027 Oct 24 09:54:44.740133 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3559/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:44 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 1374 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:54:45.764093 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:45.764635 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:45.771657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:45.772139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:45.772584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:45.773274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:45.774339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:45.774773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:45.788356 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b HTTP/1.1 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1b81b7b0-353f-4e81-9c33-ee173361df8b'} Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:45.790539 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-39c3b0e7-eb19-47c4-855d-d16fc55ef149 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 404 len: 111 microversion: 2.1 time: 0.031882 Oct 24 09:54:45.794751 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3733/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:45 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:45.854895 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:45.857201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:45.864096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:45.864662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:45.865117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:45.865843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:45.866320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:45.866764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:45.880171 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-volume_attachments HTTP/1.1 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '1b81b7b0-353f-4e81-9c33-ee173361df8b'} Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:45.882558 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22f45ea6-f64c-4852-8936-267d45438f8c tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033733 Oct 24 09:54:45.886696 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3560/7293] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:54:45 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.229433 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.229936 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.236530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.237018 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.237505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.238196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.238658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.239090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.252589 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b HTTP/1.1 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '1b81b7b0-353f-4e81-9c33-ee173361df8b'} Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.254224 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-897e161d-23ca-4c3b-ad2e-4bd703e927ee tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 404 len: 111 microversion: 2.1 time: 0.030475 Oct 24 09:54:49.258410 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3734/7294] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:54:49 2022] DELETE /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.264444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.265087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 1b81b7b0-353f-4e81-9c33-ee173361df8b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.272461 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.272979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.273987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.275017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.275550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.276047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.294152 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b HTTP/1.1 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1b81b7b0-353f-4e81-9c33-ee173361df8b'} Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.295932 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 1b81b7b0-353f-4e81-9c33-ee173361df8b could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.300825 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11eaf726-82d0-4d76-a2ba-002a22533bfb tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b" status: 404 len: 111 microversion: 2.1 time: 0.036938 Oct 24 09:54:49.301505 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3561/7295] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:49 2022] GET /compute/v2.1/servers/1b81b7b0-353f-4e81-9c33-ee173361df8b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.307879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.308456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.315168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.315661 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.316256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.316950 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.317419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.317844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.332996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 HTTP/1.1 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'b82b4723-478a-4507-852f-721687701c45'} Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.334723 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ed0ef0f-72f4-4ef4-a9d0-ce3196a77e92 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 404 len: 111 microversion: 2.1 time: 0.033137 Oct 24 09:54:49.339425 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3735/7296] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:54:49 2022] DELETE /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.344845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.345518 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: b82b4723-478a-4507-852f-721687701c45] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.352369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.352922 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.353403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.354134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.354604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.355053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.369167 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 HTTP/1.1 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b82b4723-478a-4507-852f-721687701c45'} Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.370737 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance b82b4723-478a-4507-852f-721687701c45 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5fce37d6-74c0-4581-b5a4-5441bcfed4ec tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45" status: 404 len: 111 microversion: 2.1 time: 0.031197 Oct 24 09:54:49.377495 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3562/7297] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:49 2022] GET /compute/v2.1/servers/b82b4723-478a-4507-852f-721687701c45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.380711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.381211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.387797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.388281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.388715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.389432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.389884 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.390306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.404284 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 HTTP/1.1 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '87de54ed-4741-4e15-b035-26245621e134'} Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.406058 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90a90c57-8a20-425b-ae4a-af2dbd35ce5a tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 404 len: 111 microversion: 2.1 time: 0.030593 Oct 24 09:54:49.410991 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3736/7298] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:54:49 2022] DELETE /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.417821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.418454 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 87de54ed-4741-4e15-b035-26245621e134] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.424637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.425136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.425630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.426345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.426815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.427260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.440886 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 HTTP/1.1 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '87de54ed-4741-4e15-b035-26245621e134'} Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.442468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 87de54ed-4741-4e15-b035-26245621e134 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-90adde51-9060-47e4-8fa0-22eeda09d3ba tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134" status: 404 len: 111 microversion: 2.1 time: 0.030517 Oct 24 09:54:49.447734 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3563/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:49 2022] GET /compute/v2.1/servers/87de54ed-4741-4e15-b035-26245621e134 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.453707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.454200 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.460169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.460652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.461699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.462388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.462838 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.463260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.476949 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a HTTP/1.1 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '79b5b8de-a820-4a3b-854b-d0248c45c96a'} Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.478515 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb46d6be-698c-4669-bb6d-7e1d5daaea8b tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 404 len: 111 microversion: 2.1 time: 0.029999 Oct 24 09:54:49.482728 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3737/7300] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:54:49 2022] DELETE /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.488931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.489600 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] [instance: 79b5b8de-a820-4a3b-854b-d0248c45c96a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:49.495606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.496105 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.496554 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.497382 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:49.497813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:49.498256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:49.512694 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] HTTP exception thrown: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Request method failure captured: Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a HTTP/1.1 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVl-Hqsh_P0uUGGTAMB5YhWOKyqyfEETIHEuDOzH_SPjEOAbohkMCnp58sVM3-PK2uXccNXWfz92MMF6ijX4OvY4LbL8mLQWescQF4MQZ2qWd9Y1wKIfZ0k4Z6e8dugytzQDOWD1UILdx4QgTkTqG-f4qFww5DngKrFIUBAo_w9LK7tM Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deab71e5559a471cbe856a6360093250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deab71e5559a471cbe856a6360093250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deab71e5559a471cbe856a6360093250"}]}] Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: deab71e5559a471cbe856a6360093250 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerActionsTestJSON-568010851 Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: afe39e1dac7e4a5eb5be30ac83fc748d Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServerActionsTestJSON-568010851-project Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '79b5b8de-a820-4a3b-854b-d0248c45c96a'} Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:54:49.514295 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Returning 404 to user: Instance 79b5b8de-a820-4a3b-854b-d0248c45c96a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd83bbc5-0230-4ce7-9df2-361bcd5bcf69 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a" status: 404 len: 111 microversion: 2.1 time: 0.030701 Oct 24 09:54:49.518728 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3564/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:49 2022] GET /compute/v2.1/servers/79b5b8de-a820-4a3b-854b-d0248c45c96a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:54:49.524852 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5aaf34c-3c65-47e7-85d6-02533ae2f289 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] Calling method '.version_select at 0x7f8daa5c8e50>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:49.548538 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5aaf34c-3c65-47e7-85d6-02533ae2f289 tempest-ServerActionsTestJSON-568010851 tempest-ServerActionsTestJSON-568010851-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454579110" status: 202 len: 0 microversion: 2.1 time: 0.027967 Oct 24 09:54:49.549121 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3738/7302] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454579110 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:54:59.077667 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639518909", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "174526d5-1d71-4cd3-86a1-171f963c3432"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:54:59.133994 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] validate_networks() for [('174526d5-1d71-4cd3-86a1-171f963c3432', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:54:59.503797 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=37 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:59.554356 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:54:59.555341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:54:59.555864 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:54:59.556262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:54:59.556687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:54:59.566559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:59.567146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:59.567813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:59.568628 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:54:59.569069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:54:59.569557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:54:59.587387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Getting quotas for project 7fb13907ffea4abdbc6ce84f83038f44. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:54:59.592795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Getting quotas for user 7a77edfe753f40daaa8b0c00ccb18b47 and project 7fb13907ffea4abdbc6ce84f83038f44. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:54:59.605621 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:54:59.607965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:54:59.655361 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f75ce6d-41b3-4bfe-bba4-a62e30731fb0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713035 Oct 24 09:54:59.656387 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3565/7303] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:54:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:54:59.667867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce4adb2c-1a26-4e89-a058-19f74e37bed2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:54:59.668488 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce4adb2c-1a26-4e89-a058-19f74e37bed2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:54:59.675265 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=25 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:59.675564 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:59.730978 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ce4adb2c-1a26-4e89-a058-19f74e37bed2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:54:59.738256 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce4adb2c-1a26-4e89-a058-19f74e37bed2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1217 microversion: 2.1 time: 0.074489 Oct 24 09:54:59.738890 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3739/7304] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:54:59 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:00.762857 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7f93f26-bd5c-4152-8654-829fa03d5f49 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:00.763661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c7f93f26-bd5c-4152-8654-829fa03d5f49 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:00.823615 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c7f93f26-bd5c-4152-8654-829fa03d5f49 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:00.831569 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7f93f26-bd5c-4152-8654-829fa03d5f49 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1217 microversion: 2.1 time: 0.073575 Oct 24 09:55:00.832166 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3566/7305] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:00 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:01.854815 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c076a6f5-5e10-4885-bbb8-3e4e0cefb20a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:01.855445 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c076a6f5-5e10-4885-bbb8-3e4e0cefb20a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:01.920869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c076a6f5-5e10-4885-bbb8-3e4e0cefb20a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:01.929088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c076a6f5-5e10-4885-bbb8-3e4e0cefb20a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1217 microversion: 2.1 time: 0.078214 Oct 24 09:55:01.930247 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3740/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:01 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:02.951698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fa101a7-c42a-4c9c-bd5c-a141613d6480 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:02.952345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fa101a7-c42a-4c9c-bd5c-a141613d6480 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:03.011028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fa101a7-c42a-4c9c-bd5c-a141613d6480 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:03.017984 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fa101a7-c42a-4c9c-bd5c-a141613d6480 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1217 microversion: 2.1 time: 0.070155 Oct 24 09:55:03.018565 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3567/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:02 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:04.041407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:04.042034 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:04.049551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:04.050071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:04.050520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:04.051216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:04.051681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:04.052177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:04.113587 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:04.121997 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee9de539-b026-42a6-b77c-979cc3e2caa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1221 microversion: 2.1 time: 0.084589 Oct 24 09:55:04.122562 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3741/7308] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:04 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:05.145702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:05.146490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:05.154138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:05.154914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:05.155370 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:05.156094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:05.156569 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:05.157225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:05.221580 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:05.230366 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b391411-471e-40f3-9c98-dacd7f299169 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1275 microversion: 2.1 time: 0.088794 Oct 24 09:55:05.230946 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3568/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:05 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:06.256154 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:06.256916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:06.264662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:06.265159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:06.265637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:06.266368 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:06.266803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:06.267229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:06.272168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2fb0eb3b-f58b-4dfb-9463-01a837071e59 req-1cdcc56e-a4bb-4ae1-80c2-f00e469fcd5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b53f1e-1f28-47cc-a7d2-0c41d4874352", "tag": "6cb475a7-637f-4cfe-8f12-984b6f41e11a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:06.288256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fb0eb3b-f58b-4dfb-9463-01a837071e59 req-1cdcc56e-a4bb-4ae1-80c2-f00e469fcd5b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:06.289619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fb0eb3b-f58b-4dfb-9463-01a837071e59 req-1cdcc56e-a4bb-4ae1-80c2-f00e469fcd5b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:06.290101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fb0eb3b-f58b-4dfb-9463-01a837071e59 req-1cdcc56e-a4bb-4ae1-80c2-f00e469fcd5b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:06.302887 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2fb0eb3b-f58b-4dfb-9463-01a837071e59 req-1cdcc56e-a4bb-4ae1-80c2-f00e469fcd5b service nova] Creating event network-changed:6cb475a7-637f-4cfe-8f12-984b6f41e11a for instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 on n-h1-master-1 Oct 24 09:55:06.308433 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2fb0eb3b-f58b-4dfb-9463-01a837071e59 req-1cdcc56e-a4bb-4ae1-80c2-f00e469fcd5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041544 Oct 24 09:55:06.309912 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3569/7310] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:55:06.517537 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:06.526099 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d29ada9e-bd65-4b04-bd21-275e6868ebdb tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1317 microversion: 2.1 time: 0.274036 Oct 24 09:55:06.526605 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3742/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:06 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:07.551765 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:07.552445 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:07.559476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:07.559970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:07.560416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:07.561110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:07.561599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:07.562037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:07.694664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:07.702468 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a486511-da4c-47ae-95fb-36575939ac39 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1317 microversion: 2.1 time: 0.155221 Oct 24 09:55:07.703040 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3570/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:07 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:08.725913 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:08.726659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:08.733557 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:08.734052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:08.734494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:08.735208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:08.735671 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:08.736109 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:08.865407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:08.873727 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00ff2e3b-756b-4084-b565-23d079ea5a1e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1317 microversion: 2.1 time: 0.151748 Oct 24 09:55:08.874304 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3743/7313] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:08 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:09.897215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:09.897875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:09.901438 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:09.907263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:09.907764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:09.908221 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:09.908935 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:09.909446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:09.909893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:10.038471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:10.046865 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d383a087-49cf-4926-b697-5bd5711c3a8c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1317 microversion: 2.1 time: 0.153536 Oct 24 09:55:10.047441 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3571/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:09 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:10.495490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2b92bbe7-8bde-40d7-8dfe-54b17a73f599 req-93647368-c96e-4da3-ae28-97e2c9e193e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b53f1e-1f28-47cc-a7d2-0c41d4874352", "name": "network-vif-plugged", "status": "completed", "tag": "6cb475a7-637f-4cfe-8f12-984b6f41e11a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:10.504925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b92bbe7-8bde-40d7-8dfe-54b17a73f599 req-93647368-c96e-4da3-ae28-97e2c9e193e6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:10.505429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b92bbe7-8bde-40d7-8dfe-54b17a73f599 req-93647368-c96e-4da3-ae28-97e2c9e193e6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:10.505864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2b92bbe7-8bde-40d7-8dfe-54b17a73f599 req-93647368-c96e-4da3-ae28-97e2c9e193e6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:10.516628 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2b92bbe7-8bde-40d7-8dfe-54b17a73f599 req-93647368-c96e-4da3-ae28-97e2c9e193e6 service nova] Creating event network-vif-plugged:6cb475a7-637f-4cfe-8f12-984b6f41e11a for instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 on n-h1-master-1 Oct 24 09:55:10.521737 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2b92bbe7-8bde-40d7-8dfe-54b17a73f599 req-93647368-c96e-4da3-ae28-97e2c9e193e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089913 Oct 24 09:55:10.522340 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3744/7315] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:55:11.070341 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:11.070874 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:11.077705 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:11.078201 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:11.078652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:11.079350 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:11.079816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:11.080255 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:11.211511 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:11.220060 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bd651f1-565b-46ff-bcd5-3febd650055e tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1317 microversion: 2.1 time: 0.154107 Oct 24 09:55:11.220654 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3572/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:11 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:55:12.240480 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:12.244801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:12.245541 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:12.251999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:12.252486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:12.252927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:12.253645 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:12.254103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:12.254532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:12.381870 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:12.390163 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b1d3457-63fd-48f4-b84b-46009f7cbaa2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.151517 Oct 24 09:55:12.390741 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3745/7317] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:12 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:12.451268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1642814285", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "174526d5-1d71-4cd3-86a1-171f963c3432"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:12.504068 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] validate_networks() for [('174526d5-1d71-4cd3-86a1-171f963c3432', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:55:12.919235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:55:12.919669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:55:12.920149 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:55:12.920562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:55:12.920977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:55:12.929687 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:12.930183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:12.930632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:12.931358 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:12.931817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:12.932251 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:12.948701 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Getting quotas for project 7fb13907ffea4abdbc6ce84f83038f44. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:55:12.953951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Getting quotas for user 7a77edfe753f40daaa8b0c00ccb18b47 and project 7fb13907ffea4abdbc6ce84f83038f44. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:55:12.966442 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:55:12.968668 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:55:13.016021 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98818db6-df74-485d-90fd-e058ca5e65c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568526 Oct 24 09:55:13.016668 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3573/7318] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:55:13.028222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08ef2c56-eca4-484f-82ab-8d14aa2829d7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:13.028842 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08ef2c56-eca4-484f-82ab-8d14aa2829d7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:13.080467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-08ef2c56-eca4-484f-82ab-8d14aa2829d7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:13.087908 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08ef2c56-eca4-484f-82ab-8d14aa2829d7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1217 microversion: 2.1 time: 0.063502 Oct 24 09:55:13.089326 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3746/7319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:13 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:14.114323 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:14.115057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:14.123890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:14.124408 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:14.124861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:14.125601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:14.126065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:14.126507 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:14.227049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:14.239327 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-597dbfc9-1b01-45b0-8838-1a5a4fd23daf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1277 microversion: 2.1 time: 0.132336 Oct 24 09:55:14.249418 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3574/7320] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:14 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:15.264269 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:15.264915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:15.272357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:15.272875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:15.273844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:15.274536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:15.274988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:15.275416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:15.409835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:15.418521 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8d1cd30e-ba92-46e6-bc1d-52254a1199ef tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1317 microversion: 2.1 time: 0.158105 Oct 24 09:55:15.433330 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3747/7321] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:15 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:15.680559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4d29c0de-07f2-4b2f-9d2f-661a382c97ca req-43d03382-70f2-476f-a83a-2fa205664d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a039c54a-2ce2-4c61-850d-8568ff47980e", "tag": "29d61050-a3a0-4032-b948-a82945b32f94"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:15.686270 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:15.693047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4d29c0de-07f2-4b2f-9d2f-661a382c97ca req-43d03382-70f2-476f-a83a-2fa205664d49 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:15.693727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4d29c0de-07f2-4b2f-9d2f-661a382c97ca req-43d03382-70f2-476f-a83a-2fa205664d49 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:15.694094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4d29c0de-07f2-4b2f-9d2f-661a382c97ca req-43d03382-70f2-476f-a83a-2fa205664d49 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:15.713782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4d29c0de-07f2-4b2f-9d2f-661a382c97ca req-43d03382-70f2-476f-a83a-2fa205664d49 service nova] Creating event network-changed:29d61050-a3a0-4032-b948-a82945b32f94 for instance a039c54a-2ce2-4c61-850d-8568ff47980e on n-h2-master-1 Oct 24 09:55:15.718923 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4d29c0de-07f2-4b2f-9d2f-661a382c97ca req-43d03382-70f2-476f-a83a-2fa205664d49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105782 Oct 24 09:55:15.719540 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3575/7322] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:55:16.446928 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:16.447546 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:16.454369 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:16.454855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:16.455295 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:16.455983 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:16.456438 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:16.456864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:16.587051 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:16.594705 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b07306a8-a642-4c33-b4ac-ab79fc1e010a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1317 microversion: 2.1 time: 0.152322 Oct 24 09:55:16.595294 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3748/7323] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:16 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:17.618008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:17.618729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:17.626159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:17.626652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:17.627102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:17.627798 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:17.628263 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:17.628703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:17.762978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:17.770779 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-582ab22b-296a-4b24-98b8-cca7ee92bcc8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1317 microversion: 2.1 time: 0.157137 Oct 24 09:55:17.771352 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3576/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:17 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:18.794678 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:18.795261 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:18.802122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:18.802602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:18.803035 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:18.803721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:18.804683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:18.805105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:18.937675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:18.945876 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aed7b8cd-f08b-493d-a426-aef1f38ffb27 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1317 microversion: 2.1 time: 0.155213 Oct 24 09:55:18.946447 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3749/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:18 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:19.968878 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:19.969542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:19.976872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:19.977386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:19.977854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:19.978541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:19.979001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:19.979434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:20.106560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:20.114100 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8d2e1d29-1128-43c7-9d8e-a7c4bc59c031 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1317 microversion: 2.1 time: 0.149162 Oct 24 09:55:20.114663 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3577/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:19 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:20.345479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e8ea8ed0-1de6-4bcd-9af8-e8fd59b25065 req-9edefe31-1248-4c6f-94f4-79168934c5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a039c54a-2ce2-4c61-850d-8568ff47980e", "name": "network-vif-plugged", "status": "completed", "tag": "29d61050-a3a0-4032-b948-a82945b32f94"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:20.357731 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e8ea8ed0-1de6-4bcd-9af8-e8fd59b25065 req-9edefe31-1248-4c6f-94f4-79168934c5ba service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:20.358268 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e8ea8ed0-1de6-4bcd-9af8-e8fd59b25065 req-9edefe31-1248-4c6f-94f4-79168934c5ba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:20.359141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e8ea8ed0-1de6-4bcd-9af8-e8fd59b25065 req-9edefe31-1248-4c6f-94f4-79168934c5ba service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:20.370702 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e8ea8ed0-1de6-4bcd-9af8-e8fd59b25065 req-9edefe31-1248-4c6f-94f4-79168934c5ba service nova] Creating event network-vif-plugged:29d61050-a3a0-4032-b948-a82945b32f94 for instance a039c54a-2ce2-4c61-850d-8568ff47980e on n-h2-master-1 Oct 24 09:55:20.375818 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e8ea8ed0-1de6-4bcd-9af8-e8fd59b25065 req-9edefe31-1248-4c6f-94f4-79168934c5ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Oct 24 09:55:20.376422 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3750/7327] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:55:21.137582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:21.138210 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:21.145284 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:21.145835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:21.146297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:21.147019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:21.147492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:21.148435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:21.280495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:21.288102 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d2b4168-6648-48b2-895a-d02bf014b145 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1317 microversion: 2.1 time: 0.154524 Oct 24 09:55:21.288677 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3578/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:21 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:22.311793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:22.312514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:22.319843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:22.320334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:22.320779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:22.321503 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:22.321965 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:22.322396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:22.448956 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:22.456667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e59cc87-8dfd-4c0d-94a0-1a5cfb3a57cf tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1506 microversion: 2.1 time: 0.149139 Oct 24 09:55:22.457245 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3751/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:22 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:22.479441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:22.479962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:22.486698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:22.487193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:22.487966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:22.488679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:22.489148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:22.489614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:22.515253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:55:22.587801 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1b14bd2-e421-4d10-a0a4-29cf616476f4 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 204 len: 0 microversion: 2.1 time: 0.111833 Oct 24 09:55:22.588399 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3579/7330] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:55:22 2022] DELETE /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:55:22.596974 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:22.597622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:22.603633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:22.604127 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:22.604568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:22.605255 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:22.605738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:22.606165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:22.738524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:22.746911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6b81bed-41cd-4398-8c20-fe3a8f750a71 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1512 microversion: 2.1 time: 0.154262 Oct 24 09:55:22.747505 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3752/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:22 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:23.770816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:23.771527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:23.773492 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:23.774163 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=16 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:23.784869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:23.785393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:23.785844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:23.786556 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:23.787802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:23.788760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:23.916032 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:23.923715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08bcf5ed-d012-44a6-b58f-e6d357aa97b7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1512 microversion: 2.1 time: 0.157076 Oct 24 09:55:23.924295 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3580/7332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:23 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:24.463628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-b706b1c2-61f1-4cbe-b629-7ae203bc1735 req-b8b3150c-2677-4b41-9335-47def484de19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a039c54a-2ce2-4c61-850d-8568ff47980e", "name": "network-vif-deleted", "tag": "29d61050-a3a0-4032-b948-a82945b32f94"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:24.470894 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:24.479559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b706b1c2-61f1-4cbe-b629-7ae203bc1735 req-b8b3150c-2677-4b41-9335-47def484de19 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:24.480049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b706b1c2-61f1-4cbe-b629-7ae203bc1735 req-b8b3150c-2677-4b41-9335-47def484de19 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:24.480488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-b706b1c2-61f1-4cbe-b629-7ae203bc1735 req-b8b3150c-2677-4b41-9335-47def484de19 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:24.500298 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-b706b1c2-61f1-4cbe-b629-7ae203bc1735 req-b8b3150c-2677-4b41-9335-47def484de19 service nova] Creating event network-vif-deleted:29d61050-a3a0-4032-b948-a82945b32f94 for instance a039c54a-2ce2-4c61-850d-8568ff47980e on n-h2-master-1 Oct 24 09:55:24.506897 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-b706b1c2-61f1-4cbe-b629-7ae203bc1735 req-b8b3150c-2677-4b41-9335-47def484de19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047616 Oct 24 09:55:24.508367 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3753/7333] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:55:24.946716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:24.947348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:24.954216 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:24.954714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:24.955166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:24.955940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:24.956393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:24.956839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:24.989639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:24.990135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:24.990602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:24.991060 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lazy-loading 'fault' on Instance uuid a039c54a-2ce2-4c61-850d-8568ff47980e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:55:25.033160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:25.042310 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61de1974-a620-4337-8e42-222b86adf8d8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 200 len: 1307 microversion: 2.1 time: 0.100086 Oct 24 09:55:25.042895 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3581/7334] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:24 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:26.069467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:26.070050 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.076139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.076641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.077071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.077780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.078228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.078647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.091551 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] HTTP exception thrown: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e HTTP/1.1 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a039c54a-2ce2-4c61-850d-8568ff47980e'} Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:26.093168 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 404 to user: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-81758f7d-7a22-4cac-bf0a-c1c32fcb4673 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 404 len: 111 microversion: 2.1 time: 0.030338 Oct 24 09:55:26.098487 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3754/7335] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:26 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:55:26.104336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:26.104993 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.111831 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.112320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.112768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.113499 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.113968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.114416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.240389 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:26.248616 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c41eec85-7dbb-430a-814c-fdd53891c059 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.148624 Oct 24 09:55:26.249189 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3582/7336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:26 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:26.271441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-392d3cb2-4f15-45d3-98ad-8acb8ea0e416 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:26.273698 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-392d3cb2-4f15-45d3-98ad-8acb8ea0e416 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 6f5f5ac6-5de5-46df-b142-b6cc561ded9d] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.279147 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-392d3cb2-4f15-45d3-98ad-8acb8ea0e416 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] HTTP exception thrown: Instance 6f5f5ac6-5de5-46df-b142-b6cc561ded9d could not be found. Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-392d3cb2-4f15-45d3-98ad-8acb8ea0e416 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/6f5f5ac6-5de5-46df-b142-b6cc561ded9d/action HTTP/1.1 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 32 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: {"resize": {"flavorRef": "452"}} Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 6f5f5ac6-5de5-46df-b142-b6cc561ded9d could not be found. Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '6f5f5ac6-5de5-46df-b142-b6cc561ded9d', 'body': {'resize': {'flavorRef': '452'}}} Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5f5ac6-5de5-46df-b142-b6cc561ded9d could not be found. Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:55:26.280940 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5f5ac6-5de5-46df-b142-b6cc561ded9d could not be found. Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5f5ac6-5de5-46df-b142-b6cc561ded9d could not be found. Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-392d3cb2-4f15-45d3-98ad-8acb8ea0e416 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 404 to user: Instance 6f5f5ac6-5de5-46df-b142-b6cc561ded9d could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-392d3cb2-4f15-45d3-98ad-8acb8ea0e416 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "POST /compute/v2.1/servers/6f5f5ac6-5de5-46df-b142-b6cc561ded9d/action" status: 404 len: 111 microversion: 2.1 time: 0.014865 Oct 24 09:55:26.286465 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3755/7337] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:55:26 2022] POST /compute/v2.1/servers/6f5f5ac6-5de5-46df-b142-b6cc561ded9d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:55:26.290748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:26.291401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.297208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.297733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.298183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.298879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.299349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.299788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.428527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:26.436673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fdc34d33-5472-4e80-9e9d-e3c1c1462e33 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.149759 Oct 24 09:55:26.437238 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3583/7338] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:26 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:26.460128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:26.460741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.467525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.468008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.468444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.469129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.469620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.470052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.597016 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:26.604778 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a6957cd-ee1b-4da7-a8bc-344f694155da tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.148464 Oct 24 09:55:26.605362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3756/7339] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:26 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:26.626813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "04969e8c-1982-4892-b727-d163a5f05eee"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:26.629139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.635963 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.636456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.636902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.637632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.638451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.638583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.643593 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:26.670029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:26.675196 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] HTTP exception thrown: Flavor 04969e8c-1982-4892-b727-d163a5f05eee could not be found. Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352/action HTTP/1.1 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 65 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: {"resize": {"flavorRef": "04969e8c-1982-4892-b727-d163a5f05eee"}} Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: exception: Flavor 04969e8c-1982-4892-b727-d163a5f05eee could not be found. Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '35b53f1e-1f28-47cc-a7d2-0c41d4874352', 'body': {'resize': {'flavorRef': '04969e8c-1982-4892-b727-d163a5f05eee'}}} Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:26.677106 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 04969e8c-1982-4892-b727-d163a5f05eee could not be found. Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 04969e8c-1982-4892-b727-d163a5f05eee could not be found. Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 04969e8c-1982-4892-b727-d163a5f05eee could not be found. Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 400 to user: Flavor 04969e8c-1982-4892-b727-d163a5f05eee could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-66cd57a8-8c3c-4a32-b80e-742fecb854b3 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "POST /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352/action" status: 400 len: 107 microversion: 2.1 time: 0.055637 Oct 24 09:55:26.681488 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3584/7340] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:55:26 2022] POST /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352/action => generated 107 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:55:26.687604 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:26.688222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.694277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.695334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.695775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.696465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.696920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.697378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.826962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:26.834625 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c5c1f839-e4ab-49cc-98f9-db38ae9931fc tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.150964 Oct 24 09:55:26.835729 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3757/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:26 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:26.858699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:26.859332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:26.865340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.865844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.866839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.867646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:26.868122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:26.868565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:26.995157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:27.002999 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a8a3625-1f5b-4baf-8353-9ea62920c149 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.148184 Oct 24 09:55:27.003577 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3585/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:26 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:27.025726 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7bd6f73-8699-4b6d-aedd-49b3fe2381f7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7bd6f73-8699-4b6d-aedd-49b3fe2381f7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: request: POST /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352/action HTTP/1.1 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 29 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: {"resize": {"flavorRef": ""}} Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '35b53f1e-1f28-47cc-a7d2-0c41d4874352', 'body': {'resize': {'flavorRef': ''}}} Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '' Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.029266 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7bd6f73-8699-4b6d-aedd-49b3fe2381f7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7bd6f73-8699-4b6d-aedd-49b3fe2381f7 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "POST /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352/action" status: 400 len: 113 microversion: 2.1 time: 0.009095 Oct 24 09:55:27.034656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3758/7343] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:55:27 2022] POST /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 09:55:27.038910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:27.039564 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:27.045648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.046150 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.046607 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.047318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.047789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.048285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.182898 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:27.190638 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e8bcb10f-6c3d-4131-88c0-07b924acef03 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1505 microversion: 2.1 time: 0.155455 Oct 24 09:55:27.191211 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3586/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:27 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:55:27.217642 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:27.218152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:27.225163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.226230 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.226678 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.227376 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.227836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.228269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.241204 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] HTTP exception thrown: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e HTTP/1.1 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: exception: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'a039c54a-2ce2-4c61-850d-8568ff47980e'} Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:55:27.243307 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 404 to user: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e68bb063-25ab-4963-84bd-dd55cbe7265c tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 404 len: 111 microversion: 2.1 time: 0.031705 Oct 24 09:55:27.247508 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3759/7345] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:55:27 2022] DELETE /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:55:27.253079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:27.253733 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: a039c54a-2ce2-4c61-850d-8568ff47980e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:27.259684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.260182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.260629 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.261345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.261817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.262259 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.275564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] HTTP exception thrown: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e HTTP/1.1 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: exception: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'a039c54a-2ce2-4c61-850d-8568ff47980e'} Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:27.277083 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 404 to user: Instance a039c54a-2ce2-4c61-850d-8568ff47980e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a5f3c0b-f361-47fe-a709-6b6ff3223f66 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e" status: 404 len: 111 microversion: 2.1 time: 0.029286 Oct 24 09:55:27.282288 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3587/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:27 2022] GET /compute/v2.1/servers/a039c54a-2ce2-4c61-850d-8568ff47980e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:55:27.287882 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:27.288934 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:27.294833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.295320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.295759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.296444 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.296902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.297393 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.322390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:55:27.394825 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-146dca6f-572b-4642-aacf-28b842bfe8f2 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "DELETE /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 204 len: 0 microversion: 2.1 time: 0.110391 Oct 24 09:55:27.395511 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3760/7347] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:55:27 2022] DELETE /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:55:27.404585 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:27.405502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:27.411643 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.412141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.412589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.413860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:27.414324 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:27.414760 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:27.541853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:27.549472 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e8d3afc-f372-4dd6-aa1e-e15df9293ee8 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1511 microversion: 2.1 time: 0.149501 Oct 24 09:55:27.550081 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3588/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:27 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:28.573745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:28.574383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:28.581101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:28.581608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:28.582045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:28.582723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:28.583175 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:28.583594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:28.716843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:28.724526 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-feb416a0-53da-4a80-9ae7-f1b1a9caa9c0 tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1511 microversion: 2.1 time: 0.155139 Oct 24 09:55:28.725087 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3761/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:28 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:29.413616 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d42a7832-7d8d-43a6-9fd5-7743300d98ec req-dfcc667a-d2e1-4628-a357-13bebb8b5139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b53f1e-1f28-47cc-a7d2-0c41d4874352", "name": "network-vif-deleted", "tag": "6cb475a7-637f-4cfe-8f12-984b6f41e11a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:55:29.423078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d42a7832-7d8d-43a6-9fd5-7743300d98ec req-dfcc667a-d2e1-4628-a357-13bebb8b5139 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:29.423575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d42a7832-7d8d-43a6-9fd5-7743300d98ec req-dfcc667a-d2e1-4628-a357-13bebb8b5139 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:29.424012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d42a7832-7d8d-43a6-9fd5-7743300d98ec req-dfcc667a-d2e1-4628-a357-13bebb8b5139 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:29.436991 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d42a7832-7d8d-43a6-9fd5-7743300d98ec req-dfcc667a-d2e1-4628-a357-13bebb8b5139 service nova] Creating event network-vif-deleted:6cb475a7-637f-4cfe-8f12-984b6f41e11a for instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 on n-h1-master-1 Oct 24 09:55:29.442684 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d42a7832-7d8d-43a6-9fd5-7743300d98ec req-dfcc667a-d2e1-4628-a357-13bebb8b5139 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098496 Oct 24 09:55:29.444393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3589/7350] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:55:29.748551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:29.749106 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:29.751929 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:29.757755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:29.758262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:29.758698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:29.759454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:29.759959 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:29.760435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:29.765218 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:29.794748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:29.795244 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:29.795677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:29.796391 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lazy-loading 'fault' on Instance uuid 35b53f1e-1f28-47cc-a7d2-0c41d4874352 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:55:29.841633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a77edfe753f40daaa8b0c00ccb18b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb13907ffea4abdbc6ce84f83038f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:55:29.849352 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b07afb88-9c59-4c08-85ba-432c00984cba tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 200 len: 1307 microversion: 2.1 time: 0.104751 Oct 24 09:55:29.849953 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3762/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:29 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:55:30.873635 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:55:30.874349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] [instance: 35b53f1e-1f28-47cc-a7d2-0c41d4874352] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:55:30.877108 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:55:30.877237 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 09:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 (ip 10.222.0.25) !!! Oct 24 09:55:30.887904 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:30.888411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:30.888873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:30.889606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:55:30.890110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:55:30.890557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:55:30.904417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] HTTP exception thrown: Instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 could not be found. Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Request method failure captured: Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 HTTP/1.1 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmDyEMX5-g7PTA4876kRhK3j35nE-ZCLOi8L_VEzMgvmVCwlsIVpuGxFp0Kumi6IvgMiosCBx3Q3HzQx8vmKLDM9yz7YI0N4Y32DfpqFOMITsggqu0HwCsICk_twkIwBoQ77VQx0CeAlIMjXTx6epXwBdQzttbIjrThafexrXcryrNk Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fb13907ffea4abdbc6ce84f83038f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fb13907ffea4abdbc6ce84f83038f44"}]}] Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 7fb13907ffea4abdbc6ce84f83038f44 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServersNegativeTestJSON-908369313 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 7a77edfe753f40daaa8b0c00ccb18b47 Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-ServersNegativeTestJSON-908369313-project Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 could not be found. Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '35b53f1e-1f28-47cc-a7d2-0c41d4874352'} Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 could not be found. Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 could not be found. Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:55:30.906346 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 could not be found. Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] Returning 404 to user: Instance 35b53f1e-1f28-47cc-a7d2-0c41d4874352 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afebad20-0037-4334-87d5-09c24870707a tempest-ServersNegativeTestJSON-908369313 tempest-ServersNegativeTestJSON-908369313-project] 10.222.0.25 "GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352" status: 404 len: 111 microversion: 2.1 time: 0.038524 Oct 24 09:55:30.911105 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3590/7352] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:55:30 2022] GET /compute/v2.1/servers/35b53f1e-1f28-47cc-a7d2-0c41d4874352 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:56:04.121457 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:56:04.122090 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 09:56:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 24 09:56:04.123655 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:04.130165 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:04.415540 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd26a0da-b016-4ffa-96cd-a820c9c7e162 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: .version_select at 0x7f8daaf9ce50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1741596115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7ajIfZ/zOHG4uey7LVSN1biK3KiGqxmidFk6QOuwJnMDSdWSqDMAjLQJ/cZ9WjodPO2//gK9bNJKktD2/Y0PtvSIVJHMZI4cUx0o14YUZsKVCI+RLGdHtKJsL7rIceJA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:04.439126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cd26a0da-b016-4ffa-96cd-a820c9c7e162 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:56:04.444894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-cd26a0da-b016-4ffa-96cd-a820c9c7e162 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for user ce547983f5274f288dfc88a36e234e19 and project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:56:04.472495 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd26a0da-b016-4ffa-96cd-a820c9c7e162 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.357968 Oct 24 09:56:04.473434 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3763/7353] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:56:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:04.529739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-983471592", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1741596115", "networks": [{"uuid": "ce677c8d-bd1d-429f-b49b-473654c1572a"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:04.553403 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:04.554168 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=26 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:04.591842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] validate_networks() for [('ce677c8d-bd1d-429f-b49b-473654c1572a', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:56:04.973563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:56:04.974079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:56:04.974640 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:56:04.975653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:56:04.976156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:56:04.986498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:04.987086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:04.987538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:04.988277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:04.988749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:04.989192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:05.006317 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:56:05.011563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for user ce547983f5274f288dfc88a36e234e19 and project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:56:05.024184 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:56:05.026523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:56:05.074524 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9a20cc7-5d08-4d61-b2d3-71e102d450f3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549140 Oct 24 09:56:05.075387 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3591/7354] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:56:05.086178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a4badc6-727f-4111-9f62-5e216fbc6491 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:05.086799 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a4badc6-727f-4111-9f62-5e216fbc6491 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:05.140932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a4badc6-727f-4111-9f62-5e216fbc6491 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:05.148689 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a4badc6-727f-4111-9f62-5e216fbc6491 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1262 microversion: 2.1 time: 0.066386 Oct 24 09:56:05.149462 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3764/7355] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:05 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:06.173277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:06.173277 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:06.180749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:06.181399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:06.182076 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:06.183012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:06.184294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:06.184932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:06.254092 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:06.264397 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64c33460-01fc-4c4e-bd97-1b1affc5c8f8 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1322 microversion: 2.1 time: 0.096088 Oct 24 09:56:06.265715 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3592/7356] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:06 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:07.292132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:07.293593 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:07.312225 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:07.312723 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:07.313169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:07.314100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:07.314727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:07.315164 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:07.583273 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:07.591610 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f31f8ab1-183b-4524-9869-8f364ee4b8d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1362 microversion: 2.1 time: 0.303391 Oct 24 09:56:07.592658 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3765/7357] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:07 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:08.026522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ea8d7532-1bfc-4e99-9802-d447bfda7b85 req-0e2e2426-2f02-49fa-8155-dd43418cead3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e874678-547a-48ef-971a-3a23887d0c88", "tag": "9ef2cdfa-be3f-41e1-87d0-6ad365e718e8"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:08.042058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea8d7532-1bfc-4e99-9802-d447bfda7b85 req-0e2e2426-2f02-49fa-8155-dd43418cead3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:08.042606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea8d7532-1bfc-4e99-9802-d447bfda7b85 req-0e2e2426-2f02-49fa-8155-dd43418cead3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:08.043094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ea8d7532-1bfc-4e99-9802-d447bfda7b85 req-0e2e2426-2f02-49fa-8155-dd43418cead3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:08.057564 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ea8d7532-1bfc-4e99-9802-d447bfda7b85 req-0e2e2426-2f02-49fa-8155-dd43418cead3 service nova] Creating event network-changed:9ef2cdfa-be3f-41e1-87d0-6ad365e718e8 for instance 0e874678-547a-48ef-971a-3a23887d0c88 on n-h1-master-1 Oct 24 09:56:08.063931 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ea8d7532-1bfc-4e99-9802-d447bfda7b85 req-0e2e2426-2f02-49fa-8155-dd43418cead3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050014 Oct 24 09:56:08.064584 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3593/7358] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:08.614766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:08.615390 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:08.622205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:08.622694 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:08.623134 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:08.623821 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:08.624282 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:08.624710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:08.750930 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:08.759058 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4e8196e-b9a6-405e-9dc3-373015f578e7 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1362 microversion: 2.1 time: 0.148123 Oct 24 09:56:08.759631 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3766/7359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:08 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:09.783718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:09.784435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:09.791278 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:09.791769 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:09.792215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:09.792919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:09.793407 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:09.793849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:09.931030 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:09.939113 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e8260ff-c2f3-4761-b5d2-0941cded06dd tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1362 microversion: 2.1 time: 0.160745 Oct 24 09:56:09.939697 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3594/7360] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:09 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:10.963470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:10.964113 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:10.970900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:10.971394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:10.971835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:10.972527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:10.972985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:10.973446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:11.105893 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:11.113748 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b988b85-a700-4699-8aba-1c477d746e71 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1362 microversion: 2.1 time: 0.154736 Oct 24 09:56:11.114347 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3767/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:10 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:12.137075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:12.137724 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:12.144522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:12.145017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:12.145494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:12.146195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:12.147148 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:12.147582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:12.280849 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:12.288645 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5449bbd9-cbe1-4d6a-9684-a3e6039b173e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1362 microversion: 2.1 time: 0.155432 Oct 24 09:56:12.289211 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3595/7362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:12 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:12.838115 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9d1e45bb-0888-489a-af72-5931cbc443eb req-86453917-c903-4d6c-9875-ab693f875468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e874678-547a-48ef-971a-3a23887d0c88", "name": "network-vif-plugged", "status": "completed", "tag": "9ef2cdfa-be3f-41e1-87d0-6ad365e718e8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:12.848666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9d1e45bb-0888-489a-af72-5931cbc443eb req-86453917-c903-4d6c-9875-ab693f875468 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:12.849156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9d1e45bb-0888-489a-af72-5931cbc443eb req-86453917-c903-4d6c-9875-ab693f875468 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:12.849647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9d1e45bb-0888-489a-af72-5931cbc443eb req-86453917-c903-4d6c-9875-ab693f875468 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:12.860559 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9d1e45bb-0888-489a-af72-5931cbc443eb req-86453917-c903-4d6c-9875-ab693f875468 service nova] Creating event network-vif-plugged:9ef2cdfa-be3f-41e1-87d0-6ad365e718e8 for instance 0e874678-547a-48ef-971a-3a23887d0c88 on n-h1-master-1 Oct 24 09:56:12.865578 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9d1e45bb-0888-489a-af72-5931cbc443eb req-86453917-c903-4d6c-9875-ab693f875468 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031752 Oct 24 09:56:12.866181 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3768/7363] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:13.311542 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:13.312160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:13.319544 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:13.320031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:13.320470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:13.321163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:13.321659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:13.322096 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:13.450717 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:13.458317 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0250f061-be9e-470d-a395-4a75bece2318 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1362 microversion: 2.1 time: 0.150653 Oct 24 09:56:13.459656 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3596/7364] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:13 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:14.483314 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:14.484013 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:14.490110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:14.490666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:14.491105 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:14.491781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:14.492231 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:14.492654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:14.624906 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:14.633117 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5fc711c6-a81e-468e-a1a2-202ead780409 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1554 microversion: 2.1 time: 0.155041 Oct 24 09:56:14.633709 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3769/7365] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:14 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:14.656470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:14.657045 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:14.663895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:14.664390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:14.664843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:14.665604 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:14.666075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:14.666516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:14.799834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:14.808163 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d22f6a89-4a0b-4033-923b-c1dbc1309376 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1554 microversion: 2.1 time: 0.155828 Oct 24 09:56:14.808739 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3597/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:14 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:16.479708 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b80e7ce-4609-4182-860c-3f1bd169e70e"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:16.482177 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:16.484236 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:16.490355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:16.490839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:16.491278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:16.491966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:16.492420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:16.492846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:16.774191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4619995-4824-4657-b5a5-da9cf751dae5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298285 Oct 24 09:56:16.774819 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3770/7367] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:56:16 2022] POST /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:27.478811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:27.479343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:27.481258 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:27.482030 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:27.483763 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:27.484469 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:27.492276 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:27.492777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:27.493368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:27.494070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:27.494532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:27.494972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:27.573412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lazy-loading 'services' on Instance uuid 0e874678-547a-48ef-971a-3a23887d0c88 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:56:27.644705 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe2acbbe-842b-44d5-bfd0-a1734e3c277c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments/0b80e7ce-4609-4182-860c-3f1bd169e70e" status: 202 len: 0 microversion: 2.1 time: 0.169588 Oct 24 09:56:27.645426 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3598/7368] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:56:27 2022] DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments/0b80e7ce-4609-4182-860c-3f1bd169e70e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:56:27.652491 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:27.653462 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:27.658821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:27.661813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:27.671038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:27.671519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:27.671952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:27.672640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:27.673094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:27.673545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:27.709270 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43ef70e2-d39e-496f-8c47-ed45d6d7e5b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058100 Oct 24 09:56:27.709887 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3771/7369] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:56:27 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:28.723367 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:28.725775 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:28.732091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:28.732583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:28.733034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:28.733789 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:28.734265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:28.734707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:28.765400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cf776fd-cdc7-4879-ada7-85ef2ab5a4ec tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047146 Oct 24 09:56:28.765982 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3599/7370] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:56:28 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:29.778428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:29.780985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:29.788696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:29.789183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:29.789647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:29.790351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:29.790811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:29.791237 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:29.820507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7fd0501b-aed9-47eb-a9ab-0f8d09fc8b51 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046091 Oct 24 09:56:29.821082 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3772/7371] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:56:29 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:30.832568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:30.835360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:30.841558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:30.842061 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:30.842515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:30.843224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:30.843693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:30.844136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:30.873117 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b7fb32d1-7f3b-4f1d-a8dc-d2774ba97d26 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Oct 24 09:56:30.874040 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3600/7372] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:56:30 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:31.885989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:31.888449 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:31.894949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:31.895475 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:31.895918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:31.897106 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:31.897594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:31.898028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:31.928026 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f4d299c-ab8e-42eb-9a6b-b69d4ab1015a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046242 Oct 24 09:56:31.928607 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3773/7373] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:56:31 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:32.941708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:32.943893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:32.950771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:32.951262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:32.951707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:32.952400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:32.952861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:32.953320 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:32.985081 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-efc80be4-11e0-4bb8-aa3e-3bc928137bfb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047292 Oct 24 09:56:32.985743 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3601/7374] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:56:32 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:56:32.997088 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:32.997601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:33.004270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:33.004750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:33.005184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:33.006086 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:33.006538 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:33.006958 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:33.083507 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] HTTP exception thrown: Instance 0e874678-547a-48ef-971a-3a23887d0c88 is not attached to volume 0b80e7ce-4609-4182-860c-3f1bd169e70e Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Request method failure captured: Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments/0b80e7ce-4609-4182-860c-3f1bd169e70e HTTP/1.1 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmEv5RZmzuuDmqLEenZLaBcKaLQ4iXRb2gxsu89lwCzNn2pVSg7b95sncSnm_uLkbCOy2Xq1H5nvUaoNtL1IQekGNUZ38pJ0q8bLChKSlQHicTH8TwQ2XUOPbriFQagrncPIiTrq1i3ml2jyX0tfaQsBGHAWiRQiZTUuN9B1VoQ_K3M Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}] Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ce547983f5274f288dfc88a36e234e19 Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0e874678-547a-48ef-971a-3a23887d0c88 is not attached to volume 0b80e7ce-4609-4182-860c-3f1bd169e70e Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: action_args: {'server_id': '0e874678-547a-48ef-971a-3a23887d0c88', 'id': '0b80e7ce-4609-4182-860c-3f1bd169e70e'} Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0b80e7ce-4609-4182-860c-3f1bd169e70e. Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e874678-547a-48ef-971a-3a23887d0c88 is not attached to volume 0b80e7ce-4609-4182-860c-3f1bd169e70e Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:56:33.089603 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e874678-547a-48ef-971a-3a23887d0c88 is not attached to volume 0b80e7ce-4609-4182-860c-3f1bd169e70e Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Returning 404 to user: Instance 0e874678-547a-48ef-971a-3a23887d0c88 is not attached to volume 0b80e7ce-4609-4182-860c-3f1bd169e70e {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9477f030-afc9-4741-a537-1f6a76975f78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments/0b80e7ce-4609-4182-860c-3f1bd169e70e" status: 404 len: 154 microversion: 2.1 time: 0.098039 Oct 24 09:56:33.094824 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3774/7375] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:56:32 2022] DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88/os-volume_attachments/0b80e7ce-4609-4182-860c-3f1bd169e70e => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:56:36.447986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:36.448560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:36.455313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:36.455917 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:36.456366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:36.457065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:36.457571 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:36.458010 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:36.483403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:56:36.561183 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ae70ca2c-c0cd-4834-94ac-5ad32b34c882 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 204 len: 0 microversion: 2.1 time: 0.116783 Oct 24 09:56:36.563508 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3602/7376] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:56:36 2022] DELETE /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:56:36.572533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:36.573272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:36.580894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:36.581525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:36.582038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:36.582806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:36.583366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:36.583880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:36.715854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:36.723603 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6fc703d9-ab94-4a67-9f9a-037b76b1c28b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1560 microversion: 2.1 time: 0.157197 Oct 24 09:56:36.724175 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3775/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:36 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:37.747568 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:37.748285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:37.755665 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:37.756162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:37.756614 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:37.757342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:37.757815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:37.758256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:37.886714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:37.894482 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e852a145-f99c-451b-b493-c610b308b705 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1560 microversion: 2.1 time: 0.151158 Oct 24 09:56:37.895059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3603/7378] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:37 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:38.765023 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ce94c165-6164-431a-8310-a3c91acb8b40 req-02413087-53f3-4440-a5fa-4fb5a6d94f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e874678-547a-48ef-971a-3a23887d0c88", "name": "network-vif-deleted", "tag": "9ef2cdfa-be3f-41e1-87d0-6ad365e718e8"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:38.775641 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ce94c165-6164-431a-8310-a3c91acb8b40 req-02413087-53f3-4440-a5fa-4fb5a6d94f85 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:38.776121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ce94c165-6164-431a-8310-a3c91acb8b40 req-02413087-53f3-4440-a5fa-4fb5a6d94f85 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:38.776555 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ce94c165-6164-431a-8310-a3c91acb8b40 req-02413087-53f3-4440-a5fa-4fb5a6d94f85 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:38.787983 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ce94c165-6164-431a-8310-a3c91acb8b40 req-02413087-53f3-4440-a5fa-4fb5a6d94f85 service nova] Creating event network-vif-deleted:9ef2cdfa-be3f-41e1-87d0-6ad365e718e8 for instance 0e874678-547a-48ef-971a-3a23887d0c88 on n-h1-master-1 Oct 24 09:56:38.793204 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ce94c165-6164-431a-8310-a3c91acb8b40 req-02413087-53f3-4440-a5fa-4fb5a6d94f85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Oct 24 09:56:38.793835 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3776/7379] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:38.918911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:38.919920 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:38.926889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:38.927951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:38.928399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:38.929164 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:38.929655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:38.930094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:38.962039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:38.962535 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:38.962984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:38.963440 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lazy-loading 'fault' on Instance uuid 0e874678-547a-48ef-971a-3a23887d0c88 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:56:39.009274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:39.017646 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-11c44f4d-c636-4b48-be20-457930edd44d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 200 len: 1352 microversion: 2.1 time: 0.102632 Oct 24 09:56:39.018234 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3604/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:38 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:40.042751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:40.043479 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e874678-547a-48ef-971a-3a23887d0c88] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:40.049619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:40.050095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:40.050532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:40.051224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:40.051675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:40.052593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:40.066746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] HTTP exception thrown: Instance 0e874678-547a-48ef-971a-3a23887d0c88 could not be found. Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Request method failure captured: Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 HTTP/1.1 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmEv5RZmzuuDmqLEenZLaBcKaLQ4iXRb2gxsu89lwCzNn2pVSg7b95sncSnm_uLkbCOy2Xq1H5nvUaoNtL1IQekGNUZ38pJ0q8bLChKSlQHicTH8TwQ2XUOPbriFQagrncPIiTrq1i3ml2jyX0tfaQsBGHAWiRQiZTUuN9B1VoQ_K3M Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}] Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ce547983f5274f288dfc88a36e234e19 Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0e874678-547a-48ef-971a-3a23887d0c88 could not be found. Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0e874678-547a-48ef-971a-3a23887d0c88'} Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e874678-547a-48ef-971a-3a23887d0c88 could not be found. Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e874678-547a-48ef-971a-3a23887d0c88 could not be found. Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:40.069110 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e874678-547a-48ef-971a-3a23887d0c88 could not be found. Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Returning 404 to user: Instance 0e874678-547a-48ef-971a-3a23887d0c88 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-877d9b42-ed16-42b2-adbd-099afcaa4d55 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88" status: 404 len: 111 microversion: 2.1 time: 0.033085 Oct 24 09:56:40.074779 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3777/7381] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:40 2022] GET /compute/v2.1/servers/0e874678-547a-48ef-971a-3a23887d0c88 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:56:40.079420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d5d24800-337e-4904-9d50-b6b0a261607b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '.version_select at 0x7f8da98cef70>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:40.103494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d5d24800-337e-4904-9d50-b6b0a261607b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1741596115" status: 202 len: 0 microversion: 2.1 time: 0.027869 Oct 24 09:56:40.104118 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3605/7382] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1741596115 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:56:40.121822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f443c81-f5f7-408f-9890-e22ecab8c9e6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: .version_select at 0x7f8da9ad0d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1595156705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgOaq/2RnU0qliVASRumBT4SDQu9VVmKb45TV0dsKgvk8kL6OjOeyPxUCLEkeqThaXqI/z1rxniKhr/E9FA1CX8w2ctQEnEvGGSlNXjx0ihkFwHO4Hvtzx+6Z3C7p5I3g=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:40.138157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2f443c81-f5f7-408f-9890-e22ecab8c9e6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:56:40.144247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2f443c81-f5f7-408f-9890-e22ecab8c9e6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for user ce547983f5274f288dfc88a36e234e19 and project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:56:40.168407 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f443c81-f5f7-408f-9890-e22ecab8c9e6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050663 Oct 24 09:56:40.169035 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3778/7383] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:56:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:40.224208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-233356379", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1595156705", "networks": [{"uuid": "ce677c8d-bd1d-429f-b49b-473654c1572a"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:40.278588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] validate_networks() for [('ce677c8d-bd1d-429f-b49b-473654c1572a', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:56:40.644342 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:56:40.644779 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:56:40.645264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:56:40.645705 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:56:40.646157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:56:40.655933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:40.656422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:40.656866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:40.657630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:40.658098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:40.658538 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:40.676125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:56:40.681912 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for user ce547983f5274f288dfc88a36e234e19 and project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:56:40.694058 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:56:40.696349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:56:40.744475 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a6c3635d-7d4c-4d78-9a5e-a93be1463be1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524185 Oct 24 09:56:40.745357 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3606/7384] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:56:40.756601 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58562e88-88fb-4bc5-ad30-9a5175a05644 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:40.757245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58562e88-88fb-4bc5-ad30-9a5175a05644 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:40.812320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-58562e88-88fb-4bc5-ad30-9a5175a05644 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:40.819935 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58562e88-88fb-4bc5-ad30-9a5175a05644 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1262 microversion: 2.1 time: 0.067298 Oct 24 09:56:40.820509 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3779/7385] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:40 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:41.844879 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:41.845598 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:41.853112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:41.858414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:41.858976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:41.859796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:41.860269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:41.860881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:41.932345 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:41.940960 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15d9fffb-d48b-413c-a67b-515dd4d36480 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1332 microversion: 2.1 time: 0.101278 Oct 24 09:56:41.941602 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3607/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:41 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:42.966843 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:42.967533 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:42.974898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:42.975517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:42.975966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:42.976667 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:42.977128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:42.977594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:43.180311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:43.188328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba3ed237-f81d-4eb9-a25b-40865e367175 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1362 microversion: 2.1 time: 0.225538 Oct 24 09:56:43.189897 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3780/7387] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:42 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:43.220991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5b5282c6-7473-4939-8cba-16051c9474cb req-b75d2bd9-9cc8-48ef-a74d-7ead3f8ad762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5d28fb-e370-470a-97da-8d0d586e42df", "tag": "b057ec02-7be6-43e5-a332-f5cf2e9bed4a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:43.234347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5b5282c6-7473-4939-8cba-16051c9474cb req-b75d2bd9-9cc8-48ef-a74d-7ead3f8ad762 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:43.235371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5b5282c6-7473-4939-8cba-16051c9474cb req-b75d2bd9-9cc8-48ef-a74d-7ead3f8ad762 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:43.235893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5b5282c6-7473-4939-8cba-16051c9474cb req-b75d2bd9-9cc8-48ef-a74d-7ead3f8ad762 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:43.250487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5b5282c6-7473-4939-8cba-16051c9474cb req-b75d2bd9-9cc8-48ef-a74d-7ead3f8ad762 service nova] Creating event network-changed:b057ec02-7be6-43e5-a332-f5cf2e9bed4a for instance 0e5d28fb-e370-470a-97da-8d0d586e42df on n-h1-master-1 Oct 24 09:56:43.255244 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5b5282c6-7473-4939-8cba-16051c9474cb req-b75d2bd9-9cc8-48ef-a74d-7ead3f8ad762 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039205 Oct 24 09:56:43.256481 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3608/7388] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:44.211894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:44.212512 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:44.219290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:44.219770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:44.220201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:44.220877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:44.221347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:44.221770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:44.350750 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:44.358396 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85152471-cbc9-4867-831c-2a071b0ea907 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1362 microversion: 2.1 time: 0.150959 Oct 24 09:56:44.358988 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3781/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:44 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:45.386079 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:45.386828 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:45.392944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:45.393488 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:45.393948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:45.394650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:45.395119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:45.395562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:45.530056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:45.538292 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8c61b79-22db-42cf-a475-d8e8b227c7c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1362 microversion: 2.1 time: 0.157841 Oct 24 09:56:45.539075 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3609/7390] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:45 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:46.562007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:46.562629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:46.570090 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:46.570583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:46.571024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:46.571741 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:46.572199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:46.572631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:46.706095 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:46.714856 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc99a58e-def2-42fc-aaa0-08445d9d81fb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1362 microversion: 2.1 time: 0.156787 Oct 24 09:56:46.715456 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3782/7391] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:46 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:46.964128 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f5a87e42-a8d1-47bd-a16d-269af25cfe10 req-4c521b27-f555-4e17-ba10-13dafc0bb5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5d28fb-e370-470a-97da-8d0d586e42df", "name": "network-vif-plugged", "status": "completed", "tag": "b057ec02-7be6-43e5-a332-f5cf2e9bed4a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:46.974606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f5a87e42-a8d1-47bd-a16d-269af25cfe10 req-4c521b27-f555-4e17-ba10-13dafc0bb5cb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:46.975102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f5a87e42-a8d1-47bd-a16d-269af25cfe10 req-4c521b27-f555-4e17-ba10-13dafc0bb5cb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:46.975553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f5a87e42-a8d1-47bd-a16d-269af25cfe10 req-4c521b27-f555-4e17-ba10-13dafc0bb5cb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:46.986658 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f5a87e42-a8d1-47bd-a16d-269af25cfe10 req-4c521b27-f555-4e17-ba10-13dafc0bb5cb service nova] Creating event network-vif-plugged:b057ec02-7be6-43e5-a332-f5cf2e9bed4a for instance 0e5d28fb-e370-470a-97da-8d0d586e42df on n-h1-master-1 Oct 24 09:56:46.991993 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f5a87e42-a8d1-47bd-a16d-269af25cfe10 req-4c521b27-f555-4e17-ba10-13dafc0bb5cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Oct 24 09:56:46.992591 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3610/7392] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:56:47.738461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:47.739076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:47.746363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:47.746845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:47.747281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:47.747970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:47.748428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:47.748859 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:47.875631 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:47.883838 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98feeb36-be25-4aff-b75e-7c06ea6b783b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1362 microversion: 2.1 time: 0.149343 Oct 24 09:56:47.884410 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3783/7393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:47 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:56:48.908484 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:48.909127 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:48.915973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:48.916473 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:48.916929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:48.917671 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:48.918151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:48.918595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:49.046869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:49.056134 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-137d3786-9540-4913-8af5-929c1ccdd548 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1555 microversion: 2.1 time: 0.153101 Oct 24 09:56:49.056729 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3611/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:48 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:49.079439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:56:49.080077 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:49.087017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:49.087508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:49.087947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:49.088637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:49.089101 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:49.089560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:49.223233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:56:49.230911 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7068386-e694-49f0-914b-af81d35c8b1f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1555 microversion: 2.1 time: 0.155318 Oct 24 09:56:49.231493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3784/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:56:49 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:56:50.737951 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23f3ad72-e5c3-4dab-997d-6a5ed8a80c37"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:56:50.740806 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:56:50.743618 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:50.744291 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:50.750194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:50.750685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:50.751129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:50.751823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:56:50.752280 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:56:50.752722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:56:51.015509 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-133e4609-e4ff-4f34-a49a-25dc232a7191 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281320 Oct 24 09:56:51.016290 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3612/7396] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:56:50 2022] POST /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:01.730455 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:01.730991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:01.733227 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:01.734032 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:01.734669 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=64 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:01.740582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:01.741071 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:01.741547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:01.742241 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:01.742704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:01.743129 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:01.822270 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lazy-loading 'services' on Instance uuid 0e5d28fb-e370-470a-97da-8d0d586e42df {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:57:01.890978 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3601f663-fb47-458b-903a-796a5f4cb2db tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments/23f3ad72-e5c3-4dab-997d-6a5ed8a80c37" status: 202 len: 0 microversion: 2.1 time: 0.164212 Oct 24 09:57:01.891614 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3785/7397] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:57:01 2022] DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments/23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:57:01.898683 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:01.899934 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:01.904838 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:01.907633 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:01.917332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:01.917801 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:01.918250 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:01.918955 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:01.919440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:01.919855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:01.952492 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8ec91abc-896b-463c-82ed-8768dbeebb63 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055615 Oct 24 09:57:01.953048 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3613/7398] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:01 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:02.966136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:02.968576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:02.974818 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:02.975298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:02.975738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:02.976424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:02.976902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:02.977344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:03.007160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06eff67f-8975-45f2-b560-aa503f32833c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Oct 24 09:57:03.007728 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3786/7399] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:02 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:04.019870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:04.022162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:04.029040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:04.029564 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:04.030018 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:04.030992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:04.031463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:04.031909 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:04.065989 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec151104-1850-44d4-bcfa-9e421de12ec3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050081 Oct 24 09:57:04.066588 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3614/7400] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:04 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:05.078482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:05.080716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:05.088160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:05.088681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:05.089123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:05.089852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:05.090316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:05.090749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:05.122819 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-743a5252-9f6d-43a5-b906-ddbc491c9255 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048347 Oct 24 09:57:05.123386 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3787/7401] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:05 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:06.135766 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:06.138066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:06.145072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:06.146177 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:06.146624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:06.147342 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:06.147805 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:06.148242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:06.179060 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-51138af8-f7bd-48d5-9ee7-3f9ad5528854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Oct 24 09:57:06.179629 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3615/7402] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:06 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:07.191773 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:07.194572 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:07.201370 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:07.201861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:07.202305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:07.202994 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:07.203456 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:07.203883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:07.232917 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77508ad1-eea0-4dca-a7cd-f2ed1d12bc72 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045164 Oct 24 09:57:07.233510 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3788/7403] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:07 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:57:07.244624 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:07.245119 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:07.251957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:07.252447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:07.252894 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:07.253626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:07.254093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:07.255161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:07.329929 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] HTTP exception thrown: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df is not attached to volume 23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Request method failure captured: Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments/23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 HTTP/1.1 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmEv5RZmzuuDmqLEenZLaBcKaLQ4iXRb2gxsu89lwCzNn2pVSg7b95sncSnm_uLkbCOy2Xq1H5nvUaoNtL1IQekGNUZ38pJ0q8bLChKSlQHicTH8TwQ2XUOPbriFQagrncPIiTrq1i3ml2jyX0tfaQsBGHAWiRQiZTUuN9B1VoQ_K3M Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}] Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ce547983f5274f288dfc88a36e234e19 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df is not attached to volume 23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': '0e5d28fb-e370-470a-97da-8d0d586e42df', 'id': '23f3ad72-e5c3-4dab-997d-6a5ed8a80c37'} Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23f3ad72-e5c3-4dab-997d-6a5ed8a80c37. Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df is not attached to volume 23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:07.331900 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df is not attached to volume 23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Returning 404 to user: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df is not attached to volume 23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-724bb999-9b9b-410d-a2d5-1cb0dad2a381 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments/23f3ad72-e5c3-4dab-997d-6a5ed8a80c37" status: 404 len: 154 microversion: 2.1 time: 0.093060 Oct 24 09:57:07.336939 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3616/7404] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:57:07 2022] DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df/os-volume_attachments/23f3ad72-e5c3-4dab-997d-6a5ed8a80c37 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:57:10.703350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:10.703915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:10.711446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:10.711941 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:10.712384 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:10.713077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:10.713576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:10.714008 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:10.739220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:57:10.817723 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-675733f9-f93e-4c53-bedb-f7c176101c9c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 204 len: 0 microversion: 2.1 time: 0.117516 Oct 24 09:57:10.818468 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3789/7405] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:57:10 2022] DELETE /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:57:10.827187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:10.827739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:10.835261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:10.835761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:10.836212 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:10.836919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:10.837594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:10.838039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:10.972888 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:10.980765 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5515f0f4-6811-432b-821c-9586baeabd37 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1561 microversion: 2.1 time: 0.157500 Oct 24 09:57:10.981347 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3617/7406] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:10 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:12.005055 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:12.005776 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:12.012602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:12.013081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:12.013550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:12.014233 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:12.014683 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:12.015131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:12.144142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:12.152561 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2f9c096-5004-4880-ac77-dae4644ee0b6 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1561 microversion: 2.1 time: 0.152175 Oct 24 09:57:12.153135 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3790/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:11 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:13.176882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:13.178156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:13.188277 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:13.188710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:13.189088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:13.190147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:13.190675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:13.191505 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:13.220007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c270a5da-419a-4f6a-8109-83adc8fa644a req-c393f326-c362-4df5-a343-c2f7b0890aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5d28fb-e370-470a-97da-8d0d586e42df", "name": "network-vif-deleted", "tag": "b057ec02-7be6-43e5-a332-f5cf2e9bed4a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:13.230253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c270a5da-419a-4f6a-8109-83adc8fa644a req-c393f326-c362-4df5-a343-c2f7b0890aff service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:13.230735 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c270a5da-419a-4f6a-8109-83adc8fa644a req-c393f326-c362-4df5-a343-c2f7b0890aff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:13.231169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c270a5da-419a-4f6a-8109-83adc8fa644a req-c393f326-c362-4df5-a343-c2f7b0890aff service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:13.243094 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c270a5da-419a-4f6a-8109-83adc8fa644a req-c393f326-c362-4df5-a343-c2f7b0890aff service nova] Creating event network-vif-deleted:b057ec02-7be6-43e5-a332-f5cf2e9bed4a for instance 0e5d28fb-e370-470a-97da-8d0d586e42df on n-h1-master-1 Oct 24 09:57:13.247853 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c270a5da-419a-4f6a-8109-83adc8fa644a req-c393f326-c362-4df5-a343-c2f7b0890aff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 Oct 24 09:57:13.248771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3791/7408] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:13.258578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:13.267845 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61596ecc-61de-42b7-a986-60b4ed45fdeb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 200 len: 1519 microversion: 2.1 time: 0.095628 Oct 24 09:57:13.268423 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3618/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:13 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 1519 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:14.294097 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:14.294807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: 0e5d28fb-e370-470a-97da-8d0d586e42df] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:14.301031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:14.302094 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:14.302533 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:14.303245 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:14.303703 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:14.304139 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:14.317216 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] HTTP exception thrown: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df could not be found. Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Request method failure captured: Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df HTTP/1.1 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmEv5RZmzuuDmqLEenZLaBcKaLQ4iXRb2gxsu89lwCzNn2pVSg7b95sncSnm_uLkbCOy2Xq1H5nvUaoNtL1IQekGNUZ38pJ0q8bLChKSlQHicTH8TwQ2XUOPbriFQagrncPIiTrq1i3ml2jyX0tfaQsBGHAWiRQiZTUuN9B1VoQ_K3M Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}] Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: ce547983f5274f288dfc88a36e234e19 Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df could not be found. Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '0e5d28fb-e370-470a-97da-8d0d586e42df'} Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df could not be found. Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df could not be found. Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:57:14.318846 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df could not be found. Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Returning 404 to user: Instance 0e5d28fb-e370-470a-97da-8d0d586e42df could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c39c1410-35d3-4b10-9d27-d353e58a1d0e tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df" status: 404 len: 111 microversion: 2.1 time: 0.031310 Oct 24 09:57:14.323722 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3792/7410] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:14 2022] GET /compute/v2.1/servers/0e5d28fb-e370-470a-97da-8d0d586e42df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:57:14.328927 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-752f0aa9-1b16-4e79-87be-835224f893b9 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '.version_select at 0x7f8daa12a4c0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:14.349092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-752f0aa9-1b16-4e79-87be-835224f893b9 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1595156705" status: 202 len: 0 microversion: 2.1 time: 0.024003 Oct 24 09:57:14.349733 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3619/7411] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1595156705 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 09:57:14.366645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dfd2cd83-0716-4e65-af1b-a87ee632ac5f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: .version_select at 0x7f8da9add1f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-312751151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK//JXDvxq7eWUPzVa0T9F/5UV9Wbw4NAfXKplF4tTmskBvySo7TXFry28iumVtNQ4KftxnmRChj6QUZ/njp5W3sHHlaLAmLfCYQLYsVEzvY5h4IvOiIk+VYu0Pr0a6Aeg=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:14.381918 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dfd2cd83-0716-4e65-af1b-a87ee632ac5f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:57:14.387685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-dfd2cd83-0716-4e65-af1b-a87ee632ac5f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for user ce547983f5274f288dfc88a36e234e19 and project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:57:14.409683 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dfd2cd83-0716-4e65-af1b-a87ee632ac5f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047375 Oct 24 09:57:14.410169 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3793/7412] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:57:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:14.461435 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1064732993", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-312751151", "networks": [{"uuid": "ce677c8d-bd1d-429f-b49b-473654c1572a"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:14.513578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] validate_networks() for [('ce677c8d-bd1d-429f-b49b-473654c1572a', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:57:14.891537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:57:14.891975 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:57:14.892457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:57:14.892873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:57:14.893288 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:57:14.902458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:14.902946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:14.903389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:14.904118 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:14.904575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:14.905008 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:14.922739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:57:14.927858 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Getting quotas for user ce547983f5274f288dfc88a36e234e19 and project f0f1d38b43d74ef0b8b3e40b8260e9fd. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:57:14.940457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:57:14.943253 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:57:14.988169 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9f49681-aefd-4de0-a6c8-8dab86a40815 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531176 Oct 24 09:57:14.989408 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3620/7413] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:57:15.000834 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f6f01b6-100d-4b80-bafb-c8f37094bf1b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:15.001748 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f6f01b6-100d-4b80-bafb-c8f37094bf1b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:15.057014 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f6f01b6-100d-4b80-bafb-c8f37094bf1b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:15.066540 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f6f01b6-100d-4b80-bafb-c8f37094bf1b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1262 microversion: 2.1 time: 0.069801 Oct 24 09:57:15.067149 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3794/7414] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:14 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:16.092272 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:16.093781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:16.102565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:16.103334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:16.103790 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:16.104521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:16.105000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:16.105466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:16.174139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:16.182543 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b94e060c-86f3-4a14-ba60-739fac6410a2 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1332 microversion: 2.1 time: 0.096445 Oct 24 09:57:16.183225 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3621/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:16 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:17.206944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:17.207703 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:17.215361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:17.215970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:17.216621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:17.217436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:17.217898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:17.218321 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:17.403120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:17.411729 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c5f61c4-95e9-4acd-a050-5caca66acf0a tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1362 microversion: 2.1 time: 0.209033 Oct 24 09:57:17.420366 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3795/7416] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:17 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:17.443608 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-08200853-33f7-4dfd-904a-d8073a7105a2 req-11ad81aa-b4ed-47c3-a6ce-6e67f8050a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e842d78e-18e9-4f08-b469-df610346b144", "tag": "c4947a68-8840-4ec1-9ba2-e440a5450f57"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:17.454978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08200853-33f7-4dfd-904a-d8073a7105a2 req-11ad81aa-b4ed-47c3-a6ce-6e67f8050a54 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:17.456241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08200853-33f7-4dfd-904a-d8073a7105a2 req-11ad81aa-b4ed-47c3-a6ce-6e67f8050a54 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:17.456697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-08200853-33f7-4dfd-904a-d8073a7105a2 req-11ad81aa-b4ed-47c3-a6ce-6e67f8050a54 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:17.471666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-08200853-33f7-4dfd-904a-d8073a7105a2 req-11ad81aa-b4ed-47c3-a6ce-6e67f8050a54 service nova] Creating event network-changed:c4947a68-8840-4ec1-9ba2-e440a5450f57 for instance e842d78e-18e9-4f08-b469-df610346b144 on n-h1-master-1 Oct 24 09:57:17.478798 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-08200853-33f7-4dfd-904a-d8073a7105a2 req-11ad81aa-b4ed-47c3-a6ce-6e67f8050a54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039217 Oct 24 09:57:17.479770 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3622/7417] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:18.435677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:18.436222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:18.442901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:18.443375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:18.443806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:18.444492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:18.444940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:18.445386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:18.578238 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:18.586411 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddcb96d3-c61f-4b85-98bb-17d258f03854 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1362 microversion: 2.1 time: 0.154655 Oct 24 09:57:18.586977 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3796/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:18 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:19.609907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:19.610749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:19.618293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:19.618780 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:19.619219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:19.619910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:19.620365 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:19.620827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:19.752150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:19.759697 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4cd52e50-408b-423e-9680-6670143cf755 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1362 microversion: 2.1 time: 0.154024 Oct 24 09:57:19.760267 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3623/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:19 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:20.782311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:20.782935 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:20.790361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:20.790839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:20.791270 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:20.791949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:20.792406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:20.792905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:20.922739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:20.930355 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8ee737b-10c7-438a-a0cc-90b15ea2b88f tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1362 microversion: 2.1 time: 0.152186 Oct 24 09:57:20.930922 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3797/7420] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:20 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:21.281554 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-85af036b-81f9-4ad8-8081-cf33ca833ce3 req-5b48a1cf-28c7-4aca-bb0d-c05fa624ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e842d78e-18e9-4f08-b469-df610346b144", "name": "network-vif-plugged", "status": "completed", "tag": "c4947a68-8840-4ec1-9ba2-e440a5450f57"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:21.292375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-85af036b-81f9-4ad8-8081-cf33ca833ce3 req-5b48a1cf-28c7-4aca-bb0d-c05fa624ad5f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:21.292866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-85af036b-81f9-4ad8-8081-cf33ca833ce3 req-5b48a1cf-28c7-4aca-bb0d-c05fa624ad5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:21.293519 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-85af036b-81f9-4ad8-8081-cf33ca833ce3 req-5b48a1cf-28c7-4aca-bb0d-c05fa624ad5f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:21.305944 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-85af036b-81f9-4ad8-8081-cf33ca833ce3 req-5b48a1cf-28c7-4aca-bb0d-c05fa624ad5f service nova] Creating event network-vif-plugged:c4947a68-8840-4ec1-9ba2-e440a5450f57 for instance e842d78e-18e9-4f08-b469-df610346b144 on n-h1-master-1 Oct 24 09:57:21.311215 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-85af036b-81f9-4ad8-8081-cf33ca833ce3 req-5b48a1cf-28c7-4aca-bb0d-c05fa624ad5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Oct 24 09:57:21.311897 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3624/7421] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:21.953768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:21.954419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:21.961833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:21.962316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:21.962755 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:21.963439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:21.963893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:21.964317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:22.095481 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:22.103816 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b19cbcd-b70c-4a2f-bc43-07b02c3248d5 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1362 microversion: 2.1 time: 0.153990 Oct 24 09:57:22.104392 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3798/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:21 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:23.127412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:23.128121 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:23.134331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:23.134829 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:23.135281 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:23.135977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:23.136444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:23.136885 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:23.265264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:23.273410 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65c0de9d-e3f2-46f0-b140-71d495eb9780 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1555 microversion: 2.1 time: 0.151007 Oct 24 09:57:23.273985 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3625/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:23 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:23.295825 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:23.296529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:23.303347 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:23.303823 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:23.304253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:23.304933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:23.305407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:23.305833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:23.431472 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:23.439324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-41564070-3a9b-4c9a-8ec1-bdfcdc18940d tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1555 microversion: 2.1 time: 0.147341 Oct 24 09:57:23.439940 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3799/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:23 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:24.925948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de35bf0a-d1f8-420e-84c6-6d57e6934138"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:24.928861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:24.931683 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:24.935699 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:24.938269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:24.938756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:24.939214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:24.939918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:24.940912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:24.941381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:25.206227 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f7cd345-9395-4a47-a6eb-5a8d86703967 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "POST /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284069 Oct 24 09:57:25.206913 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3626/7425] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:57:24 2022] POST /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:35.911723 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:35.912223 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:35.914363 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:35.915142 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:35.915887 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:35.922420 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:35.922901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:35.923337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:35.924019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:35.924469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:35.924888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:36.006841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lazy-loading 'services' on Instance uuid e842d78e-18e9-4f08-b469-df610346b144 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:57:36.076116 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-90e6bd57-f0f5-4415-b3d6-a40287b534cb tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments/de35bf0a-d1f8-420e-84c6-6d57e6934138" status: 202 len: 0 microversion: 2.1 time: 0.168704 Oct 24 09:57:36.076717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3800/7426] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:57:35 2022] DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments/de35bf0a-d1f8-420e-84c6-6d57e6934138 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:57:36.083281 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:36.084246 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:36.088962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:36.091353 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:36.099581 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:36.100084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:36.100537 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:36.101267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:36.101764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:36.102205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:36.134501 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88bc20a9-ea09-4c87-a1be-ebb57ca186f0 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053089 Oct 24 09:57:36.135072 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3627/7427] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:36 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:37.153564 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:37.156126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:37.162974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:37.163462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:37.163894 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:37.164579 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:37.165031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:37.165498 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:37.197711 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76aad2a1-8c44-4c6f-be29-a1b34069ba6b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049194 Oct 24 09:57:37.198275 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3801/7428] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:37 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:38.209756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:38.212144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:38.219425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:38.219929 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:38.220386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:38.221114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:38.221675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:38.222344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:38.255966 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-626224e5-c3ec-4837-be50-8128cfa8948b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050269 Oct 24 09:57:38.256549 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3628/7429] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:38 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:39.268606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:39.271275 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:39.278091 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:39.278574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:39.279011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:39.279701 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:39.280155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:39.280834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:39.310149 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6eb078f-3f07-4ac2-8474-3392260d40f1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Oct 24 09:57:39.310811 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3802/7430] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:39 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:40.322826 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:40.325003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:40.332292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:40.332792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:40.333242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:40.333969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:40.334439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:40.334882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:40.364790 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5be44b56-5150-41c9-a48c-3bc4ac6b4b02 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Oct 24 09:57:40.365383 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3629/7431] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:40 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:41.377136 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:41.379316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:41.386120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:41.386602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:41.387043 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:41.387729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:41.388183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:41.388610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:41.417967 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96c8a096-b454-48e4-8cc5-9884c4bf9fe1 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044771 Oct 24 09:57:41.418457 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3803/7432] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:57:41 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 09:57:41.429613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:41.430125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:41.436822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:41.437343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:41.437799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:41.438494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:41.438959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:41.439397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:41.515977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] HTTP exception thrown: Instance e842d78e-18e9-4f08-b469-df610346b144 is not attached to volume de35bf0a-d1f8-420e-84c6-6d57e6934138 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Request method failure captured: Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments/de35bf0a-d1f8-420e-84c6-6d57e6934138 HTTP/1.1 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmEv5RZmzuuDmqLEenZLaBcKaLQ4iXRb2gxsu89lwCzNn2pVSg7b95sncSnm_uLkbCOy2Xq1H5nvUaoNtL1IQekGNUZ38pJ0q8bLChKSlQHicTH8TwQ2XUOPbriFQagrncPIiTrq1i3ml2jyX0tfaQsBGHAWiRQiZTUuN9B1VoQ_K3M Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}] Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ce547983f5274f288dfc88a36e234e19 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e842d78e-18e9-4f08-b469-df610346b144 is not attached to volume de35bf0a-d1f8-420e-84c6-6d57e6934138 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'e842d78e-18e9-4f08-b469-df610346b144', 'id': 'de35bf0a-d1f8-420e-84c6-6d57e6934138'} Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id de35bf0a-d1f8-420e-84c6-6d57e6934138. Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e842d78e-18e9-4f08-b469-df610346b144 is not attached to volume de35bf0a-d1f8-420e-84c6-6d57e6934138 Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:41.517642 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e842d78e-18e9-4f08-b469-df610346b144 is not attached to volume de35bf0a-d1f8-420e-84c6-6d57e6934138 Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Returning 404 to user: Instance e842d78e-18e9-4f08-b469-df610346b144 is not attached to volume de35bf0a-d1f8-420e-84c6-6d57e6934138 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c77eb79-01b8-405e-8296-a285e2f9387b tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments/de35bf0a-d1f8-420e-84c6-6d57e6934138" status: 404 len: 154 microversion: 2.1 time: 0.094098 Oct 24 09:57:41.522613 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3630/7433] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 09:57:41 2022] DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144/os-volume_attachments/de35bf0a-d1f8-420e-84c6-6d57e6934138 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:57:44.899259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:44.899788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:44.907551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:44.908046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:44.908492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:44.909190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:44.909690 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:44.910622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:44.938989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:57:45.019130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96947a63-7eb2-4663-80b2-8d097a35e1ce tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 204 len: 0 microversion: 2.1 time: 0.123363 Oct 24 09:57:45.020223 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3804/7434] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:57:44 2022] DELETE /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 09:57:45.028812 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:45.029557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:45.037063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:45.037677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:45.038196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:45.039001 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:45.039541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:45.040057 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:45.173875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:45.184236 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f56e1856-c18a-4cc6-ab92-a5f7f562f40c tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1561 microversion: 2.1 time: 0.159034 Oct 24 09:57:45.185031 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3631/7435] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:45 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:46.208658 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:46.209393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:46.216248 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:46.216728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:46.217170 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:46.217882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:46.218333 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:46.218752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:46.355027 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:46.362996 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-239ddccd-b691-4e83-bb6b-ff173ed92f66 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1561 microversion: 2.1 time: 0.158570 Oct 24 09:57:46.363577 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3805/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:46 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:47.110214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-177b2c17-64aa-41d5-a0d8-956436eb0fcd req-cb8c7527-f5f2-4ba3-9824-1fa3929420b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e842d78e-18e9-4f08-b469-df610346b144", "name": "network-vif-deleted", "tag": "c4947a68-8840-4ec1-9ba2-e440a5450f57"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:57:47.123043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-177b2c17-64aa-41d5-a0d8-956436eb0fcd req-cb8c7527-f5f2-4ba3-9824-1fa3929420b5 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:47.123480 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-177b2c17-64aa-41d5-a0d8-956436eb0fcd req-cb8c7527-f5f2-4ba3-9824-1fa3929420b5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:47.123927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-177b2c17-64aa-41d5-a0d8-956436eb0fcd req-cb8c7527-f5f2-4ba3-9824-1fa3929420b5 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:47.137404 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-177b2c17-64aa-41d5-a0d8-956436eb0fcd req-cb8c7527-f5f2-4ba3-9824-1fa3929420b5 service nova] Creating event network-vif-deleted:c4947a68-8840-4ec1-9ba2-e440a5450f57 for instance e842d78e-18e9-4f08-b469-df610346b144 on n-h1-master-1 Oct 24 09:57:47.144651 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-177b2c17-64aa-41d5-a0d8-956436eb0fcd req-cb8c7527-f5f2-4ba3-9824-1fa3929420b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037575 Oct 24 09:57:47.145251 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3632/7437] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:57:47.385733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:47.386467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:47.393846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:47.394946 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:47.395387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:47.396093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:47.396551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:47.396978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:47.429357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:47.429842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:47.430278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:47.430721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lazy-loading 'fault' on Instance uuid e842d78e-18e9-4f08-b469-df610346b144 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 09:57:47.472988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce547983f5274f288dfc88a36e234e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:57:47.481746 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-641f1e00-1a00-414a-bca4-3cb66230f5c3 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 200 len: 1352 microversion: 2.1 time: 0.099813 Oct 24 09:57:47.482337 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3806/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:47 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:57:48.507035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:48.507665 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] [instance: e842d78e-18e9-4f08-b469-df610346b144] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:57:48.514597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:48.515089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:48.515534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:48.516227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:57:48.516695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:57:48.517130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:57:48.530020 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] HTTP exception thrown: Instance e842d78e-18e9-4f08-b469-df610346b144 could not be found. Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Request method failure captured: Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 HTTP/1.1 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmEv5RZmzuuDmqLEenZLaBcKaLQ4iXRb2gxsu89lwCzNn2pVSg7b95sncSnm_uLkbCOy2Xq1H5nvUaoNtL1IQekGNUZ38pJ0q8bLChKSlQHicTH8TwQ2XUOPbriFQagrncPIiTrq1i3ml2jyX0tfaQsBGHAWiRQiZTUuN9B1VoQ_K3M Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0f1d38b43d74ef0b8b3e40b8260e9fd"}]}] Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: f0f1d38b43d74ef0b8b3e40b8260e9fd Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1919488188 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: ce547983f5274f288dfc88a36e234e19 Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestEncryptedCinderVolumes-1919488188-project Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: exception: Instance e842d78e-18e9-4f08-b469-df610346b144 could not be found. Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'e842d78e-18e9-4f08-b469-df610346b144'} Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e842d78e-18e9-4f08-b469-df610346b144 could not be found. Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e842d78e-18e9-4f08-b469-df610346b144 could not be found. Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:48.531875 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e842d78e-18e9-4f08-b469-df610346b144 could not be found. Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Returning 404 to user: Instance e842d78e-18e9-4f08-b469-df610346b144 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b78e9a9-3d5e-437d-8701-1a7b901cdc78 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144" status: 404 len: 111 microversion: 2.1 time: 0.031175 Oct 24 09:57:48.536237 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3633/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:57:48 2022] GET /compute/v2.1/servers/e842d78e-18e9-4f08-b469-df610346b144 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:57:48.543247 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91a026b6-d9c8-4379-aa2f-5bfc43d90f76 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] Calling method '.version_select at 0x7f8da9a58790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:57:48.564031 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91a026b6-d9c8-4379-aa2f-5bfc43d90f76 tempest-TestEncryptedCinderVolumes-1919488188 tempest-TestEncryptedCinderVolumes-1919488188-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-312751151" status: 202 len: 0 microversion: 2.1 time: 0.025729 Oct 24 09:57:48.564636 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3807/7440] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-312751151 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:58:15.503853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-253acf7b-27b2-444d-9c4c-5cf3ad9246c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'create', calling method: .version_select at 0x7f8da992adc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-879424826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/XRrmftoo9XiwOtZ08mlfDObznAy9NfKdTs0vh6opZZDfAaCvTepEj/Uv6bnQr2l6TKwyDFwVTXwSKdPcfteuMH6EBTNwXoieu0hdCAAWScwfTz6yR4Vv4e1epj1wfbg=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:15.509682 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=14 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:15.510358 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:15.521948 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-253acf7b-27b2-444d-9c4c-5cf3ad9246c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:58:15.527118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-253acf7b-27b2-444d-9c4c-5cf3ad9246c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for user b99b86166ef34409910f6102dc49589e and project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:58:15.551538 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-253acf7b-27b2-444d-9c4c-5cf3ad9246c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052140 Oct 24 09:58:15.552128 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3634/7441] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 09:58:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:58:15.601625 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:15.602446 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:15.606607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1076087418", "imageRef": "f2f158db-1222-4fc2-8619-c8234f0c9edf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-879424826", "networks": [{"uuid": "f5a7a08d-b484-43cc-8b1d-e99feb6087e1"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:15.660477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] validate_networks() for [('f5a7a08d-b484-43cc-8b1d-e99feb6087e1', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 09:58:16.112706 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 09:58:16.113129 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 09:58:16.113643 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 09:58:16.114054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 09:58:16.114462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 09:58:16.123363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:16.123844 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:16.124281 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:16.125000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:16.125499 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:16.125927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:16.147231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 09:58:16.152530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for user b99b86166ef34409910f6102dc49589e and project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 09:58:16.165783 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 09:58:16.168024 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f2f158db-1222-4fc2-8619-c8234f0c9edf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 09:58:16.214236 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ecaef900-f0b4-41df-b852-6c9a10a8b577 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614627 Oct 24 09:58:16.214942 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3808/7442] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 09:58:16.226713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe087f2d-e9b6-4242-8b95-1d3ffe3189d4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:16.227544 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fe087f2d-e9b6-4242-8b95-1d3ffe3189d4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:16.282133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fe087f2d-e9b6-4242-8b95-1d3ffe3189d4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:16.290618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe087f2d-e9b6-4242-8b95-1d3ffe3189d4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1258 microversion: 2.1 time: 0.067924 Oct 24 09:58:16.291181 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3635/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:16 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:58:17.314561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:17.315971 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:17.322573 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:17.323059 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:17.323500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:17.324196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:17.324662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:17.325762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:17.398444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:17.407057 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e939a53-3fc4-4991-8ce7-950d8faa1695 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1310 microversion: 2.1 time: 0.097364 Oct 24 09:58:17.407650 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3809/7444] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:17 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:18.430703 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:18.431245 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:18.438160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:18.438652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:18.439112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:18.439800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:18.440317 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:18.440757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:18.603625 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:18.614785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9197f509-d4f2-4bb7-a407-d0344489449e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.187994 Oct 24 09:58:18.615636 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3636/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:18 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:19.639507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:19.640119 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:19.648032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:19.648607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:19.649110 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:19.649920 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:19.650553 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:19.650977 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:19.792584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:19.800592 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e79ff233-5f83-4ddb-b60f-a50d903aa959 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.164951 Oct 24 09:58:19.801428 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3810/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:19 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:20.824224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:20.824873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:20.834374 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:20.834920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:20.835413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:20.836202 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:20.836710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:20.837193 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:20.988513 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:20.996701 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-edc40e3e-9658-41ee-adb4-7633c5d817e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.176241 Oct 24 09:58:20.997320 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3637/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:20 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:22.021089 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:22.021937 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:22.028648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:22.029141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:22.029610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:22.030317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:22.031044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:22.031473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:22.167907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:22.176929 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4e456c4-2570-49ca-9435-c62b99d820c9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.159634 Oct 24 09:58:22.177564 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3811/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:22 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:23.200066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:23.200863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:23.208579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:23.209080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:23.209598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:23.210322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:23.210792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:23.211233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:23.361116 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:23.370532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2d447442-c62d-43fd-a64b-ef448c8e9037 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.174303 Oct 24 09:58:23.371124 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3638/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:23 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:24.394057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:24.394649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:24.401642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:24.402208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:24.402680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:24.403591 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:24.404047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:24.404472 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:24.545598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:24.553470 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eef53239-8d57-45d9-9d29-4767dd18f525 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.163507 Oct 24 09:58:24.554049 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3812/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:24 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:58:25.576301 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:25.576885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:25.584984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:25.585516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:25.585969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:25.586688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:25.587187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:25.587630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:25.719419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:25.727935 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bb742b4a-5854-4fb3-a3a1-c2fe7eb63804 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.155587 Oct 24 09:58:25.728519 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3639/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:25 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:26.751611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:26.752216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:26.754957 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:26.755625 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:26.761193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:26.761721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:26.762183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:26.762892 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:26.763355 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:26.763776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:26.805669 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-60dce8a1-0be9-4f59-84fb-62dd128f6a03 req-336d3878-1ad2-4236-8f87-740a79b8c8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:26.811124 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:26.818406 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60dce8a1-0be9-4f59-84fb-62dd128f6a03 req-336d3878-1ad2-4236-8f87-740a79b8c8f8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:26.818903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60dce8a1-0be9-4f59-84fb-62dd128f6a03 req-336d3878-1ad2-4236-8f87-740a79b8c8f8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:26.819351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-60dce8a1-0be9-4f59-84fb-62dd128f6a03 req-336d3878-1ad2-4236-8f87-740a79b8c8f8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:26.830597 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-60dce8a1-0be9-4f59-84fb-62dd128f6a03 req-336d3878-1ad2-4236-8f87-740a79b8c8f8 service nova] Creating event network-changed:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 09:58:26.835401 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-60dce8a1-0be9-4f59-84fb-62dd128f6a03 req-336d3878-1ad2-4236-8f87-740a79b8c8f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033377 Oct 24 09:58:26.836296 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3640/7452] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 09:58:27.009366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:27.017064 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca43ac7c-642a-4744-b401-f43220d5c116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.269267 Oct 24 09:58:27.017669 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3813/7453] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:26 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 09:58:28.042340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:28.042963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:28.049049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:28.049626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:28.050071 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:28.050759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:28.051222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:28.051660 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:28.183224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:28.191657 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13268069-772f-4c53-b3be-a2270c55da75 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.154389 Oct 24 09:58:28.192236 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3641/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:28 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:29.215208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:29.215888 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:29.223224 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:29.223711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:29.224147 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:29.224853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:29.225331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:29.225765 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:29.359117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:29.367268 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b2a5195-d4c9-4372-a5e6-2ee2854e7821 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.156008 Oct 24 09:58:29.367853 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3814/7455] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:29 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:30.390997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:30.391629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:30.398555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:30.399103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:30.399510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:30.400220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:30.400716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:30.401163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:30.531042 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:30.539266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d87cdc72-23c8-4ee7-ad1c-7e877b2e3b1f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.152220 Oct 24 09:58:30.539832 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3642/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:30 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:31.446651 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-82dee7d5-1e3c-4b38-a112-efe6d2a2b90b req-5a25f3c4-e443-4e47-8d50-c4b984ad3c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "name": "network-vif-plugged", "status": "completed", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:31.463188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-82dee7d5-1e3c-4b38-a112-efe6d2a2b90b req-5a25f3c4-e443-4e47-8d50-c4b984ad3c7d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:31.463670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-82dee7d5-1e3c-4b38-a112-efe6d2a2b90b req-5a25f3c4-e443-4e47-8d50-c4b984ad3c7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:31.464100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-82dee7d5-1e3c-4b38-a112-efe6d2a2b90b req-5a25f3c4-e443-4e47-8d50-c4b984ad3c7d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:31.475122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-82dee7d5-1e3c-4b38-a112-efe6d2a2b90b req-5a25f3c4-e443-4e47-8d50-c4b984ad3c7d service nova] Creating event network-vif-plugged:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 09:58:31.480457 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-82dee7d5-1e3c-4b38-a112-efe6d2a2b90b req-5a25f3c4-e443-4e47-8d50-c4b984ad3c7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041084 Oct 24 09:58:31.481043 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3815/7457] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:58:31.562472 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:31.563105 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:31.570743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:31.571268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:31.571724 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:31.572431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:31.572903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:31.573368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:31.704205 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:31.712419 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46294636-da34-4d8b-a8eb-fd8810671ee8 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1358 microversion: 2.1 time: 0.153827 Oct 24 09:58:31.712991 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3643/7458] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:31 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:32.736316 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:32.737626 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:32.744899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:32.745434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:32.745883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:32.746669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:32.747131 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:32.747565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:32.879312 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:32.887009 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-692829f8-8b74-4a98-8297-d55a6005fbb9 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1548 microversion: 2.1 time: 0.155055 Oct 24 09:58:32.887670 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3816/7459] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:32 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:32.909420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:32.910086 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:32.917401 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:32.917905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:32.918359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:32.919094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:32.919567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:32.920030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:33.052281 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:33.060098 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f778e555-7478-4804-bd5f-211a8cb433f6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1548 microversion: 2.1 time: 0.154775 Oct 24 09:58:33.060689 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3644/7460] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:32 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:33.083048 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:33.087742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:33.088495 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Searching by: {'deleted': False, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 09:58:33.093813 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:33.094286 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:33.094715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:33.095430 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:33.095882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:33.096303 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:33.119341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 09:58:33.146349 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dd73f57d-48b1-4984-ac90-f48a42cfc4ce tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067651 Oct 24 09:58:33.146933 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3817/7461] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:58:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:58:33.158725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:33.159349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:33.165234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:33.165754 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:33.166200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:33.166896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:33.167360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:33.167797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:33.294781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:33.302515 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d9e6448-fba5-4c1f-8517-9a4863525f4b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1548 microversion: 2.1 time: 0.147851 Oct 24 09:58:33.303088 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3645/7462] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:33 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:34.840597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:34.842932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:34.849677 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:34.850165 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:34.850608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:34.851301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:34.851756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:34.852184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:35.110699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e8614f3f-0218-4e42-bcdd-229d45d41657 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273916 Oct 24 09:58:35.111316 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3818/7463] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 09:58:34 2022] POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:58:48.149333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:48.149814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:48.152757 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:48.153455 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=56 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:48.159636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:48.160138 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:48.160590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:48.161308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:48.161786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:48.162227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:48.293702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:48.301792 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-983d7d36-8cd7-455d-ac4e-e78f9b58e880 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1594 microversion: 2.1 time: 0.156497 Oct 24 09:58:48.302372 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3646/7464] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:48 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:50.161091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a6a010e7-efad-42d6-9c9b-9186c14a59f6 req-75e139e2-8773-4386-b5c8-52cd240a8c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:50.167040 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:50.167706 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:50.168467 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:50.176322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a6a010e7-efad-42d6-9c9b-9186c14a59f6 req-75e139e2-8773-4386-b5c8-52cd240a8c66 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:50.176521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a6a010e7-efad-42d6-9c9b-9186c14a59f6 req-75e139e2-8773-4386-b5c8-52cd240a8c66 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:50.176845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a6a010e7-efad-42d6-9c9b-9186c14a59f6 req-75e139e2-8773-4386-b5c8-52cd240a8c66 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:50.191114 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a6a010e7-efad-42d6-9c9b-9186c14a59f6 req-75e139e2-8773-4386-b5c8-52cd240a8c66 service nova] Creating event network-changed:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 09:58:50.196194 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a6a010e7-efad-42d6-9c9b-9186c14a59f6 req-75e139e2-8773-4386-b5c8-52cd240a8c66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038920 Oct 24 09:58:50.199993 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3819/7465] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:58:51.234833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-634733636"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:51.236034 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:51.244089 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:51.244595 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:51.245042 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:51.245781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:51.246247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:51.246685 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:51.392749 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Adding security group 823d5f6e-45c6-4e75-bc5c-66503000bbef to port 3181db43-9c05-4120-8e80-7a0f9b9e5455 Oct 24 09:58:51.714411 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-03514ac4-6883-482c-9803-61bbd212817b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action" status: 202 len: 0 microversion: 2.1 time: 0.483768 Oct 24 09:58:51.715043 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3647/7466] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 09:58:51 2022] POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 09:58:51.726140 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:58:51.726857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:58:51.734259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:51.734752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:51.735191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:51.735897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:51.736361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:51.736791 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:51.887305 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:58:51.896557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4cd4ae43-846b-4b93-bd39-0ee670b02b00 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1759 microversion: 2.1 time: 0.177068 Oct 24 09:58:51.897284 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3820/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:58:51 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:58:52.211349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3015fdde-559c-4894-9350-b88538ad23cb req-1dc1a2ab-b124-427c-861d-89e29c60d63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:58:52.221108 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3015fdde-559c-4894-9350-b88538ad23cb req-1dc1a2ab-b124-427c-861d-89e29c60d63f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:58:52.221732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3015fdde-559c-4894-9350-b88538ad23cb req-1dc1a2ab-b124-427c-861d-89e29c60d63f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:58:52.222179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3015fdde-559c-4894-9350-b88538ad23cb req-1dc1a2ab-b124-427c-861d-89e29c60d63f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:58:52.233547 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3015fdde-559c-4894-9350-b88538ad23cb req-1dc1a2ab-b124-427c-861d-89e29c60d63f service nova] Creating event network-changed:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 09:58:52.239135 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3015fdde-559c-4894-9350-b88538ad23cb req-1dc1a2ab-b124-427c-861d-89e29c60d63f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031779 Oct 24 09:58:52.240109 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3648/7468] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 09:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:00:29.859240 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:00:29.860099 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:00:29.861275 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 10:00:29.861440 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action (ip 10.222.0.25) !!! Oct 24 10:00:29.865921 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:00:29.868262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:00:29.876857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:29.877371 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:29.877814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:29.878505 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:29.878972 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:29.879400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:29.953845 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca72e6ba-cc7a-4aa3-8a74-86f30f23a9b6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action" status: 202 len: 0 microversion: 2.1 time: 0.096819 Oct 24 10:00:29.957432 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3821/7469] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:00:29 2022] POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:00:29.961718 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:00:29.962479 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:00:29.966854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:00:29.967577 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:00:29.974508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:29.975020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:29.975466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:29.976184 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:29.976651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:29.977093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:30.243193 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:00:30.252092 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ad1228b-37a2-4e4e-8bec-8c09069523df tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1761 microversion: 2.1 time: 0.293106 Oct 24 10:00:30.252692 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3649/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:00:29 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1761 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:00:31.277344 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:00:31.278046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:00:31.284471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:31.284947 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:31.285419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:31.286100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:31.286551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:31.286971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:31.482609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:00:31.491555 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b183c26-7289-4a8f-b9e5-625efe855052 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1766 microversion: 2.1 time: 0.219498 Oct 24 10:00:31.492130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3822/7471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:00:31 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1766 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:00:32.516588 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:00:32.517133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:00:32.519671 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:00:32.519826 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a (ip 10.222.0.25) !!! Oct 24 10:00:32.520845 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:00:32.520996 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a (ip 10.222.0.25) !!! Oct 24 10:00:32.528260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:32.528756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:32.529208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:32.529944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:00:32.530417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:00:32.530860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:00:32.672471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:00:32.680788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb074af0-b2bb-4950-8c24-6ab254b1d55c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1759 microversion: 2.1 time: 0.168818 Oct 24 10:00:32.681385 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3650/7472] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:00:32 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:01:42.365950 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:01:42.366706 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:01:42.371389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-634733636"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:01:42.371920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:42.379530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:42.380010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:42.380443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:42.381123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:42.381607 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:42.382028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:42.511725 n-d-master-1 devstack@n-api.service[126920]: INFO nova.network.security_group_api [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Removing security group 823d5f6e-45c6-4e75-bc5c-66503000bbef from port 3181db43-9c05-4120-8e80-7a0f9b9e5455 Oct 24 10:01:42.807516 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-66a02f7e-2671-48ed-9a71-6646fe1155c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action" status: 202 len: 0 microversion: 2.1 time: 0.443504 Oct 24 10:01:42.808621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3823/7473] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:01:42 2022] POST /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:01:42.816149 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:01:42.817945 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:01:42.910699 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:01:42.920695 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:42.921326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:42.921646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:42.932788 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] Creating event network-changed:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 10:01:42.936331 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] [299b47fe-1f32-4175-a806-8a9c8cd120a0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:01:43.880047 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:43.880627 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:43.887169 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:43.887758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:43.888815 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:43.889568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:43.890032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:43.890465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:43.943409 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] [299b47fe-1f32-4175-a806-8a9c8cd120a0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33408. Oct 24 10:01:43.947796 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-afafaabb-657a-4375-a630-9a2d7b0c336f req-b0af7bff-3f05-40a7-a047-0a6a45d7ac15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.133247 Oct 24 10:01:43.948926 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3651/7474] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:01:43.981249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lazy-loading 'services' on Instance uuid b737ecde-2d7e-427f-8c6c-d5f3755fff5a {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:01:44.061257 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a7741c71-66a8-4578-819e-57c7235045b2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments/35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0" status: 202 len: 0 microversion: 2.1 time: 0.186047 Oct 24 10:01:44.062045 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3824/7475] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 10:01:43 2022] DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments/35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:01:44.078547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:44.086709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:44.097940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:44.098497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:44.098968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:44.099984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:44.100463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:44.100913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:44.142782 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5bb0e293-aecb-4879-ac89-12122e99a8c6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075868 Oct 24 10:01:44.145873 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3652/7476] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:01:44 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:01:45.159986 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:45.162360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:45.168728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:45.169256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:45.169728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:45.170425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:45.170881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:45.171309 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:45.201583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-945b7c7f-d3f8-43cc-a48f-3a720d545257 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Oct 24 10:01:45.202440 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3825/7477] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:01:45 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:01:45.964590 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-7834f1a4-64d2-4332-a31d-9097acf12419 req-8962fa48-8686-4f0d-a617-cb8d4feb098f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:01:45.977070 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7834f1a4-64d2-4332-a31d-9097acf12419 req-8962fa48-8686-4f0d-a617-cb8d4feb098f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:45.977804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7834f1a4-64d2-4332-a31d-9097acf12419 req-8962fa48-8686-4f0d-a617-cb8d4feb098f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:45.978322 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-7834f1a4-64d2-4332-a31d-9097acf12419 req-8962fa48-8686-4f0d-a617-cb8d4feb098f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:45.993687 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-7834f1a4-64d2-4332-a31d-9097acf12419 req-8962fa48-8686-4f0d-a617-cb8d4feb098f service nova] Creating event network-changed:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 10:01:45.999428 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-7834f1a4-64d2-4332-a31d-9097acf12419 req-8962fa48-8686-4f0d-a617-cb8d4feb098f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038627 Oct 24 10:01:46.000473 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3653/7478] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:01:46.215237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:46.218175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:46.226278 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:46.227174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:46.227907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:46.228893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:46.229638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:46.230298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:46.265171 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-46b4d777-74de-48e6-86ff-4d206f5e0046 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054558 Oct 24 10:01:46.266185 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3826/7479] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:01:46 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:01:47.280327 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:47.282763 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:47.289026 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:47.289555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:47.290005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:47.290704 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:47.291168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:47.291605 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:47.600649 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cba932da-35a4-4fbd-a3a1-6abccefba42b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.326040 Oct 24 10:01:47.601612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3654/7480] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:01:47 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 197 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:01:48.613359 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:48.615504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:48.622353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:48.622835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:48.623269 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:48.623952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:48.624405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:48.624825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:48.660049 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be950ccf-cd21-44b7-98e6-023c41448d7a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050627 Oct 24 10:01:48.660640 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3827/7481] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:01:48 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:01:49.673349 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:49.675603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:49.682360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:49.682848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:49.683293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:49.683995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:49.684458 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:49.684900 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:49.712715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0807e6d-559b-4aca-8a8d-e7a75026036c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044078 Oct 24 10:01:49.713261 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3655/7482] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:01:49 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:01:49.724565 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:49.725059 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:49.732342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:49.732829 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:49.733266 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:49.733976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:49.734435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:49.734886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:49.807311 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] HTTP exception thrown: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a is not attached to volume 35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Request method failure captured: Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments/35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 HTTP/1.1 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmGoVSBXRanI2dJ1g-x8JTV4DT0rFrpTegOBek7e2aXU7Ne64EkqDsSzKgnBtNIm6bxRfDIZK_O0JBSrWZZro8vpdfR44WniJ5910hy8h-4iy-hGFzMs1HQiJhWsAOffYPKtCEz-Rw7Fjuf9qMl7u03SKTZ4IN5jAzHOsHQ28JCPw5A Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3cf4715cd28d40d08c2527be9671e8ca"}]}] Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: b99b86166ef34409910f6102dc49589e Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: exception: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a is not attached to volume 35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: action_args: {'server_id': 'b737ecde-2d7e-427f-8c6c-d5f3755fff5a', 'id': '35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0'} Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0. Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a is not attached to volume 35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:01:49.808904 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a is not attached to volume 35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Returning 404 to user: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a is not attached to volume 35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3588ff95-e8de-475a-861c-4c1487fd8cdc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments/35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0" status: 404 len: 154 microversion: 2.1 time: 0.089789 Oct 24 10:01:49.816356 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3828/7483] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 10:01:49 2022] DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a/os-volume_attachments/35b8d1f4-ec8b-4cca-bf38-2cb46d8368e0 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:01:53.063799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:53.064373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:53.071565 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:53.072075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:53.072534 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:53.073260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:53.073762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:53.074203 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:53.103597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:01:53.181860 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b16d66af-992b-459b-94a4-d20c4b9bfa7d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 204 len: 0 microversion: 2.1 time: 0.121616 Oct 24 10:01:53.182489 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3656/7484] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:01:53 2022] DELETE /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:01:53.190806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:53.191411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:53.199748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:53.200776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:53.201239 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:53.201974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:53.202439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:53.202861 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:53.333382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:01:53.341376 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1c6c0a2-b935-49f9-9fea-a4763ed075da tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1554 microversion: 2.1 time: 0.154392 Oct 24 10:01:53.341946 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3829/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:01:53 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:01:54.365209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:54.365958 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:54.375877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:54.376375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:54.376827 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:54.377560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:54.378033 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:54.378474 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:54.507276 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:01:54.515042 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-504f22ba-0e60-48c2-a9e9-ea7feae5187b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1554 microversion: 2.1 time: 0.154042 Oct 24 10:01:54.515610 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3657/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:01:54 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:01:55.539108 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:55.539736 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:55.547409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:55.547901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:55.548341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:55.549044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:55.549532 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:55.549961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:55.580873 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-453fac79-c879-456a-85cd-2a56a56cdd1f req-f593a5b9-1310-4cf2-aae9-83d8d1dbbf53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b737ecde-2d7e-427f-8c6c-d5f3755fff5a", "name": "network-vif-deleted", "tag": "3181db43-9c05-4120-8e80-7a0f9b9e5455"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:01:55.591811 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-453fac79-c879-456a-85cd-2a56a56cdd1f req-f593a5b9-1310-4cf2-aae9-83d8d1dbbf53 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:55.592300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-453fac79-c879-456a-85cd-2a56a56cdd1f req-f593a5b9-1310-4cf2-aae9-83d8d1dbbf53 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:55.592817 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-453fac79-c879-456a-85cd-2a56a56cdd1f req-f593a5b9-1310-4cf2-aae9-83d8d1dbbf53 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:55.604791 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-453fac79-c879-456a-85cd-2a56a56cdd1f req-f593a5b9-1310-4cf2-aae9-83d8d1dbbf53 service nova] Creating event network-vif-deleted:3181db43-9c05-4120-8e80-7a0f9b9e5455 for instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a on n-h1-master-1 Oct 24 10:01:55.610727 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-453fac79-c879-456a-85cd-2a56a56cdd1f req-f593a5b9-1310-4cf2-aae9-83d8d1dbbf53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Oct 24 10:01:55.611329 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3658/7487] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:01:55.621407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:01:55.629920 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-44e74c27-04e4-4793-89d4-c82b0b82632a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 200 len: 1512 microversion: 2.1 time: 0.094816 Oct 24 10:01:55.630489 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3830/7488] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:01:55 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 1512 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:01:56.655130 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:56.655846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b737ecde-2d7e-427f-8c6c-d5f3755fff5a] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:01:56.662343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:56.662841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:56.663295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:56.663999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:01:56.664468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:01:56.664908 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:01:56.679151 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] HTTP exception thrown: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a could not be found. Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Request method failure captured: Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a HTTP/1.1 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmGoVSBXRanI2dJ1g-x8JTV4DT0rFrpTegOBek7e2aXU7Ne64EkqDsSzKgnBtNIm6bxRfDIZK_O0JBSrWZZro8vpdfR44WniJ5910hy8h-4iy-hGFzMs1HQiJhWsAOffYPKtCEz-Rw7Fjuf9qMl7u03SKTZ4IN5jAzHOsHQ28JCPw5A Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3cf4715cd28d40d08c2527be9671e8ca"}]}] Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b99b86166ef34409910f6102dc49589e Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a could not be found. Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b737ecde-2d7e-427f-8c6c-d5f3755fff5a'} Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a could not be found. Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a could not be found. Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:01:56.680955 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a could not be found. Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Returning 404 to user: Instance b737ecde-2d7e-427f-8c6c-d5f3755fff5a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5f962c1-7ac3-44fa-baf2-a7195003be05 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a" status: 404 len: 111 microversion: 2.1 time: 0.032378 Oct 24 10:01:56.686785 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3659/7489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:01:56 2022] GET /compute/v2.1/servers/b737ecde-2d7e-427f-8c6c-d5f3755fff5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:01:56.692742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aee9a24a-af72-40d2-9a5a-bdf13ffd2f03 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '.version_select at 0x7f8da9e7ab80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:01:56.716269 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aee9a24a-af72-40d2-9a5a-bdf13ffd2f03 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-879424826" status: 202 len: 0 microversion: 2.1 time: 0.027335 Oct 24 10:01:56.716849 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3831/7490] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 10:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-879424826 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:02:05.746670 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2aa5bbc-5c48-43eb-8da8-0a881b479cd1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'create', calling method: .version_select at 0x7f8da992adc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-319568299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd0lIM5n7PrDkvOcsxri7I+lmsqOHX6sZt3CS3ex+9cDO9vXoMw5TQ7kJSzVFvtMolvQanTMgZTB6qLF5PDML+l53DZoumPNgUDi9oLOp77gkw7pAQ/5CqqS5qAUdaUgw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:05.762939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a2aa5bbc-5c48-43eb-8da8-0a881b479cd1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:02:05.771471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-a2aa5bbc-5c48-43eb-8da8-0a881b479cd1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for user b99b86166ef34409910f6102dc49589e and project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:02:05.798395 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2aa5bbc-5c48-43eb-8da8-0a881b479cd1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055551 Oct 24 10:02:05.799003 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3660/7491] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:02:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:05.849402 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1919994559", "imageRef": "a8fb22b4-0e6d-4f9a-a8ec-33ddfa4cb2b4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-319568299", "networks": [{"uuid": "f5a7a08d-b484-43cc-8b1d-e99feb6087e1"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:05.858644 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:05.901721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] validate_networks() for [('f5a7a08d-b484-43cc-8b1d-e99feb6087e1', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:02:06.280504 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:02:06.280940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:02:06.281451 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:02:06.282135 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:02:06.282552 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:02:06.291487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:06.291974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:06.292412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:06.293149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:06.293656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:06.294103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:06.311660 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:02:06.316853 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Getting quotas for user b99b86166ef34409910f6102dc49589e and project 3cf4715cd28d40d08c2527be9671e8ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:02:06.329508 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:02:06.331745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8fb22b4-0e6d-4f9a-a8ec-33ddfa4cb2b4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:02:06.372987 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:02:07.381146 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33556. Oct 24 10:02:07.385088 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f0e8115-4211-48f5-8141-b0a8b8045e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539717 Oct 24 10:02:07.385951 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3832/7492] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:02:07.393790 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:07.399033 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6dc20a8d-4c61-48cb-9390-6c5d5f21fda6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:07.399620 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6dc20a8d-4c61-48cb-9390-6c5d5f21fda6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:07.455254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6dc20a8d-4c61-48cb-9390-6c5d5f21fda6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:07.462026 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6dc20a8d-4c61-48cb-9390-6c5d5f21fda6 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1258 microversion: 2.1 time: 0.069098 Oct 24 10:02:07.462592 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3661/7493] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:07 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:08.484755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e323afbf-00ba-4fc6-a620-f48048034715 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:08.485993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e323afbf-00ba-4fc6-a620-f48048034715 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:08.542745 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e323afbf-00ba-4fc6-a620-f48048034715 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:08.549775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e323afbf-00ba-4fc6-a620-f48048034715 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1258 microversion: 2.1 time: 0.069770 Oct 24 10:02:08.550348 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3833/7494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:08 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:09.573132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f17d76f-cfe8-4e6b-ad5b-7b3197a07c15 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:09.573807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f17d76f-cfe8-4e6b-ad5b-7b3197a07c15 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:09.631416 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f17d76f-cfe8-4e6b-ad5b-7b3197a07c15 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:09.638417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f17d76f-cfe8-4e6b-ad5b-7b3197a07c15 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1258 microversion: 2.1 time: 0.069262 Oct 24 10:02:09.638998 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3662/7495] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:09 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:10.661622 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3737833b-96a5-4a85-89dd-1644d7cc74d5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:10.662244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3737833b-96a5-4a85-89dd-1644d7cc74d5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:10.719452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3737833b-96a5-4a85-89dd-1644d7cc74d5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:10.726872 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3737833b-96a5-4a85-89dd-1644d7cc74d5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1258 microversion: 2.1 time: 0.069130 Oct 24 10:02:10.727625 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3834/7496] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:10 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:11.750573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:11.751114 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:11.757948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:11.758439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:11.758884 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:11.759590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:11.760053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:11.760487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:11.821576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:11.829326 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78cb6093-618a-4fe3-9527-51e18e599a43 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1262 microversion: 2.1 time: 0.083202 Oct 24 10:02:11.829903 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3663/7497] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:11 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:12.852158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:12.852778 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:12.855508 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:12.863521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:12.863909 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:12.864454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:12.865260 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:12.865848 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:12.866358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:12.948122 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:12.957319 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31f6cb05-5a44-46fc-920c-4e9b37b2525d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1316 microversion: 2.1 time: 0.108850 Oct 24 10:02:12.974736 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3835/7498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:12 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1316 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:13.988289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:13.988834 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:13.992614 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:14.000848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:14.001550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:14.002129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:14.002920 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:14.003697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:14.004205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:14.182939 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:14.192009 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c197841b-60e1-4a21-83e5-6658ce5040e4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.208003 Oct 24 10:02:14.192707 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3664/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:13 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:15.215878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:15.216500 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:15.223388 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:15.223878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:15.224317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:15.225317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:15.225951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:15.226551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:15.629791 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:15.638130 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efdc5e13-94b4-461e-a6dd-8bacad27aeac tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.426759 Oct 24 10:02:15.638703 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3836/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:15 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:16.662029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:16.662660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:16.670653 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:16.671153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:16.671608 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:16.672318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:16.672793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:16.673241 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:16.803808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:16.811999 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df18a868-578e-4872-8554-76031f723e5f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.153862 Oct 24 10:02:16.812573 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3665/7501] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:16 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:17.835507 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:17.836144 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:17.838816 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:17.844806 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:17.845285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:17.845742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:17.846454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:17.846907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:17.847331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:17.986021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:17.995775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87be0836-b8eb-4031-902b-1f6cd31abd02 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.164179 Oct 24 10:02:17.997239 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3837/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:17 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:19.019647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:19.020264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:19.027303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:19.027851 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:19.028313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:19.029034 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:19.029542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:19.029993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:19.175375 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:19.183329 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6cdc520-2c01-4310-837e-cea132a7d8d2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.167543 Oct 24 10:02:19.183917 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3666/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:19 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:20.209107 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:20.210076 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:20.218971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:20.219656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:20.220214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:20.221060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:20.221710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:20.222218 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:20.367233 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:20.375566 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3cdfe91f-8900-4fe0-8820-aac0295b2a79 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.171518 Oct 24 10:02:20.376139 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3838/7504] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:20 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:21.400583 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:21.402055 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:21.404337 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:21.411472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:21.412063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:21.412626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:21.413450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:21.413998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:21.414515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:21.546889 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:21.554553 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dd1b83c6-43ad-45d6-9616-b2cb355edc63 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.158715 Oct 24 10:02:21.555123 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3667/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:21 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:22.578950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:22.579558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:22.581459 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:22.587422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:22.587913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:22.588353 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:22.589046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:22.589536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:22.589995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:22.715720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:22.723374 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-daebe939-f4bc-41cc-b52e-4a9aeaa415d7 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.148987 Oct 24 10:02:22.723938 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3839/7506] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:22 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:23.745957 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:23.747104 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:23.754002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:23.754504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:23.754965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:23.755678 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:23.756176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:23.756622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:23.890555 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:23.898355 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a58b4f17-b6bf-4faf-b2a8-3b1f292d8e4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.156330 Oct 24 10:02:23.899264 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3668/7507] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:23 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:24.542407 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c50376d9-62ce-4907-abdc-e3ab6c2746ca req-f834eac4-c99a-470c-a1d9-2c3be1c79842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:24.553545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c50376d9-62ce-4907-abdc-e3ab6c2746ca req-f834eac4-c99a-470c-a1d9-2c3be1c79842 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:24.554030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c50376d9-62ce-4907-abdc-e3ab6c2746ca req-f834eac4-c99a-470c-a1d9-2c3be1c79842 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:24.554464 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c50376d9-62ce-4907-abdc-e3ab6c2746ca req-f834eac4-c99a-470c-a1d9-2c3be1c79842 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:24.565250 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c50376d9-62ce-4907-abdc-e3ab6c2746ca req-f834eac4-c99a-470c-a1d9-2c3be1c79842 service nova] Creating event network-changed:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:02:24.570128 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c50376d9-62ce-4907-abdc-e3ab6c2746ca req-f834eac4-c99a-470c-a1d9-2c3be1c79842 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031469 Oct 24 10:02:24.570722 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3840/7508] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:24.922574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:24.923206 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:24.930035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:24.930530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:24.930983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:24.931689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:24.932160 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:24.932603 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:25.062460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:25.070239 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-249b03d5-7144-4a28-b288-3752435d0500 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.151671 Oct 24 10:02:25.070821 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3669/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:24 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:26.095743 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:26.096477 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:26.102738 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:26.103228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:26.103672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:26.104377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:26.104834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:26.105267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:26.312596 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:26.320267 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-36193d85-950f-48a7-8d8b-4ddaf1e3489f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.230265 Oct 24 10:02:26.320845 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3841/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:26 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:27.344162 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:27.344786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:27.351928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:27.352418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:27.352861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:27.353584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:27.354051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:27.354486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:27.486403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:27.494133 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a74cf903-3b2c-43cf-bb5b-484a92a6e0ef tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.154353 Oct 24 10:02:27.494700 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3670/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:27 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:28.517634 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:28.518264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:28.525042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:28.525566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:28.526010 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:28.526715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:28.527173 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:28.528099 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:28.992082 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:29.000323 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c69e9e2-66fc-4fc9-8fb6-35694f766592 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.486590 Oct 24 10:02:29.009338 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3842/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:28 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:30.023560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:30.024188 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:30.031134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:30.031631 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:30.032332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:30.033032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:30.033529 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:30.033973 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:30.161548 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:30.169308 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8108792f-11d7-478e-ae7e-2626e74a7d8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.149667 Oct 24 10:02:30.169891 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3671/7513] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:30 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:30.729756 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-55f7da49-8ce5-4606-a931-30241dbcad8a req-40c3a3be-7425-4d51-b189-251459fae786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "name": "network-vif-plugged", "status": "completed", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:30.739122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55f7da49-8ce5-4606-a931-30241dbcad8a req-40c3a3be-7425-4d51-b189-251459fae786 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:30.739599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55f7da49-8ce5-4606-a931-30241dbcad8a req-40c3a3be-7425-4d51-b189-251459fae786 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:30.740050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55f7da49-8ce5-4606-a931-30241dbcad8a req-40c3a3be-7425-4d51-b189-251459fae786 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:30.754935 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-55f7da49-8ce5-4606-a931-30241dbcad8a req-40c3a3be-7425-4d51-b189-251459fae786 service nova] Creating event network-vif-plugged:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:02:30.759830 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-55f7da49-8ce5-4606-a931-30241dbcad8a req-40c3a3be-7425-4d51-b189-251459fae786 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105670 Oct 24 10:02:30.760497 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3843/7514] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:31.192057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:31.192683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:31.198961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:31.199951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:31.200399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:31.201094 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:31.201584 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:31.202027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:31.332886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:31.341076 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71fce453-1b6a-49d5-9fd7-195b8f6a8162 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1358 microversion: 2.1 time: 0.152904 Oct 24 10:02:31.341683 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3672/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:31 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:32.365503 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:32.366226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:32.373009 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.373575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.374019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.374714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.375176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.375615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.506351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:32.514636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e36a5f64-2881-4d86-a9d5-a2153b8fce6a tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1548 microversion: 2.1 time: 0.154389 Oct 24 10:02:32.515209 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3844/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:32 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:32.536857 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:32.537628 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:32.544549 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.545052 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.545540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.546260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.546735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.547183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.673704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:32.681399 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8b310467-e408-4f57-92dd-76a492f4c208 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1548 microversion: 2.1 time: 0.148332 Oct 24 10:02:32.681982 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3673/7517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:32 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:32.703829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:32.708711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:32.709459 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Searching by: {'deleted': False, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca'} {{(pid=126920) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:02:32.714798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.715283 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.715728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.716451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.716908 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.717366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.740345 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.multi_cell_list [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:02:32.766399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32af7ac8-057c-41af-97e6-52427dacb6e5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066394 Oct 24 10:02:32.766978 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3845/7518] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 10:02:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:32.778910 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:32.779552 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:32.786039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.786542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.787002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.787714 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:32.788190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:32.788641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:32.917623 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:32.925792 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cda7f191-66cf-43e8-a662-db66cfb90af5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1548 microversion: 2.1 time: 0.151070 Oct 24 10:02:32.926396 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3674/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:32 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:34.428623 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57a58cfb-0b4d-4224-91b1-a5f5c788059f"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:34.430953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:34.437743 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:34.438222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:34.438660 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:34.439342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:34.439797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:34.440216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:34.690739 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79e04de3-7f0e-4fff-99ac-29e1d3874374 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265828 Oct 24 10:02:34.691344 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3846/7520] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Oct 24 10:02:34 2022] POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:45.461021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:45.461683 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:45.465442 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=21 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:45.466124 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=72 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:45.472161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:45.472659 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:45.473117 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:45.473875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:45.474335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:45.474782 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:45.612503 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:45.623800 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9d03cfd-1da9-4830-8b20-e5a18dbe67c1 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1594 microversion: 2.1 time: 0.166337 Oct 24 10:02:45.624603 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3675/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:45 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1594 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:02:47.256777 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-662a2e27-2590-4fea-8e73-05c1221bc1f0 req-44d7fd72-78b1-49a7-8dda-2c08a78a7244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:47.267415 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:47.268759 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=23 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:47.269983 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:47.272399 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-662a2e27-2590-4fea-8e73-05c1221bc1f0 req-44d7fd72-78b1-49a7-8dda-2c08a78a7244 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:47.273176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-662a2e27-2590-4fea-8e73-05c1221bc1f0 req-44d7fd72-78b1-49a7-8dda-2c08a78a7244 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:47.273600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-662a2e27-2590-4fea-8e73-05c1221bc1f0 req-44d7fd72-78b1-49a7-8dda-2c08a78a7244 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:47.288137 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-662a2e27-2590-4fea-8e73-05c1221bc1f0 req-44d7fd72-78b1-49a7-8dda-2c08a78a7244 service nova] Creating event network-changed:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:02:47.294158 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-662a2e27-2590-4fea-8e73-05c1221bc1f0 req-44d7fd72-78b1-49a7-8dda-2c08a78a7244 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041693 Oct 24 10:02:47.295349 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3847/7522] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:48.356255 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-430542056"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:48.356904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:48.363784 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:48.364287 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:48.364744 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:48.365494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:48.365969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:48.366411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:48.497629 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Adding security group 47faacf6-88c0-4349-af7b-872de0453be3 to port 1e2a49c8-b193-4afb-84f9-5647fbd2473b Oct 24 10:02:48.805161 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67d19361-1353-4b88-9d8b-5b8bced09b73 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/action" status: 202 len: 0 microversion: 2.1 time: 0.453400 Oct 24 10:02:48.805835 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3676/7523] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:02:48 2022] POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:02:48.816417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:02:48.817126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:02:48.831646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:48.832155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:48.832603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:48.833339 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:48.834249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:48.834845 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:48.900536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-611f763a-1afc-4004-b7fd-b469c4aab8d6 req-30e05593-6455-470a-8c9d-0f5f51fbbe6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:02:48.913195 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-611f763a-1afc-4004-b7fd-b469c4aab8d6 req-30e05593-6455-470a-8c9d-0f5f51fbbe6f service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:02:48.914022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-611f763a-1afc-4004-b7fd-b469c4aab8d6 req-30e05593-6455-470a-8c9d-0f5f51fbbe6f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:02:48.914672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-611f763a-1afc-4004-b7fd-b469c4aab8d6 req-30e05593-6455-470a-8c9d-0f5f51fbbe6f service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:02:48.931382 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-611f763a-1afc-4004-b7fd-b469c4aab8d6 req-30e05593-6455-470a-8c9d-0f5f51fbbe6f service nova] Creating event network-changed:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:02:48.937673 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-611f763a-1afc-4004-b7fd-b469c4aab8d6 req-30e05593-6455-470a-8c9d-0f5f51fbbe6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115941 Oct 24 10:02:48.938524 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3677/7524] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:02:48.989487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:02:48.999078 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b744932-1fe9-4a32-9383-9d749c651545 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1759 microversion: 2.1 time: 0.188398 Oct 24 10:02:48.999924 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3848/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:02:48 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:04.756057 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:04.756828 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:04.760978 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:03:04.763309 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:04.770260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:04.770762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:04.771219 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:04.771933 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:04.772410 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:04.772857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:04.843634 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78b4e53e-3586-422c-a929-eb294e178f85 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/action" status: 202 len: 0 microversion: 2.1 time: 0.089257 Oct 24 10:03:04.844335 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3678/7526] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:03:04 2022] POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:03:04.853645 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:04.854327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:04.857441 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:04.858095 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:04.866271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:04.867181 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:04.867629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:04.868334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:04.868789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:04.869217 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:05.097567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:05.105925 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f47ab18-7887-4012-bcd8-24c96cd3c18b tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1751 microversion: 2.1 time: 0.257400 Oct 24 10:03:05.106500 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3849/7527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:04 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:06.174882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:06.175601 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:06.181807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:06.182306 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:06.183337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:06.184040 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:06.184511 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:06.184954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:06.330370 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:06.338512 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de25cab3-285e-4790-abf8-e0afd1e0aa9d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.213008 Oct 24 10:03:06.339125 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3679/7528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:06 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:07.361325 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:07.361965 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:07.368781 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:07.369265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:07.369737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:07.370431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:07.370890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:07.371320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:07.519437 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:07.527644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab4cf80d-8a6b-4a9f-845f-95967182a174 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.170408 Oct 24 10:03:07.528220 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3850/7529] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:07 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:08.551781 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:08.552340 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:08.559395 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:08.559896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:08.560354 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:08.561069 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:08.561573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:08.562024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:08.703523 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:08.711897 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-763141dc-f7e4-4106-a4e5-7e7a2d394dbc tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.164123 Oct 24 10:03:08.712476 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3680/7530] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:08 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:09.735829 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:09.736378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:09.743144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:09.743636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:09.744077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:09.744794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:09.745775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:09.746211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:09.888727 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:09.896968 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c83a857-7eb6-453f-ae51-31c09489e05c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.165056 Oct 24 10:03:09.897569 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3851/7531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:09 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:10.920622 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:10.921247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:10.928151 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:10.928647 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:10.929091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:10.929835 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:10.930302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:10.930738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:11.075091 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:11.083425 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f69d2b1d-762f-4acc-bc39-68e06f3ce355 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.167252 Oct 24 10:03:11.083989 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3681/7532] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:10 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:12.109406 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:12.110021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:12.117011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:12.117527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:12.117967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:12.118652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:12.119107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:12.119530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:12.257991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:12.266760 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9420b9c-8f40-4631-a1d5-64d1867db116 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.161237 Oct 24 10:03:12.267329 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3852/7533] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:12 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:03:13.290447 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:13.291074 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:13.298000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:13.298497 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:13.298957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:13.299662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:13.300130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:13.300572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:13.442603 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:13.451308 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f56491b1-5c6d-4091-aa92-28365a426a59 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.164731 Oct 24 10:03:13.451884 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3682/7534] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:13 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:14.474724 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:14.475256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:14.482328 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:14.482807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:14.483242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:14.483929 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:14.484377 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:14.484803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:14.626695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:14.635053 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f475f6a9-25c0-4192-93b3-db9085f69523 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.164290 Oct 24 10:03:14.635651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3853/7535] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:14 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:15.659300 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:15.659995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:15.667460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:15.667951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:15.668399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:15.669131 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:15.669623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:15.670060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:15.815932 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:15.824603 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d6c2918-2895-45ad-90f5-a306faffbc4c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1756 microversion: 2.1 time: 0.169456 Oct 24 10:03:15.825524 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3683/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:15 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:16.848070 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:16.848624 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:16.855548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:16.856032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:16.856471 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:16.857167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:16.857721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:16.858157 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:16.997774 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:17.005934 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-490ae97e-d7b6-4724-996a-e1f8efee3884 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1759 microversion: 2.1 time: 0.161871 Oct 24 10:03:17.006512 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3854/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:16 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:03:49.169575 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-430542056"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:03:49.170108 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:49.172255 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:49.172938 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:49.180056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:49.180593 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:49.181037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:49.182388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:49.182853 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:49.183290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:49.317174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Removing security group 47faacf6-88c0-4349-af7b-872de0453be3 from port 1e2a49c8-b193-4afb-84f9-5647fbd2473b Oct 24 10:03:49.615166 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98e51f70-deee-4673-aa79-76085fb57b65 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/action" status: 202 len: 0 microversion: 2.1 time: 0.450479 Oct 24 10:03:49.616124 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3684/7538] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:03:49 2022] POST /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:03:49.624813 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0a6e8d75-797c-479a-a0c3-53352e7ded73 req-cc745cec-7e5a-4cda-a38a-5a096e1ebf43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:03:49.631409 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:49.632421 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=36 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:49.638033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0a6e8d75-797c-479a-a0c3-53352e7ded73 req-cc745cec-7e5a-4cda-a38a-5a096e1ebf43 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:49.638943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0a6e8d75-797c-479a-a0c3-53352e7ded73 req-cc745cec-7e5a-4cda-a38a-5a096e1ebf43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:49.639635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0a6e8d75-797c-479a-a0c3-53352e7ded73 req-cc745cec-7e5a-4cda-a38a-5a096e1ebf43 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:49.652438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0a6e8d75-797c-479a-a0c3-53352e7ded73 req-cc745cec-7e5a-4cda-a38a-5a096e1ebf43 service nova] Creating event network-changed:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:03:49.658547 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0a6e8d75-797c-479a-a0c3-53352e7ded73 req-cc745cec-7e5a-4cda-a38a-5a096e1ebf43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037218 Oct 24 10:03:49.659761 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3855/7539] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:50.745649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:50.746157 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:50.752183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:50.752708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:50.753161 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:50.753913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:50.754381 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:50.754825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:50.840750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lazy-loading 'services' on Instance uuid b8fbb90e-4953-49f3-98f4-f9cb63d32e30 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:03:50.919366 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58636e3f-6f99-42a8-b047-4ad69618a64c tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments/57a58cfb-0b4d-4224-91b1-a5f5c788059f" status: 202 len: 0 microversion: 2.1 time: 0.178736 Oct 24 10:03:50.920045 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3685/7540] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 10:03:50 2022] DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments/57a58cfb-0b4d-4224-91b1-a5f5c788059f => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:03:50.931392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:50.934441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:50.943864 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:50.944392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:50.944828 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:50.945565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:50.946026 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:50.946461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:50.979948 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f03c0a03-cd87-4087-aed2-33629435ad8d tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055153 Oct 24 10:03:50.980864 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3856/7541] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:03:50 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:51.677328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5e3b27a5-7620-4879-ae7d-d0b739d5807b req-a808bcce-ba76-47c8-9c10-60ba13f81b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:03:51.694084 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5e3b27a5-7620-4879-ae7d-d0b739d5807b req-a808bcce-ba76-47c8-9c10-60ba13f81b48 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:51.694589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5e3b27a5-7620-4879-ae7d-d0b739d5807b req-a808bcce-ba76-47c8-9c10-60ba13f81b48 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:51.695039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5e3b27a5-7620-4879-ae7d-d0b739d5807b req-a808bcce-ba76-47c8-9c10-60ba13f81b48 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:51.706520 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5e3b27a5-7620-4879-ae7d-d0b739d5807b req-a808bcce-ba76-47c8-9c10-60ba13f81b48 service nova] Creating event network-changed:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:03:51.711591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5e3b27a5-7620-4879-ae7d-d0b739d5807b req-a808bcce-ba76-47c8-9c10-60ba13f81b48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038270 Oct 24 10:03:51.715500 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3686/7542] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:51.992320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:51.994837 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:52.001578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:52.002832 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:52.003412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:52.004234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:52.004794 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:52.005343 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:52.037699 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-14134791-b541-442e-adc1-08f15c560651 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049348 Oct 24 10:03:52.038432 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3857/7543] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:03:51 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:53.052491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:53.054901 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:53.061983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:53.062489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:53.062940 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:53.063652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:53.064119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:53.064567 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:53.094495 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b144b35-df13-457c-90d3-8283609b9af3 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047051 Oct 24 10:03:53.095150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3687/7544] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:03:53 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:54.107332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:54.109600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:54.116392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:54.116886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:54.117357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:54.118056 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:54.118520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:54.119447 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:54.149175 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a63bf7e7-7fe6-4d68-9ac7-07751eb96ebf tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045756 Oct 24 10:03:54.149796 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3858/7545] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:03:54 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:55.162262 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:55.164453 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:55.166774 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:03:55.166929 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:03:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments (ip 10.222.0.25) !!! Oct 24 10:03:55.182845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:55.183346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:55.183800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:55.184515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:55.184984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:55.185456 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:55.216581 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0b9ffda7-db4f-4d4f-a136-80b1078b172e tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058297 Oct 24 10:03:55.217160 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3688/7546] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:03:55 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:03:56.228850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:56.231216 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:56.237974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:56.238454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:56.238895 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:56.239580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:56.240029 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:56.240452 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:56.268359 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c375565e-64dc-4b82-a905-2d499b7ed94f tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044049 Oct 24 10:03:56.268913 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3859/7547] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 10:03:56 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:03:56.280015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:56.280510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:56.287489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:56.287979 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:56.288426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:56.289120 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:56.289610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:56.290045 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:56.363088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] HTTP exception thrown: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 is not attached to volume 57a58cfb-0b4d-4224-91b1-a5f5c788059f Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Request method failure captured: Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments/57a58cfb-0b4d-4224-91b1-a5f5c788059f HTTP/1.1 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmGoVSBXRanI2dJ1g-x8JTV4DT0rFrpTegOBek7e2aXU7Ne64EkqDsSzKgnBtNIm6bxRfDIZK_O0JBSrWZZro8vpdfR44WniJ5910hy8h-4iy-hGFzMs1HQiJhWsAOffYPKtCEz-Rw7Fjuf9qMl7u03SKTZ4IN5jAzHOsHQ28JCPw5A Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3cf4715cd28d40d08c2527be9671e8ca"}]}] Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b99b86166ef34409910f6102dc49589e Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 is not attached to volume 57a58cfb-0b4d-4224-91b1-a5f5c788059f Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: action_args: {'server_id': 'b8fbb90e-4953-49f3-98f4-f9cb63d32e30', 'id': '57a58cfb-0b4d-4224-91b1-a5f5c788059f'} Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 57a58cfb-0b4d-4224-91b1-a5f5c788059f. Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 is not attached to volume 57a58cfb-0b4d-4224-91b1-a5f5c788059f Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:03:56.364707 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 is not attached to volume 57a58cfb-0b4d-4224-91b1-a5f5c788059f Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Returning 404 to user: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 is not attached to volume 57a58cfb-0b4d-4224-91b1-a5f5c788059f {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2306dc97-8dd9-47c8-8a1a-21ca741fa2de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments/57a58cfb-0b4d-4224-91b1-a5f5c788059f" status: 404 len: 154 microversion: 2.1 time: 0.090167 Oct 24 10:03:56.369468 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3689/7548] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Oct 24 10:03:56 2022] DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30/os-volume_attachments/57a58cfb-0b4d-4224-91b1-a5f5c788059f => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:03:59.612282 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:59.612782 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:59.619737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:59.620221 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:59.620659 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:59.621375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:59.621835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:59.622261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:59.648676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:03:59.729579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-907a9751-47c8-4cd4-9444-75deeae8eee2 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 204 len: 0 microversion: 2.1 time: 0.120804 Oct 24 10:03:59.730166 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3860/7549] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:03:59 2022] DELETE /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:03:59.738886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:03:59.739456 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:03:59.747861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:59.748360 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:59.748824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:59.749572 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:03:59.750046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:03:59.750494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:03:59.880467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:03:59.888590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b06ef85-1900-458d-9994-5b2b2f1f9da5 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1554 microversion: 2.1 time: 0.153955 Oct 24 10:03:59.889202 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3690/7550] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:03:59 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:04:00.912337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:00.913049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:00.921117 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:00.921631 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:00.922077 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:00.922776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:00.923234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:00.923666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:01.054245 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:01.062106 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f61ee783-a91b-4f5e-82cf-d5fee6c193de tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1554 microversion: 2.1 time: 0.154125 Oct 24 10:04:01.062681 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3861/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:00 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:01.958414 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6eac5b88-a1d7-43e5-8179-3c01e0b2fa55 req-0ef9dcb1-723f-498e-833d-c1abb52ba18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fbb90e-4953-49f3-98f4-f9cb63d32e30", "name": "network-vif-deleted", "tag": "1e2a49c8-b193-4afb-84f9-5647fbd2473b"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:01.968194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6eac5b88-a1d7-43e5-8179-3c01e0b2fa55 req-0ef9dcb1-723f-498e-833d-c1abb52ba18c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:01.968689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6eac5b88-a1d7-43e5-8179-3c01e0b2fa55 req-0ef9dcb1-723f-498e-833d-c1abb52ba18c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:01.969145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6eac5b88-a1d7-43e5-8179-3c01e0b2fa55 req-0ef9dcb1-723f-498e-833d-c1abb52ba18c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:01.981348 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6eac5b88-a1d7-43e5-8179-3c01e0b2fa55 req-0ef9dcb1-723f-498e-833d-c1abb52ba18c service nova] Creating event network-vif-deleted:1e2a49c8-b193-4afb-84f9-5647fbd2473b for instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 on n-h1-master-1 Oct 24 10:04:01.986715 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6eac5b88-a1d7-43e5-8179-3c01e0b2fa55 req-0ef9dcb1-723f-498e-833d-c1abb52ba18c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Oct 24 10:04:01.987315 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3691/7552] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:04:02.085670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:02.086850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:02.093523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:02.094426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:02.094902 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:02.095752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:02.096226 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:02.096709 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:02.130658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:02.131145 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:02.131582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:02.132033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lazy-loading 'fault' on Instance uuid b8fbb90e-4953-49f3-98f4-f9cb63d32e30 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:04:02.174804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99b86166ef34409910f6102dc49589e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf4715cd28d40d08c2527be9671e8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:02.183095 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df9b7f76-d2ee-4be8-8b36-778f02ead973 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 200 len: 1348 microversion: 2.1 time: 0.101667 Oct 24 10:04:02.183683 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3862/7553] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:02 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:03.207311 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:03.208037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] [instance: b8fbb90e-4953-49f3-98f4-f9cb63d32e30] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:03.214814 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:03.215313 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:03.215772 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:03.216482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:03.216956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:03.217434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:03.231117 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] HTTP exception thrown: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 could not be found. Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Request method failure captured: Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 HTTP/1.1 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmGoVSBXRanI2dJ1g-x8JTV4DT0rFrpTegOBek7e2aXU7Ne64EkqDsSzKgnBtNIm6bxRfDIZK_O0JBSrWZZro8vpdfR44WniJ5910hy8h-4iy-hGFzMs1HQiJhWsAOffYPKtCEz-Rw7Fjuf9qMl7u03SKTZ4IN5jAzHOsHQ28JCPw5A Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3cf4715cd28d40d08c2527be9671e8ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3cf4715cd28d40d08c2527be9671e8ca"}]}] Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: 3cf4715cd28d40d08c2527be9671e8ca Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1527097888 Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: b99b86166ef34409910f6102dc49589e Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestMinimumBasicScenario-1527097888-project Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 could not be found. Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b8fbb90e-4953-49f3-98f4-f9cb63d32e30'} Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 could not be found. Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 could not be found. Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:04:03.232758 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 could not be found. Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Returning 404 to user: Instance b8fbb90e-4953-49f3-98f4-f9cb63d32e30 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3bdd5738-4f6e-4aa7-878b-a9f32548e5b4 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30" status: 404 len: 111 microversion: 2.1 time: 0.032103 Oct 24 10:04:03.238150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3692/7554] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:03 2022] GET /compute/v2.1/servers/b8fbb90e-4953-49f3-98f4-f9cb63d32e30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:04:03.242907 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff5aef26-b7a6-4825-8527-e3e9fd920e83 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] Calling method '.version_select at 0x7f8daa3e19d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:03.262666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff5aef26-b7a6-4825-8527-e3e9fd920e83 tempest-TestMinimumBasicScenario-1527097888 tempest-TestMinimumBasicScenario-1527097888-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-319568299" status: 202 len: 0 microversion: 2.1 time: 0.023514 Oct 24 10:04:03.263247 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3863/7555] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 10:04:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-319568299 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:04:12.258722 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1eb241e-ed33-4f0b-b4d0-ff76b0ee4406 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: .version_select at 0x7f8daa0f68b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1857658766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzWFhpCu/reQyPcqEubpLgvRZpleDhOH5q17D/h4h4bQsT+3pC459mgHIGKudBK2qWLPwSGEkc2Y/gHPKXX1IoP5VTdHHCZP6P3oG18pxCdksmUdofMRlc74/5P67vb+w=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:12.274661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c1eb241e-ed33-4f0b-b4d0-ff76b0ee4406 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:04:12.280576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c1eb241e-ed33-4f0b-b4d0-ff76b0ee4406 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:04:12.305284 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1eb241e-ed33-4f0b-b4d0-ff76b0ee4406 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.207065 Oct 24 10:04:12.306415 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3693/7556] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:04:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:04:18.385181 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:18.386506 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:18.392350 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-293701675", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "a12b0530-0155-4c32-a20a-c8e8ab5d00cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1857658766", "security_groups": [{"name": "tempest-secgroup-smoke-462156964"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:18.511549 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] validate_networks() for [('a12b0530-0155-4c32-a20a-c8e8ab5d00cd', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:04:18.978612 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:04:18.979039 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:04:18.979536 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:04:18.979941 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:04:18.980360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:04:18.989542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:18.990022 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:18.990535 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:18.991257 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:18.991715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:18.992138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:19.011175 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:04:19.016393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:04:19.029188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:04:19.031516 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:04:19.080666 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95e4e87b-6882-47aa-9027-4119eec198f8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697821 Oct 24 10:04:19.081341 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3864/7557] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:04:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:04:19.091145 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:19.095829 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1a70dedb-41c3-4163-9c92-25635dc5da09 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:19.096833 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1a70dedb-41c3-4163-9c92-25635dc5da09 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:19.170156 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1a70dedb-41c3-4163-9c92-25635dc5da09 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:19.178968 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1a70dedb-41c3-4163-9c92-25635dc5da09 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1266 microversion: 2.1 time: 0.089406 Oct 24 10:04:19.193732 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3694/7558] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:19 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:20.203018 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:20.203649 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:20.213949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:20.214451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:20.214897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:20.215615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:20.216078 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:20.216517 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:20.283394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:20.291925 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-38253ac7-d59a-4b57-becc-145f15122f02 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1318 microversion: 2.1 time: 0.092835 Oct 24 10:04:20.292525 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3865/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:20 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:21.315855 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:21.316413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:21.321271 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:21.329035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:21.329681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:21.330142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:21.330866 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:21.331524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:21.331972 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:21.547557 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:21.555781 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e28a32e5-1b14-4548-868b-e7edb53365ea tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1391 microversion: 2.1 time: 0.244560 Oct 24 10:04:21.556988 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3695/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:21 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:21.943423 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cfdc3449-4141-4ec2-b913-8f6e319f78b9 req-989448d9-853f-4193-a9a0-c802231f47ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1e8a6c-9f9d-43b2-88cb-0974b7d02771", "tag": "bd07ab86-5c73-453a-af7b-3bd03e76a0eb"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:21.964400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cfdc3449-4141-4ec2-b913-8f6e319f78b9 req-989448d9-853f-4193-a9a0-c802231f47ac service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:21.964897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cfdc3449-4141-4ec2-b913-8f6e319f78b9 req-989448d9-853f-4193-a9a0-c802231f47ac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:21.965569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cfdc3449-4141-4ec2-b913-8f6e319f78b9 req-989448d9-853f-4193-a9a0-c802231f47ac service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:21.976839 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cfdc3449-4141-4ec2-b913-8f6e319f78b9 req-989448d9-853f-4193-a9a0-c802231f47ac service nova] Creating event network-changed:bd07ab86-5c73-453a-af7b-3bd03e76a0eb for instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 on n-h2-master-1 Oct 24 10:04:21.982271 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cfdc3449-4141-4ec2-b913-8f6e319f78b9 req-989448d9-853f-4193-a9a0-c802231f47ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042632 Oct 24 10:04:21.982890 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3866/7561] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:04:22.579028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:22.579651 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:22.586672 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:22.587712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:22.588162 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:22.588863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:22.589713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:22.590133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:22.721200 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:22.729443 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9d8224d-b721-459b-b9fe-c940fb5fc8b8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1391 microversion: 2.1 time: 0.154260 Oct 24 10:04:22.730021 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3696/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:22 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:23.753524 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:23.754240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:23.760725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:23.761228 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:23.761699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:23.762416 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:23.762877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:23.763311 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:23.906683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:23.914860 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f4e284a4-d7f6-4d55-8722-b9c1ca1f16eb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1391 microversion: 2.1 time: 0.166435 Oct 24 10:04:23.915968 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3867/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:23 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:24.941374 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:24.942005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:24.951078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:24.951578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:24.952032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:24.952775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:24.953247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:24.953716 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:25.091037 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:25.099590 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c04f42c7-9a26-4756-95b2-8c53c40feb51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1391 microversion: 2.1 time: 0.162084 Oct 24 10:04:25.100189 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3697/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:24 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:26.122869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:26.123490 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:26.130712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:26.131212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:26.131648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:26.132349 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:26.132996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:26.133454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:26.264788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:26.272595 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c1f48582-09d4-400c-a6b2-f70a7b05f823 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1391 microversion: 2.1 time: 0.153626 Oct 24 10:04:26.273177 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3868/7565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:26 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:26.706741 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b9655884-48d2-4f33-ac97-11f1fdf747c2 req-ae1f014e-ce80-4a22-bc8d-3ac81843835d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1e8a6c-9f9d-43b2-88cb-0974b7d02771", "name": "network-vif-plugged", "status": "completed", "tag": "bd07ab86-5c73-453a-af7b-3bd03e76a0eb"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:26.718051 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9655884-48d2-4f33-ac97-11f1fdf747c2 req-ae1f014e-ce80-4a22-bc8d-3ac81843835d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:26.718540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9655884-48d2-4f33-ac97-11f1fdf747c2 req-ae1f014e-ce80-4a22-bc8d-3ac81843835d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:26.719022 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b9655884-48d2-4f33-ac97-11f1fdf747c2 req-ae1f014e-ce80-4a22-bc8d-3ac81843835d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:26.730464 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b9655884-48d2-4f33-ac97-11f1fdf747c2 req-ae1f014e-ce80-4a22-bc8d-3ac81843835d service nova] Creating event network-vif-plugged:bd07ab86-5c73-453a-af7b-3bd03e76a0eb for instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 on n-h2-master-1 Oct 24 10:04:26.735560 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b9655884-48d2-4f33-ac97-11f1fdf747c2 req-ae1f014e-ce80-4a22-bc8d-3ac81843835d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032601 Oct 24 10:04:26.736150 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3698/7566] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:04:27.296180 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:27.296808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:27.303715 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:27.304207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:27.304654 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:27.305385 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:27.306378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:27.306816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:27.440062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:27.447683 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00242b29-b9ee-496a-9655-a0d0fb22a00d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1391 microversion: 2.1 time: 0.155396 Oct 24 10:04:27.448259 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3869/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:27 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:28.471819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:28.472527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:28.479017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:28.479513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:28.479961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:28.480662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:28.481128 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:28.481606 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:28.614136 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:28.622493 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-893953e1-fc11-49f2-b6c7-2ddc7181c430 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1563 microversion: 2.1 time: 0.155720 Oct 24 10:04:28.623072 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3699/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:28 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:28.645953 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:28.646578 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:28.653392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:28.653883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:28.654325 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:28.655012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:28.655469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:28.655899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:28.784951 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:28.793259 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2b9d492-8859-4103-98fe-2233e97f75e0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1563 microversion: 2.1 time: 0.151268 Oct 24 10:04:28.793917 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3870/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:28 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:30.345322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:04:30.350526 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5fa51c4a-5e36-4f80-9714-c4eea8e4af5d req-976e2a97-ac1f-4ec6-84a6-3d6441f438ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1e8a6c-9f9d-43b2-88cb-0974b7d02771", "tag": "bd07ab86-5c73-453a-af7b-3bd03e76a0eb"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:30.356080 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:30.356754 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:30.358217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:30.360320 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:30.366882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:30.367390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:30.367861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:30.368586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:30.369053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:30.371064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:30.377199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5fa51c4a-5e36-4f80-9714-c4eea8e4af5d req-976e2a97-ac1f-4ec6-84a6-3d6441f438ee service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:30.377750 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5fa51c4a-5e36-4f80-9714-c4eea8e4af5d req-976e2a97-ac1f-4ec6-84a6-3d6441f438ee service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:30.378189 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5fa51c4a-5e36-4f80-9714-c4eea8e4af5d req-976e2a97-ac1f-4ec6-84a6-3d6441f438ee service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:30.391218 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5fa51c4a-5e36-4f80-9714-c4eea8e4af5d req-976e2a97-ac1f-4ec6-84a6-3d6441f438ee service nova] Creating event network-changed:bd07ab86-5c73-453a-af7b-3bd03e76a0eb for instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 on n-h2-master-1 Oct 24 10:04:30.397051 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5fa51c4a-5e36-4f80-9714-c4eea8e4af5d req-976e2a97-ac1f-4ec6-84a6-3d6441f438ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050257 Oct 24 10:04:30.398442 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3871/7570] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:04:30.598894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:04:30.608660 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13f095e1-f8b4-4ea3-aef0-accf25317908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1563 microversion: 2.1 time: 0.267490 Oct 24 10:04:30.624143 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3700/7571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:04:30 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:04:55.908477 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:55.909287 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=36 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:55.913570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:04:55.915908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:04:55.923510 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:55.924004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:55.924453 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:55.925153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:04:55.925650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:04:55.926085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:04:55.990481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c7d57d43-45ce-49a8-b86b-6362c1a4c793 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action" status: 200 len: 24571 microversion: 2.1 time: 0.084196 Oct 24 10:04:55.991127 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3872/7572] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:04:55 2022] POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:05:07.031021 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:07.031626 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:07.034008 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=11 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:07.034847 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=32 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:07.040293 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:07.040793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:07.041248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:07.041989 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:07.042459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:07.042903 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:07.115499 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b9bfe332-e31f-40fc-9592-fc61ba593e42 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action" status: 202 len: 0 microversion: 2.1 time: 0.087642 Oct 24 10:05:07.116324 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3701/7573] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:05:07 2022] POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:05:07.125917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:07.126632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:07.129161 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:07.130157 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:07.136668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:07.137171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:07.137652 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:07.138357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:07.138822 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:07.139256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:07.271848 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:07.280247 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8f2b3af8-c8df-4159-8f31-e4deb0bd6061 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1687 microversion: 2.1 time: 0.158808 Oct 24 10:05:07.281083 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3873/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:07 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:08.306862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:08.307581 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:08.315390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:08.315888 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:08.316343 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:08.317048 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:08.317543 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:08.317988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:08.449814 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:08.457629 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4571d17e-5e6f-4102-98c6-1fe3da81b9a1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1667 microversion: 2.1 time: 0.155525 Oct 24 10:05:08.458200 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3702/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:08 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:09.553307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:09.555707 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:09.564179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:09.564666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:09.565118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:09.565820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:09.566271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:09.566696 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:09.628048 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52d47b98-c48d-4132-a232-92bd6ed26d15 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action" status: 200 len: 32636 microversion: 2.1 time: 0.078491 Oct 24 10:05:09.628717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3874/7576] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:05:09 2022] POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action => generated 32636 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:05:09.640444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:09.640996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:09.647819 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:09.648314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:09.648766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:09.649508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:09.649978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:09.650421 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:09.718143 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-890051cb-0064-4c01-9f07-fa416807c382 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action" status: 202 len: 0 microversion: 2.1 time: 0.081410 Oct 24 10:05:09.718808 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3703/7577] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:05:09 2022] POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:05:09.728332 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:09.729804 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:09.737198 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:09.737728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:09.738833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:09.739640 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:09.740337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:09.740787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:09.876272 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:09.884067 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1177d66f-7da0-416e-afc3-23faee6dac2c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1674 microversion: 2.1 time: 0.160709 Oct 24 10:05:09.885316 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3875/7578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:09 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:10.910866 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:10.911579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:10.918340 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:10.918838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:10.919294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:10.920002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:10.920485 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:10.920911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:11.051811 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:11.060312 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ea713c7-1616-496b-a9a7-c6c899dde107 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1682 microversion: 2.1 time: 0.154808 Oct 24 10:05:11.060887 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3704/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:10 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:11.155244 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:11.157790 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:11.165310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:11.166285 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:11.166733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:11.167424 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:11.167881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:11.168310 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:11.220326 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6de08284-3e61-4c30-8440-95d16d5b3cfd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action" status: 200 len: 38440 microversion: 2.1 time: 0.069152 Oct 24 10:05:11.220974 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3876/7580] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:05:11 2022] POST /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771/action => generated 38440 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:05:12.237894 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:12.238412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:12.240890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e2015a2f-f17e-4c8f-abed-264fc4ad99e5 req-a2065053-915b-4679-bc5f-7ab35ee2cd86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1e8a6c-9f9d-43b2-88cb-0974b7d02771", "tag": "bd07ab86-5c73-453a-af7b-3bd03e76a0eb"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:12.246557 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:12.247058 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:12.247510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:12.248224 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:12.248688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:12.249272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:12.253262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e2015a2f-f17e-4c8f-abed-264fc4ad99e5 req-a2065053-915b-4679-bc5f-7ab35ee2cd86 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:12.254132 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e2015a2f-f17e-4c8f-abed-264fc4ad99e5 req-a2065053-915b-4679-bc5f-7ab35ee2cd86 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:12.254662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e2015a2f-f17e-4c8f-abed-264fc4ad99e5 req-a2065053-915b-4679-bc5f-7ab35ee2cd86 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:12.267191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e2015a2f-f17e-4c8f-abed-264fc4ad99e5 req-a2065053-915b-4679-bc5f-7ab35ee2cd86 service nova] Creating event network-changed:bd07ab86-5c73-453a-af7b-3bd03e76a0eb for instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 on n-h2-master-1 Oct 24 10:05:12.272387 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e2015a2f-f17e-4c8f-abed-264fc4ad99e5 req-a2065053-915b-4679-bc5f-7ab35ee2cd86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Oct 24 10:05:12.273141 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3877/7581] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:05:12.277005 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:05:12.367546 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b662afc9-aa44-4412-90fd-e71690721029 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 204 len: 0 microversion: 2.1 time: 0.133232 Oct 24 10:05:12.369710 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3705/7582] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:05:12 2022] DELETE /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:05:12.380561 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:12.381584 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:12.391306 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:12.392053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:12.392531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:12.393833 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:12.394401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:12.394997 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:12.536755 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:12.545060 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cdf2f329-97cb-4d5f-a573-26abf19e53fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1688 microversion: 2.1 time: 0.169337 Oct 24 10:05:12.545675 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3878/7583] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:12 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:13.574687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:13.575420 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:13.582260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:13.582764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:13.583222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:13.583939 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:13.584415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:13.584864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:13.715208 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:13.723055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3042f02e-bd5a-45f1-aa69-dd77ab645d1a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1688 microversion: 2.1 time: 0.153244 Oct 24 10:05:13.723635 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3706/7584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:13 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:14.674976 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1fac6586-e4ee-45b2-8a18-8586389c2d1c req-79e5f2dc-ef60-4792-b453-6ec2bbaf5ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1e8a6c-9f9d-43b2-88cb-0974b7d02771", "name": "network-vif-deleted", "tag": "bd07ab86-5c73-453a-af7b-3bd03e76a0eb"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:14.685331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1fac6586-e4ee-45b2-8a18-8586389c2d1c req-79e5f2dc-ef60-4792-b453-6ec2bbaf5ff1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:14.685758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1fac6586-e4ee-45b2-8a18-8586389c2d1c req-79e5f2dc-ef60-4792-b453-6ec2bbaf5ff1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:14.686195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1fac6586-e4ee-45b2-8a18-8586389c2d1c req-79e5f2dc-ef60-4792-b453-6ec2bbaf5ff1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:14.700961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1fac6586-e4ee-45b2-8a18-8586389c2d1c req-79e5f2dc-ef60-4792-b453-6ec2bbaf5ff1 service nova] Creating event network-vif-deleted:bd07ab86-5c73-453a-af7b-3bd03e76a0eb for instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 on n-h2-master-1 Oct 24 10:05:14.705848 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1fac6586-e4ee-45b2-8a18-8586389c2d1c req-79e5f2dc-ef60-4792-b453-6ec2bbaf5ff1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Oct 24 10:05:14.706470 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3879/7585] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:05:14.747214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:14.747845 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:14.755652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:14.756662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:14.757334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:14.758068 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:14.759919 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:14.760375 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:14.793795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:14.794294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:14.794759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:14.795229 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lazy-loading 'fault' on Instance uuid 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:05:14.841772 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:14.849641 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6171fd26-b379-4a9a-9e14-491605541d43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 200 len: 1356 microversion: 2.1 time: 0.106656 Oct 24 10:05:14.850436 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3707/7586] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:14 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:15.874562 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:15.875308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:15.881511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:15.881999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:15.882439 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:15.883128 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:15.883586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:15.884013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:15.897123 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] HTTP exception thrown: Instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 could not be found. Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Request method failure captured: Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 HTTP/1.1 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmMbYI4y3T_wI_yt_R1BmKED1P7vQvRXCgo8P40XkGEnNAJ9OasrjRR_rHwzGL68747SRTdrocpD2w-kgpMluCHGsbbNyQ9yS59yx-m71Pqr1V2iYSOyV7zYDXzcWsLPE6nmDyIKAOXzS_ICq5RWCoQ1MI_R20w9iIcxkQrDvG4mbvg Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb905347dd6e4086ace6b3acb35ef30b"}]}] Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8291b3fbb6324df8a1111509a3b39d2d Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 could not be found. Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8c1e8a6c-9f9d-43b2-88cb-0974b7d02771'} Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 could not be found. Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 could not be found. Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:05:15.898767 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 could not be found. Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Returning 404 to user: Instance 8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fe38f94c-3b2a-407c-a231-36a94252ff9d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771" status: 404 len: 111 microversion: 2.1 time: 0.031929 Oct 24 10:05:15.904397 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3880/7587] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:15 2022] GET /compute/v2.1/servers/8c1e8a6c-9f9d-43b2-88cb-0974b7d02771 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:05:19.135500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2ee4189-4295-4558-bb01-8fcd1142b852 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '.version_select at 0x7f8da99dfee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:19.157074 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2ee4189-4295-4558-bb01-8fcd1142b852 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1857658766" status: 202 len: 0 microversion: 2.1 time: 0.025781 Oct 24 10:05:19.157901 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3708/7588] 10.222.0.25 () {58 vars in 1284 bytes} [Mon Oct 24 10:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1857658766 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:05:19.179942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2929f6b7-0b84-4834-bbf3-9431d8506a63 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: .version_select at 0x7f8da9e7a0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-748595892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNGjqFUBHJFB8QsE26FE8QIa7L8SRQviGauIbumUeW1dXyeEcamXGDVOu1wHAbkp8/uCEjwsfJLPM6qpTgh0rbugknYQ5FjOjMWlOX09TFLSwIUTJX9WkqqFGGOPcqawA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:19.197184 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2929f6b7-0b84-4834-bbf3-9431d8506a63 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:05:19.204714 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-2929f6b7-0b84-4834-bbf3-9431d8506a63 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:05:19.230385 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2929f6b7-0b84-4834-bbf3-9431d8506a63 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054592 Oct 24 10:05:19.236757 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3881/7589] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:05:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:05:24.668911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1776749287", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "8b41bf03-9e64-4b6a-a793-486d312b4162"}], "key_name": "tempest-TestNetworkAdvancedServerOps-748595892", "security_groups": [{"name": "tempest-secgroup-smoke-1849853230"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:24.779382 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] validate_networks() for [('8b41bf03-9e64-4b6a-a793-486d312b4162', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:05:24.846116 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:25.279391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:05:25.279835 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:05:25.280321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:05:25.280743 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:05:25.281170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:05:25.291890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:25.292423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:25.292881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:25.293890 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:25.294539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:25.294991 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:25.325412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:05:25.333953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:05:25.349572 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:05:25.352029 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:05:25.421227 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0696c075-b909-4b75-9970-09cf029a505b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753061 Oct 24 10:05:25.428535 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3709/7590] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:05:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:05:25.435494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc04ec43-e2f2-4d16-869b-4eb69d2ef03d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:25.436715 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc04ec43-e2f2-4d16-869b-4eb69d2ef03d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:25.506093 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc04ec43-e2f2-4d16-869b-4eb69d2ef03d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:25.514445 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc04ec43-e2f2-4d16-869b-4eb69d2ef03d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1266 microversion: 2.1 time: 0.083222 Oct 24 10:05:25.517656 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3882/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:25 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:26.540740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:26.541408 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:26.548397 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:26.548936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:26.549781 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:26.550840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:26.551613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:26.552248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:26.619885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:26.629231 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea12aa54-827b-4957-a86a-996c1a5462c3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1318 microversion: 2.1 time: 0.093867 Oct 24 10:05:26.636780 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3710/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:26 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:05:27.653894 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:27.655142 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:27.661150 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=32 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:27.664160 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:27.664680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:27.665392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:27.666108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:27.666740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:27.667168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:28.124932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:28.132604 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-18b26e2b-3f4a-4636-b54a-a03588938784 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1392 microversion: 2.1 time: 0.483137 Oct 24 10:05:28.133180 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3883/7593] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:27 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:28.631870 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9dbee956-3457-46cb-b536-502b6643bb96 req-95ce60c2-030c-4ae9-926f-37e1bc98c974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab5550b-5182-4c93-8448-7f1fed449e0b", "tag": "e16ca824-1018-48d6-9087-7732a0da815a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:28.643786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9dbee956-3457-46cb-b536-502b6643bb96 req-95ce60c2-030c-4ae9-926f-37e1bc98c974 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:28.645398 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9dbee956-3457-46cb-b536-502b6643bb96 req-95ce60c2-030c-4ae9-926f-37e1bc98c974 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:28.645723 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9dbee956-3457-46cb-b536-502b6643bb96 req-95ce60c2-030c-4ae9-926f-37e1bc98c974 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:28.657935 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9dbee956-3457-46cb-b536-502b6643bb96 req-95ce60c2-030c-4ae9-926f-37e1bc98c974 service nova] Creating event network-changed:e16ca824-1018-48d6-9087-7732a0da815a for instance 8ab5550b-5182-4c93-8448-7f1fed449e0b on n-h1-master-1 Oct 24 10:05:28.662862 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9dbee956-3457-46cb-b536-502b6643bb96 req-95ce60c2-030c-4ae9-926f-37e1bc98c974 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036279 Oct 24 10:05:28.663896 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3711/7594] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:05:29.156539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:29.157157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:29.164478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:29.164962 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:29.165437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:29.166123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:29.166648 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:29.167100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:29.303181 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:29.311856 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c23679f6-4d9c-40b2-9ee2-3d9ae92a92b7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1392 microversion: 2.1 time: 0.159244 Oct 24 10:05:29.312439 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3884/7595] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:29 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:30.336940 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:30.337682 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:30.343807 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:30.344305 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:30.344763 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:30.345510 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:30.345983 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:30.346428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:30.537573 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:30.545179 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97037406-2c22-42a6-91e6-a043d944b754 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1392 microversion: 2.1 time: 0.213409 Oct 24 10:05:30.545782 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3712/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:30 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:31.567798 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:31.568419 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:31.576542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:31.576990 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:31.577469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:31.578246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:31.578632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:31.579054 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:31.759491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:31.767354 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d066994-e395-4eb8-abd8-e23f0159406a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1392 microversion: 2.1 time: 0.203492 Oct 24 10:05:31.767934 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3885/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:31 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:32.790972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:32.791612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:32.798467 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:32.798981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:32.799443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:32.800159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:32.800632 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:32.801082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:32.937123 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:32.945088 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23aa8b49-afd3-42b1-8468-6fc246996e22 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1392 microversion: 2.1 time: 0.158069 Oct 24 10:05:32.945684 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3713/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:32 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:33.580805 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ed2f5c8d-2849-471c-890f-4f04d50ef607 req-819e1192-2168-4416-b7e0-66850e4dab96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab5550b-5182-4c93-8448-7f1fed449e0b", "name": "network-vif-plugged", "status": "completed", "tag": "e16ca824-1018-48d6-9087-7732a0da815a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:33.592211 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ed2f5c8d-2849-471c-890f-4f04d50ef607 req-819e1192-2168-4416-b7e0-66850e4dab96 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:33.592687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ed2f5c8d-2849-471c-890f-4f04d50ef607 req-819e1192-2168-4416-b7e0-66850e4dab96 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:33.593480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ed2f5c8d-2849-471c-890f-4f04d50ef607 req-819e1192-2168-4416-b7e0-66850e4dab96 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:33.605961 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ed2f5c8d-2849-471c-890f-4f04d50ef607 req-819e1192-2168-4416-b7e0-66850e4dab96 service nova] Creating event network-vif-plugged:e16ca824-1018-48d6-9087-7732a0da815a for instance 8ab5550b-5182-4c93-8448-7f1fed449e0b on n-h1-master-1 Oct 24 10:05:33.610918 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ed2f5c8d-2849-471c-890f-4f04d50ef607 req-819e1192-2168-4416-b7e0-66850e4dab96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Oct 24 10:05:33.611639 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3886/7599] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:05:33.968520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:33.969153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:33.976055 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:33.976558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:33.977011 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:33.978492 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:33.978967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:33.979413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:34.112195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:34.120010 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fa1b6823-e3f7-4c79-b307-df35b0488f29 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1392 microversion: 2.1 time: 0.155423 Oct 24 10:05:34.120584 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3714/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:33 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:35.144831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:35.146172 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:35.152407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:35.152890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:35.153356 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:35.154045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:35.154514 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:35.154923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:35.285167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:35.293481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-93fc8e83-6850-4ee2-a794-fa85f5f0a919 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1563 microversion: 2.1 time: 0.153813 Oct 24 10:05:35.294059 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3887/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:35 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:35.391312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:35.391877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:35.395157 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:35.395845 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:35.403225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:35.403728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:35.404183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:35.404896 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:35.405392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:35.405840 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:35.539076 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:35.547696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-da918374-f0dc-4166-a557-9905e78ca05d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1563 microversion: 2.1 time: 0.160276 Oct 24 10:05:35.548276 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3715/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:35 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:37.109683 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:05:37.110403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:37.110904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-feb52922-8870-4cca-be12-dccffbed8e58 req-9274e835-6bc5-422a-b9ae-8d41bc42761a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab5550b-5182-4c93-8448-7f1fed449e0b", "tag": "e16ca824-1018-48d6-9087-7732a0da815a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:37.113732 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:37.117586 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:37.119267 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:37.119766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:37.120855 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:37.121000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:37.121459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:37.121893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:37.125168 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-feb52922-8870-4cca-be12-dccffbed8e58 req-9274e835-6bc5-422a-b9ae-8d41bc42761a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:37.125735 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-feb52922-8870-4cca-be12-dccffbed8e58 req-9274e835-6bc5-422a-b9ae-8d41bc42761a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:37.126192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-feb52922-8870-4cca-be12-dccffbed8e58 req-9274e835-6bc5-422a-b9ae-8d41bc42761a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:37.146607 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-feb52922-8870-4cca-be12-dccffbed8e58 req-9274e835-6bc5-422a-b9ae-8d41bc42761a service nova] Creating event network-changed:e16ca824-1018-48d6-9087-7732a0da815a for instance 8ab5550b-5182-4c93-8448-7f1fed449e0b on n-h1-master-1 Oct 24 10:05:37.153417 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-feb52922-8870-4cca-be12-dccffbed8e58 req-9274e835-6bc5-422a-b9ae-8d41bc42761a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045859 Oct 24 10:05:37.154064 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3716/7603] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:05:37.314329 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:05:37.324067 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07e52035-ce4e-4d82-8509-c7d83e7dd1da tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1563 microversion: 2.1 time: 0.219317 Oct 24 10:05:37.324786 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3888/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:05:37 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:05:58.570630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:05:58.572869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:05:58.576134 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=36 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:58.582719 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:58.583222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:58.583680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:58.584393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:05:58.584870 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:05:58.585768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:05:58.659111 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa25a1ad-91d3-4f14-a0a8-8696f483d296 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b/action" status: 200 len: 24571 microversion: 2.1 time: 0.092622 Oct 24 10:05:58.661895 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3717/7605] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:05:58 2022] POST /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b/action => generated 24571 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:06:09.579340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:06:09.581608 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:09.583734 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:09.584546 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=32 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:09.590406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:09.590898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:09.591397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:09.592085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:09.592546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:09.592978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:09.665399 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4f305c5-c313-472d-bbf1-d7c862602334 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b/action" status: 202 len: 0 microversion: 2.1 time: 0.089398 Oct 24 10:06:09.666238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3889/7606] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:06:09 2022] POST /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:06:09.674739 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:09.675563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:09.678383 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:09.679139 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:09.685601 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:09.686107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:09.686566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:09.687312 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:09.687786 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:09.688235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:09.824215 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:09.831990 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-416c4f33-6abe-4618-b1b5-66e7053a53af tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1673 microversion: 2.1 time: 0.161510 Oct 24 10:06:09.832763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3718/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:09 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:10.858030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:10.858733 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:10.864837 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:10.865357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:10.865804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:10.866491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:10.866951 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:10.867379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:11.003717 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:11.011843 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a4c724c-0937-49d2-a698-eede5b425d16 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.159503 Oct 24 10:06:11.012412 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3890/7608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:10 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:12.036313 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:12.036938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:12.044101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:12.044598 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:12.045050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:12.045791 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:12.046257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:12.046863 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:12.184008 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:12.192474 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6767efd-4a34-43c5-8b25-3940495b486c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.160431 Oct 24 10:06:12.193118 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3719/7609] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:12 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:13.218211 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:13.218828 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:13.225969 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:13.226455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:13.226897 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:13.227589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:13.228049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:13.228478 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:13.354997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:13.362669 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9ac71ed-02bd-4428-893c-ec5f9cca33a2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.148434 Oct 24 10:06:13.363238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3891/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:13 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:14.387195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:14.387816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:14.394573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:14.395064 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:14.395513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:14.396208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:14.396670 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:14.397107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:14.529080 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:14.537057 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0557e6ab-328a-4de0-9d11-d2bf0f35886e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.154334 Oct 24 10:06:14.537655 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3720/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:14 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:15.560665 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:15.561729 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:15.568114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:15.568604 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:15.569050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:15.569770 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:15.570234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:15.570666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:15.702431 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:15.710122 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e5be317-d3f9-43a6-a892-3bb0d13d36ce tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.153427 Oct 24 10:06:15.710705 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3892/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:15 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:16.734002 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:16.734652 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:16.741483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:16.741981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:16.742426 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:16.743795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:16.744266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:16.744708 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:16.873214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:16.880985 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-df9461b0-5cdf-4585-a291-c234259b1e90 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.150942 Oct 24 10:06:16.881578 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3721/7613] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:16 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:17.905025 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:17.905666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:17.912708 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:17.913194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:17.913673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:17.914366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:17.914824 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:17.915914 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:18.044944 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:18.052505 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35b4571a-d45a-4806-8518-51f767c15bf1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.151389 Oct 24 10:06:18.053075 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3893/7614] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:17 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:19.076392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:19.077028 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:19.084037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:19.084542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:19.085002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:19.085752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:19.086231 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:19.086681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:19.223003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:19.231013 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-033f6c25-bb76-4db2-b870-49abb1f7d22c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.158617 Oct 24 10:06:19.231596 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3722/7615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:19 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:20.254920 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:20.255575 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:20.262650 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:20.263171 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:20.263617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:20.264314 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:20.264780 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:20.265215 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:20.395728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:20.403923 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b67de0a0-21e9-47b8-920e-accb5962e46c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.152863 Oct 24 10:06:20.404449 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3894/7616] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:20 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:21.427938 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:21.428500 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:21.436072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:21.436563 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:21.437012 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:21.437740 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:21.438206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:21.438644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:21.576217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:21.584050 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fc912634-17ad-463a-b7da-29c6f1fe8d9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.160091 Oct 24 10:06:21.584640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3723/7617] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:21 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:22.608551 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:22.609146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:22.616037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:22.616521 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:22.616956 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:22.617680 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:22.618740 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:22.620199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:22.753933 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:22.761668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dcc477af-46bf-412f-abd0-2eee9decc1ed tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.156976 Oct 24 10:06:22.762238 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3895/7618] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:22 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:23.785328 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:23.785953 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:23.793308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:23.793810 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:23.794262 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:23.794962 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:23.795430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:23.795871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:23.924533 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:23.932396 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8153f935-d042-4d7f-b525-182884f84c17 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.151330 Oct 24 10:06:23.932968 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3724/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:23 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:24.956132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:24.956739 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:24.963662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:24.964143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:24.964586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:24.965276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:24.965766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:24.966197 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:25.094897 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:25.103290 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2e006739-de9d-4d7b-8544-468781e52cb9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1678 microversion: 2.1 time: 0.151056 Oct 24 10:06:25.103865 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3896/7620] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:24 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:26.127740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:26.128373 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:26.135800 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:26.136302 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:26.136765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:26.137540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:26.138020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:26.138470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:26.272516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:26.280267 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e2a7f83-9328-468c-8e11-f54f693764bb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1681 microversion: 2.1 time: 0.156492 Oct 24 10:06:26.280836 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3725/7621] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:26 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:50.467491 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:06:50.469659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:50.471866 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:50.472541 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:50.478200 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:50.478692 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:50.479138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:50.479847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:50.480341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:50.480776 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:50.562220 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12359757-6daf-42b8-920e-2373a1534a0e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b/action" status: 200 len: 69023 microversion: 2.1 time: 0.098789 Oct 24 10:06:50.562909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3897/7622] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:06:50 2022] POST /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b/action => generated 69023 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:06:57.898394 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:57.899816 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:57.903405 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=16 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:57.904292 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=48 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:06:57.904878 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-64843075-de6d-47e8-8737-93697dbedbd2 req-f359b514-1fe9-46b7-9f53-5c5ee39d7cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab5550b-5182-4c93-8448-7f1fed449e0b", "tag": "e16ca824-1018-48d6-9087-7732a0da815a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:06:57.908353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:57.908864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:57.909335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:57.910230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:57.910706 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:57.911159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:57.915812 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-64843075-de6d-47e8-8737-93697dbedbd2 req-f359b514-1fe9-46b7-9f53-5c5ee39d7cd2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:57.917406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-64843075-de6d-47e8-8737-93697dbedbd2 req-f359b514-1fe9-46b7-9f53-5c5ee39d7cd2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:57.917406 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-64843075-de6d-47e8-8737-93697dbedbd2 req-f359b514-1fe9-46b7-9f53-5c5ee39d7cd2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:57.928438 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-64843075-de6d-47e8-8737-93697dbedbd2 req-f359b514-1fe9-46b7-9f53-5c5ee39d7cd2 service nova] Creating event network-changed:e16ca824-1018-48d6-9087-7732a0da815a for instance 8ab5550b-5182-4c93-8448-7f1fed449e0b on n-h1-master-1 Oct 24 10:06:57.933576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-64843075-de6d-47e8-8737-93697dbedbd2 req-f359b514-1fe9-46b7-9f53-5c5ee39d7cd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032601 Oct 24 10:06:57.934435 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3898/7623] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:06:57.937970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:06:58.020619 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-873bdc59-bdb0-409f-827a-39da2d829b43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 204 len: 0 microversion: 2.1 time: 0.125677 Oct 24 10:06:58.021496 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3726/7624] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:06:57 2022] DELETE /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:06:58.030728 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:58.031444 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:58.038527 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:58.039400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:58.039753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:58.040460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:58.040937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:58.041392 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:58.175972 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:58.184841 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fcfcea41-83e2-4583-967b-3cfbc2a35464 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1687 microversion: 2.1 time: 0.158309 Oct 24 10:06:58.185448 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3899/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:58 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:06:59.210213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:06:59.210931 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:06:59.218356 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:59.218850 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:59.219300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:59.220004 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:06:59.220469 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:06:59.220910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:06:59.361797 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:06:59.370130 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e03d2fb-bd4e-409d-8add-3f6b3b745ec7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1687 microversion: 2.1 time: 0.164167 Oct 24 10:06:59.370707 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3727/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:06:59 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:00.341375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-e17c2235-28a9-4509-9f5a-a9407e704773 req-4885d3f2-c751-40cc-9d27-56c44de0d971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab5550b-5182-4c93-8448-7f1fed449e0b", "name": "network-vif-deleted", "tag": "e16ca824-1018-48d6-9087-7732a0da815a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:00.352459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e17c2235-28a9-4509-9f5a-a9407e704773 req-4885d3f2-c751-40cc-9d27-56c44de0d971 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:00.352940 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e17c2235-28a9-4509-9f5a-a9407e704773 req-4885d3f2-c751-40cc-9d27-56c44de0d971 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:00.353966 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-e17c2235-28a9-4509-9f5a-a9407e704773 req-4885d3f2-c751-40cc-9d27-56c44de0d971 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:00.365526 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-e17c2235-28a9-4509-9f5a-a9407e704773 req-4885d3f2-c751-40cc-9d27-56c44de0d971 service nova] Creating event network-vif-deleted:e16ca824-1018-48d6-9087-7732a0da815a for instance 8ab5550b-5182-4c93-8448-7f1fed449e0b on n-h1-master-1 Oct 24 10:07:00.371387 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-e17c2235-28a9-4509-9f5a-a9407e704773 req-4885d3f2-c751-40cc-9d27-56c44de0d971 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Oct 24 10:07:00.372290 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3900/7627] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:07:00.394392 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:00.395025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:00.402701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:00.403453 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:00.404101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:00.404820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:00.405289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:00.405752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:00.470882 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:00.479327 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2427d66-ecf5-43f3-918f-694147f55c56 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 200 len: 1351 microversion: 2.1 time: 0.088971 Oct 24 10:07:00.479910 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3728/7628] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:00 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:01.504096 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:01.504793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 8ab5550b-5182-4c93-8448-7f1fed449e0b] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:01.511432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:01.511911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:01.512350 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:01.513542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:01.514001 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:01.514431 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:01.528286 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] HTTP exception thrown: Instance 8ab5550b-5182-4c93-8448-7f1fed449e0b could not be found. Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Request method failure captured: Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b HTTP/1.1 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmMbYI4y3T_wI_yt_R1BmKED1P7vQvRXCgo8P40XkGEnNAJ9OasrjRR_rHwzGL68747SRTdrocpD2w-kgpMluCHGsbbNyQ9yS59yx-m71Pqr1V2iYSOyV7zYDXzcWsLPE6nmDyIKAOXzS_ICq5RWCoQ1MI_R20w9iIcxkQrDvG4mbvg Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb905347dd6e4086ace6b3acb35ef30b"}]}] Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8291b3fbb6324df8a1111509a3b39d2d Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 8ab5550b-5182-4c93-8448-7f1fed449e0b could not be found. Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '8ab5550b-5182-4c93-8448-7f1fed449e0b'} Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab5550b-5182-4c93-8448-7f1fed449e0b could not be found. Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab5550b-5182-4c93-8448-7f1fed449e0b could not be found. Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:07:01.529962 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab5550b-5182-4c93-8448-7f1fed449e0b could not be found. Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Returning 404 to user: Instance 8ab5550b-5182-4c93-8448-7f1fed449e0b could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-344a678e-5a95-4f6f-b04d-b44ea7824a11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b" status: 404 len: 111 microversion: 2.1 time: 0.032483 Oct 24 10:07:01.535740 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3901/7629] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:01 2022] GET /compute/v2.1/servers/8ab5550b-5182-4c93-8448-7f1fed449e0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:07:04.932378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-931c1605-de15-404c-88cb-4a52b9c61b09 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '.version_select at 0x7f8daa0e4a60>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:04.956133 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-931c1605-de15-404c-88cb-4a52b9c61b09 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-748595892" status: 202 len: 0 microversion: 2.1 time: 0.028108 Oct 24 10:07:04.956908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3729/7630] 10.222.0.25 () {58 vars in 1281 bytes} [Mon Oct 24 10:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-748595892 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:07:04.987644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-73ba70b6-8921-4596-8cec-8740aded0024 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: .version_select at 0x7f8dab0cfd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-923764664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANJeqIPWbii0EJ9p01D13Pvg+zRkO/BdEVJa7THI5BnUkTIzXTzkMow+KgrSMf+LHFgtKFuO0YVq8eFmIUjht2Cw6F3iAaVjAiG84lVoecpR0Nmw5C4FWcCehq1q1prnA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:05.004242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-73ba70b6-8921-4596-8cec-8740aded0024 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:07:05.013474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-73ba70b6-8921-4596-8cec-8740aded0024 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:07:05.036893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-73ba70b6-8921-4596-8cec-8740aded0024 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053324 Oct 24 10:07:05.037558 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3902/7631] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:07:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:07:10.176198 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-372101824", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "1b646c5c-0f03-431e-aa22-57526b8957bb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-923764664", "security_groups": [{"name": "tempest-secgroup-smoke-1916049159"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:10.318578 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] validate_networks() for [('1b646c5c-0f03-431e-aa22-57526b8957bb', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:07:10.480109 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:11.043740 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:07:11.044263 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:07:11.044823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:07:11.045402 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:07:11.045914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:07:11.056447 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:11.056945 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:11.057455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:11.058493 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:11.059129 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:11.059573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:11.077674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:07:11.082890 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:07:11.096254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:07:11.098587 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:07:11.148041 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3515eeae-2340-45e6-b46a-269184743633 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.977144 Oct 24 10:07:11.149152 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3730/7632] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:07:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:07:11.162315 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa71aff0-96a5-4618-b834-8d93ab6746e4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:11.163176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa71aff0-96a5-4618-b834-8d93ab6746e4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:11.230043 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa71aff0-96a5-4618-b834-8d93ab6746e4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:11.238092 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa71aff0-96a5-4618-b834-8d93ab6746e4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1265 microversion: 2.1 time: 0.081700 Oct 24 10:07:11.238705 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3903/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:11 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:07:12.261493 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:12.262133 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:12.271176 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:12.271693 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:12.272347 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:12.273274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:12.273944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:12.274644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:12.352003 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:12.360239 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64b6ff66-213a-4536-ace6-a41d4e7b484c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1325 microversion: 2.1 time: 0.103228 Oct 24 10:07:12.364199 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3731/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:12 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:13.384806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:13.386162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:13.388587 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:13.389595 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:07:13.389754 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 (ip 10.222.0.25) !!! Oct 24 10:07:13.398922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:13.399417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:13.399888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:13.400600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:13.401061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:13.401528 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:13.691442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:13.701174 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efa6c332-c323-41f6-9972-c8d5f3df10a8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.320783 Oct 24 10:07:13.702177 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3904/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:13 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:14.231242 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-64010acf-d62b-4e3f-9344-00b8f22c6dea req-ec9fd31a-7266-44a4-a581-03d4406c53f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:14.241332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-64010acf-d62b-4e3f-9344-00b8f22c6dea req-ec9fd31a-7266-44a4-a581-03d4406c53f8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:14.241897 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-64010acf-d62b-4e3f-9344-00b8f22c6dea req-ec9fd31a-7266-44a4-a581-03d4406c53f8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:14.242484 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-64010acf-d62b-4e3f-9344-00b8f22c6dea req-ec9fd31a-7266-44a4-a581-03d4406c53f8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:14.253977 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-64010acf-d62b-4e3f-9344-00b8f22c6dea req-ec9fd31a-7266-44a4-a581-03d4406c53f8 service nova] Creating event network-changed:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h1-master-1 Oct 24 10:07:14.259666 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-64010acf-d62b-4e3f-9344-00b8f22c6dea req-ec9fd31a-7266-44a4-a581-03d4406c53f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097722 Oct 24 10:07:14.260276 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3732/7636] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:07:14.725209 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:14.725857 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:14.733860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:14.734357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:14.734820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:14.735508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:14.735968 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:14.736398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:14.867281 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:14.875434 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5d23fc1-0a8b-4197-a91e-343f15ee87c0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.154211 Oct 24 10:07:14.876009 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3905/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:14 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:15.901854 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:15.902574 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:15.909495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:15.910015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:15.910498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:15.911214 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:15.911684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:15.912133 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:16.043061 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:16.050756 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b52cc27c-ec2a-4b23-96ed-5b0d0573c534 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.155407 Oct 24 10:07:16.051324 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3733/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:15 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:17.073563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:17.074185 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:17.081004 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:17.081548 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:17.081987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:17.082668 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:17.083121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:17.083546 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:17.214286 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:17.221907 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-977e926f-21d8-4c45-90e9-788f9f09634e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.152269 Oct 24 10:07:17.222475 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3906/7639] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:17 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:18.244111 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:18.245360 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:18.252135 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:18.252637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:18.253090 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:18.253825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:18.254294 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:18.254738 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:18.389547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:18.397144 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-990eded7-b179-4fdb-a30b-cb529b608081 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.157079 Oct 24 10:07:18.397741 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3734/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:18 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:19.420307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:19.420916 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:19.427679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:19.428159 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:19.428593 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:19.429276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:19.429756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:19.430183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:19.560401 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:19.567965 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1af74b16-2256-4a32-af09-a67920c19cc0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.151586 Oct 24 10:07:19.568535 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3907/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:19 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:20.127614 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3f66bda2-2efd-4a13-ae26-11cefacfb7d1 req-b1b6a3b9-f7e1-40b4-8390-986cbbf27f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "name": "network-vif-plugged", "status": "completed", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:20.138520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3f66bda2-2efd-4a13-ae26-11cefacfb7d1 req-b1b6a3b9-f7e1-40b4-8390-986cbbf27f62 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:20.139021 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3f66bda2-2efd-4a13-ae26-11cefacfb7d1 req-b1b6a3b9-f7e1-40b4-8390-986cbbf27f62 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:20.139472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3f66bda2-2efd-4a13-ae26-11cefacfb7d1 req-b1b6a3b9-f7e1-40b4-8390-986cbbf27f62 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:20.155808 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3f66bda2-2efd-4a13-ae26-11cefacfb7d1 req-b1b6a3b9-f7e1-40b4-8390-986cbbf27f62 service nova] Creating event network-vif-plugged:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h1-master-1 Oct 24 10:07:20.161072 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3f66bda2-2efd-4a13-ae26-11cefacfb7d1 req-b1b6a3b9-f7e1-40b4-8390-986cbbf27f62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Oct 24 10:07:20.161700 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3735/7642] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:07:20.591428 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:20.591970 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:20.594643 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:20.600615 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:20.601096 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:20.601565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:20.602256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:20.602711 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:20.603138 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:20.734821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:20.742488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-203286d1-3657-4d47-a0b5-79869475fa27 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1391 microversion: 2.1 time: 0.155592 Oct 24 10:07:20.743065 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3908/7643] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:20 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:21.763387 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:21.764297 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:21.769403 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:21.770132 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:21.776913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:21.777446 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:21.777905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:21.779122 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:21.779599 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:21.780075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:21.911000 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:21.919405 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0ca84da-ae59-4eb4-b035-ad484a963b33 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1563 microversion: 2.1 time: 0.156513 Oct 24 10:07:21.919989 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3736/7644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:21 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:21.941751 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:21.942373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:21.944308 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:21.950819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:21.951299 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:21.951737 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:21.952422 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:21.952875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:21.953345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:22.092090 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:22.099796 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2914a4f3-649c-46a3-a83a-3e868503065e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1563 microversion: 2.1 time: 0.161924 Oct 24 10:07:22.100384 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3909/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:21 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:23.647783 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:23.648430 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:23.650742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a5763ea5-0359-45a1-80d8-d992286cf032 req-78255157-237a-4049-9033-b8f2c0c4386a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:23.661603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a5763ea5-0359-45a1-80d8-d992286cf032 req-78255157-237a-4049-9033-b8f2c0c4386a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:23.662100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a5763ea5-0359-45a1-80d8-d992286cf032 req-78255157-237a-4049-9033-b8f2c0c4386a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:23.662569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a5763ea5-0359-45a1-80d8-d992286cf032 req-78255157-237a-4049-9033-b8f2c0c4386a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:23.663183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:23.663697 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:23.664156 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:23.664889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:23.665394 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:23.665842 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:23.675129 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a5763ea5-0359-45a1-80d8-d992286cf032 req-78255157-237a-4049-9033-b8f2c0c4386a service nova] Creating event network-changed:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h1-master-1 Oct 24 10:07:23.680200 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a5763ea5-0359-45a1-80d8-d992286cf032 req-78255157-237a-4049-9033-b8f2c0c4386a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037564 Oct 24 10:07:23.680991 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3910/7646] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:07:23.822053 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:23.830851 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17755827-7999-4c6e-9f31-f6f3199c03f6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1563 microversion: 2.1 time: 0.191253 Oct 24 10:07:23.831626 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3737/7647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:23 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:45.086569 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:45.087349 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=38 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:45.091538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:45.093886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:45.100753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:45.101236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:45.101702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:45.102397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:45.102856 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:45.103280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:45.172294 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bba61e62-25e6-48a4-9c56-315c44b24171 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action" status: 200 len: 24568 microversion: 2.1 time: 0.087458 Oct 24 10:07:45.173183 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3911/7648] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:07:45 2022] POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action => generated 24568 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:07:56.180698 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:07:56.183071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:56.185585 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:56.186302 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=36 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:56.192713 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:56.193210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:56.193701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:56.194441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:56.194914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:56.195363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:56.236115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:56.242077 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Old instance type m1.heat2, new instance type m1.heat {{(pid=126919) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 24 10:07:56.248594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:07:56.249035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:07:56.249550 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:07:56.249973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:07:56.250399 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:07:56.313154 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84a7beb3-6b37-4489-a3c0-5e8dd783f46d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action" status: 202 len: 0 microversion: 2.1 time: 0.136377 Oct 24 10:07:56.313876 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3738/7649] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:07:56 2022] POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:07:56.322594 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:56.323342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:56.326280 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:56.326974 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:56.333240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:56.333758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:56.334205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:56.334915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:56.335382 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:56.335817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:56.480192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:56.488458 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-064ad94e-b7d7-4bac-abd4-a8ff52a3f2ad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1691 microversion: 2.1 time: 0.170064 Oct 24 10:07:56.489033 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3912/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:56 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:57.514099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:57.514735 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:57.522879 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:57.523816 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:57.524283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:57.525007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:57.525515 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:57.525966 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:57.660808 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:57.668537 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6ce98ffc-ce44-4378-9791-00e43168c946 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1691 microversion: 2.1 time: 0.159797 Oct 24 10:07:57.669106 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3739/7651] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:57 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:58.692803 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:58.693579 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:58.701143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:58.702305 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:58.702754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:58.703457 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:58.703927 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:58.704362 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:58.836404 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:07:58.844762 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e27936f7-af28-449e-8962-8291701c6885 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.155898 Oct 24 10:07:58.845354 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3913/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:58 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:07:59.868261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:07:59.868821 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:07:59.876155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:59.876652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:59.877101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:07:59.877823 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:07:59.878292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:07:59.878730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:00.010823 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:00.019265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1eff6af4-8d83-4ec5-83f6-ea0a62e5fbac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.155109 Oct 24 10:08:00.019845 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3740/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:07:59 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:01.043005 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:01.043633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:01.050618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:01.051135 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:01.051577 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:01.052274 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:01.052733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:01.053163 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:01.184256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:01.192531 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a325f36-25cf-496f-8237-7c3ffeed5950 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.153450 Oct 24 10:08:01.193107 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3914/7654] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:01 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:02.216103 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:02.216736 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:02.223075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:02.223580 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:02.224039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:02.224752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:02.225233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:02.225709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:02.354491 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:02.362722 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-875c25f2-4bff-4cb0-b350-c8ebb070a710 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.150662 Oct 24 10:08:02.363297 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3741/7655] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:02 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:03.386264 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:03.386847 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:03.394172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:03.394658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:03.395092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:03.395784 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:03.396240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:03.396662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:03.530394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:03.538373 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05f99d3a-42c6-4c5c-838f-6b78abb99bac tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.156111 Oct 24 10:08:03.538941 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3915/7656] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:03 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:04.561720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:04.562264 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:04.569211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:04.569739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:04.570196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:04.570902 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:04.571396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:04.571837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:04.704630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:04.712433 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-673ab93f-7577-49c8-b638-c3ff747a988a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.154716 Oct 24 10:08:04.713002 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3742/7657] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:04 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:05.735850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:05.736480 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:05.743316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:05.743804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:05.744247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:05.744967 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:05.745459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:05.745881 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:05.876854 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:05.884736 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-605fea28-21f6-49fa-b099-62da341493b0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.152845 Oct 24 10:08:05.885342 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3916/7658] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:05 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:06.910087 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:06.910728 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:06.917748 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:06.918242 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:06.918694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:06.919393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:06.919860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:06.920300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:07.052891 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:07.063469 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-49f38164-891e-4de5-9c29-9d182ea082bd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.157560 Oct 24 10:08:07.064056 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3743/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:06 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:08.088298 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:08.088846 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:08.096202 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:08.096686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:08.097124 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:08.097839 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:08.098293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:08.098718 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:08.231157 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:08.239468 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0f688b98-823e-42fb-9b43-cfcbb19d7636 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.155457 Oct 24 10:08:08.240037 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3917/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:08 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:09.263106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:09.263907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:09.271303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:09.271806 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:09.272285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:09.272988 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:09.273504 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:09.273950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:09.409902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:09.418028 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-94aa8bf7-41c7-4ae2-a5ec-92969bfd4340 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.158818 Oct 24 10:08:09.418609 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3744/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:09 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:10.442354 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:10.442940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:10.449787 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:10.450277 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:10.450721 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:10.452027 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:10.452488 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:10.452924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:10.585808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:10.593579 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e795559e-a996-42fe-bb9b-9e6872acee54 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.155201 Oct 24 10:08:10.594151 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3918/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:10 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:11.617962 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:11.618594 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:11.626371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:11.626875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:11.627334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:11.628047 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:11.628520 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:11.628978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:11.758856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:11.767234 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ec57ab4-a8e0-478e-888a-f8ed354ffec8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.153245 Oct 24 10:08:11.767811 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3745/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:11 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:12.790737 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:12.791351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:12.798714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:12.799196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:12.799632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:12.800346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:12.800798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:12.801222 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:12.930237 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:12.938614 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc9b2ceb-8e11-4e5d-bd04-8ab558025709 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.151782 Oct 24 10:08:12.939200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3919/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:12 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:13.962480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:13.962991 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:13.970321 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:13.970815 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:13.971269 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:13.971967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:13.972432 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:13.972871 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:14.103694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:14.112077 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-99d5265e-d0a2-480e-b3e8-153129242186 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.153563 Oct 24 10:08:14.112881 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3746/7665] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:13 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:15.136075 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:15.136684 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:15.144158 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:15.144669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:15.145098 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:15.145816 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:15.146271 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:15.146699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:15.274256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:15.282560 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6307761d-2c07-4b6e-9961-d3e14486a397 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1696 microversion: 2.1 time: 0.150464 Oct 24 10:08:15.283139 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3920/7666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:15 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:16.014933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "name": "network-vif-unplugged", "status": "completed", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:16.026141 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:16.026624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:16.027265 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:16.039988 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] Creating event network-vif-unplugged:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h2-master-1 Oct 24 10:08:16.046280 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126919) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 10:08:16.057584 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8454d34d-92a3-4e5f-bdad-fd6f128ad09f req-e8f7294a-b250-4644-b8e1-dd8e8349ec5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046413 Oct 24 10:08:16.058451 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3747/7667] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:08:16.308035 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:16.308694 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:16.315636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:16.316125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:16.316570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:16.317273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:16.317766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:16.318196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:16.513226 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:16.521640 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d101c764-539c-4132-a51f-16b67a859431 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1695 microversion: 2.1 time: 0.217428 Oct 24 10:08:16.522243 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3921/7668] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:16 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:17.551885 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:17.552517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:17.558679 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:17.559178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:17.559634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:17.560959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:17.561539 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:17.561990 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:17.705246 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:17.713051 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0974beb6-a8ae-403b-b4f0-ce345cc1aa9c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1693 microversion: 2.1 time: 0.166497 Oct 24 10:08:17.713650 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3748/7669] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:17 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:18.101152 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:18.111455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:18.112007 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:18.112525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:18.124544 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] Creating event network-changed:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h2-master-1 Oct 24 10:08:18.129807 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=126920) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 24 10:08:18.141488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f586b75e-df6d-40a4-99ed-edad1636ff33 req-c6a58833-2ae2-41b3-b805-f76972169e39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044016 Oct 24 10:08:18.142085 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3922/7670] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:08:18.736671 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:18.737428 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:18.744802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:18.745509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:18.746244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:18.747335 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:18.748455 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:18.749412 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:18.892214 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:18.902981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8325a0fc-639b-4d1a-8c41-cf2e9ccde9d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1693 microversion: 2.1 time: 0.170100 Oct 24 10:08:18.915752 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3749/7671] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:18 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:19.927841 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:19.928538 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:19.935565 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:19.936049 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:19.936486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:19.937176 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:19.937655 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:19.938102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.076553 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:20.084711 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7c78a879-9153-4bb0-b9d0-c50c72fa7e40 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1690 microversion: 2.1 time: 0.161269 Oct 24 10:08:20.085333 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3923/7672] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:19 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:08:20.108320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:20.108801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:20.117247 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:20.117729 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:20.118209 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.118918 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:20.119385 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:20.119825 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.182146 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b3d163f-7341-4bdf-8f3a-2c8c4d0192fd tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action" status: 204 len: 0 microversion: 2.1 time: 0.077744 Oct 24 10:08:20.182743 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3750/7673] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:08:20 2022] POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:08:20.191461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:20.192085 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:20.198000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:20.198507 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:20.198936 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.199635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:20.200142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:20.200651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.420632 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:20.428610 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a643cc9-4cde-400c-8057-493d0c0c90d3 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1690 microversion: 2.1 time: 0.241147 Oct 24 10:08:20.429332 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3924/7674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:20 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:20.452412 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:20.453117 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:20.459460 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:20.459970 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:20.460428 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.461149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:20.461680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:20.462127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:20.605526 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:20.613319 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d87fdfcc-2be8-4e20-b47b-a836077dfac0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1690 microversion: 2.1 time: 0.165904 Oct 24 10:08:20.613908 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3751/7675] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:20 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:21.638307 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:21.638955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:21.646000 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:21.646495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:21.646985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:21.647820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:21.648287 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:21.648720 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:21.791583 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:21.800221 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d325846-417d-43b7-a268-80b47def4bf7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1682 microversion: 2.1 time: 0.165920 Oct 24 10:08:21.801467 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3925/7676] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:21 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:21.952687 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0f0a16df-6688-4240-9f12-7d7e4f2b6726 req-42a66ffb-79af-4e18-8e9a-55efaadcdd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "name": "network-vif-plugged", "status": "completed", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:21.962235 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0f0a16df-6688-4240-9f12-7d7e4f2b6726 req-42a66ffb-79af-4e18-8e9a-55efaadcdd2d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:21.962733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0f0a16df-6688-4240-9f12-7d7e4f2b6726 req-42a66ffb-79af-4e18-8e9a-55efaadcdd2d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:21.963178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0f0a16df-6688-4240-9f12-7d7e4f2b6726 req-42a66ffb-79af-4e18-8e9a-55efaadcdd2d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:21.974833 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0f0a16df-6688-4240-9f12-7d7e4f2b6726 req-42a66ffb-79af-4e18-8e9a-55efaadcdd2d service nova] Creating event network-vif-plugged:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h2-master-1 Oct 24 10:08:21.979760 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0f0a16df-6688-4240-9f12-7d7e4f2b6726 req-42a66ffb-79af-4e18-8e9a-55efaadcdd2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086472 Oct 24 10:08:21.980591 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3752/7677] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:08:45.990388 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:45.992716 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:45.995256 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=28 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:45.996166 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=82 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:46.002540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:46.003038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:46.003484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:46.004196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:46.004971 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:46.005432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:46.070585 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00de7e27-dc40-44f5-ba9a-e51e1da11ab4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action" status: 200 len: 24566 microversion: 2.1 time: 0.084139 Oct 24 10:08:46.071496 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3926/7678] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:08:45 2022] POST /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528/action => generated 24566 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:08:53.240882 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:53.241849 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:53.246441 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:53.247335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:53.255501 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:53.256440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:53.256440 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:53.257153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:53.257652 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:53.258098 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:53.287597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:08:53.310797 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-187ed39d-b8d9-48e7-8e9d-95faa98178fe req-4f1e1a7f-9082-471c-a837-056745019d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:53.322541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-187ed39d-b8d9-48e7-8e9d-95faa98178fe req-4f1e1a7f-9082-471c-a837-056745019d00 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:53.322996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-187ed39d-b8d9-48e7-8e9d-95faa98178fe req-4f1e1a7f-9082-471c-a837-056745019d00 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:53.324495 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-187ed39d-b8d9-48e7-8e9d-95faa98178fe req-4f1e1a7f-9082-471c-a837-056745019d00 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:53.336346 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-187ed39d-b8d9-48e7-8e9d-95faa98178fe req-4f1e1a7f-9082-471c-a837-056745019d00 service nova] Creating event network-changed:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h2-master-1 Oct 24 10:08:53.342101 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-187ed39d-b8d9-48e7-8e9d-95faa98178fe req-4f1e1a7f-9082-471c-a837-056745019d00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100171 Oct 24 10:08:53.345810 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3927/7679] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:08:53.389438 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fef1e655-3aaf-48a8-ad58-e5aac787cc73 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 204 len: 0 microversion: 2.1 time: 0.150330 Oct 24 10:08:53.391625 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3753/7680] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:08:53 2022] DELETE /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:08:53.400167 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:53.400890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:53.409675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:53.410174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:53.410625 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:53.411345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:53.411880 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:53.412320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:53.545680 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:53.553370 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-adcf027b-5d74-4e80-a372-b2110cbbbffa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1688 microversion: 2.1 time: 0.157462 Oct 24 10:08:53.553944 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3928/7681] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:53 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:54.577990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:54.578768 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:54.585681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:54.586182 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:54.587308 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:54.588261 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:54.588889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:54.589517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:54.727892 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:08:54.735854 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a2dcf84-0af6-40d2-99ff-b0f82e30491f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 200 len: 1688 microversion: 2.1 time: 0.162236 Oct 24 10:08:54.736612 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3754/7682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:54 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:08:55.356975 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3de37bea-c1dc-45a4-af1e-9fa7243cf026 req-0e66db94-35c4-4398-9c19-9edc9c9d8afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17d08a0-8c74-44e7-9ae8-0bef2c506528", "name": "network-vif-deleted", "tag": "bf266e6d-0f45-4056-a930-667e3107bb5e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:55.367298 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3de37bea-c1dc-45a4-af1e-9fa7243cf026 req-0e66db94-35c4-4398-9c19-9edc9c9d8afb service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:55.367775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3de37bea-c1dc-45a4-af1e-9fa7243cf026 req-0e66db94-35c4-4398-9c19-9edc9c9d8afb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:55.368204 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3de37bea-c1dc-45a4-af1e-9fa7243cf026 req-0e66db94-35c4-4398-9c19-9edc9c9d8afb service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:55.379893 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3de37bea-c1dc-45a4-af1e-9fa7243cf026 req-0e66db94-35c4-4398-9c19-9edc9c9d8afb service nova] Creating event network-vif-deleted:bf266e6d-0f45-4056-a930-667e3107bb5e for instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 on n-h2-master-1 Oct 24 10:08:55.385674 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3de37bea-c1dc-45a4-af1e-9fa7243cf026 req-0e66db94-35c4-4398-9c19-9edc9c9d8afb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Oct 24 10:08:55.386468 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3929/7683] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:08:55.759911 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:55.760541 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: b17d08a0-8c74-44e7-9ae8-0bef2c506528] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:08:55.767857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:55.768348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:55.768799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:55.769526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:08:55.769995 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:08:55.770434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:08:55.784596 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] HTTP exception thrown: Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 could not be found. Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Request method failure captured: Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 HTTP/1.1 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmMbYI4y3T_wI_yt_R1BmKED1P7vQvRXCgo8P40XkGEnNAJ9OasrjRR_rHwzGL68747SRTdrocpD2w-kgpMluCHGsbbNyQ9yS59yx-m71Pqr1V2iYSOyV7zYDXzcWsLPE6nmDyIKAOXzS_ICq5RWCoQ1MI_R20w9iIcxkQrDvG4mbvg Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb905347dd6e4086ace6b3acb35ef30b"}]}] Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8291b3fbb6324df8a1111509a3b39d2d Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: exception: Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 could not be found. Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'b17d08a0-8c74-44e7-9ae8-0bef2c506528'} Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 could not be found. Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 could not be found. Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:08:55.786218 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 could not be found. Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Returning 404 to user: Instance b17d08a0-8c74-44e7-9ae8-0bef2c506528 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7ce9380-82cf-4fc6-a6dd-de3d6615f366 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528" status: 404 len: 111 microversion: 2.1 time: 0.031647 Oct 24 10:08:55.791660 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3755/7684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:08:55 2022] GET /compute/v2.1/servers/b17d08a0-8c74-44e7-9ae8-0bef2c506528 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:08:59.083008 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b946608f-6398-4c25-b434-46effb165456 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '.version_select at 0x7f8daaef10d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:08:59.103997 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b946608f-6398-4c25-b434-46effb165456 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-923764664" status: 202 len: 0 microversion: 2.1 time: 0.026301 Oct 24 10:08:59.104651 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3930/7685] 10.222.0.25 () {58 vars in 1281 bytes} [Mon Oct 24 10:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-923764664 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:08:59.131937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1b7c6fbf-d408-418f-bc52-77c8fdcd0c43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: .version_select at 0x7f8daa0eeca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-15089059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApM3vnXb62MWWQP7cfp6cisI+XoLOswHR/f1EgFekWFHWqCMRXblxLryFKXUSjxVDCwmIxnIWC+MXiAlG1L6/7x24mmiEmzMqxFendudQaDqpX6mrO3AilWOwN+xQ1Tdw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:08:59.152357 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1b7c6fbf-d408-418f-bc52-77c8fdcd0c43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:08:59.157867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-1b7c6fbf-d408-418f-bc52-77c8fdcd0c43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:08:59.187400 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1b7c6fbf-d408-418f-bc52-77c8fdcd0c43 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.059567 Oct 24 10:08:59.188033 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3756/7686] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:08:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:09:04.717126 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1818471864", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "d9bb93fa-31d6-462e-a571-35649789883c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-15089059", "security_groups": [{"name": "tempest-secgroup-smoke-1650868095"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:04.834695 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] validate_networks() for [('d9bb93fa-31d6-462e-a571-35649789883c', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:09:05.258691 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:09:05.259256 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:09:05.259598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:09:05.260010 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:09:05.260438 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:09:05.271921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:05.273075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:05.273788 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:05.274807 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:05.275357 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:05.275992 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:05.298385 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:09:05.309285 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:09:05.323940 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:09:05.327259 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:09:05.384435 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efc28747-e137-4f97-8bb2-9f22694cd9b4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671794 Oct 24 10:09:05.399082 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-26b31b36-43e3-46ac-9d9f-fe93f71e05c1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:05.399714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-26b31b36-43e3-46ac-9d9f-fe93f71e05c1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:05.402778 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3931/7687] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:09:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:09:05.468318 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-26b31b36-43e3-46ac-9d9f-fe93f71e05c1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:05.478487 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-26b31b36-43e3-46ac-9d9f-fe93f71e05c1 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1265 microversion: 2.1 time: 0.084729 Oct 24 10:09:05.479369 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3757/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:05 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:06.504441 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:06.505052 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:06.526334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:06.527146 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:06.527785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:06.529242 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:06.529727 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:06.530334 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:06.608383 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:06.616709 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a716cac2-06e1-4928-ae6f-7e1611bdbe87 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1325 microversion: 2.1 time: 0.117254 Oct 24 10:09:06.634031 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3932/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:06 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:07.643547 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:07.644867 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:07.648618 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:07.692976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:07.693526 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:07.693985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:07.698590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:07.701000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:07.701559 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:07.852534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:07.864935 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa72576c-b36e-433b-80c2-e093f0740908 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.225586 Oct 24 10:09:07.869340 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3758/7690] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:07 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:08.114188 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-374b9041-c038-4bbd-bcdb-8137d4c62a7b req-01124f51-7e60-43a8-97f4-0963e8634391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae83a25a-814a-4f1c-8ff3-bde07172c1aa", "tag": "c3968566-6ef5-4335-8465-a9e36c702357"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:08.131352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-374b9041-c038-4bbd-bcdb-8137d4c62a7b req-01124f51-7e60-43a8-97f4-0963e8634391 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:08.131945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-374b9041-c038-4bbd-bcdb-8137d4c62a7b req-01124f51-7e60-43a8-97f4-0963e8634391 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:08.132395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-374b9041-c038-4bbd-bcdb-8137d4c62a7b req-01124f51-7e60-43a8-97f4-0963e8634391 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:08.143514 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-374b9041-c038-4bbd-bcdb-8137d4c62a7b req-01124f51-7e60-43a8-97f4-0963e8634391 service nova] Creating event network-changed:c3968566-6ef5-4335-8465-a9e36c702357 for instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa on n-h1-master-1 Oct 24 10:09:08.150234 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-374b9041-c038-4bbd-bcdb-8137d4c62a7b req-01124f51-7e60-43a8-97f4-0963e8634391 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046273 Oct 24 10:09:08.150892 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3933/7691] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:09:08.888702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:08.889421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:08.896303 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:08.896808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:08.897270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:08.898009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:08.898486 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:08.898937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:09.030261 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:09.038229 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0fef067-fe53-4d2a-8038-c4603e3f6287 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.154052 Oct 24 10:09:09.038810 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3759/7692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:08 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:10.063179 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:10.063968 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:10.072520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:10.073011 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:10.073484 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:10.074192 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:10.074651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:10.075118 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:10.260071 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:10.267914 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b1d93d9-6001-4a59-b010-3b910328480e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.210372 Oct 24 10:09:10.268479 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3934/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:10 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:11.291050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:11.291679 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:11.299078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:11.299579 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:11.300035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:11.300742 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:11.301215 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:11.301692 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:11.431530 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:11.440252 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9991fc0-bba4-42ae-9ad5-e5d41a0a1bc8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.153011 Oct 24 10:09:11.440840 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3760/7694] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:11 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:12.520334 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:12.521132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:12.527179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:12.527670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:12.528639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:12.529397 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:12.529860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:12.530289 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:12.662529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:12.670499 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32f3aa70-730a-4e68-8a86-aab17fad0579 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.211397 Oct 24 10:09:12.671080 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3935/7695] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:12 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:13.695035 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:13.695664 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:13.703234 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:13.703728 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:13.704178 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:13.704878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:13.705366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:13.705808 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:13.835609 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:13.843913 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ff4d883-6c43-431b-8cfc-ca0dc07824fa tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.153309 Oct 24 10:09:13.844493 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3761/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:13 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:14.662042 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7f80b7c1-9191-452c-83cf-c1c1add83158 req-4dfdcb04-6c46-4d07-b958-8b6fbbaee564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae83a25a-814a-4f1c-8ff3-bde07172c1aa", "name": "network-vif-plugged", "status": "completed", "tag": "c3968566-6ef5-4335-8465-a9e36c702357"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:14.673108 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7f80b7c1-9191-452c-83cf-c1c1add83158 req-4dfdcb04-6c46-4d07-b958-8b6fbbaee564 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:14.673636 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7f80b7c1-9191-452c-83cf-c1c1add83158 req-4dfdcb04-6c46-4d07-b958-8b6fbbaee564 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:14.674068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7f80b7c1-9191-452c-83cf-c1c1add83158 req-4dfdcb04-6c46-4d07-b958-8b6fbbaee564 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:14.685722 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7f80b7c1-9191-452c-83cf-c1c1add83158 req-4dfdcb04-6c46-4d07-b958-8b6fbbaee564 service nova] Creating event network-vif-plugged:c3968566-6ef5-4335-8465-a9e36c702357 for instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa on n-h1-master-1 Oct 24 10:09:14.690742 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7f80b7c1-9191-452c-83cf-c1c1add83158 req-4dfdcb04-6c46-4d07-b958-8b6fbbaee564 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 Oct 24 10:09:14.691357 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3936/7697] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:09:14.867019 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:14.867661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:14.875218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:14.875727 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:14.876190 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:14.876913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:14.877417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:14.877869 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:15.011333 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:15.019636 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17a694d8-fd56-498c-8851-b580d3b91fc5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1391 microversion: 2.1 time: 0.156579 Oct 24 10:09:15.020225 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3762/7698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:14 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:16.040896 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:16.041612 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:16.047663 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:16.048506 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:16.050692 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:16.057600 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:16.058313 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:16.058759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:16.059500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:16.060460 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:16.060888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:16.064137 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=39 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:16.203389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:16.211317 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f6b97e71-f36c-4185-b29e-e4aae55c0a25 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1564 microversion: 2.1 time: 0.171445 Oct 24 10:09:16.211912 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3937/7699] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:16 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:09:16.233909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:16.234655 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:16.237355 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:16.243682 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:16.244218 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:16.244676 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:16.245435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:16.245913 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:16.246363 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:16.384013 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:16.392612 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f95c3ee8-1c05-4311-9bd1-8ea04ef478e6 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1564 microversion: 2.1 time: 0.162597 Oct 24 10:09:16.393187 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3763/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:16 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:18.316570 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:18.318351 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:18.319027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-16e71a19-bd6f-4b0a-8c7c-61a9783c53d0 req-c5376d3e-55a7-4657-a080-af3d579ebaaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae83a25a-814a-4f1c-8ff3-bde07172c1aa", "tag": "c3968566-6ef5-4335-8465-a9e36c702357"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:18.327616 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:18.328121 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:18.328587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:18.329563 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:18.330136 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:18.330798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:18.331681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-16e71a19-bd6f-4b0a-8c7c-61a9783c53d0 req-c5376d3e-55a7-4657-a080-af3d579ebaaf service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:18.332175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-16e71a19-bd6f-4b0a-8c7c-61a9783c53d0 req-c5376d3e-55a7-4657-a080-af3d579ebaaf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:18.332622 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-16e71a19-bd6f-4b0a-8c7c-61a9783c53d0 req-c5376d3e-55a7-4657-a080-af3d579ebaaf service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:18.348426 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-16e71a19-bd6f-4b0a-8c7c-61a9783c53d0 req-c5376d3e-55a7-4657-a080-af3d579ebaaf service nova] Creating event network-changed:c3968566-6ef5-4335-8465-a9e36c702357 for instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa on n-h1-master-1 Oct 24 10:09:18.353604 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-16e71a19-bd6f-4b0a-8c7c-61a9783c53d0 req-c5376d3e-55a7-4657-a080-af3d579ebaaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039313 Oct 24 10:09:18.354229 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3764/7701] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:09:18.554208 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:18.562375 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-468d2722-6240-4acd-91cb-c0b1cb6114e9 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1564 microversion: 2.1 time: 0.250481 Oct 24 10:09:18.563189 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3938/7702] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:18 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:39.798683 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:39.799468 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=38 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:39.804144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:39.806599 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:39.814002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:39.814502 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:39.814957 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:39.815675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:39.816145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:39.816586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:39.884904 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2644a2e5-4a2a-4020-b1cc-deeca88d611d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action" status: 200 len: 24569 microversion: 2.1 time: 0.088363 Oct 24 10:09:39.885578 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3765/7703] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:09:39 2022] POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action => generated 24569 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:09:46.329606 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cb3d184-f0d3-4f68-ac94-f6e3fe7e536e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:46.331864 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:46.332529 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=11 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:46.338264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cb3d184-f0d3-4f68-ac94-f6e3fe7e536e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:46.338756 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cb3d184-f0d3-4f68-ac94-f6e3fe7e536e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:46.339195 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cb3d184-f0d3-4f68-ac94-f6e3fe7e536e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:46.365120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0cb3d184-f0d3-4f68-ac94-f6e3fe7e536e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:09:46.406413 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0cb3d184-f0d3-4f68-ac94-f6e3fe7e536e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action" status: 202 len: 0 microversion: 2.1 time: 0.080460 Oct 24 10:09:46.406771 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3939/7704] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:09:46 2022] POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:09:46.417806 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:46.419531 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:46.428099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:46.428594 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:46.429331 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:46.430166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:46.430910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:46.431362 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:46.567597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:46.575337 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-328dda0a-2e61-418d-b4fe-5f6e840987cb tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.162337 Oct 24 10:09:46.575899 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3766/7705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:46 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:47.599599 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:47.600249 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:47.607948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:47.608434 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:47.608874 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:47.609612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:47.610076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:47.610508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:47.743322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:47.751074 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-00cca738-ac3f-4434-8e02-74e869d9c6f0 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.155848 Oct 24 10:09:47.751652 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3940/7706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:47 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:48.774884 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:48.775516 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:48.782405 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:48.782911 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:48.783366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:48.784072 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:48.784804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:48.785249 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:48.918886 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:48.926693 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29cf12d2-9691-4f8d-85d8-9a1335fb2775 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.155757 Oct 24 10:09:48.927265 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3767/7707] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:48 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:49.951340 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:49.951876 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:49.958670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:49.959155 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:49.959596 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:49.960317 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:49.960798 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:49.961251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:50.095224 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:50.102959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff465f09-8355-4780-a2ca-5574e15d900d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.156149 Oct 24 10:09:50.103536 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3941/7708] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:49 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:51.127125 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:51.127758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:51.134756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:51.135254 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:51.135712 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:51.136433 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:51.137044 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:51.137524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:51.266945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:51.274944 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-52ae424a-692e-480f-910e-77aaa794bd46 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.151735 Oct 24 10:09:51.275607 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3768/7709] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:51 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:09:52.299393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:52.300017 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:52.306980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:52.307474 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:52.307922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:52.309153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:52.309651 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:52.310089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:52.439839 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:52.448684 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80e9e5a4-97ea-43cc-bba6-c926463e2723 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.153186 Oct 24 10:09:52.449506 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3942/7710] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:52 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:53.473881 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:53.474421 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:53.481346 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:53.482017 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:53.482522 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:53.483319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:53.483837 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:53.484351 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:53.618941 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:53.626771 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6dd3148-adbb-4e3b-a5dd-09c7797b86ec tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.156852 Oct 24 10:09:53.627336 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3769/7711] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:53 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:54.650393 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:54.651081 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:54.658536 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:54.659024 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:54.659716 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:54.660407 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:54.660862 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:54.661341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:54.794529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:54.802158 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1968d017-3fae-4487-8912-3ef7f8156aad tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.155669 Oct 24 10:09:54.802735 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3943/7712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:54 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:55.825709 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:55.826348 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:55.833286 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:55.833820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:55.834282 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:55.834999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:55.835476 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:55.835923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:55.965929 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:55.973830 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a528cb5-bd8d-453a-b91f-f5c8275b2273 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1693 microversion: 2.1 time: 0.152101 Oct 24 10:09:55.974438 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3770/7713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:55 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:56.998378 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:56.998993 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:57.005937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:57.006421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:57.006875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:57.007568 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:57.008020 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:57.008446 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:57.139895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:57.147752 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c26474fc-0b04-42ab-b8c1-49c1bb05b324 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1670 microversion: 2.1 time: 0.153811 Oct 24 10:09:57.148712 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3944/7714] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:56 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:58.245329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:58.247653 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:58.254489 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:58.254987 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:58.255443 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:58.256146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:58.256619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:58.257060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:58.320699 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b11aea55-8e94-4070-aa30-0053c0c716f7 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action" status: 200 len: 35276 microversion: 2.1 time: 0.079205 Oct 24 10:09:58.321356 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3771/7715] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:09:58 2022] POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action => generated 35276 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:09:58.333794 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df4717e7-c644-4a47-bbac-d1045ed639b5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:09:58.340705 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df4717e7-c644-4a47-bbac-d1045ed639b5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:58.341194 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df4717e7-c644-4a47-bbac-d1045ed639b5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:58.341669 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df4717e7-c644-4a47-bbac-d1045ed639b5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:58.366611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df4717e7-c644-4a47-bbac-d1045ed639b5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Going to try to start instance {{(pid=126920) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 10:09:58.407995 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df4717e7-c644-4a47-bbac-d1045ed639b5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action" status: 202 len: 0 microversion: 2.1 time: 0.077842 Oct 24 10:09:58.408719 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3945/7716] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:09:58 2022] POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:09:58.417729 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:58.418444 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:58.425646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:58.426165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:58.426768 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:58.427490 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:58.427965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:58.428508 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:58.566694 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:58.574586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9fa9b458-672c-4c81-a592-da2d43a032e8 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1679 microversion: 2.1 time: 0.161111 Oct 24 10:09:58.575163 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3772/7717] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:58 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:09:59.599410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:09:59.600128 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:09:59.607906 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:59.608404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:59.608852 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:59.609610 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:09:59.610076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:09:59.610516 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:09:59.747673 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:09:59.755462 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21bd9450-19f8-4975-a3c7-5c887b4a14d4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1679 microversion: 2.1 time: 0.160289 Oct 24 10:09:59.756041 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3946/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:09:59 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:00.780144 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:00.780770 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:00.787573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:00.788063 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:00.788513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:00.789210 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:00.789702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:00.790140 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:00.921789 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:00.929586 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72cbca02-ae94-46fe-9a61-6d4532dd5d2d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1683 microversion: 2.1 time: 0.153553 Oct 24 10:10:00.930157 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3773/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:00 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:23.122134 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:23.127955 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:23.127955 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:23.127955 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:23.133028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:23.133542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:23.133985 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:23.134682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:23.135142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:23.135572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:23.206667 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba27a0f4-9a4e-474f-89b8-f4356f22f21f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action" status: 200 len: 59839 microversion: 2.1 time: 0.089158 Oct 24 10:10:23.207336 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3947/7720] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:10:23 2022] POST /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa/action => generated 59839 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:10:30.230877 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:30.232212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:30.232757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-93824b06-6756-4e91-a569-da774c75902e req-f4122c66-a5a2-4288-a4e6-0df110df8739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae83a25a-814a-4f1c-8ff3-bde07172c1aa", "tag": "c3968566-6ef5-4335-8465-a9e36c702357"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:30.236812 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=18 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:30.237685 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=50 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:30.247427 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:30.247941 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:30.248402 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:30.249200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:30.249702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:30.250149 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:30.255702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-93824b06-6756-4e91-a569-da774c75902e req-f4122c66-a5a2-4288-a4e6-0df110df8739 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:30.256425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-93824b06-6756-4e91-a569-da774c75902e req-f4122c66-a5a2-4288-a4e6-0df110df8739 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:30.256860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-93824b06-6756-4e91-a569-da774c75902e req-f4122c66-a5a2-4288-a4e6-0df110df8739 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:30.269425 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-93824b06-6756-4e91-a569-da774c75902e req-f4122c66-a5a2-4288-a4e6-0df110df8739 service nova] Creating event network-changed:c3968566-6ef5-4335-8465-a9e36c702357 for instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa on n-h1-master-1 Oct 24 10:10:30.274776 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-93824b06-6756-4e91-a569-da774c75902e req-f4122c66-a5a2-4288-a4e6-0df110df8739 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046827 Oct 24 10:10:30.275966 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3948/7721] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:10:30.280923 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:10:30.364144 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6adb61fd-42d4-4944-872c-b78cd8419311 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 204 len: 0 microversion: 2.1 time: 0.138382 Oct 24 10:10:30.365081 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3774/7722] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:10:30 2022] DELETE /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:10:30.376301 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:30.377021 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:30.405405 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:30.405903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:30.406346 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:30.407053 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:30.407511 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:30.407943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:30.542387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:30.550160 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3c5ea4d-d93e-439b-98e7-cff79985ee14 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1689 microversion: 2.1 time: 0.179935 Oct 24 10:10:30.550728 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3949/7723] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:30 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:31.576247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:31.576966 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:31.583036 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:31.583536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:31.583992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:31.584696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:31.585165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:31.585639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:31.765285 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:31.773166 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-741b4e95-1d07-4e33-8fe9-74ca0549a1ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1689 microversion: 2.1 time: 0.201568 Oct 24 10:10:31.773781 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3775/7724] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:31 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:32.458821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-74729416-01f2-4b04-bf65-dc1de07665d8 req-70007f4a-be5b-4538-adff-01d9b84d6cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae83a25a-814a-4f1c-8ff3-bde07172c1aa", "name": "network-vif-deleted", "tag": "c3968566-6ef5-4335-8465-a9e36c702357"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:32.471916 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74729416-01f2-4b04-bf65-dc1de07665d8 req-70007f4a-be5b-4538-adff-01d9b84d6cf2 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:32.472674 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74729416-01f2-4b04-bf65-dc1de07665d8 req-70007f4a-be5b-4538-adff-01d9b84d6cf2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:32.473979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-74729416-01f2-4b04-bf65-dc1de07665d8 req-70007f4a-be5b-4538-adff-01d9b84d6cf2 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:32.486784 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-74729416-01f2-4b04-bf65-dc1de07665d8 req-70007f4a-be5b-4538-adff-01d9b84d6cf2 service nova] Creating event network-vif-deleted:c3968566-6ef5-4335-8465-a9e36c702357 for instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa on n-h1-master-1 Oct 24 10:10:32.492367 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-74729416-01f2-4b04-bf65-dc1de07665d8 req-70007f4a-be5b-4538-adff-01d9b84d6cf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 Oct 24 10:10:32.492965 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3950/7725] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:10:32.797497 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:32.798122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:32.805171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:32.805703 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:32.806155 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:32.806874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:32.807337 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:32.808292 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:32.842030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:32.842540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:32.842997 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:32.843466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lazy-loading 'fault' on Instance uuid ae83a25a-814a-4f1c-8ff3-bde07172c1aa {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:10:32.885725 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:32.899484 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c311ae99-13be-4508-9ee2-a44428bc3608 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 200 len: 1355 microversion: 2.1 time: 0.105844 Oct 24 10:10:32.900107 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3776/7726] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:32 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:33.925074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:33.925835 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: ae83a25a-814a-4f1c-8ff3-bde07172c1aa] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:33.932412 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:33.933482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:33.933923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:33.934606 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:33.935060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:33.935486 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:33.948848 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] HTTP exception thrown: Instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa could not be found. Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Request method failure captured: Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa HTTP/1.1 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmMbYI4y3T_wI_yt_R1BmKED1P7vQvRXCgo8P40XkGEnNAJ9OasrjRR_rHwzGL68747SRTdrocpD2w-kgpMluCHGsbbNyQ9yS59yx-m71Pqr1V2iYSOyV7zYDXzcWsLPE6nmDyIKAOXzS_ICq5RWCoQ1MI_R20w9iIcxkQrDvG4mbvg Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb905347dd6e4086ace6b3acb35ef30b"}]}] Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: 8291b3fbb6324df8a1111509a3b39d2d Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: exception: Instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa could not be found. Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': 'ae83a25a-814a-4f1c-8ff3-bde07172c1aa'} Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa could not be found. Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa could not be found. Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:10:33.950432 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa could not be found. Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Returning 404 to user: Instance ae83a25a-814a-4f1c-8ff3-bde07172c1aa could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-356990a8-ae1d-4892-8690-a6db2583697f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa" status: 404 len: 111 microversion: 2.1 time: 0.032604 Oct 24 10:10:33.956492 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3951/7727] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:33 2022] GET /compute/v2.1/servers/ae83a25a-814a-4f1c-8ff3-bde07172c1aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:10:37.218749 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3d460c7-174c-4b7a-902c-cd09895ab374 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '.version_select at 0x7f8da99be790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:37.242885 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3d460c7-174c-4b7a-902c-cd09895ab374 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-15089059" status: 202 len: 0 microversion: 2.1 time: 0.027656 Oct 24 10:10:37.245637 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3777/7728] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 10:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-15089059 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:10:37.273398 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06b8d3ba-be69-4459-8769-541a2f2b4f1d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: .version_select at 0x7f8dab0219d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1628744944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34MMJ43R8TJPNNtODb1hUHz36pCQtOQFO60JPnlkYtFPq6RrkphRy/5XKHPXMWWfriJe7S4dL00AmkdbO6IVQzCZIiF/q3pAGe+FQPFBpEabUkdGjMWdiE8J51/eOGzA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:37.292324 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-06b8d3ba-be69-4459-8769-541a2f2b4f1d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:10:37.297511 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-06b8d3ba-be69-4459-8769-541a2f2b4f1d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:10:37.320741 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06b8d3ba-be69-4459-8769-541a2f2b4f1d tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051137 Oct 24 10:10:37.321282 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3952/7729] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:10:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:10:42.805265 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1641271710", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "networks": [{"uuid": "60a2e5f8-d581-426c-a819-1f3c198a9815"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1628744944", "security_groups": [{"name": "tempest-secgroup-smoke-166861029"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:42.891097 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:42.934582 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] validate_networks() for [('60a2e5f8-d581-426c-a819-1f3c198a9815', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:10:43.401115 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:10:43.402124 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:10:43.402632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:10:43.403050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:10:43.403471 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:10:43.412950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:43.413481 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:43.413958 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:43.414696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:43.415159 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:43.415597 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:43.434254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:10:43.440325 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Getting quotas for user 8291b3fbb6324df8a1111509a3b39d2d and project fb905347dd6e4086ace6b3acb35ef30b. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:10:43.453209 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:10:43.456365 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:10:43.506054 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d485754f-4841-4d8e-98eb-f80576e5606a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704675 Oct 24 10:10:43.506906 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3778/7730] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:10:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:10:43.519830 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23aba331-7de5-44f4-af1a-7d5805f31c3b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:43.520421 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-23aba331-7de5-44f4-af1a-7d5805f31c3b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:43.625741 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-23aba331-7de5-44f4-af1a-7d5805f31c3b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:43.632706 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23aba331-7de5-44f4-af1a-7d5805f31c3b tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1267 microversion: 2.1 time: 0.117874 Oct 24 10:10:43.633283 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3953/7731] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:43 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1267 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:44.656335 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96e0ddc3-bb01-40cc-945d-0091ec7034a4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:44.656972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96e0ddc3-bb01-40cc-945d-0091ec7034a4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:44.717750 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-96e0ddc3-bb01-40cc-945d-0091ec7034a4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:44.724621 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96e0ddc3-bb01-40cc-945d-0091ec7034a4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1267 microversion: 2.1 time: 0.073088 Oct 24 10:10:44.725182 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3779/7732] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:44 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:45.748817 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4151099c-8309-4b2b-8860-051209797c51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:45.749482 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4151099c-8309-4b2b-8860-051209797c51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:45.751505 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=16 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:45.841988 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4151099c-8309-4b2b-8860-051209797c51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:45.849835 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4151099c-8309-4b2b-8860-051209797c51 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1267 microversion: 2.1 time: 0.105360 Oct 24 10:10:45.850556 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3954/7733] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:45 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:46.875466 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9c2c820-43e6-40ac-a764-8fe25b083208 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:46.876122 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9c2c820-43e6-40ac-a764-8fe25b083208 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:46.931545 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d9c2c820-43e6-40ac-a764-8fe25b083208 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:46.938588 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9c2c820-43e6-40ac-a764-8fe25b083208 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1267 microversion: 2.1 time: 0.067058 Oct 24 10:10:46.939525 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3780/7734] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:46 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1267 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:47.961704 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:47.962338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:47.969423 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:47.969915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:47.970364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:47.971060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:47.971526 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:47.971960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:48.041411 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:48.050536 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fbab402e-0ae5-437a-aa6f-8c7c8acb9dba tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1271 microversion: 2.1 time: 0.092558 Oct 24 10:10:48.051487 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3955/7735] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:47 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:49.075907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:49.076520 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:49.083472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:49.084032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:49.084491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:49.085204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:49.085698 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:49.086146 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:49.159458 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:49.168290 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c8c94f5-6d20-49fa-892d-e15eff55971e tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1325 microversion: 2.1 time: 0.096373 Oct 24 10:10:49.169059 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3781/7736] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:49 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1325 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:50.116996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ead81df1-b87d-4274-83ac-312bebda1929 req-4f6f7045-9b23-4f7d-a469-fb01a3dc7529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d01a53b-b221-438d-8120-6d7cf32a95b0", "tag": "ec034d00-9e30-4f42-946b-5e14969f137e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:50.127552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ead81df1-b87d-4274-83ac-312bebda1929 req-4f6f7045-9b23-4f7d-a469-fb01a3dc7529 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:50.128188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ead81df1-b87d-4274-83ac-312bebda1929 req-4f6f7045-9b23-4f7d-a469-fb01a3dc7529 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:50.128725 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ead81df1-b87d-4274-83ac-312bebda1929 req-4f6f7045-9b23-4f7d-a469-fb01a3dc7529 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:50.140548 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ead81df1-b87d-4274-83ac-312bebda1929 req-4f6f7045-9b23-4f7d-a469-fb01a3dc7529 service nova] Creating event network-changed:ec034d00-9e30-4f42-946b-5e14969f137e for instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 on n-h2-master-1 Oct 24 10:10:50.145353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ead81df1-b87d-4274-83ac-312bebda1929 req-4f6f7045-9b23-4f7d-a469-fb01a3dc7529 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032180 Oct 24 10:10:50.146045 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3956/7737] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:10:50.191865 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:50.193118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:50.200080 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:50.200582 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:50.201038 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:50.208009 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:50.208513 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:50.209102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:50.427057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:50.434838 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-47a51f56-920a-4cc1-b107-301e3bb2aae4 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1392 microversion: 2.1 time: 0.246977 Oct 24 10:10:50.435405 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3782/7738] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:50 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1392 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:51.459598 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:51.460311 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:51.467074 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:51.467560 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:51.467999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:51.468687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:51.469144 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:51.469601 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:51.601637 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:51.609892 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61387e93-ac16-4f27-8d0f-b19234851d05 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1392 microversion: 2.1 time: 0.155371 Oct 24 10:10:51.610471 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3957/7739] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:51 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:52.632292 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:52.632924 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:52.640464 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:52.640984 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:52.641475 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:52.642183 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:52.642656 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:52.643100 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:52.779502 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:52.787493 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9db98475-24f1-40cd-b235-c7249bd54add tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1392 microversion: 2.1 time: 0.159200 Oct 24 10:10:52.788068 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3783/7740] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:52 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:53.812349 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:53.812966 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:53.815765 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:53.821142 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:53.821673 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:53.822111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:53.822802 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:53.823301 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:53.823729 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:53.954931 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:53.962682 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43e1a7ec-9824-4154-b339-5d58f19d0301 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1392 microversion: 2.1 time: 0.154250 Oct 24 10:10:53.963254 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3958/7741] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:53 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:54.511537 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-18583233-55f9-407a-97e2-272b3c0141ba req-5588d228-3580-4ac6-a2e1-24fdfff52e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d01a53b-b221-438d-8120-6d7cf32a95b0", "name": "network-vif-plugged", "status": "completed", "tag": "ec034d00-9e30-4f42-946b-5e14969f137e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:54.517227 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:54.523959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-18583233-55f9-407a-97e2-272b3c0141ba req-5588d228-3580-4ac6-a2e1-24fdfff52e32 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:54.524472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-18583233-55f9-407a-97e2-272b3c0141ba req-5588d228-3580-4ac6-a2e1-24fdfff52e32 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:54.525053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-18583233-55f9-407a-97e2-272b3c0141ba req-5588d228-3580-4ac6-a2e1-24fdfff52e32 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:54.536778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-18583233-55f9-407a-97e2-272b3c0141ba req-5588d228-3580-4ac6-a2e1-24fdfff52e32 service nova] Creating event network-vif-plugged:ec034d00-9e30-4f42-946b-5e14969f137e for instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 on n-h2-master-1 Oct 24 10:10:54.541849 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-18583233-55f9-407a-97e2-272b3c0141ba req-5588d228-3580-4ac6-a2e1-24fdfff52e32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034513 Oct 24 10:10:54.542462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3784/7742] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:10:54.986174 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:54.986822 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:54.993702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:54.994191 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:54.994635 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:54.995911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:54.997387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:54.997830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:55.132467 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:55.140172 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4aaaf26f-1ae3-4e26-b6f5-79ea14d8d23c tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1392 microversion: 2.1 time: 0.157939 Oct 24 10:10:55.140748 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3959/7743] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:54 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:56.165560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:56.166296 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:56.172524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:56.173019 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:56.173509 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:56.174211 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:56.174680 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:56.175125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:56.309145 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:56.316881 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab8ab7b7-8cac-4a4f-97eb-1eb409fa27f2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1564 microversion: 2.1 time: 0.156714 Oct 24 10:10:56.317489 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3785/7744] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:56 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:10:56.339062 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:56.339685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:56.341622 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:56.347762 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:56.348246 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:56.348687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:56.349428 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:56.349889 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:56.350320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:56.479826 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:56.487487 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d955427f-ce64-444e-9f80-985d32da517f tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1564 microversion: 2.1 time: 0.152271 Oct 24 10:10:56.488061 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3960/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:56 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:10:58.368718 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:10:58.369368 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:10:58.371486 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:58.378357 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-33a668e0-0e21-419e-bc68-49ab71406999 req-4dc98b0e-af50-4687-bb55-1d53e6b4749c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d01a53b-b221-438d-8120-6d7cf32a95b0", "tag": "ec034d00-9e30-4f42-946b-5e14969f137e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:10:58.389426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-33a668e0-0e21-419e-bc68-49ab71406999 req-4dc98b0e-af50-4687-bb55-1d53e6b4749c service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:58.389925 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-33a668e0-0e21-419e-bc68-49ab71406999 req-4dc98b0e-af50-4687-bb55-1d53e6b4749c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:58.390349 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:58.390550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-33a668e0-0e21-419e-bc68-49ab71406999 req-4dc98b0e-af50-4687-bb55-1d53e6b4749c service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:58.390856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:58.391304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:58.392015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:10:58.392482 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:10:58.392921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:10:58.403353 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-33a668e0-0e21-419e-bc68-49ab71406999 req-4dc98b0e-af50-4687-bb55-1d53e6b4749c service nova] Creating event network-changed:ec034d00-9e30-4f42-946b-5e14969f137e for instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 on n-h2-master-1 Oct 24 10:10:58.408542 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-33a668e0-0e21-419e-bc68-49ab71406999 req-4dc98b0e-af50-4687-bb55-1d53e6b4749c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033737 Oct 24 10:10:58.409374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3961/7746] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:10:58.624859 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:10:58.633414 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2253ddd7-eaab-459c-8d21-12783499e02a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1564 microversion: 2.1 time: 0.268785 Oct 24 10:10:58.634320 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3786/7747] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:10:58 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:11:21.884696 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:21.885986 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=34 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:21.890764 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:21.893012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:21.899869 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:21.900352 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:21.901672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:21.902633 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:21.903102 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:21.903530 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:21.966971 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-600f067f-cc24-48f0-ba22-fff4dc6db391 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action" status: 200 len: 24567 microversion: 2.1 time: 0.084033 Oct 24 10:11:21.967618 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3962/7748] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:11:21 2022] POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action => generated 24567 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:11:32.888470 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:32.889062 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:32.891225 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:32.892127 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:32.898145 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:32.898651 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:32.899106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:32.899854 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:32.900887 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:32.901353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:32.927195 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lazy-loading 'flavor' on Instance uuid 1d01a53b-b221-438d-8120-6d7cf32a95b0 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:11:32.995778 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6d429db1-9bc6-472a-9143-cd44434d46cf tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action" status: 202 len: 0 microversion: 2.1 time: 0.111194 Oct 24 10:11:32.996466 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3787/7749] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:11:32 2022] POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:11:33.005908 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:33.006621 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:33.009498 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:33.010870 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:33.018865 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:33.019363 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:33.019810 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:33.020519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:33.020978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:33.021450 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:33.153539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:33.161557 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2fcbd9fa-967c-4a2c-9a76-cea5a478faa2 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1690 microversion: 2.1 time: 0.160609 Oct 24 10:11:33.162133 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3963/7750] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:32 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:34.188579 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:34.189319 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:34.195578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:34.196075 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:34.196532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:34.197240 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:34.197745 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:34.198189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:34.330457 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:34.340764 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f62b09e4-c2f6-4058-b37d-574251878954 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1673 microversion: 2.1 time: 0.157413 Oct 24 10:11:34.341354 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3788/7751] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:34 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:35.439092 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:35.441213 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:35.448566 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:35.449047 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:35.449515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:35.450227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:35.450702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:35.451126 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:35.514986 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c492703f-045e-4934-a175-66d124e88ede tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action" status: 200 len: 37420 microversion: 2.1 time: 0.079751 Oct 24 10:11:35.515649 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3964/7752] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:11:35 2022] POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action => generated 37420 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:11:35.528054 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:35.528584 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:35.535364 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:35.536109 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:35.536553 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:35.537244 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:35.537733 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:35.538167 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:35.603010 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e18d1f38-3d4b-4e11-b817-ea92803a628a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action" status: 202 len: 0 microversion: 2.1 time: 0.079205 Oct 24 10:11:35.603654 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3789/7753] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:11:35 2022] POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:11:35.612558 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:35.613394 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:35.620746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:35.621381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:35.622028 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:35.622890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:35.623387 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:35.623900 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:35.762187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:35.770083 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7634665-fe2c-4461-80e8-8977661e1e11 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1679 microversion: 2.1 time: 0.161794 Oct 24 10:11:35.770672 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3965/7754] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:35 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:36.795480 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:36.796196 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:36.803256 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:36.803752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:36.804206 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:36.804910 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:36.805400 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:36.805843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:36.942051 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:36.950184 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-986fa845-e8fe-4c1d-911a-62a69e9a187a tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1679 microversion: 2.1 time: 0.159471 Oct 24 10:11:36.950769 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3790/7755] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:36 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:37.974322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:37.974999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:37.982322 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:37.982804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:37.983240 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:37.983924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:37.984375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:37.984799 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:38.115190 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:38.123409 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2baff58a-da31-49f9-b86a-b26a5b7364e5 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1682 microversion: 2.1 time: 0.153016 Oct 24 10:11:38.123979 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3966/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:37 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:38.218271 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:38.220536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:38.227418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:38.227849 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:38.228301 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:38.228999 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:38.229503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:38.229952 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:38.272622 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f5c62c79-10c3-451b-b12f-fc43e428b3ee tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action" status: 200 len: 37420 microversion: 2.1 time: 0.058230 Oct 24 10:11:38.273259 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3791/7757] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:11:38 2022] POST /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0/action => generated 37420 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:11:39.256098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:39.256630 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:39.263291 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-731d86ae-47f9-4dc2-ad2c-38759666d0d5 req-03b27017-3a84-45db-a502-9e8029d6441a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d01a53b-b221-438d-8120-6d7cf32a95b0", "tag": "ec034d00-9e30-4f42-946b-5e14969f137e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:39.276044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:39.276550 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:39.276999 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:39.279320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:39.279800 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:39.280449 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:39.282860 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-731d86ae-47f9-4dc2-ad2c-38759666d0d5 req-03b27017-3a84-45db-a502-9e8029d6441a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:39.283634 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-731d86ae-47f9-4dc2-ad2c-38759666d0d5 req-03b27017-3a84-45db-a502-9e8029d6441a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:39.284359 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-731d86ae-47f9-4dc2-ad2c-38759666d0d5 req-03b27017-3a84-45db-a502-9e8029d6441a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:39.300901 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-731d86ae-47f9-4dc2-ad2c-38759666d0d5 req-03b27017-3a84-45db-a502-9e8029d6441a service nova] Creating event network-changed:ec034d00-9e30-4f42-946b-5e14969f137e for instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 on n-h2-master-1 Oct 24 10:11:39.305872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-731d86ae-47f9-4dc2-ad2c-38759666d0d5 req-03b27017-3a84-45db-a502-9e8029d6441a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047026 Oct 24 10:11:39.306535 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3792/7758] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:11:39.312801 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:11:39.399062 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e86339b0-bef5-4af2-81c1-c214de1ec395 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 204 len: 0 microversion: 2.1 time: 0.146530 Oct 24 10:11:39.405374 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3967/7759] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:11:39 2022] DELETE /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:11:39.412455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:39.413182 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:39.420272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:39.421112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:39.421802 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:39.422541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:39.423014 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:39.423468 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:39.586286 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:39.594698 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c97d0f20-7331-4b8b-beef-d679083aaa45 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1688 microversion: 2.1 time: 0.188557 Oct 24 10:11:39.595274 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3793/7760] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:39 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:11:40.621053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:40.621808 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:40.628569 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:40.629058 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:40.629539 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:40.630234 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:40.630695 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:40.631125 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:40.764597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:40.772515 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bc0c3d00-0a3a-456f-b7d6-a6e6f34d0b47 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1688 microversion: 2.1 time: 0.156305 Oct 24 10:11:40.773107 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3968/7761] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:40 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:41.588252 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f44a8dca-703f-4ae1-a7f5-98beec3ac5ee req-16fd96fd-5259-4b6c-95c0-b02b50e1d93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d01a53b-b221-438d-8120-6d7cf32a95b0", "name": "network-vif-deleted", "tag": "ec034d00-9e30-4f42-946b-5e14969f137e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:41.598540 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f44a8dca-703f-4ae1-a7f5-98beec3ac5ee req-16fd96fd-5259-4b6c-95c0-b02b50e1d93a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:41.599032 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f44a8dca-703f-4ae1-a7f5-98beec3ac5ee req-16fd96fd-5259-4b6c-95c0-b02b50e1d93a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:41.599477 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f44a8dca-703f-4ae1-a7f5-98beec3ac5ee req-16fd96fd-5259-4b6c-95c0-b02b50e1d93a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:41.611065 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f44a8dca-703f-4ae1-a7f5-98beec3ac5ee req-16fd96fd-5259-4b6c-95c0-b02b50e1d93a service nova] Creating event network-vif-deleted:ec034d00-9e30-4f42-946b-5e14969f137e for instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 on n-h2-master-1 Oct 24 10:11:41.616068 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f44a8dca-703f-4ae1-a7f5-98beec3ac5ee req-16fd96fd-5259-4b6c-95c0-b02b50e1d93a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032085 Oct 24 10:11:41.616666 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3794/7762] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:11:41.796633 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:41.797231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:41.804050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:41.804545 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:41.804991 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:41.805722 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:41.806190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:41.806624 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:41.837093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:41.838113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:41.838556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:41.839004 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lazy-loading 'fault' on Instance uuid 1d01a53b-b221-438d-8120-6d7cf32a95b0 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:11:41.880320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8291b3fbb6324df8a1111509a3b39d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb905347dd6e4086ace6b3acb35ef30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:11:41.888541 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6cb2f408-9f81-474d-b771-af105e136e64 tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 200 len: 1357 microversion: 2.1 time: 0.095848 Oct 24 10:11:41.889131 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3969/7763] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:41 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 1357 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:11:42.913893 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:42.914632 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] [instance: 1d01a53b-b221-438d-8120-6d7cf32a95b0] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:11:42.920783 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:42.921267 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:42.921743 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:42.922435 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:42.922895 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:42.923328 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:42.936552 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] HTTP exception thrown: Instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 could not be found. Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Request method failure captured: Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 HTTP/1.1 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmMbYI4y3T_wI_yt_R1BmKED1P7vQvRXCgo8P40XkGEnNAJ9OasrjRR_rHwzGL68747SRTdrocpD2w-kgpMluCHGsbbNyQ9yS59yx-m71Pqr1V2iYSOyV7zYDXzcWsLPE6nmDyIKAOXzS_ICq5RWCoQ1MI_R20w9iIcxkQrDvG4mbvg Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb905347dd6e4086ace6b3acb35ef30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb905347dd6e4086ace6b3acb35ef30b"}]}] Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: fb905347dd6e4086ace6b3acb35ef30b Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1423127626 Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 8291b3fbb6324df8a1111509a3b39d2d Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1423127626-project Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 could not be found. Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '1d01a53b-b221-438d-8120-6d7cf32a95b0'} Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 could not be found. Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 could not be found. Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:11:42.938254 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 could not be found. Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Returning 404 to user: Instance 1d01a53b-b221-438d-8120-6d7cf32a95b0 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1be7c185-0c88-4b3a-b357-9986afbf66ca tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0" status: 404 len: 111 microversion: 2.1 time: 0.031347 Oct 24 10:11:42.944071 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3795/7764] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:11:42 2022] GET /compute/v2.1/servers/1d01a53b-b221-438d-8120-6d7cf32a95b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:11:45.991377 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-78c0b16e-aee4-490f-ad0a-70cf3977f7be tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] Calling method '.version_select at 0x7f8daf2c64c0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:11:46.015035 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-78c0b16e-aee4-490f-ad0a-70cf3977f7be tempest-TestNetworkAdvancedServerOps-1423127626 tempest-TestNetworkAdvancedServerOps-1423127626-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1628744944" status: 202 len: 0 microversion: 2.1 time: 0.026062 Oct 24 10:11:46.016077 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3970/7765] 10.222.0.25 () {58 vars in 1284 bytes} [Mon Oct 24 10:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1628744944 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:11:57.194297 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=18 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:57.195057 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:57.405827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7b902f5-2799-4d51-bf39-8b77027c4e6f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'create', calling method: .version_select at 0x7f8daae95af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1618657862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInhOcKtfibM9MZSyVke+hJssNuZiIwwC6AOPGtiSjRMTYj6nHFCYzZm9uGVDdo+pbrgOPQ89phOd4w4j6Zu0ArS3gI8q8nSTxrgQLYcBH7+VsvEnkJ85ZZs/WeO9OGavw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:57.422217 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c7b902f5-2799-4d51-bf39-8b77027c4e6f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for project d30e6c02e2054515bc5fd59980095a56. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:11:57.427831 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-c7b902f5-2799-4d51-bf39-8b77027c4e6f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for user c95d0d21edd647efb08b5491688ffd86 and project d30e6c02e2054515bc5fd59980095a56. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:11:57.455038 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7b902f5-2799-4d51-bf39-8b77027c4e6f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.266532 Oct 24 10:11:57.455758 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3796/7766] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:11:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:11:58.769770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1430404190", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1618657862", "security_groups": [{"name": "tempest-secgroup-smoke-1981944313"}], "networks": [{"uuid": "59d12e7a-8aa8-48e1-8084-8cf286a350d1"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:11:58.780884 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:58.781701 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:58.882517 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] validate_networks() for [('59d12e7a-8aa8-48e1-8084-8cf286a350d1', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:11:59.350364 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:11:59.350869 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:11:59.351452 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:11:59.351866 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:11:59.352283 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:11:59.361819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:59.362307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:59.362748 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:59.363477 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:11:59.364162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:11:59.364598 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:11:59.382319 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for project d30e6c02e2054515bc5fd59980095a56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:11:59.387666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for user c95d0d21edd647efb08b5491688ffd86 and project d30e6c02e2054515bc5fd59980095a56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:11:59.400416 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:11:59.402788 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:11:59.449083 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:12:00.457411 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [d30eb67e-9422-4cec-b8b0-e2fa16d3496d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35040. Oct 24 10:12:00.461933 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5e431f1-60b3-4338-bec3-ab745a168148 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.696316 Oct 24 10:12:00.463952 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3971/7767] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:11:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:12:00.474907 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e7e3616-0d6a-4317-92c2-a35c1ab05f16 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:00.476178 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e7e3616-0d6a-4317-92c2-a35c1ab05f16 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:00.542947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e7e3616-0d6a-4317-92c2-a35c1ab05f16 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:00.551161 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e7e3616-0d6a-4317-92c2-a35c1ab05f16 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1247 microversion: 2.1 time: 0.080044 Oct 24 10:12:00.551763 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3797/7768] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:00 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1247 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:01.574299 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:01.575030 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:01.581068 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:01.581599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:01.582039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:01.582728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:01.583186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:01.583617 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:01.649033 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:01.658191 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a005d5f-b5aa-4214-8c36-ce0cbfaf1a5b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1299 microversion: 2.1 time: 0.088656 Oct 24 10:12:01.658780 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3972/7769] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:01 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:02.682606 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:02.683476 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:02.690645 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:02.691466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:02.691848 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:02.696623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:02.697637 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:02.698095 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:02.918397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:02.926461 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd92f431-cad4-42d8-a80c-4a9236940af0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.248689 Oct 24 10:12:02.927370 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3798/7770] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:02 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:03.254162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c4db8f69-b78e-45af-ad1a-c1c0d7652586 req-ddb57fb5-9eb2-4701-8413-95efbd922fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:12:03.267123 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4db8f69-b78e-45af-ad1a-c1c0d7652586 req-ddb57fb5-9eb2-4701-8413-95efbd922fa9 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:03.267608 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4db8f69-b78e-45af-ad1a-c1c0d7652586 req-ddb57fb5-9eb2-4701-8413-95efbd922fa9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:03.268040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c4db8f69-b78e-45af-ad1a-c1c0d7652586 req-ddb57fb5-9eb2-4701-8413-95efbd922fa9 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:03.279742 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c4db8f69-b78e-45af-ad1a-c1c0d7652586 req-ddb57fb5-9eb2-4701-8413-95efbd922fa9 service nova] Creating event network-changed:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h1-master-1 Oct 24 10:12:03.285644 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c4db8f69-b78e-45af-ad1a-c1c0d7652586 req-ddb57fb5-9eb2-4701-8413-95efbd922fa9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036092 Oct 24 10:12:03.286772 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3973/7771] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:12:03.950483 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:03.951106 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:03.958174 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:03.958664 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:03.959112 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:03.959820 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:03.960285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:03.960725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:04.092404 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:04.100151 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5aafd5a8-c588-45ef-ad43-1579c895e610 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.153661 Oct 24 10:12:04.100725 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3799/7772] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:03 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:05.124321 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:05.125029 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:05.132629 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:05.133172 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:05.133647 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:05.134448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:05.135410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:05.135871 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:05.279670 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:05.287694 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e72bfcb-d297-4da1-a631-89806f8de065 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.167673 Oct 24 10:12:05.288270 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3974/7773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:05 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:06.311170 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:06.311799 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:06.318739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:06.319246 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:06.319699 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:06.320403 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:06.320873 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:06.321334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:06.451567 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:06.459286 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-37079ad8-af28-44fe-be58-f9e1f0432794 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.151987 Oct 24 10:12:06.459871 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3800/7774] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:06 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:07.482187 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:07.482806 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:07.490076 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:07.490570 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:07.491002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:07.491704 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:07.492161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:07.492586 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:07.625618 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:07.633220 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1048fb54-81f4-4b47-b457-561b779dcfcc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.154935 Oct 24 10:12:07.634425 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3975/7775] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:07 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:08.656695 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:08.657704 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:08.666228 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:08.666799 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:08.667368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:08.668198 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:08.668662 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:08.669639 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:08.814071 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:08.822449 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-368f4027-d888-4659-be3b-b993724ae9b0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.169264 Oct 24 10:12:08.823029 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3801/7776] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:08 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:09.403529 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a2061724-ddaa-41d2-9653-5fe6c220a33c req-3776f11c-6692-457b-9657-efde75305765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "name": "network-vif-plugged", "status": "completed", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:12:09.409630 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:09.410536 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:09.420262 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2061724-ddaa-41d2-9653-5fe6c220a33c req-3776f11c-6692-457b-9657-efde75305765 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:09.420686 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2061724-ddaa-41d2-9653-5fe6c220a33c req-3776f11c-6692-457b-9657-efde75305765 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:09.421113 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2061724-ddaa-41d2-9653-5fe6c220a33c req-3776f11c-6692-457b-9657-efde75305765 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:09.432488 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a2061724-ddaa-41d2-9653-5fe6c220a33c req-3776f11c-6692-457b-9657-efde75305765 service nova] Creating event network-vif-plugged:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h1-master-1 Oct 24 10:12:09.437709 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a2061724-ddaa-41d2-9653-5fe6c220a33c req-3776f11c-6692-457b-9657-efde75305765 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 Oct 24 10:12:09.438614 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3976/7777] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:12:09.845757 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:09.846379 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:09.853821 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:09.854314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:09.854756 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:09.855451 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:09.855912 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:09.856348 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:09.988094 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:09.996315 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6dd1d10d-d156-4474-b46d-c1efc07f8a4a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1373 microversion: 2.1 time: 0.154481 Oct 24 10:12:09.996883 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3802/7778] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:09 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:11.020153 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:11.020867 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:11.028436 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:11.028924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:11.029402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:11.030100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:11.030564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:11.030995 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:11.167366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:11.175166 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df2434dd-d4ab-494a-8122-b18c7a9b2812 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1557 microversion: 2.1 time: 0.159331 Oct 24 10:12:11.175767 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3977/7779] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:11 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:11.199984 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:12:11.200610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:12:11.202577 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:11.208858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:11.209318 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:11.209765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:11.210472 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:11.210946 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:11.211389 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:11.339562 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:12:11.347266 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-da7752eb-ae47-4918-a279-58ef6edd774a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1557 microversion: 2.1 time: 0.153241 Oct 24 10:12:11.347845 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3803/7780] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:12:11 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:12:13.249747 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-72d050ef-14fa-4e9c-97d4-a122fd9e8f86 req-076fad6b-78c6-4c87-be97-3dc818a43ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:12:13.259915 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-72d050ef-14fa-4e9c-97d4-a122fd9e8f86 req-076fad6b-78c6-4c87-be97-3dc818a43ef8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:12:13.260400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-72d050ef-14fa-4e9c-97d4-a122fd9e8f86 req-076fad6b-78c6-4c87-be97-3dc818a43ef8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:12:13.260836 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-72d050ef-14fa-4e9c-97d4-a122fd9e8f86 req-076fad6b-78c6-4c87-be97-3dc818a43ef8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:12:13.271773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-72d050ef-14fa-4e9c-97d4-a122fd9e8f86 req-076fad6b-78c6-4c87-be97-3dc818a43ef8 service nova] Creating event network-changed:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h1-master-1 Oct 24 10:12:13.277331 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-72d050ef-14fa-4e9c-97d4-a122fd9e8f86 req-076fad6b-78c6-4c87-be97-3dc818a43ef8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031241 Oct 24 10:12:13.278132 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3978/7781] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:14:07.208165 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 10:14:07.209095 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17ac0623-892c-4f4d-af69-1915864327ee] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 10:14:07.210166 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:07.211047 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=36 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:07.212055 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 10:14:07.212225 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e/action (ip 10.222.0.25) !!! Oct 24 10:14:07.213621 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 10:14:07.213760 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e/action (ip 10.222.0.25) !!! Oct 24 10:14:07.217909 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:07.218456 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:07.228613 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:07.229102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:07.229586 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:07.230290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:07.230755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:07.231192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:07.256415 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lazy-loading 'flavor' on Instance uuid 21ceb2d0-acc5-4c07-b923-51bf364b424e {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:14:07.444238 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-500c7096-02e6-4500-b3b9-69d4e6c827ff tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e/action" status: 202 len: 0 microversion: 2.1 time: 0.237854 Oct 24 10:14:07.445016 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3804/7782] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:14:07 2022] POST /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:14:07.453556 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:14:07.454380 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:14:07.455024 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:07.455765 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=32 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:07.461418 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:07.462240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:07.471178 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:07.471698 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:07.472141 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:07.472842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:07.473316 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:07.473758 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:07.610341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:07.618668 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f76340b4-8bff-451f-8996-559229cee6cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.168245 Oct 24 10:14:07.619254 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3979/7783] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:07 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:08.644887 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:08.645629 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:08.656489 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [17ac0623-892c-4f4d-af69-1915864327ee] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35138. Oct 24 10:14:08.660674 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:08.661171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:08.661646 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:08.663238 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:08.663707 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:08.664175 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:08.669503 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35136. Oct 24 10:14:08.799648 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:08.807972 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1ae44063-0616-45d0-b2a5-96d5ee8ef2d3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.169491 Oct 24 10:14:08.808547 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3805/7784] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:08 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:09.834812 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:09.835462 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:09.844572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:09.845060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:09.845525 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:09.846219 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:09.846679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:09.847111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:09.852275 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35144. Oct 24 10:14:09.854487 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35142. Oct 24 10:14:09.981581 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:09.989434 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a2683a7-c2f1-4552-afa9-d4782e95557d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.158563 Oct 24 10:14:09.990007 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3980/7785] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:09 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:11.013693 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:11.014321 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:11.021179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:11.021710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:11.022165 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:11.022867 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:11.023333 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:11.023771 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:11.158630 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:11.166810 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33f276da-592a-4ed7-b153-d2aa6fb62869 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.157134 Oct 24 10:14:11.167393 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3806/7786] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:11 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:14:12.190770 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:12.191403 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:12.198714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:12.199196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:12.199630 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:12.200319 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:12.200772 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:12.201193 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:12.333366 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:12.341518 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48e8ab21-752d-4551-bc9a-c17ef95902b7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.154690 Oct 24 10:14:12.342091 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3981/7787] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:12 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:13.365519 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:13.366139 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:13.372905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:13.373418 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:13.373868 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:13.374555 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:13.375015 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:13.375448 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:13.510237 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:13.518127 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3af34f70-91a4-49ed-a446-40c1d5b0a14b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.156633 Oct 24 10:14:13.518699 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3807/7788] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:13 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:14.541957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:14.542585 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:14.549519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:14.550012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:14.550459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:14.551150 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:14.551611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:14.552046 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:14.684357 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:14.692102 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-756c20a5-07bd-4745-a892-1c810879fc99 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.154097 Oct 24 10:14:14.692690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3982/7789] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:14 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:15.716425 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:15.716973 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:15.724078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:15.724898 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:15.725992 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:15.726696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:15.727166 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:15.727600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:15.861049 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:15.869620 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1f10b15-b59b-49bc-b67f-b06ec1c9dd96 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.157371 Oct 24 10:14:15.870228 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3808/7790] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:15 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:14:16.893262 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:16.893915 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:16.900857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:16.901379 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:16.901820 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:16.902512 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:16.902970 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:16.903398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:17.037186 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:17.045480 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9a0ecaed-5732-454b-9721-cbeb78af3e2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.156140 Oct 24 10:14:17.046057 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3983/7791] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:16 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:18.069977 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:18.070597 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:18.078696 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:18.079189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:18.079636 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:18.080334 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:18.080797 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:18.081227 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:18.219075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:18.226873 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5afc7953-416f-4ec4-8f68-9efce224e930 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1703 microversion: 2.1 time: 0.161358 Oct 24 10:14:18.227456 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3809/7792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:18 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1703 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:19.250990 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:19.251600 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:19.259112 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:19.259597 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:19.260031 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:19.260713 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:19.261168 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:19.261622 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:19.392410 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:19.400276 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4bd1204-e4ae-4454-88a6-8ece2cf2247d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1703 microversion: 2.1 time: 0.153163 Oct 24 10:14:19.400789 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3984/7793] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:19 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1703 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:20.423254 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:20.424047 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:20.432041 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:20.432932 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:20.433778 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:20.435067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:20.435928 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:20.436777 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:20.588813 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:20.598854 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4be3281e-30c5-42da-8a52-4f7c57d79d55 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.179789 Oct 24 10:14:20.599462 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3810/7794] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:20 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:21.624676 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:21.625387 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:21.632945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:21.633619 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:21.634066 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:21.634811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:21.635273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:21.635707 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:21.786530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:21.795930 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-251d5522-d83d-4404-9483-2aec94841052 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.175195 Oct 24 10:14:21.797273 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3985/7795] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:21 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:22.218796 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6f04c0c4-d67f-4763-88fb-68e0422a7888 req-1826764a-c5e0-4765-aa93-c0e527078a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "name": "network-vif-plugged", "status": "completed", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:22.230969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6f04c0c4-d67f-4763-88fb-68e0422a7888 req-1826764a-c5e0-4765-aa93-c0e527078a05 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:22.231617 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6f04c0c4-d67f-4763-88fb-68e0422a7888 req-1826764a-c5e0-4765-aa93-c0e527078a05 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:22.232065 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6f04c0c4-d67f-4763-88fb-68e0422a7888 req-1826764a-c5e0-4765-aa93-c0e527078a05 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:22.244679 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6f04c0c4-d67f-4763-88fb-68e0422a7888 req-1826764a-c5e0-4765-aa93-c0e527078a05 service nova] Creating event network-vif-plugged:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h1-master-1 Oct 24 10:14:22.250161 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6f04c0c4-d67f-4763-88fb-68e0422a7888 req-1826764a-c5e0-4765-aa93-c0e527078a05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121813 Oct 24 10:14:22.250941 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3811/7796] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:22.824373 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:22.826212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:22.835767 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:22.836657 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:22.837487 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:22.838443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:22.839033 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:22.839699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:22.995571 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:23.003633 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc27f17f-aa66-4aaa-8fb4-3d906b95dd08 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.183489 Oct 24 10:14:23.004460 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3986/7797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:22 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:14:24.039417 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:24.041268 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:24.049233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:24.049773 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:24.050230 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:24.050950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:24.051422 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:24.051861 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:24.221764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:24.232522 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6a04237-aba0-46dd-b1fd-f7a1e1b60dab tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.201391 Oct 24 10:14:24.233531 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3812/7798] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:24 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:14:25.259007 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:25.259700 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:25.270620 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:25.271116 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:25.272093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:25.272814 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:25.273276 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:25.273733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:25.435607 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:25.443773 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77e47036-5587-4f09-9b2a-90458b280da3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.188836 Oct 24 10:14:25.444362 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3987/7799] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:25 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:26.468661 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:26.469896 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:26.478434 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:26.479258 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:26.479948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:26.480964 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:26.481541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:26.482223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:26.635922 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:26.644240 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a335f541-ae0f-4cbb-b5d3-9583a36bba1e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.179957 Oct 24 10:14:26.644834 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3813/7800] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:26 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:27.670330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:27.671757 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:27.679642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:27.680137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:27.680587 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:27.681905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:27.682751 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:27.683232 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:27.839330 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:27.849432 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76780f30-c8d4-4dcd-846a-c7bb20dad82b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.184725 Oct 24 10:14:27.851018 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3988/7801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:27 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:28.873827 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:28.875489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:28.883650 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:28.884163 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:28.884619 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:28.885371 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:28.885845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:28.886291 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:29.036329 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:29.045936 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d815cc68-323e-4128-892a-74e9b1199ec0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1698 microversion: 2.1 time: 0.175993 Oct 24 10:14:29.047248 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3814/7802] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:28 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:30.070470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:30.071083 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:30.078092 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:30.078513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:30.078948 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:30.079628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:30.080081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:30.080504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:30.212501 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:30.221866 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b0efa1e4-f4c8-447b-b10d-f808afcd4322 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1680 microversion: 2.1 time: 0.155244 Oct 24 10:14:30.222448 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3989/7803] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:30 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:31.246088 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:31.246720 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:31.253943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:31.254372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:31.254818 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:31.255517 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:31.256046 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:31.256483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:31.386084 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:31.393872 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-67dff221-ba64-4ffe-8a25-4bbb83532547 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1680 microversion: 2.1 time: 0.151726 Oct 24 10:14:31.394457 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3815/7804] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:31 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:32.418320 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:32.419147 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:32.425943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:32.426437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:32.426883 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:32.427612 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:32.428075 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:32.428508 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:32.566636 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:32.575036 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db2ff777-46bb-4309-8954-4ccbb4ac0b64 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1683 microversion: 2.1 time: 0.160485 Oct 24 10:14:32.575650 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3990/7805] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:32 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:32.598332 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:32.598947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:32.605828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:32.606393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:32.606761 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:32.607459 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:32.607944 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:32.608367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:32.650610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 10:14:32.722101 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6c14e8c6-a7d4-4095-ab49-6afcca2d37eb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e/action" status: 202 len: 0 microversion: 2.1 time: 0.127605 Oct 24 10:14:32.722737 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3816/7806] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:14:32 2022] POST /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:14:32.731759 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:32.732380 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:32.741425 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:32.741882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:32.742296 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:32.742949 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:32.743410 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:32.743846 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:32.878906 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:32.887467 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f81c0253-49c3-4d53-ab36-29fbaa9beb2c tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1631 microversion: 2.1 time: 0.159769 Oct 24 10:14:32.888054 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3991/7807] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:32 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1631 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:33.911495 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:33.912802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:33.918796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:33.919285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:33.919732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:33.920423 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:33.920889 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:33.921345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:34.051919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:34.061263 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-176ad5f9-2d5f-4a6c-b826-3af73ff3ebf5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.154576 Oct 24 10:14:34.061880 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3817/7808] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:33 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:34.119361 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0cfe4cd3-5ed3-42dc-ba85-73acc17ffb4c req-e16e5ba0-aabf-44e6-b9fb-172b4cb8fd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "name": "network-vif-unplugged", "status": "completed", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:34.134061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0cfe4cd3-5ed3-42dc-ba85-73acc17ffb4c req-e16e5ba0-aabf-44e6-b9fb-172b4cb8fd9e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:34.134061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0cfe4cd3-5ed3-42dc-ba85-73acc17ffb4c req-e16e5ba0-aabf-44e6-b9fb-172b4cb8fd9e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:34.134061 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0cfe4cd3-5ed3-42dc-ba85-73acc17ffb4c req-e16e5ba0-aabf-44e6-b9fb-172b4cb8fd9e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:34.147259 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0cfe4cd3-5ed3-42dc-ba85-73acc17ffb4c req-e16e5ba0-aabf-44e6-b9fb-172b4cb8fd9e service nova] Creating event network-vif-unplugged:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h2-master-1 Oct 24 10:14:34.153583 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0cfe4cd3-5ed3-42dc-ba85-73acc17ffb4c req-e16e5ba0-aabf-44e6-b9fb-172b4cb8fd9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038740 Oct 24 10:14:34.154396 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3992/7809] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:35.036786 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-dfaeaa7f-8c6b-4acb-a2b3-779eaf997da7 req-5e45fa0b-b7f2-4aec-a04a-bdae2fd41ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:35.047527 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dfaeaa7f-8c6b-4acb-a2b3-779eaf997da7 req-5e45fa0b-b7f2-4aec-a04a-bdae2fd41ca8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:35.048023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dfaeaa7f-8c6b-4acb-a2b3-779eaf997da7 req-5e45fa0b-b7f2-4aec-a04a-bdae2fd41ca8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:35.048470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dfaeaa7f-8c6b-4acb-a2b3-779eaf997da7 req-5e45fa0b-b7f2-4aec-a04a-bdae2fd41ca8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:35.061198 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:35.066408 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-dfaeaa7f-8c6b-4acb-a2b3-779eaf997da7 req-5e45fa0b-b7f2-4aec-a04a-bdae2fd41ca8 service nova] Creating event network-changed:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h2-master-1 Oct 24 10:14:35.073270 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-dfaeaa7f-8c6b-4acb-a2b3-779eaf997da7 req-5e45fa0b-b7f2-4aec-a04a-bdae2fd41ca8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098312 Oct 24 10:14:35.073926 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3818/7810] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:35.085182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:35.085973 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:35.092265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:35.092749 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:35.093187 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:35.093911 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:35.094367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:35.094796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:35.293215 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:35.301010 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9dab837d-f6e6-4a53-9187-461e4a310706 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.220146 Oct 24 10:14:35.301817 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3993/7811] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:35 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:36.326846 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:36.327559 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:36.335332 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:36.335828 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:36.336273 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:36.336976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:36.337466 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:36.337905 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:36.501113 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:36.509434 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6b258fda-f17f-4c46-a4e4-5408c3789b33 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.187660 Oct 24 10:14:36.510022 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3819/7812] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:36 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:37.533679 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:37.534235 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:37.541039 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=31 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:37.543490 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:37.543978 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:37.544414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:37.545122 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:37.545611 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:37.546042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:37.549392 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=87 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:37.701985 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:37.710082 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc85bda4-bba5-4602-930a-b38be596d116 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.180405 Oct 24 10:14:37.725807 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3994/7813] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:37 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:38.740401 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:38.741095 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:38.743249 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:38.750000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:38.750623 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:38.751194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:38.751977 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:38.752574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:38.753079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:38.895807 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:38.904368 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-41530051-0094-4111-bd89-24b6c87bae4e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.170238 Oct 24 10:14:38.905273 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3820/7814] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:38 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:39.928879 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:39.929550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:39.935728 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:39.936599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:39.937398 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:39.938177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:39.938642 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:39.939378 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:40.100528 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:40.108500 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-053943fd-b1a5-4f74-944f-33d9e7946c2f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.183619 Oct 24 10:14:40.109456 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3995/7815] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:39 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:41.134015 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:41.134663 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:41.147225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:41.147225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:41.147225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:41.147225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:41.147225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:41.147225 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:41.297426 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:41.305559 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8ba2b3a3-397b-4f4a-84d3-4ed2d889d1ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.175799 Oct 24 10:14:41.306155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3821/7816] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:41 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:42.330012 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:42.330922 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:42.338910 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:42.339502 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:42.340038 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:42.340830 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:42.341531 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:42.342040 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:42.509590 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:42.517815 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c49f110-db7c-492d-86f6-451a44f559c9 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.191653 Oct 24 10:14:42.522339 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3996/7817] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:42 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:43.543468 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:43.544138 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:43.551494 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:43.552078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:43.553043 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:43.553804 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:43.554289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:43.554930 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:43.687818 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:43.697055 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-82e11f39-6202-48d9-819b-b177825d7c4d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.157695 Oct 24 10:14:43.697681 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3822/7818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:43 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:44.720749 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:44.721399 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:44.728804 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:44.729290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:44.729757 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:44.730454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:44.730912 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:44.731364 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:44.887116 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:44.894775 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94db6618-eb9f-4975-b2c5-3ea1c44591e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.178026 Oct 24 10:14:44.895360 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3997/7819] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:44 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:45.918802 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:45.919439 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:45.926574 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:45.927082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:45.928153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:45.928874 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:45.929369 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:45.929813 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:46.065057 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:46.073312 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2710ee26-bf5d-4853-a3c9-c84799f77491 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.158401 Oct 24 10:14:46.073920 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3823/7820] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:45 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:47.097586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:47.098146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:47.105087 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:47.105621 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:47.106070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:47.106766 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:47.107227 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:47.107662 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:47.239576 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:47.247792 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e6fdc1b-9d0d-4455-b144-68b0c5837873 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.154370 Oct 24 10:14:47.248376 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3998/7821] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:47 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:48.272322 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:48.272875 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:48.279717 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:48.280204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:48.280648 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:48.281372 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:48.281839 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:48.282270 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:48.415675 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:48.423439 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4ecf495d-fefc-481e-9d69-69b75a438504 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.155679 Oct 24 10:14:48.424014 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3824/7822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:48 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:49.445929 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5c10be2b-c6bf-4a9e-9808-59d29874a372 req-20b7c1f5-c308-4d16-9214-39c0d11d4ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "name": "network-vif-plugged", "status": "completed", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:49.456320 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5c10be2b-c6bf-4a9e-9808-59d29874a372 req-20b7c1f5-c308-4d16-9214-39c0d11d4ebe service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:49.456700 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:49.457400 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:49.457786 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5c10be2b-c6bf-4a9e-9808-59d29874a372 req-20b7c1f5-c308-4d16-9214-39c0d11d4ebe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:49.458905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5c10be2b-c6bf-4a9e-9808-59d29874a372 req-20b7c1f5-c308-4d16-9214-39c0d11d4ebe service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:49.465067 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:49.465630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:49.466086 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:49.467039 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:49.467521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:49.467968 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:49.470512 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5c10be2b-c6bf-4a9e-9808-59d29874a372 req-20b7c1f5-c308-4d16-9214-39c0d11d4ebe service nova] Creating event network-vif-plugged:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h2-master-1 Oct 24 10:14:49.476318 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5c10be2b-c6bf-4a9e-9808-59d29874a372 req-20b7c1f5-c308-4d16-9214-39c0d11d4ebe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034058 Oct 24 10:14:49.476932 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3999/7823] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:49.608862 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:49.616723 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9478743d-d46d-4aab-933c-1dcc1931e7aa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.164248 Oct 24 10:14:49.617348 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3825/7824] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:49 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:50.642932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:50.643661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:50.650100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:50.650581 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:50.651012 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:50.651700 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:50.652156 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:50.652580 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:50.786554 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:50.794549 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3623a038-5213-4267-9d65-beffe8650247 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1689 microversion: 2.1 time: 0.156816 Oct 24 10:14:50.795130 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4000/7825] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:50 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:51.818589 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:51.819201 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:14:51.826194 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:51.826689 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:51.827147 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:51.827846 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:14:51.828314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:14:51.828755 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:14:51.964747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:14:51.972494 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d211a8e-1fab-4bbb-ad73-7ae1b96a35ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1676 microversion: 2.1 time: 0.157852 Oct 24 10:14:51.973271 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3826/7826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:14:51 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:06.631457 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=13 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:06.632205 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=37 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:06.633389 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:16:06.633545 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e (ip 10.222.0.25) !!! Oct 24 10:16:06.633902 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=13 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:06.634674 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:16:06.634802 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e (ip 10.222.0.25) !!! Oct 24 10:16:06.634893 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=48 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:06.635781 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:16:06.635924 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 24 10:16:06.651487 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:06.651995 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:06.661065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:06.661366 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:06.661803 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:06.662500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:06.663208 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:06.663638 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:06.699072 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:16:06.719118 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-59454dbd-6a27-4233-8c33-43ac7b2c91b5 req-fdcaa974-ca73-4b63-b02e-6f55e3918f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:06.729872 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-59454dbd-6a27-4233-8c33-43ac7b2c91b5 req-fdcaa974-ca73-4b63-b02e-6f55e3918f84 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:06.730450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-59454dbd-6a27-4233-8c33-43ac7b2c91b5 req-fdcaa974-ca73-4b63-b02e-6f55e3918f84 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:06.730996 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-59454dbd-6a27-4233-8c33-43ac7b2c91b5 req-fdcaa974-ca73-4b63-b02e-6f55e3918f84 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:06.744557 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-59454dbd-6a27-4233-8c33-43ac7b2c91b5 req-fdcaa974-ca73-4b63-b02e-6f55e3918f84 service nova] Creating event network-changed:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h2-master-1 Oct 24 10:16:06.749634 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-59454dbd-6a27-4233-8c33-43ac7b2c91b5 req-fdcaa974-ca73-4b63-b02e-6f55e3918f84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117728 Oct 24 10:16:06.750608 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3827/7827] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:16:06.785861 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09795c80-308d-4afa-85ed-4718837ddf0d tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 204 len: 0 microversion: 2.1 time: 0.156164 Oct 24 10:16:06.786690 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4001/7828] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:16:06 2022] DELETE /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:16:06.797844 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:06.799056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:06.806616 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:06.807199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:06.807750 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:06.808560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:06.809222 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:06.809956 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:07.006290 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:07.014126 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b69c51a5-f65c-4bc7-92d4-b37eeaa85258 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.222508 Oct 24 10:16:07.014786 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3828/7829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:06 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:08.038241 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:08.038958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:08.046342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:08.046826 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:08.047259 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:08.047979 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:08.048429 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:08.048877 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:08.249323 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:08.258245 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9961d158-2d06-499a-884c-43321bc5d8e5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1682 microversion: 2.1 time: 0.224527 Oct 24 10:16:08.259077 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4002/7830] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:08 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:08.827235 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-fe868a8c-0546-4c43-baf0-be51bd7fae2e req-897bf244-567f-4468-b5d5-fc4d260bf22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ceb2d0-acc5-4c07-b923-51bf364b424e", "name": "network-vif-deleted", "tag": "e083a319-c30b-4377-8d23-9b864c1dc881"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:08.838725 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fe868a8c-0546-4c43-baf0-be51bd7fae2e req-897bf244-567f-4468-b5d5-fc4d260bf22a service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:08.839390 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fe868a8c-0546-4c43-baf0-be51bd7fae2e req-897bf244-567f-4468-b5d5-fc4d260bf22a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:08.839845 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-fe868a8c-0546-4c43-baf0-be51bd7fae2e req-897bf244-567f-4468-b5d5-fc4d260bf22a service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:08.851852 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-fe868a8c-0546-4c43-baf0-be51bd7fae2e req-897bf244-567f-4468-b5d5-fc4d260bf22a service nova] Creating event network-vif-deleted:e083a319-c30b-4377-8d23-9b864c1dc881 for instance 21ceb2d0-acc5-4c07-b923-51bf364b424e on n-h2-master-1 Oct 24 10:16:08.857186 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-fe868a8c-0546-4c43-baf0-be51bd7fae2e req-897bf244-567f-4468-b5d5-fc4d260bf22a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Oct 24 10:16:08.857825 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3829/7831] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:16:09.284382 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:09.285483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:09.292899 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:09.293414 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:09.293857 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:09.294551 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:09.295034 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:09.295462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:09.327273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:09.327768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:09.328210 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:09.328661 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lazy-loading 'fault' on Instance uuid 21ceb2d0-acc5-4c07-b923-51bf364b424e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:16:09.372685 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:09.381264 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b6ef7f5-033e-4c8a-bf7c-3005a80673dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 200 len: 1337 microversion: 2.1 time: 0.101149 Oct 24 10:16:09.381874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4003/7832] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:09 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:10.405926 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:10.406612 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 21ceb2d0-acc5-4c07-b923-51bf364b424e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:10.414399 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:10.414892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:10.415339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:10.416035 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:10.416500 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:10.416936 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:10.430531 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] HTTP exception thrown: Instance 21ceb2d0-acc5-4c07-b923-51bf364b424e could not be found. Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Request method failure captured: Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e HTTP/1.1 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmTnPvMYaylN0vargHPVJ3HH-2xd5UXIqu8lw7a8yJ9WT3nj8OUCwJ5ZfGYhhlArOtTEieJ18KkFOXLS-H8KPYDx23R4-Lj_mlnfHXX7eSNs8KS9e-M7JyuvJDUeO7YOGCwqy66rKJAfI5EEzzwJ7VNTH4deXuynFBAJCVQCs8mNw3I Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: d30e6c02e2054515bc5fd59980095a56 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestShelveInstance-1912818403 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d30e6c02e2054515bc5fd59980095a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d30e6c02e2054515bc5fd59980095a56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d30e6c02e2054515bc5fd59980095a56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d30e6c02e2054515bc5fd59980095a56"}]}] Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestShelveInstance-1912818403 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: d30e6c02e2054515bc5fd59980095a56 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestShelveInstance-1912818403 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestShelveInstance-1912818403-project Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: c95d0d21edd647efb08b5491688ffd86 Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestShelveInstance-1912818403-project Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: exception: Instance 21ceb2d0-acc5-4c07-b923-51bf364b424e could not be found. Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': '21ceb2d0-acc5-4c07-b923-51bf364b424e'} Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ceb2d0-acc5-4c07-b923-51bf364b424e could not be found. Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ceb2d0-acc5-4c07-b923-51bf364b424e could not be found. Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:16:10.432160 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ceb2d0-acc5-4c07-b923-51bf364b424e could not be found. Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Returning 404 to user: Instance 21ceb2d0-acc5-4c07-b923-51bf364b424e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c6b4284-d26d-4663-b81d-f209f632339b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e" status: 404 len: 111 microversion: 2.1 time: 0.031986 Oct 24 10:16:10.438424 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3830/7833] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:10 2022] GET /compute/v2.1/servers/21ceb2d0-acc5-4c07-b923-51bf364b424e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:16:10.590991 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d38563b8-c7cd-4d5c-81d4-12262d20b252 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '.version_select at 0x7f8daafcddc0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:10.617105 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d38563b8-c7cd-4d5c-81d4-12262d20b252 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1618657862" status: 202 len: 0 microversion: 2.1 time: 0.029970 Oct 24 10:16:10.617979 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4004/7834] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 10:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1618657862 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:16:10.640413 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fe6b0da1-2d15-48b2-952c-54e48138627e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'create', calling method: .version_select at 0x7f8daaf395e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1955870549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWYIP0xDP5nrIo5kCHDeDm3QMd8W7gRZLYNg2tYlaJIJ3z3mDnjmIzSQ3xYgvoOrrRSe18AVbLkqgMg85x5XXb2DrSLsZV8CddjbpoGlIjKf4gdZq8u0Rg2yGYviQUdLg=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:10.655751 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-fe6b0da1-2d15-48b2-952c-54e48138627e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for project d30e6c02e2054515bc5fd59980095a56. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:16:10.661383 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-fe6b0da1-2d15-48b2-952c-54e48138627e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for user c95d0d21edd647efb08b5491688ffd86 and project d30e6c02e2054515bc5fd59980095a56. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:16:10.687687 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fe6b0da1-2d15-48b2-952c-54e48138627e tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051226 Oct 24 10:16:10.688553 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3831/7835] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:16:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:16:26.833475 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:26.834307 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:26.838675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1637820603", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1955870549", "security_groups": [{"name": "tempest-secgroup-smoke-1323928618"}], "networks": [{"uuid": "59d12e7a-8aa8-48e1-8084-8cf286a350d1"}], "block_device_mapping_v2": [{"uuid": "3cceaed3-e7c5-4a33-9a38-7d491f2340c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:26.951146 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] validate_networks() for [('59d12e7a-8aa8-48e1-8084-8cf286a350d1', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:16:27.321220 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:16:27.321720 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:16:27.322192 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:16:27.322597 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:16:27.323011 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:16:27.331793 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:27.332273 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:27.332710 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:27.333461 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:27.333917 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:27.334337 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:27.351231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for project d30e6c02e2054515bc5fd59980095a56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:16:27.356389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Getting quotas for user c95d0d21edd647efb08b5491688ffd86 and project d30e6c02e2054515bc5fd59980095a56. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:16:27.415677 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:16:27.417932 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3cceaed3-e7c5-4a33-9a38-7d491f2340c9',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:16:27.546642 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6bd11a21-4f68-4d30-abe3-463a4c110db1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715403 Oct 24 10:16:27.547303 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4005/7836] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:16:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:16:27.556989 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:27.557778 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:27.558663 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:27.563289 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-240076b2-cecd-4d3b-992c-4899408800ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:27.564336 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-240076b2-cecd-4d3b-992c-4899408800ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:27.623224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-240076b2-cecd-4d3b-992c-4899408800ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:27.630747 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-240076b2-cecd-4d3b-992c-4899408800ba tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1089 microversion: 2.1 time: 0.075515 Oct 24 10:16:27.631414 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3832/7837] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:27 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:28.654514 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:28.655091 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:28.662185 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:28.662492 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:28.663196 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:28.663898 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:28.664395 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:28.664785 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:28.733483 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:28.741846 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6bbea7f1-df0c-4de5-bab8-41aa1ee41085 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1205 microversion: 2.1 time: 0.092199 Oct 24 10:16:28.742431 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4006/7838] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:28 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:29.765819 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:29.766546 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:29.774179 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:29.774765 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:29.775290 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:29.776097 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:29.777266 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:29.777838 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:29.989997 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:29.998532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e534938f-a34f-40ae-ab73-c4c2ba07c7d5 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1273 microversion: 2.1 time: 0.236621 Oct 24 10:16:29.999244 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3833/7839] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:29 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:30.125032 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-80f10f83-3d76-4991-aeeb-fb3065ddb055 req-fa1b28e9-8769-48b1-8525-cadad1322546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:30.136759 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80f10f83-3d76-4991-aeeb-fb3065ddb055 req-fa1b28e9-8769-48b1-8525-cadad1322546 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:30.137547 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80f10f83-3d76-4991-aeeb-fb3065ddb055 req-fa1b28e9-8769-48b1-8525-cadad1322546 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:30.138183 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-80f10f83-3d76-4991-aeeb-fb3065ddb055 req-fa1b28e9-8769-48b1-8525-cadad1322546 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:30.154785 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-80f10f83-3d76-4991-aeeb-fb3065ddb055 req-fa1b28e9-8769-48b1-8525-cadad1322546 service nova] Creating event network-changed:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h1-master-1 Oct 24 10:16:30.160768 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-80f10f83-3d76-4991-aeeb-fb3065ddb055 req-fa1b28e9-8769-48b1-8525-cadad1322546 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039350 Oct 24 10:16:30.162071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4007/7840] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:16:31.023027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:31.023688 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:31.031449 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:31.031982 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:31.032430 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:31.033444 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:31.033915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:31.034411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:31.199714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:31.208952 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0daecff1-e564-43bf-b921-9a67268459cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1273 microversion: 2.1 time: 0.190421 Oct 24 10:16:31.209602 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3834/7841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:31 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:32.233465 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:32.234171 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:32.240811 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:32.241307 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:32.241752 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:32.242441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:32.242893 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:32.243315 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:32.380666 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:32.388634 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22017014-c735-4ff6-8daa-e328490265bc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1273 microversion: 2.1 time: 0.160311 Oct 24 10:16:32.389327 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4008/7842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:32 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:33.412576 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:33.413515 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:33.421260 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:33.422205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:33.422323 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:33.422924 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:33.423388 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:33.424002 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:33.564591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:33.572530 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6909f7ae-b4e1-4c3c-800a-3bcca98eb2b2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1273 microversion: 2.1 time: 0.164325 Oct 24 10:16:33.573119 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3835/7843] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:33 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:34.595662 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:34.596231 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:34.603114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:34.603602 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:34.604039 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:34.604730 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:34.605186 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:34.605646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:34.737460 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:34.745189 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1bf26480-4d07-4a38-a13f-bfac27b3e5f7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.153505 Oct 24 10:16:34.745898 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4009/7844] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:34 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:35.770220 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:35.770840 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:35.777600 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:35.778088 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:35.778531 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:35.779223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:35.779681 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:35.780113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:35.912100 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:35.920166 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5253a434-967e-402c-ac1c-f78226599f24 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.153986 Oct 24 10:16:35.920737 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3836/7845] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:35 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:36.943327 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:36.943947 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:36.950763 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:36.951247 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:36.951687 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:36.952375 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:36.952835 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:36.953264 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:37.086163 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:37.093970 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20fdc5d8-6742-4d57-bcf7-8496168cf865 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.154538 Oct 24 10:16:37.094540 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4010/7846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:36 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:38.118083 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:38.118696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:38.121465 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:38.126788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:38.127275 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:38.127741 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:38.129000 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:38.129495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:38.129950 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:38.259713 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:38.267578 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7696fbdf-ba26-4ebb-aede-306d59c1b0c7 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.153396 Oct 24 10:16:38.268155 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3837/7847] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:38 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:39.290984 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:39.291603 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:39.293625 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:39.294288 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:39.301789 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:39.302290 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:39.302733 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:39.303443 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:39.303901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:39.304331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:39.436671 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:39.444465 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7263f6e0-c6e5-4997-8287-4911514b6e5a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.157663 Oct 24 10:16:39.445043 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4011/7848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:39 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:40.468224 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:40.468853 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:40.475093 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:40.475587 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:40.476037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:40.476732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:40.477200 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:40.477669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:40.612856 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:40.620600 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3b55c19b-43c2-4d93-a749-ccbf5a5b2b05 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.156401 Oct 24 10:16:40.621166 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3838/7849] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:40 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:41.642911 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:41.643539 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:41.649924 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:41.650417 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:41.650863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:41.651594 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:41.652060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:41.652493 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:41.780328 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:41.788886 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b756622c-4e14-4969-98bd-05ec1346d3bb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.149928 Oct 24 10:16:41.789493 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4012/7850] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:41 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:42.806863 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9c13b2f6-e123-4b1f-8f41-d04dbf19b2a3 req-481bc25c-3684-4dd8-8c8c-42ccd5ee990e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "name": "network-vif-plugged", "status": "completed", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:42.811895 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:42.813375 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:42.818483 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9c13b2f6-e123-4b1f-8f41-d04dbf19b2a3 req-481bc25c-3684-4dd8-8c8c-42ccd5ee990e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:42.819107 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9c13b2f6-e123-4b1f-8f41-d04dbf19b2a3 req-481bc25c-3684-4dd8-8c8c-42ccd5ee990e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:42.819752 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9c13b2f6-e123-4b1f-8f41-d04dbf19b2a3 req-481bc25c-3684-4dd8-8c8c-42ccd5ee990e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:42.820081 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:42.820576 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:42.821036 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:42.821872 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:42.822590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:42.823100 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:42.833605 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9c13b2f6-e123-4b1f-8f41-d04dbf19b2a3 req-481bc25c-3684-4dd8-8c8c-42ccd5ee990e service nova] Creating event network-vif-plugged:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h1-master-1 Oct 24 10:16:42.839099 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9c13b2f6-e123-4b1f-8f41-d04dbf19b2a3 req-481bc25c-3684-4dd8-8c8c-42ccd5ee990e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035984 Oct 24 10:16:42.839792 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3839/7851] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:16:42.959442 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:42.967533 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c3662cc3-f2ea-4660-bc13-5515ca7004f4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.159484 Oct 24 10:16:42.968124 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4013/7852] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:42 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:16:43.992716 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:43.993460 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:43.999630 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:44.000123 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:44.000575 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:44.001268 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:44.001759 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:44.002196 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:44.139419 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:44.148470 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-27b5c402-c807-4530-b45a-460593254083 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1261 microversion: 2.1 time: 0.160941 Oct 24 10:16:44.149719 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3840/7853] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:43 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:45.172471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:45.173086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:45.180590 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:45.181070 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:45.181534 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:45.182216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:45.182672 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:45.183095 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:45.314294 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:45.322207 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f99a71f4-b818-444e-b278-8c98ca5e4282 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1445 microversion: 2.1 time: 0.153585 Oct 24 10:16:45.322789 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4014/7854] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:45 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:45.344522 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:45.345154 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:16:45.352701 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:45.353199 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:45.353677 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:45.354386 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:45.354855 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:45.355297 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:45.488591 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:16:45.496591 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43270d87-19d6-4b10-856a-d058c17f5883 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1445 microversion: 2.1 time: 0.155931 Oct 24 10:16:45.497178 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3841/7855] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:16:45 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:47.378530 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-9629464e-89f8-4212-8829-cfdacefd19d6 req-63b4110e-36d4-475a-ae2b-20098df2940d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:16:47.388939 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9629464e-89f8-4212-8829-cfdacefd19d6 req-63b4110e-36d4-475a-ae2b-20098df2940d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:16:47.389451 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9629464e-89f8-4212-8829-cfdacefd19d6 req-63b4110e-36d4-475a-ae2b-20098df2940d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:16:47.389887 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-9629464e-89f8-4212-8829-cfdacefd19d6 req-63b4110e-36d4-475a-ae2b-20098df2940d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:16:47.400884 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-9629464e-89f8-4212-8829-cfdacefd19d6 req-63b4110e-36d4-475a-ae2b-20098df2940d service nova] Creating event network-changed:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h1-master-1 Oct 24 10:16:47.406015 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-9629464e-89f8-4212-8829-cfdacefd19d6 req-63b4110e-36d4-475a-ae2b-20098df2940d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 Oct 24 10:16:47.406613 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4015/7856] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:18:41.932964 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=22 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:41.934170 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=50 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:41.935699 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:18:41.935976 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:18:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f/action (ip 10.222.0.25) !!! Oct 24 10:18:41.989850 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:18:41.990407 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:41.996420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:41.996921 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:41.997392 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:41.998091 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:41.998558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:41.998993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:42.021536 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lazy-loading 'flavor' on Instance uuid 385adda1-eb02-4fc7-af37-3aa3f81f406f {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:18:42.095175 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-56b03b77-ee22-448a-877a-cc583e4e34a4 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f/action" status: 202 len: 0 microversion: 2.1 time: 0.164037 Oct 24 10:18:42.095776 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3842/7857] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:18:41 2022] POST /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:18:42.102799 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:18:42.103794 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:18:42.104421 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:42.105159 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=54 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:42.111061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:42.111874 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:42.121469 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:42.121960 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:42.122419 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:42.123111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:42.123564 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:42.123988 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:42.264640 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:42.272973 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85f057c3-318e-4fc5-9fd8-3bb8136915a0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.172144 Oct 24 10:18:42.273593 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4016/7858] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:42 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:43.299048 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:43.299758 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:43.306102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:43.306588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:43.307031 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:43.307722 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:43.308180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:43.308610 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:43.437970 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:43.446178 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-425b913e-d2b5-4c2f-a16b-46549f3c8f37 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.152443 Oct 24 10:18:43.446748 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3843/7859] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:43 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:44.470440 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:44.470980 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:44.484031 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35690. Oct 24 10:18:44.490872 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35688. Oct 24 10:18:44.494943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:44.495435 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:44.495882 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:44.496589 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:44.497050 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:44.497523 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:44.628900 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:44.636883 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1457b550-a39e-4471-8916-089ab7a7f2cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.170460 Oct 24 10:18:44.637492 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4017/7860] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:44 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:45.661093 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:45.661754 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:45.668943 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:45.669491 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:45.669954 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:45.670730 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:45.671208 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:45.671658 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:45.807756 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:45.815654 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-050393dd-78dd-41e1-93e0-ed97972a3272 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.158734 Oct 24 10:18:45.816234 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3844/7861] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:45 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:46.838996 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:46.839615 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:46.846628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:46.847044 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:46.847482 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:46.848174 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:46.849249 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:46.850045 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:46.984474 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:46.992255 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-54da2a06-8f31-494e-b66f-9aa790b30ba1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.157182 Oct 24 10:18:46.992836 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4018/7862] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:46 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:48.016027 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:48.016904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:48.023739 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:48.024233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:48.024673 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:48.025516 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:48.025981 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:48.026416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:48.155461 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:48.165114 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b14947a9-208c-4af6-aa8f-f51c598c24f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.153003 Oct 24 10:18:48.165805 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3845/7863] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:48 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:49.188054 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:49.188699 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:49.196085 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:49.196574 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:49.197017 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:49.197746 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:49.198207 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:49.198639 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:49.330308 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:49.338474 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56f9ff85-3547-4b3d-b12c-8fbe42dd007a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.154371 Oct 24 10:18:49.339069 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4019/7864] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:49 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:50.362274 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:50.362902 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:50.370352 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:50.370843 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:50.371285 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:50.371978 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:50.372439 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:50.372875 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:50.505213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:50.513078 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-332e5ae4-7156-4f46-bb86-2ee9b50a97b1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.154682 Oct 24 10:18:50.513681 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3846/7865] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:50 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:18:51.537760 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:51.538450 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:51.545935 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:51.546442 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:51.546963 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:51.547632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:51.548052 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:51.548584 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:51.678162 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:51.685901 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b2ab757-eacf-405c-8661-e7bbee7c2433 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.152636 Oct 24 10:18:51.686481 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4020/7866] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:51 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:52.710801 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:52.711467 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:52.718546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:52.719049 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:52.719503 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:52.720217 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:52.720688 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:52.721130 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:52.933489 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:52.944148 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-001a0e68-995c-400d-a7ca-832aaf456374 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.237895 Oct 24 10:18:52.944942 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3847/7867] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:52 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:53.968337 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:53.968979 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:53.975954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:53.976699 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:53.977140 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:53.977922 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:53.978373 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:53.978825 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:54.110886 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:54.118594 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3131119-c9ba-45e9-a0e7-c813bcc947fa tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.154545 Oct 24 10:18:54.119170 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4021/7868] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:53 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:55.142213 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:55.142848 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:55.149998 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:55.150495 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:55.150937 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:55.151641 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:55.152102 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:55.152536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:55.299330 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:55.308002 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d03c4a14-1607-45b9-8712-50efbae4bbb1 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.169652 Oct 24 10:18:55.308617 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3848/7869] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:55 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:56.331982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:56.333138 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:56.340063 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:56.340501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:56.340943 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:56.341670 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:56.342133 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:56.343037 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:56.476057 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:56.483850 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05d89ca7-4953-4f18-a198-f20c80d4f306 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1570 microversion: 2.1 time: 0.155766 Oct 24 10:18:56.484434 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4022/7870] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:56 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:56.506299 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:18:56.506952 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:56.513757 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:56.514257 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:56.514710 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:56.515411 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:56.515883 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:56.516326 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:56.545539 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 10:18:56.611571 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-48a5e321-d29b-42b2-9fd2-6b8c9f62f5f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "POST /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f/action" status: 202 len: 0 microversion: 2.1 time: 0.109148 Oct 24 10:18:56.612434 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3849/7871] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:18:56 2022] POST /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:18:56.620322 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:56.620942 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:56.627179 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:56.627768 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:56.628214 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:56.628918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:56.629413 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:56.629843 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:56.778415 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:56.786299 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb552e68-e765-4a72-a35d-70426f678da0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1518 microversion: 2.1 time: 0.169880 Oct 24 10:18:56.789338 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4023/7872] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:56 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:57.811561 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:57.812187 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:57.819205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:57.819694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:57.820142 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:57.820841 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:57.821327 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:57.821762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:57.961782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:57.969824 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c1c364a5-7378-48b5-be90-99032f1ed0cd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1520 microversion: 2.1 time: 0.163049 Oct 24 10:18:57.970399 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3850/7873] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:57 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:58.993486 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:18:58.994074 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:18:59.000933 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:59.001454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:59.001903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:59.002603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:59.003069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:59.003504 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:59.134471 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:18:59.142576 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-100f921b-3a28-49a4-9134-de9df5132d50 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1520 microversion: 2.1 time: 0.153086 Oct 24 10:18:59.143169 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4024/7874] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:18:58 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:18:59.510343 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-8a52ca64-db14-4758-9e28-876eae9e559b req-fe8eaf33-badc-489e-8e3a-1207f6d3f237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "name": "network-vif-unplugged", "status": "completed", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:18:59.523298 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8a52ca64-db14-4758-9e28-876eae9e559b req-fe8eaf33-badc-489e-8e3a-1207f6d3f237 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:18:59.523795 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8a52ca64-db14-4758-9e28-876eae9e559b req-fe8eaf33-badc-489e-8e3a-1207f6d3f237 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:18:59.524330 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-8a52ca64-db14-4758-9e28-876eae9e559b req-fe8eaf33-badc-489e-8e3a-1207f6d3f237 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:18:59.536730 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.server_external_events [req-8a52ca64-db14-4758-9e28-876eae9e559b req-fe8eaf33-badc-489e-8e3a-1207f6d3f237 service nova] Unable to find a host for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f. Dropping event network-vif-unplugged {{(pid=126919) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 10:18:59.537746 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-8a52ca64-db14-4758-9e28-876eae9e559b req-fe8eaf33-badc-489e-8e3a-1207f6d3f237 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031396 Oct 24 10:18:59.538570 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3851/7875] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 10:19:00.168295 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:00.170342 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:00.178907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:00.179404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:00.179842 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:00.180556 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:00.181014 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:00.181480 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:00.318347 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:00.326493 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e7fd64d-6346-49a5-b1b5-7c8725e0bb4b tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1520 microversion: 2.1 time: 0.162819 Oct 24 10:19:00.327062 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4025/7876] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:00 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:01.350433 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:01.350974 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:01.357985 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:01.358487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:01.358948 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:01.359655 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:01.360125 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:01.360570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:01.495510 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:01.503371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f9931cf-28eb-4564-9755-24eea645d23f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1520 microversion: 2.1 time: 0.157551 Oct 24 10:19:01.503946 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3852/7877] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:01 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:02.527178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:02.527721 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:02.534896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:02.535400 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:02.536466 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:02.537180 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:02.537679 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:02.538114 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:02.999950 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:03.007767 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9bb16e74-da04-49b2-be03-4ea611226178 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.484729 Oct 24 10:19:03.008573 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4026/7878] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:02 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:03.386787 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a664a926-dc9a-402e-8816-46625ccdf8cd req-1e1cec20-4ab4-4dac-9ca3-9ce7b782cbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:19:03.397776 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a664a926-dc9a-402e-8816-46625ccdf8cd req-1e1cec20-4ab4-4dac-9ca3-9ce7b782cbe3 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:03.398271 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a664a926-dc9a-402e-8816-46625ccdf8cd req-1e1cec20-4ab4-4dac-9ca3-9ce7b782cbe3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:03.398762 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a664a926-dc9a-402e-8816-46625ccdf8cd req-1e1cec20-4ab4-4dac-9ca3-9ce7b782cbe3 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:03.409828 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a664a926-dc9a-402e-8816-46625ccdf8cd req-1e1cec20-4ab4-4dac-9ca3-9ce7b782cbe3 service nova] Creating event network-changed:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h2-master-1 Oct 24 10:19:03.415785 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a664a926-dc9a-402e-8816-46625ccdf8cd req-1e1cec20-4ab4-4dac-9ca3-9ce7b782cbe3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032742 Oct 24 10:19:03.416394 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3853/7879] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:19:04.031580 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:04.032197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:04.039719 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:04.040216 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:04.040658 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:04.041396 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:04.041860 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:04.042294 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:04.175850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:04.184547 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9869cab5-bccd-404c-8446-fdeada1b9712 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.156997 Oct 24 10:19:04.185139 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4027/7880] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:04 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:05.210563 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:05.211275 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:05.217425 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:05.217923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:05.218377 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:05.219103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:05.219570 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:05.220007 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:05.348965 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:05.356650 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c516824-b8f9-4b31-bac3-a44dce7352e3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.151688 Oct 24 10:19:05.357220 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3854/7881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:05 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:06.380061 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:06.380711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:06.387572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:06.388055 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:06.388491 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:06.389177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:06.389656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:06.390080 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:06.524447 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:06.532148 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87d35381-03b1-4601-a873-8592860eec67 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.156159 Oct 24 10:19:06.532717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4028/7882] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:06 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:07.557056 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:07.557708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:07.564562 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:07.565056 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:07.565530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:07.566274 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:07.566766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:07.567205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:07.706822 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:07.714828 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-53648077-5c8a-4b27-9577-8b8427c7ead3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.161700 Oct 24 10:19:07.715428 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3855/7883] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:07 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:08.738905 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:08.739532 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:08.746367 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:08.746853 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:08.747293 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:08.747980 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:08.748437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:08.748866 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:08.876178 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:08.884614 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1995c444-0982-473b-89d1-0a168a3122f0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.150117 Oct 24 10:19:08.885200 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4029/7884] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:08 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:19:09.908861 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:09.909527 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:09.915976 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:09.916775 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:09.917233 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:09.917967 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:09.918438 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:09.918877 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:10.056947 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:10.060811 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:19:10.068751 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3114c82-dc72-4690-ba68-19ceeb5d1cb2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.163941 Oct 24 10:19:10.069841 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3856/7885] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:09 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:11.092158 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:11.092768 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:11.100236 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:11.100717 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:11.101153 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:11.101873 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:11.102331 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:11.102753 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:11.239766 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:11.247658 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a60963e0-53f0-4ac3-8940-b634b9f95adb tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.159372 Oct 24 10:19:11.248242 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4030/7886] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:11 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:12.272359 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:12.272963 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:12.275612 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:19:12.282568 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:12.283060 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:12.283506 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:12.284204 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:12.284667 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:12.285101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:12.418490 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:12.426278 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23400838-61b7-4a06-83c7-04f800f412f3 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.159123 Oct 24 10:19:12.426853 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3857/7887] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:12 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:13.449891 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:13.450470 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:13.453135 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=31 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:19:13.458330 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:13.458817 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:13.459256 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:13.459945 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:13.460401 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:13.460831 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:13.464951 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=91 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:19:13.588257 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:13.596016 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92f8cf21-037a-4182-b6ad-c159c905b9c2 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.150143 Oct 24 10:19:13.596597 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4031/7888] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:13 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:14.619755 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:14.620387 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:14.627858 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:14.628367 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:14.629226 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:14.629993 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:14.630471 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:14.630915 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:14.636831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "name": "network-vif-plugged", "status": "completed", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:19:14.651235 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:14.651834 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:14.652351 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:14.670621 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] Creating event network-vif-plugged:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h2-master-1 Oct 24 10:19:14.675279 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] [4ad7696c-be74-4874-9131-6c89a94bbe2b] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:19:14.876767 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:14.886016 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8c969cf6-ce8a-46fa-9c47-79a5f95105fd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.270048 Oct 24 10:19:14.886606 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3858/7889] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:14 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:15.681972 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] [4ad7696c-be74-4874-9131-6c89a94bbe2b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35774. Oct 24 10:19:15.685412 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2e26f82f-bf59-4f48-9a6c-02da1b88e276 req-9e06f53c-e475-40e9-a047-cbf012914ba6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.055055 Oct 24 10:19:15.686028 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4032/7890] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:19:15.909649 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:15.910312 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:15.917462 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:15.917961 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:15.918414 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:15.919114 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:15.919583 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:15.920024 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:16.052748 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:16.060761 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28e8868a-8c20-41ba-9382-35174661f4cc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1576 microversion: 2.1 time: 0.155034 Oct 24 10:19:16.061364 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3859/7891] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:15 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:19:17.086239 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:19:17.087073 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:19:17.093381 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:17.093863 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:17.094300 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:17.094987 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:19:17.095441 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:19:17.095896 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:19:17.231865 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:19:17.239709 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-70ecaa76-4b7d-4d6b-b2bc-76b584ad60f6 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1563 microversion: 2.1 time: 0.159151 Oct 24 10:19:17.240325 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4033/7892] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:19:17 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:20:33.584346 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=5 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:33.585611 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=18 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:33.587061 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:20:33.587211 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:20:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f (ip 10.222.0.25) !!! Oct 24 10:20:33.590436 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-d602b9f7-7466-4855-a64c-3d41074b8e3b req-07383f82-267e-4d99-ad84-bd1e78a8c04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:20:33.595810 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:33.596406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:33.598553 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:33.599425 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=13 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:33.600981 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:20:33.601148 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:20:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 24 10:20:33.603113 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:20:33.603285 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:20:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 24 10:20:33.614567 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d602b9f7-7466-4855-a64c-3d41074b8e3b req-07383f82-267e-4d99-ad84-bd1e78a8c04d service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:33.614881 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:33.615065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d602b9f7-7466-4855-a64c-3d41074b8e3b req-07383f82-267e-4d99-ad84-bd1e78a8c04d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:33.615383 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:33.615520 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-d602b9f7-7466-4855-a64c-3d41074b8e3b req-07383f82-267e-4d99-ad84-bd1e78a8c04d service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:33.615836 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:33.616548 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:33.617013 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:33.617487 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:33.630410 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-d602b9f7-7466-4855-a64c-3d41074b8e3b req-07383f82-267e-4d99-ad84-bd1e78a8c04d service nova] Creating event network-changed:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h2-master-1 Oct 24 10:20:33.635594 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-d602b9f7-7466-4855-a64c-3d41074b8e3b req-07383f82-267e-4d99-ad84-bd1e78a8c04d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051044 Oct 24 10:20:33.636419 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4034/7893] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:20:33.649247 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:20:33.735194 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e3e7972-496d-40c4-970e-f2c45e39a006 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 204 len: 0 microversion: 2.1 time: 0.152521 Oct 24 10:20:33.736250 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3860/7894] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:20:33 2022] DELETE /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:20:33.745339 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:33.746098 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:33.753279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:33.753279 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:33.753603 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:33.754167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:33.754632 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:33.755065 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:33.893430 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:33.901481 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5767377a-92c6-4e1f-95e1-c6e0c022f6da tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.160481 Oct 24 10:20:33.902270 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4035/7895] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:33 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:20:34.925996 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:34.926714 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:34.934078 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:34.934573 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:34.935023 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:34.936223 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:34.936694 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:34.937136 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:35.154455 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:35.162519 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-711507a1-14fc-4bfe-ba44-02e765bd31dc tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1569 microversion: 2.1 time: 0.240947 Oct 24 10:20:35.163101 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3861/7896] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:34 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:20:36.025132 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1a9edb30-23c1-40b2-adf4-e879cb5ac70f req-f4001339-0152-466c-8d33-78d0e48a986e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385adda1-eb02-4fc7-af37-3aa3f81f406f", "name": "network-vif-deleted", "tag": "52138da3-96cb-4ea3-9401-9ab560d4e702"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:20:36.040082 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1a9edb30-23c1-40b2-adf4-e879cb5ac70f req-f4001339-0152-466c-8d33-78d0e48a986e service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:36.040559 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1a9edb30-23c1-40b2-adf4-e879cb5ac70f req-f4001339-0152-466c-8d33-78d0e48a986e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:36.040996 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1a9edb30-23c1-40b2-adf4-e879cb5ac70f req-f4001339-0152-466c-8d33-78d0e48a986e service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:36.054715 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1a9edb30-23c1-40b2-adf4-e879cb5ac70f req-f4001339-0152-466c-8d33-78d0e48a986e service nova] Creating event network-vif-deleted:52138da3-96cb-4ea3-9401-9ab560d4e702 for instance 385adda1-eb02-4fc7-af37-3aa3f81f406f on n-h2-master-1 Oct 24 10:20:36.060330 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1a9edb30-23c1-40b2-adf4-e879cb5ac70f req-f4001339-0152-466c-8d33-78d0e48a986e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038822 Oct 24 10:20:36.061439 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4036/7897] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:20:36.186732 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:36.187397 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:36.194393 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:36.194891 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:36.195345 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:36.196062 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:36.196532 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:36.196974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:36.264900 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:36.273004 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e88d2277-b444-471b-8a4c-baece056f2bd tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1220 microversion: 2.1 time: 0.090247 Oct 24 10:20:36.273638 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3862/7898] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:36 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:20:37.297875 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:37.298617 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:37.305903 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:37.306386 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:37.306841 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:37.307518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:37.307974 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:37.308402 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:37.373550 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:37.381480 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9300db08-6b99-4158-8b2a-1f9a1de13444 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1220 microversion: 2.1 time: 0.088427 Oct 24 10:20:37.382071 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4037/7899] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:37 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:20:38.404790 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:38.405560 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:38.413134 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:38.413732 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:38.414101 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:38.415079 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:38.415550 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:38.416119 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:38.479795 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:38.488190 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5b0fa1e-d0a3-48d1-8f31-77018f5b1459 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1220 microversion: 2.1 time: 0.087493 Oct 24 10:20:38.488791 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3863/7900] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:38 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:20:39.511360 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:39.514049 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:39.521212 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:39.521745 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:39.522182 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:39.522875 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:39.523329 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:39.523754 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:39.588738 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:39.596562 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b0c5d16-d33f-4ff9-9db0-77032746a85a tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1220 microversion: 2.1 time: 0.089287 Oct 24 10:20:39.597140 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4038/7901] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:39 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:20:40.620025 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:40.620657 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:40.627431 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:40.628314 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:40.628792 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:40.629533 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:40.630590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:40.630590 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:40.666566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:40.666927 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:40.667300 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:40.667869 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lazy-loading 'fault' on Instance uuid 385adda1-eb02-4fc7-af37-3aa3f81f406f {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:20:40.712099 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95d0d21edd647efb08b5491688ffd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30e6c02e2054515bc5fd59980095a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:20:40.719618 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dbd3764f-9ae9-43a6-8adf-d4654cc3bff0 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 200 len: 1179 microversion: 2.1 time: 0.104339 Oct 24 10:20:40.720270 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3864/7902] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:40 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 1179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:20:41.744405 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:41.744957 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] [instance: 385adda1-eb02-4fc7-af37-3aa3f81f406f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:20:41.752628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:41.753253 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:41.753747 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:41.754455 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:20:41.754923 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:20:41.755359 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:20:41.769781 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] HTTP exception thrown: Instance 385adda1-eb02-4fc7-af37-3aa3f81f406f could not be found. Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Request method failure captured: Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f HTTP/1.1 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Accept: application/json Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Accept-Encoding: identity Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Connection: close Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Content-Length: 0 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Content-Type: application/json Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Host: 10.222.0.25 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: Openstack-System-Scope: None Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjVmTnPvMYaylN0vargHPVJ3HH-2xd5UXIqu8lw7a8yJ9WT3nj8OUCwJ5ZfGYhhlArOtTEieJ18KkFOXLS-H8KPYDx23R4-Lj_mlnfHXX7eSNs8KS9e-M7JyuvJDUeO7YOGCwqy66rKJAfI5EEzzwJ7VNTH4deXuynFBAJCVQCs8mNw3I Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Id: None Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Domain-Name: None Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Identity-Status: Confirmed Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Is-Admin-Project: True Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Id: default Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Project-Domain-Name: Default Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Project-Id: d30e6c02e2054515bc5fd59980095a56 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Project-Name: tempest-TestShelveInstance-1912818403 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Role: member,reader Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Roles: member,reader Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d30e6c02e2054515bc5fd59980095a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d30e6c02e2054515bc5fd59980095a56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d30e6c02e2054515bc5fd59980095a56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d30e6c02e2054515bc5fd59980095a56"}]}] Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Tenant: tempest-TestShelveInstance-1912818403 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Id: d30e6c02e2054515bc5fd59980095a56 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestShelveInstance-1912818403 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-User: tempest-TestShelveInstance-1912818403-project Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Id: default Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-User-Domain-Name: Default Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-User-Id: c95d0d21edd647efb08b5491688ffd86 Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: X-User-Name: tempest-TestShelveInstance-1912818403-project Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: method: > Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: exception: Instance 385adda1-eb02-4fc7-af37-3aa3f81f406f could not be found. Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: action_args: {'id': '385adda1-eb02-4fc7-af37-3aa3f81f406f'} Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 385adda1-eb02-4fc7-af37-3aa3f81f406f could not be found. Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 385adda1-eb02-4fc7-af37-3aa3f81f406f could not be found. Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:20:41.771461 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 385adda1-eb02-4fc7-af37-3aa3f81f406f could not be found. Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Returning 404 to user: Instance 385adda1-eb02-4fc7-af37-3aa3f81f406f could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25558eea-366b-41cf-8537-60bc350ba84f tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f" status: 404 len: 111 microversion: 2.1 time: 0.032574 Oct 24 10:20:41.777389 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4039/7903] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:20:41 2022] GET /compute/v2.1/servers/385adda1-eb02-4fc7-af37-3aa3f81f406f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:20:41.938727 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9632ccfc-d268-46bb-97c2-b7437f5df0e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] Calling method '.version_select at 0x7f8da9d71ee0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:20:41.965048 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9632ccfc-d268-46bb-97c2-b7437f5df0e8 tempest-TestShelveInstance-1912818403 tempest-TestShelveInstance-1912818403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1955870549" status: 202 len: 0 microversion: 2.1 time: 0.031200 Oct 24 10:20:41.965877 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3865/7904] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 10:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1955870549 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:20:59.246660 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:59.249600 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=24 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:59.426772 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5712ee7b-483c-4864-b349-42511b990f03 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Action: 'create', calling method: .version_select at 0x7f8daf2e44c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2043205129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaQrRnplKbGKTs1q6zub3rnVYttpFd8++Yk00vcDsX74BoDolSX3XQh8ZL50VaLVYVy+IqAHIA8mZiv0Q6fJOw3dYuVjaPUHcT55K6QLkKH/GyIQ2KgTIgM5d9yHTs0Ig=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:20:59.443240 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5712ee7b-483c-4864-b349-42511b990f03 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Getting quotas for project a2cf6a6ff48d4f66a4ae9af2f2d93eda. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:20:59.448785 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-5712ee7b-483c-4864-b349-42511b990f03 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Getting quotas for user 2b49aefb7bfd4dffb2a4bf39f88c1177 and project a2cf6a6ff48d4f66a4ae9af2f2d93eda. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:20:59.479151 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5712ee7b-483c-4864-b349-42511b990f03 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.238095 Oct 24 10:20:59.479871 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4040/7905] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Oct 24 10:20:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:21:00.448475 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:00.449241 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:00.454189 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-977325271", "imageRef": "a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2043205129", "security_groups": [{"name": "tempest-secgroup-smoke-689548541"}], "networks": [{"uuid": "6afb3b02-2958-4f99-b0d4-75286e1b3396"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:21:00.575517 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] validate_networks() for [('6afb3b02-2958-4f99-b0d4-75286e1b3396', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:21:01.073986 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:21:01.074436 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:21:01.074928 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:21:01.075378 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:21:01.075800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:21:01.085099 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:01.085624 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:01.086082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:01.086844 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:01.087344 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:01.087787 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:01.105824 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Getting quotas for project a2cf6a6ff48d4f66a4ae9af2f2d93eda. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:21:01.111759 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.quota [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Getting quotas for user 2b49aefb7bfd4dffb2a4bf39f88c1177 and project a2cf6a6ff48d4f66a4ae9af2f2d93eda. Resources: {'ram', 'instances', 'cores'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:21:01.124747 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:21:01.127075 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8f9ca6b-3b06-4e3b-87a3-faab1eeebdc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:21:01.174733 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c7e9ff7-d48f-4b8f-ac2a-098ecbeff802 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727979 Oct 24 10:21:01.175580 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3866/7906] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:21:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:21:01.186793 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e69087bb-9281-43b1-98b2-5e839a950357 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:01.187392 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e69087bb-9281-43b1-98b2-5e839a950357 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:01.244927 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-e69087bb-9281-43b1-98b2-5e839a950357 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:01.252466 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e69087bb-9281-43b1-98b2-5e839a950357 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1248 microversion: 2.1 time: 0.069622 Oct 24 10:21:01.261834 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4041/7907] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:01 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:02.278153 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:02.280098 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:02.290144 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:02.291037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:02.291796 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:02.292726 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:02.293413 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:02.294626 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:02.374078 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:02.382288 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e3d04f5-8f67-4ab0-96a4-878014d01930 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1300 microversion: 2.1 time: 0.110037 Oct 24 10:21:02.383229 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3867/7908] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:02 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:03.407053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:03.408212 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:03.416161 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:03.416932 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:03.417714 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:03.418583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:03.419819 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:03.420454 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:03.586989 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:03.596728 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-897b657a-f02c-4ee8-8d06-e855ec7ed4d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1373 microversion: 2.1 time: 0.194265 Oct 24 10:21:03.597754 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4042/7909] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:03 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:03.914995 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5e9b087a-9ddd-4673-ac28-d564b7233f99 req-f9e893ab-f96f-4d0c-be6c-9ebb2682c930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:21:03.926969 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5e9b087a-9ddd-4673-ac28-d564b7233f99 req-f9e893ab-f96f-4d0c-be6c-9ebb2682c930 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:03.927396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5e9b087a-9ddd-4673-ac28-d564b7233f99 req-f9e893ab-f96f-4d0c-be6c-9ebb2682c930 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:03.927974 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5e9b087a-9ddd-4673-ac28-d564b7233f99 req-f9e893ab-f96f-4d0c-be6c-9ebb2682c930 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:03.939732 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5e9b087a-9ddd-4673-ac28-d564b7233f99 req-f9e893ab-f96f-4d0c-be6c-9ebb2682c930 service nova] Creating event network-changed:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:21:03.944846 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5e9b087a-9ddd-4673-ac28-d564b7233f99 req-f9e893ab-f96f-4d0c-be6c-9ebb2682c930 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Oct 24 10:21:03.945520 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3868/7910] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:21:04.620056 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:04.620711 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:04.628229 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:04.628712 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:04.629149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:04.629886 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:04.630345 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:04.630775 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:04.762850 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:04.770570 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4a7e6894-54c1-4806-a8f5-406dbc0bb63a tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1373 microversion: 2.1 time: 0.154430 Oct 24 10:21:04.771144 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4043/7911] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:04 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:05.795320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:05.796041 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:05.802295 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:05.802793 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:05.803245 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:05.803947 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:05.804415 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:05.804857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:05.948647 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:05.956962 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8a9fd785-185c-4f0e-9049-cfeaa6f31a1b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1373 microversion: 2.1 time: 0.167136 Oct 24 10:21:05.957596 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3869/7912] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:05 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:06.981997 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:06.982675 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:06.989779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:06.990265 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:06.990702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:06.991394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:06.991847 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:06.992272 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:07.126628 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:07.134328 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa2732ef-bf5c-4ea7-8514-3f09fb33df89 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1373 microversion: 2.1 time: 0.156805 Oct 24 10:21:07.134897 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4044/7913] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:06 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:08.077498 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-657f05ed-ee71-4b53-bacc-cf692e8c8500 req-1e85f3b4-9053-4f96-8989-d4a7d0f9b689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "name": "network-vif-plugged", "status": "completed", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:21:08.087366 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-657f05ed-ee71-4b53-bacc-cf692e8c8500 req-1e85f3b4-9053-4f96-8989-d4a7d0f9b689 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:08.087857 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-657f05ed-ee71-4b53-bacc-cf692e8c8500 req-1e85f3b4-9053-4f96-8989-d4a7d0f9b689 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:08.088304 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-657f05ed-ee71-4b53-bacc-cf692e8c8500 req-1e85f3b4-9053-4f96-8989-d4a7d0f9b689 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:08.099272 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-657f05ed-ee71-4b53-bacc-cf692e8c8500 req-1e85f3b4-9053-4f96-8989-d4a7d0f9b689 service nova] Creating event network-vif-plugged:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:21:08.104371 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-657f05ed-ee71-4b53-bacc-cf692e8c8500 req-1e85f3b4-9053-4f96-8989-d4a7d0f9b689 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093630 Oct 24 10:21:08.104999 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3870/7914] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:21:08.157439 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:08.158063 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:08.165205 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:08.165742 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:08.166188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:08.166905 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:08.167365 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:08.167797 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:08.356265 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:08.364636 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22b4144d-9daf-4b27-96ad-8322788c7085 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1373 microversion: 2.1 time: 0.211193 Oct 24 10:21:08.365212 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4045/7915] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:08 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:09.389791 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:09.390512 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:09.396764 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:09.397264 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:09.397747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:09.398450 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:09.398923 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:09.399368 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:09.582778 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:09.591174 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b47e93a-5e68-4ded-873c-365e399cf6d9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1557 microversion: 2.1 time: 0.206312 Oct 24 10:21:09.591770 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3871/7916] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:09 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1557 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:09.613820 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:21:09.614448 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:21:09.621500 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:09.622021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:09.622465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:09.623162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:09.623628 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:09.624060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:09.754586 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:21:09.762263 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c23a387-0138-4d2c-92c2-9a176d958bfd tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1557 microversion: 2.1 time: 0.152413 Oct 24 10:21:09.763351 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4046/7917] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:21:09 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:21:11.383224 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:11.384474 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:11.439225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f7e9bdbb-b3d0-49cb-ae8c-046f9bfb00e4 req-c4817459-e2f3-407b-b2c3-f33847a8248b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:21:11.448959 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f7e9bdbb-b3d0-49cb-ae8c-046f9bfb00e4 req-c4817459-e2f3-407b-b2c3-f33847a8248b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:21:11.449542 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f7e9bdbb-b3d0-49cb-ae8c-046f9bfb00e4 req-c4817459-e2f3-407b-b2c3-f33847a8248b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:21:11.450618 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f7e9bdbb-b3d0-49cb-ae8c-046f9bfb00e4 req-c4817459-e2f3-407b-b2c3-f33847a8248b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:21:11.462005 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f7e9bdbb-b3d0-49cb-ae8c-046f9bfb00e4 req-c4817459-e2f3-407b-b2c3-f33847a8248b service nova] Creating event network-changed:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:21:11.467798 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f7e9bdbb-b3d0-49cb-ae8c-046f9bfb00e4 req-c4817459-e2f3-407b-b2c3-f33847a8248b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089837 Oct 24 10:21:11.468461 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3872/7918] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:23:03.347749 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 10:23:03.348935 n-d-master-1 devstack@n-api.service[126920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 10:23:03.349330 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:03.350196 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:03.350832 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=30 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:03.356182 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1863720287"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:03.358591 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:03.367032 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:03.367518 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:03.367954 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:03.368646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:03.369137 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:03.369599 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:03.570763 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c776abd8-5ca4-4510-954c-459b14e02896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "POST /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564/action" status: 202 len: 0 microversion: 2.1 time: 0.224568 Oct 24 10:23:03.571417 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4047/7919] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:23:03 2022] POST /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:23:08.573611 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:08.575657 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=26 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:08.582225 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-687ed094-ca1d-423f-96d3-0e41a9ff9422 req-375b385c-e490-4bdc-b6f0-fcc6dd76dbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "name": "network-vif-plugged", "status": "completed", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:08.597416 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-687ed094-ca1d-423f-96d3-0e41a9ff9422 req-375b385c-e490-4bdc-b6f0-fcc6dd76dbcd service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:08.598189 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-687ed094-ca1d-423f-96d3-0e41a9ff9422 req-375b385c-e490-4bdc-b6f0-fcc6dd76dbcd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:08.599220 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-687ed094-ca1d-423f-96d3-0e41a9ff9422 req-375b385c-e490-4bdc-b6f0-fcc6dd76dbcd service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:08.613558 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-687ed094-ca1d-423f-96d3-0e41a9ff9422 req-375b385c-e490-4bdc-b6f0-fcc6dd76dbcd service nova] Creating event network-vif-plugged:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:23:08.619265 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-687ed094-ca1d-423f-96d3-0e41a9ff9422 req-375b385c-e490-4bdc-b6f0-fcc6dd76dbcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048823 Oct 24 10:23:08.620040 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3873/7920] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:23:17.117455 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:17.118232 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:17.123943 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-8461539", "imageRef": "df9959ba-27eb-43f2-805f-e070c488c2c6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2043205129", "security_groups": [{"name": "tempest-secgroup-smoke-689548541"}], "networks": [{"uuid": "6afb3b02-2958-4f99-b0d4-75286e1b3396"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:17.155850 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [87aeca61-d4c5-4df8-b925-17a7e26789b8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36174. Oct 24 10:23:17.157099 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c43a9c6-568c-4b1a-a138-4ce8333e0808] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36172. Oct 24 10:23:17.237917 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] validate_networks() for [('6afb3b02-2958-4f99-b0d4-75286e1b3396', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:23:17.647821 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:23:17.648242 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:23:17.648710 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:23:17.649114 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:23:17.649577 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:23:17.658426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:17.658907 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:17.659341 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:17.660062 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:17.660515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:17.660944 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:17.679284 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Getting quotas for project a2cf6a6ff48d4f66a4ae9af2f2d93eda. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:23:17.685379 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.quota [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Getting quotas for user 2b49aefb7bfd4dffb2a4bf39f88c1177 and project a2cf6a6ff48d4f66a4ae9af2f2d93eda. Resources: {'ram', 'instances', 'cores'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:23:17.697567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:23:17.700060 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df9959ba-27eb-43f2-805f-e070c488c2c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:23:17.746959 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1604be8d-e8d1-4c46-b29e-ea76c704fc3c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.631666 Oct 24 10:23:17.747621 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4048/7921] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 10:23:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:23:17.760764 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3862564-7c13-4c55-96c4-b9907b2493c2 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:17.761534 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3862564-7c13-4c55-96c4-b9907b2493c2 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:17.817945 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3862564-7c13-4c55-96c4-b9907b2493c2 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:17.824855 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3862564-7c13-4c55-96c4-b9907b2493c2 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1246 microversion: 2.1 time: 0.069659 Oct 24 10:23:17.825453 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3874/7922] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:17 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:18.847692 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:18.848338 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:18.854583 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:18.855093 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:18.856167 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:18.856918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:18.857421 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:18.857901 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:18.924952 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:18.935423 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53d73269-c31c-4928-8ae3-1fe71c03368c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1306 microversion: 2.1 time: 0.092509 Oct 24 10:23:18.936197 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4049/7923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:18 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:19.959287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:19.959914 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:19.962013 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:19.970470 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:19.971006 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:19.971463 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:19.972191 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:19.972822 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:19.973512 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:20.138800 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:20.147710 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-349643de-e6f9-49a3-940a-d7d61adef093 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.192248 Oct 24 10:23:20.148302 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3875/7924] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:19 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:20.600053 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5f0b403a-1087-44de-8781-e60d2cbd0a2d req-781cfb33-0395-4061-a577-7a8bfb18b476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "name": "network-vif-unplugged", "status": "completed", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:20.614448 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5f0b403a-1087-44de-8781-e60d2cbd0a2d req-781cfb33-0395-4061-a577-7a8bfb18b476 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:20.617582 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5f0b403a-1087-44de-8781-e60d2cbd0a2d req-781cfb33-0395-4061-a577-7a8bfb18b476 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:20.618203 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5f0b403a-1087-44de-8781-e60d2cbd0a2d req-781cfb33-0395-4061-a577-7a8bfb18b476 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:20.632121 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5f0b403a-1087-44de-8781-e60d2cbd0a2d req-781cfb33-0395-4061-a577-7a8bfb18b476 service nova] Creating event network-vif-unplugged:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:23:20.641573 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5f0b403a-1087-44de-8781-e60d2cbd0a2d req-781cfb33-0395-4061-a577-7a8bfb18b476 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047686 Oct 24 10:23:20.642717 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4050/7925] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:23:21.172702 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:21.173487 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:21.180547 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:21.181037 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:21.181675 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:21.182396 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:21.182971 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:21.183588 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:21.329904 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:21.338740 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb96ea22-86cb-4990-b65b-ebfd14d5dce9 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.170610 Oct 24 10:23:21.340029 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3876/7926] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:21 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:23:22.364629 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:22.365494 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:22.372656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:22.373149 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:22.373618 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:22.374324 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:22.374783 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:22.375213 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:22.525925 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:22.541420 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48106e15-6843-4d7c-9756-5930c8b456c5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.182135 Oct 24 10:23:22.542212 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4051/7927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:22 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:23.564610 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:23.565168 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:23.572050 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:23.572536 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:23.573081 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:23.573824 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:23.574180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:23.575180 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:23.732351 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:23.741270 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab803b65-54e7-4ea1-90a9-844b16eef682 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.180580 Oct 24 10:23:23.742042 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3877/7928] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:23 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:24.764704 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:24.765335 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:24.772042 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:24.772519 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:24.772961 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:24.773666 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:24.774120 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:24.774542 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:24.918341 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:24.926142 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3ab69e2-d72b-41ca-b5ec-b38c621f1896 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.165289 Oct 24 10:23:24.926909 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4052/7929] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:24 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:25.948287 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:25.948919 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:25.956546 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:25.957053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:25.957541 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:25.958272 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:25.958749 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:25.959192 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:26.222937 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:26.233109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1fc7d85c-f5b9-448b-8a8d-5d7ac3a7f5d7 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.288763 Oct 24 10:23:26.234169 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3878/7930] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:25 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:27.256046 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:27.256589 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:27.263462 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:27.263952 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:27.264394 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:27.265089 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:27.265572 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:27.266002 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:27.401376 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:27.409076 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d447a32e-dd56-4eb5-a974-3dade280e27c tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.156909 Oct 24 10:23:27.409668 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4053/7931] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:27 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:27.858350 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:27.921674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3c4b7523-9172-4478-a19e-0942f1199135 req-03576918-9a7d-478c-8f4d-fc4a589a60e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac6cfbff-0d71-4b5c-8954-d01f967aacd4", "tag": "633561d7-f596-49b6-9ba9-4ccf081ebe8e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:27.931391 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3c4b7523-9172-4478-a19e-0942f1199135 req-03576918-9a7d-478c-8f4d-fc4a589a60e8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:27.931878 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3c4b7523-9172-4478-a19e-0942f1199135 req-03576918-9a7d-478c-8f4d-fc4a589a60e8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:27.932319 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3c4b7523-9172-4478-a19e-0942f1199135 req-03576918-9a7d-478c-8f4d-fc4a589a60e8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:27.944164 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3c4b7523-9172-4478-a19e-0942f1199135 req-03576918-9a7d-478c-8f4d-fc4a589a60e8 service nova] Creating event network-changed:633561d7-f596-49b6-9ba9-4ccf081ebe8e for instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 on n-h2-master-1 Oct 24 10:23:27.949141 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3c4b7523-9172-4478-a19e-0942f1199135 req-03576918-9a7d-478c-8f4d-fc4a589a60e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096054 Oct 24 10:23:27.950389 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3879/7932] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:23:28.433120 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:28.434268 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:28.436236 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:28.437017 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:28.443870 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:28.444358 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:28.444796 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:28.445515 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:28.445976 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:28.446404 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:28.574890 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:28.582899 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32772b6c-d6f4-4fad-8ad7-fd1031c84b57 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.153831 Oct 24 10:23:28.583476 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4054/7933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:28 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:29.608391 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:29.609050 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:29.615602 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:29.616110 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:29.616566 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:29.617283 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:29.617779 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:29.618279 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:29.833240 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:29.841016 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fab4cc11-9703-4489-b2bf-1a3c677ea723 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.237906 Oct 24 10:23:29.841640 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3880/7934] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:29 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:30.864086 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:30.864734 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:30.871588 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:30.872069 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:30.872513 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:30.873201 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:30.873681 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:30.874107 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:31.005165 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:31.014324 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-efc1eb22-7531-41f1-8c11-582d41b4a4fa tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.154151 Oct 24 10:23:31.014919 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4055/7935] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:30 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:32.039202 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:32.039782 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:32.047746 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:32.048239 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:32.048691 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:32.049420 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:32.049893 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:32.050339 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:32.183990 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:32.192542 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f4a1c3c3-1a44-41cc-9812-f84d156b8b36 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.157263 Oct 24 10:23:32.193322 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3881/7936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:32 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:33.216563 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:33.217176 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:33.224019 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:33.224501 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:33.224937 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:33.225656 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:33.226111 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:33.226540 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:33.360456 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:33.368283 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2808750-1dbf-4895-b725-d08f712088ca tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.156283 Oct 24 10:23:33.368874 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4056/7937] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:33 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:33.656809 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-77730c8d-cb8e-46ab-a99a-bf3deecceee8 req-a759b96b-2c81-4e09-ad6a-2aa7fcfaba4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6cfbff-0d71-4b5c-8954-d01f967aacd4", "name": "network-vif-plugged", "status": "completed", "tag": "633561d7-f596-49b6-9ba9-4ccf081ebe8e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:33.669171 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-77730c8d-cb8e-46ab-a99a-bf3deecceee8 req-a759b96b-2c81-4e09-ad6a-2aa7fcfaba4b service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:33.669709 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-77730c8d-cb8e-46ab-a99a-bf3deecceee8 req-a759b96b-2c81-4e09-ad6a-2aa7fcfaba4b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:33.670153 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-77730c8d-cb8e-46ab-a99a-bf3deecceee8 req-a759b96b-2c81-4e09-ad6a-2aa7fcfaba4b service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:33.681442 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-77730c8d-cb8e-46ab-a99a-bf3deecceee8 req-a759b96b-2c81-4e09-ad6a-2aa7fcfaba4b service nova] Creating event network-vif-plugged:633561d7-f596-49b6-9ba9-4ccf081ebe8e for instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 on n-h2-master-1 Oct 24 10:23:33.686438 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-77730c8d-cb8e-46ab-a99a-bf3deecceee8 req-a759b96b-2c81-4e09-ad6a-2aa7fcfaba4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033892 Oct 24 10:23:33.687304 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3882/7938] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:23:34.392258 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:34.392880 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:34.399773 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:34.400261 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:34.400702 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:34.401426 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:34.401888 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:34.402361 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:34.533609 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:34.541537 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-92c73400-550d-4d75-8b5f-4ea8a6b56b32 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1371 microversion: 2.1 time: 0.153146 Oct 24 10:23:34.542116 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4057/7939] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:34 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:35.566146 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:35.566773 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:35.572914 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:35.573436 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:35.573882 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:35.575205 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:35.575669 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:35.576106 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:35.708052 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:35.715742 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cc92d7c4-e922-48e6-8925-1fb2b0f06f10 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1556 microversion: 2.1 time: 0.154806 Oct 24 10:23:35.716312 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3883/7940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:35 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:35.738263 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:23:35.738885 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:23:35.745682 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:35.746744 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:35.747188 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:35.747878 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:35.748344 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:35.748769 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:35.881958 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:23:35.889689 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd6068e5-05b5-4cf2-bd32-a1d138c4e417 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1556 microversion: 2.1 time: 0.155336 Oct 24 10:23:35.890267 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4058/7941] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:23:35 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:23:37.448761 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-94fc1749-c28e-4ea2-8b2b-825eb6fa4df0 req-9055726b-25df-46b1-920a-9a00be51bda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac6cfbff-0d71-4b5c-8954-d01f967aacd4", "tag": "633561d7-f596-49b6-9ba9-4ccf081ebe8e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:23:37.459103 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-94fc1749-c28e-4ea2-8b2b-825eb6fa4df0 req-9055726b-25df-46b1-920a-9a00be51bda4 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:37.459589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-94fc1749-c28e-4ea2-8b2b-825eb6fa4df0 req-9055726b-25df-46b1-920a-9a00be51bda4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:37.460030 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-94fc1749-c28e-4ea2-8b2b-825eb6fa4df0 req-9055726b-25df-46b1-920a-9a00be51bda4 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:37.471109 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-94fc1749-c28e-4ea2-8b2b-825eb6fa4df0 req-9055726b-25df-46b1-920a-9a00be51bda4 service nova] Creating event network-changed:633561d7-f596-49b6-9ba9-4ccf081ebe8e for instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 on n-h2-master-1 Oct 24 10:23:37.476189 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-94fc1749-c28e-4ea2-8b2b-825eb6fa4df0 req-9055726b-25df-46b1-920a-9a00be51bda4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031428 Oct 24 10:23:37.476987 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3884/7942] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:05.552747 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:05.552747 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=58 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:05.553970 n-d-master-1 devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:25:05.554120 n-d-master-1 devstack@n-api.service[126920]: Mon Oct 24 10:25:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4/action (ip 10.222.0.25) !!! Oct 24 10:25:05.560197 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-903198328"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:05.562567 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:05.571541 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.572030 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.572473 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.573177 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.573675 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.574103 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.785435 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-674a1f6d-7fa3-460e-b57b-03ffef77fc46 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "POST /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4/action" status: 202 len: 0 microversion: 2.1 time: 0.234280 Oct 24 10:25:05.786524 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4059/7943] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Oct 24 10:25:05 2022] POST /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:25:12.273928 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 10:25:12.274949 n-d-master-1 devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17ac0623-892c-4f4d-af69-1915864327ee] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 10:25:12.275820 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=26 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:12.277101 n-d-master-1 devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=48 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:12.278794 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:25:12.278938 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 24 10:25:12.281655 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:25:12.281827 n-d-master-1 devstack@n-api.service[126919]: Mon Oct 24 10:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 24 10:25:12.297708 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1a8c449a-217d-4ef4-9eca-7323749700fc req-335cfe6e-4967-463d-941f-fbebcd069d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6cfbff-0d71-4b5c-8954-d01f967aacd4", "name": "network-vif-plugged", "status": "completed", "tag": "633561d7-f596-49b6-9ba9-4ccf081ebe8e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:12.316788 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a8c449a-217d-4ef4-9eca-7323749700fc req-335cfe6e-4967-463d-941f-fbebcd069d16 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:12.317409 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a8c449a-217d-4ef4-9eca-7323749700fc req-335cfe6e-4967-463d-941f-fbebcd069d16 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:12.318127 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1a8c449a-217d-4ef4-9eca-7323749700fc req-335cfe6e-4967-463d-941f-fbebcd069d16 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:12.329981 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1a8c449a-217d-4ef4-9eca-7323749700fc req-335cfe6e-4967-463d-941f-fbebcd069d16 service nova] Creating event network-vif-plugged:633561d7-f596-49b6-9ba9-4ccf081ebe8e for instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 on n-h2-master-1 Oct 24 10:25:12.335653 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1a8c449a-217d-4ef4-9eca-7323749700fc req-335cfe6e-4967-463d-941f-fbebcd069d16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065424 Oct 24 10:25:12.337104 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3885/7944] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:19.361132 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:19.364674 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4267eaa3-8873-4fc2-82e6-8da4d149dd8d req-0ea75061-41e1-4965-bc05-7c898f24c488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac6cfbff-0d71-4b5c-8954-d01f967aacd4", "tag": "633561d7-f596-49b6-9ba9-4ccf081ebe8e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:19.365385 n-d-master-1 devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:19.370786 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:19.371417 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:19.378921 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.379409 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.379851 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.380552 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.381006 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.381465 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.399056 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [17ac0623-892c-4f4d-af69-1915864327ee] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36480. Oct 24 10:25:19.409400 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:25:19.410856 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4267eaa3-8873-4fc2-82e6-8da4d149dd8d req-0ea75061-41e1-4965-bc05-7c898f24c488 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.411766 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4267eaa3-8873-4fc2-82e6-8da4d149dd8d req-0ea75061-41e1-4965-bc05-7c898f24c488 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.412353 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4267eaa3-8873-4fc2-82e6-8da4d149dd8d req-0ea75061-41e1-4965-bc05-7c898f24c488 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.427802 n-d-master-1 devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d2311a0-aa1a-4b56-8b40-b4a2f06c9ae4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36478. Oct 24 10:25:19.430664 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4267eaa3-8873-4fc2-82e6-8da4d149dd8d req-0ea75061-41e1-4965-bc05-7c898f24c488 service nova] Creating event network-changed:633561d7-f596-49b6-9ba9-4ccf081ebe8e for instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 on n-h2-master-1 Oct 24 10:25:19.436067 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4267eaa3-8873-4fc2-82e6-8da4d149dd8d req-0ea75061-41e1-4965-bc05-7c898f24c488 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077750 Oct 24 10:25:19.436795 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3886/7945] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:25:19.510432 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77d6d06d-f42c-4308-a590-170d6d86b42d tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 204 len: 0 microversion: 2.1 time: 0.157217 Oct 24 10:25:19.511555 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4060/7946] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:25:19 2022] DELETE /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:25:19.521212 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:19.521972 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:19.529578 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.530082 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.530530 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.531248 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.531747 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.532185 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.671155 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:19.679113 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-96fb5935-2792-451b-8ec4-33d820274e9b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1680 microversion: 2.1 time: 0.163016 Oct 24 10:25:19.679693 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3887/7947] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:19 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:20.705611 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:20.706243 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:20.713578 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:20.714060 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:20.714494 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:20.715190 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:20.715646 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:20.716072 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:20.847641 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:20.855706 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fec12131-2faf-4d5d-8e4a-aab1fc60bfd5 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1680 microversion: 2.1 time: 0.154511 Oct 24 10:25:20.856463 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4061/7948] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:20 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:21.750239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ddfa182b-6f82-44d7-a189-0eb31e86d1a1 req-2b408c29-5da6-42a7-a054-ad2b76ba6252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6cfbff-0d71-4b5c-8954-d01f967aacd4", "name": "network-vif-deleted", "tag": "633561d7-f596-49b6-9ba9-4ccf081ebe8e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:21.761560 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ddfa182b-6f82-44d7-a189-0eb31e86d1a1 req-2b408c29-5da6-42a7-a054-ad2b76ba6252 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.762053 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ddfa182b-6f82-44d7-a189-0eb31e86d1a1 req-2b408c29-5da6-42a7-a054-ad2b76ba6252 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.762498 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ddfa182b-6f82-44d7-a189-0eb31e86d1a1 req-2b408c29-5da6-42a7-a054-ad2b76ba6252 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.774001 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ddfa182b-6f82-44d7-a189-0eb31e86d1a1 req-2b408c29-5da6-42a7-a054-ad2b76ba6252 service nova] Creating event network-vif-deleted:633561d7-f596-49b6-9ba9-4ccf081ebe8e for instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 on n-h2-master-1 Oct 24 10:25:21.778734 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ddfa182b-6f82-44d7-a189-0eb31e86d1a1 req-2b408c29-5da6-42a7-a054-ad2b76ba6252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032469 Oct 24 10:25:21.779342 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3888/7949] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:21.879644 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:21.880222 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:21.887918 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.888437 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.888930 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.889676 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.890143 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.890575 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.927280 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.927779 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.928284 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.928742 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lazy-loading 'fault' on Instance uuid ac6cfbff-0d71-4b5c-8954-d01f967aacd4 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:25:21.969962 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:21.978275 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c24630c-d61b-4d96-bffc-3f1ace13b257 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 200 len: 1336 microversion: 2.1 time: 0.102508 Oct 24 10:25:21.978847 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4062/7950] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:21 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:23.003686 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:23.004320 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: ac6cfbff-0d71-4b5c-8954-d01f967aacd4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:23.011027 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:23.011524 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:23.012005 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:23.012702 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:23.013173 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:23.013638 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:23.027453 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] HTTP exception thrown: Instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 could not be found. Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Request method failure captured: Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 HTTP/1.1 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmcFIo8LZy4phSWjUwKTqWL0fyOtVinSOZrMO2FjYFkl-N52PTo2tXwbbQ3n7IIUxZaVXUdvnmp1QH4qTF67RyjTk4ea78SsgzLELWj9pqFW7UQpOwvUJQ0Fpqcq3XL5IE-FwnTsOWh6r6BQcJj7FG304LsmGsglkB1neM4FAiiS0PE Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a2cf6a6ff48d4f66a4ae9af2f2d93eda Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestSnapshotPattern-1000579879 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}] Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestSnapshotPattern-1000579879 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a2cf6a6ff48d4f66a4ae9af2f2d93eda Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestSnapshotPattern-1000579879 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestSnapshotPattern-1000579879-project Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2b49aefb7bfd4dffb2a4bf39f88c1177 Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestSnapshotPattern-1000579879-project Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: exception: Instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 could not be found. Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'ac6cfbff-0d71-4b5c-8954-d01f967aacd4'} Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 could not be found. Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 could not be found. Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:23.029102 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 could not be found. Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Returning 404 to user: Instance ac6cfbff-0d71-4b5c-8954-d01f967aacd4 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-81b947cc-5a7a-46df-85bb-da09f5cb364e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4" status: 404 len: 111 microversion: 2.1 time: 0.032216 Oct 24 10:25:23.033233 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3889/7951] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:22 2022] GET /compute/v2.1/servers/ac6cfbff-0d71-4b5c-8954-d01f967aacd4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:24.356117 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:24.356619 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:24.358933 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f3e4cdda-abc4-492f-a1da-21ca80970e6c req-76c4cec2-8df3-4bad-a8a6-f717dd6f58a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:24.365251 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.366013 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.366459 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.367734 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.368199 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.368637 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.372826 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f3e4cdda-abc4-492f-a1da-21ca80970e6c req-76c4cec2-8df3-4bad-a8a6-f717dd6f58a8 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.373341 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f3e4cdda-abc4-492f-a1da-21ca80970e6c req-76c4cec2-8df3-4bad-a8a6-f717dd6f58a8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.373965 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f3e4cdda-abc4-492f-a1da-21ca80970e6c req-76c4cec2-8df3-4bad-a8a6-f717dd6f58a8 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.386039 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f3e4cdda-abc4-492f-a1da-21ca80970e6c req-76c4cec2-8df3-4bad-a8a6-f717dd6f58a8 service nova] Creating event network-changed:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:25:24.391589 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f3e4cdda-abc4-492f-a1da-21ca80970e6c req-76c4cec2-8df3-4bad-a8a6-f717dd6f58a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036986 Oct 24 10:25:24.392517 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3890/7952] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:24.396982 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:25:24.472870 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d9543563-5f95-4dc6-af32-0a1062dd7b60 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 204 len: 0 microversion: 2.1 time: 0.121415 Oct 24 10:25:24.473515 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4063/7953] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 10:25:24 2022] DELETE /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:25:24.483102 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:24.483842 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:24.490684 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.491187 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.491644 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.492934 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.493441 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.494073 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.633239 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:24.641002 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77ad862a-8b4d-4920-b59d-c181cc14869e tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1680 microversion: 2.1 time: 0.162149 Oct 24 10:25:24.641605 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3891/7954] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:24 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:25.666999 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:25.667697 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:25.674432 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:25.674913 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:25.675342 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:25.676021 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:25.676470 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:25.676890 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:25.806831 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.policy [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:25.814569 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6e255ae2-8be9-4084-8110-90ead6d4cc09 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1680 microversion: 2.1 time: 0.152633 Oct 24 10:25:25.815138 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4064/7955] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:25 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:26.838565 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.839981 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:26.847734 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.848289 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.848753 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.849589 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.850113 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.850521 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.997112 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.policy [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b49aefb7bfd4dffb2a4bf39f88c1177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:27.005532 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ed32aad-f8f8-4131-9558-b321fc9c7811 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 200 len: 1563 microversion: 2.1 time: 0.171300 Oct 24 10:25:27.006138 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3892/7956] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:27.319659 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-17d0f2d1-d69e-4cb7-87be-4ca64716462f req-e5b15ab8-3167-41ca-a333-09694a61aeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4df921c-06bb-40e5-b503-f6a8e8184564", "name": "network-vif-deleted", "tag": "84a412cd-a5a7-468d-a6d3-240d029479a9"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:27.338184 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-17d0f2d1-d69e-4cb7-87be-4ca64716462f req-e5b15ab8-3167-41ca-a333-09694a61aeb1 service nova] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.338764 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-17d0f2d1-d69e-4cb7-87be-4ca64716462f req-e5b15ab8-3167-41ca-a333-09694a61aeb1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.340162 n-d-master-1 devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-17d0f2d1-d69e-4cb7-87be-4ca64716462f req-e5b15ab8-3167-41ca-a333-09694a61aeb1 service nova] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:27.353230 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-17d0f2d1-d69e-4cb7-87be-4ca64716462f req-e5b15ab8-3167-41ca-a333-09694a61aeb1 service nova] Creating event network-vif-deleted:84a412cd-a5a7-468d-a6d3-240d029479a9 for instance c4df921c-06bb-40e5-b503-f6a8e8184564 on n-h1-master-1 Oct 24 10:25:27.359902 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-17d0f2d1-d69e-4cb7-87be-4ca64716462f req-e5b15ab8-3167-41ca-a333-09694a61aeb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043952 Oct 24 10:25:27.360628 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4065/7957] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:28.029406 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:28.029943 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] [instance: c4df921c-06bb-40e5-b503-f6a8e8184564] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:28.036892 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:28.037417 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:28.037864 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.038558 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Acquiring lock "49a311bb-62b1-4843-b101-e8316c1df8dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:28.039020 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:28.039951 n-d-master-1 devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Lock "49a311bb-62b1-4843-b101-e8316c1df8dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.053735 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] HTTP exception thrown: Instance c4df921c-06bb-40e5-b503-f6a8e8184564 could not be found. Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Request method failure captured: Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 HTTP/1.1 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Accept: application/json Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Accept-Encoding: identity Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Connection: close Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Content-Length: 0 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Content-Type: application/json Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Host: 10.222.0.25 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: Openstack-System-Scope: None Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjVmcFIo8LZy4phSWjUwKTqWL0fyOtVinSOZrMO2FjYFkl-N52PTo2tXwbbQ3n7IIUxZaVXUdvnmp1QH4qTF67RyjTk4ea78SsgzLELWj9pqFW7UQpOwvUJQ0Fpqcq3XL5IE-FwnTsOWh6r6BQcJj7FG304LsmGsglkB1neM4FAiiS0PE Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Id: None Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Domain-Name: None Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Identity-Status: Confirmed Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Is-Admin-Project: True Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Id: default Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Project-Domain-Name: Default Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Project-Id: a2cf6a6ff48d4f66a4ae9af2f2d93eda Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Project-Name: tempest-TestSnapshotPattern-1000579879 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Role: member,reader Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Roles: member,reader Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a2cf6a6ff48d4f66a4ae9af2f2d93eda"}]}] Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Tenant: tempest-TestSnapshotPattern-1000579879 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Id: a2cf6a6ff48d4f66a4ae9af2f2d93eda Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestSnapshotPattern-1000579879 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-User: tempest-TestSnapshotPattern-1000579879-project Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Id: default Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-User-Domain-Name: Default Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-User-Id: 2b49aefb7bfd4dffb2a4bf39f88c1177 Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: X-User-Name: tempest-TestSnapshotPattern-1000579879-project Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: method: > Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: exception: Instance c4df921c-06bb-40e5-b503-f6a8e8184564 could not be found. Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: action_args: {'id': 'c4df921c-06bb-40e5-b503-f6a8e8184564'} Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4df921c-06bb-40e5-b503-f6a8e8184564 could not be found. Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4df921c-06bb-40e5-b503-f6a8e8184564 could not be found. Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:28.056066 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4df921c-06bb-40e5-b503-f6a8e8184564 could not be found. Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Returning 404 to user: Instance c4df921c-06bb-40e5-b503-f6a8e8184564 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31749cd9-b9a6-4ce6-9ea1-fbb670774a4b tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564" status: 404 len: 111 microversion: 2.1 time: 0.032086 Oct 24 10:25:28.059696 n-d-master-1 devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3893/7958] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:28 2022] GET /compute/v2.1/servers/c4df921c-06bb-40e5-b503-f6a8e8184564 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:28.217650 n-d-master-1 devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c64817a8-e3db-43ee-b62e-a313795bb970 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] Calling method '.version_select at 0x7f8daae005e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:28.242596 n-d-master-1 devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c64817a8-e3db-43ee-b62e-a313795bb970 tempest-TestSnapshotPattern-1000579879 tempest-TestSnapshotPattern-1000579879-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2043205129" status: 202 len: 0 microversion: 2.1 time: 0.029121 Oct 24 10:25:28.243802 n-d-master-1 devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4066/7959] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 10:25:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2043205129 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)